00:00:00.001 Started by upstream project "autotest-spdk-v24.01-LTS-vs-dpdk-v23.11" build number 1013 00:00:00.001 originally caused by: 00:00:00.001 Started by upstream project "nightly-trigger" build number 3680 00:00:00.001 originally caused by: 00:00:00.001 Started by timer 00:00:00.110 Checking out git https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool into /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4 to read jbp/jenkins/jjb-config/jobs/autotest-downstream/autotest-phy.groovy 00:00:00.110 The recommended git tool is: git 00:00:00.111 using credential 00000000-0000-0000-0000-000000000002 00:00:00.113 > git rev-parse --resolve-git-dir /var/jenkins_home/workspace/nvmf-tcp-phy-autotest_script/33b20b30f0a51e6b52980845e0f6aa336787973ad45e341fbbf98d1b65b265d4/jbp/.git # timeout=10 00:00:00.148 Fetching changes from the remote Git repository 00:00:00.151 > git config remote.origin.url https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool # timeout=10 00:00:00.178 Using shallow fetch with depth 1 00:00:00.178 Fetching upstream changes from https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool 00:00:00.178 > git --version # timeout=10 00:00:00.204 > git --version # 'git version 2.39.2' 00:00:00.204 using GIT_ASKPASS to set credentials SPDKCI HTTPS Credentials 00:00:00.226 Setting http proxy: proxy-dmz.intel.com:911 00:00:00.226 > git fetch --tags --force --progress --depth=1 -- https://review.spdk.io/gerrit/a/build_pool/jenkins_build_pool refs/heads/master # timeout=5 00:00:06.060 > git rev-parse origin/FETCH_HEAD^{commit} # timeout=10 00:00:06.071 > git rev-parse FETCH_HEAD^{commit} # timeout=10 00:00:06.081 Checking out Revision db4637e8b949f278f369ec13f70585206ccd9507 (FETCH_HEAD) 00:00:06.081 > git config core.sparsecheckout # timeout=10 00:00:06.092 > git read-tree -mu HEAD # timeout=10 00:00:06.107 > git checkout -f db4637e8b949f278f369ec13f70585206ccd9507 # timeout=5 00:00:06.129 Commit message: "jenkins/jjb-config: Add missing SPDK_TEST_NVME_INTERRUPT flag" 00:00:06.129 > git rev-list --no-walk db4637e8b949f278f369ec13f70585206ccd9507 # timeout=10 00:00:06.220 [Pipeline] Start of Pipeline 00:00:06.230 [Pipeline] library 00:00:06.232 Loading library shm_lib@master 00:00:06.232 Library shm_lib@master is cached. Copying from home. 00:00:06.248 [Pipeline] node 00:00:06.255 Running on GP11 in /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:00:06.256 [Pipeline] { 00:00:06.266 [Pipeline] catchError 00:00:06.267 [Pipeline] { 00:00:06.276 [Pipeline] wrap 00:00:06.283 [Pipeline] { 00:00:06.291 [Pipeline] stage 00:00:06.292 [Pipeline] { (Prologue) 00:00:06.479 [Pipeline] sh 00:00:06.762 + logger -p user.info -t JENKINS-CI 00:00:06.781 [Pipeline] echo 00:00:06.783 Node: GP11 00:00:06.791 [Pipeline] sh 00:00:07.092 [Pipeline] setCustomBuildProperty 00:00:07.101 [Pipeline] echo 00:00:07.102 Cleanup processes 00:00:07.106 [Pipeline] sh 00:00:07.389 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.389 2150159 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.403 [Pipeline] sh 00:00:07.686 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:00:07.686 ++ grep -v 'sudo pgrep' 00:00:07.686 ++ awk '{print $1}' 00:00:07.686 + sudo kill -9 00:00:07.686 + true 00:00:07.702 [Pipeline] cleanWs 00:00:07.714 [WS-CLEANUP] Deleting project workspace... 00:00:07.714 [WS-CLEANUP] Deferred wipeout is used... 00:00:07.722 [WS-CLEANUP] done 00:00:07.727 [Pipeline] setCustomBuildProperty 00:00:07.743 [Pipeline] sh 00:00:08.027 + sudo git config --global --replace-all safe.directory '*' 00:00:08.122 [Pipeline] httpRequest 00:00:08.708 [Pipeline] echo 00:00:08.710 Sorcerer 10.211.164.20 is alive 00:00:08.719 [Pipeline] retry 00:00:08.721 [Pipeline] { 00:00:08.734 [Pipeline] httpRequest 00:00:08.739 HttpMethod: GET 00:00:08.740 URL: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.740 Sending request to url: http://10.211.164.20/packages/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:08.743 Response Code: HTTP/1.1 200 OK 00:00:08.744 Success: Status code 200 is in the accepted range: 200,404 00:00:08.744 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.644 [Pipeline] } 00:00:09.661 [Pipeline] // retry 00:00:09.668 [Pipeline] sh 00:00:09.954 + tar --no-same-owner -xf jbp_db4637e8b949f278f369ec13f70585206ccd9507.tar.gz 00:00:09.972 [Pipeline] httpRequest 00:00:10.346 [Pipeline] echo 00:00:10.348 Sorcerer 10.211.164.20 is alive 00:00:10.358 [Pipeline] retry 00:00:10.360 [Pipeline] { 00:00:10.375 [Pipeline] httpRequest 00:00:10.380 HttpMethod: GET 00:00:10.380 URL: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:10.381 Sending request to url: http://10.211.164.20/packages/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:10.384 Response Code: HTTP/1.1 200 OK 00:00:10.385 Success: Status code 200 is in the accepted range: 200,404 00:00:10.385 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:25.920 [Pipeline] } 00:00:25.938 [Pipeline] // retry 00:00:25.946 [Pipeline] sh 00:00:26.229 + tar --no-same-owner -xf spdk_c13c99a5eba3bff912124706e0ae1d70defef44d.tar.gz 00:00:28.774 [Pipeline] sh 00:00:29.056 + git -C spdk log --oneline -n5 00:00:29.056 c13c99a5e test: Various fixes for Fedora40 00:00:29.056 726a04d70 test/nvmf: adjust timeout for bigger nvmes 00:00:29.056 61c96acfb dpdk: Point dpdk submodule at a latest fix from spdk-23.11 00:00:29.056 7db6dcdb8 nvme/fio_plugin: update the way ruhs descriptors are fetched 00:00:29.056 ff6f5c41e nvme/fio_plugin: trim add support for multiple ranges 00:00:29.076 [Pipeline] withCredentials 00:00:29.088 > git --version # timeout=10 00:00:29.101 > git --version # 'git version 2.39.2' 00:00:29.118 Masking supported pattern matches of $GIT_PASSWORD or $GIT_ASKPASS 00:00:29.120 [Pipeline] { 00:00:29.133 [Pipeline] retry 00:00:29.135 [Pipeline] { 00:00:29.154 [Pipeline] sh 00:00:29.437 + git ls-remote http://dpdk.org/git/dpdk-stable v23.11 00:00:29.711 [Pipeline] } 00:00:29.732 [Pipeline] // retry 00:00:29.739 [Pipeline] } 00:00:29.757 [Pipeline] // withCredentials 00:00:29.769 [Pipeline] httpRequest 00:00:30.218 [Pipeline] echo 00:00:30.220 Sorcerer 10.211.164.20 is alive 00:00:30.230 [Pipeline] retry 00:00:30.233 [Pipeline] { 00:00:30.247 [Pipeline] httpRequest 00:00:30.252 HttpMethod: GET 00:00:30.252 URL: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:00:30.253 Sending request to url: http://10.211.164.20/packages/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:00:30.258 Response Code: HTTP/1.1 200 OK 00:00:30.259 Success: Status code 200 is in the accepted range: 200,404 00:00:30.259 Saving response body to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:17.077 [Pipeline] } 00:01:17.097 [Pipeline] // retry 00:01:17.104 [Pipeline] sh 00:01:17.379 + tar --no-same-owner -xf dpdk_d15625009dced269fcec27fc81dd74fd58d54cdb.tar.gz 00:01:19.289 [Pipeline] sh 00:01:19.569 + git -C dpdk log --oneline -n5 00:01:19.569 eeb0605f11 version: 23.11.0 00:01:19.569 238778122a doc: update release notes for 23.11 00:01:19.569 46aa6b3cfc doc: fix description of RSS features 00:01:19.569 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:19.569 7e421ae345 devtools: support skipping forbid rule check 00:01:19.578 [Pipeline] } 00:01:19.593 [Pipeline] // stage 00:01:19.602 [Pipeline] stage 00:01:19.604 [Pipeline] { (Prepare) 00:01:19.625 [Pipeline] writeFile 00:01:19.641 [Pipeline] sh 00:01:19.920 + logger -p user.info -t JENKINS-CI 00:01:19.934 [Pipeline] sh 00:01:20.214 + logger -p user.info -t JENKINS-CI 00:01:20.226 [Pipeline] sh 00:01:20.510 + cat autorun-spdk.conf 00:01:20.510 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:20.510 SPDK_TEST_NVMF=1 00:01:20.510 SPDK_TEST_NVME_CLI=1 00:01:20.510 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:20.510 SPDK_TEST_NVMF_NICS=e810 00:01:20.510 SPDK_TEST_VFIOUSER=1 00:01:20.510 SPDK_RUN_UBSAN=1 00:01:20.510 NET_TYPE=phy 00:01:20.510 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:20.510 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:20.519 RUN_NIGHTLY=1 00:01:20.526 [Pipeline] readFile 00:01:20.559 [Pipeline] withEnv 00:01:20.562 [Pipeline] { 00:01:20.577 [Pipeline] sh 00:01:20.866 + set -ex 00:01:20.866 + [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf ]] 00:01:20.866 + source /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:20.866 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:20.866 ++ SPDK_TEST_NVMF=1 00:01:20.866 ++ SPDK_TEST_NVME_CLI=1 00:01:20.866 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:20.866 ++ SPDK_TEST_NVMF_NICS=e810 00:01:20.866 ++ SPDK_TEST_VFIOUSER=1 00:01:20.866 ++ SPDK_RUN_UBSAN=1 00:01:20.866 ++ NET_TYPE=phy 00:01:20.866 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:20.866 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:20.866 ++ RUN_NIGHTLY=1 00:01:20.866 + case $SPDK_TEST_NVMF_NICS in 00:01:20.866 + DRIVERS=ice 00:01:20.866 + [[ tcp == \r\d\m\a ]] 00:01:20.866 + [[ -n ice ]] 00:01:20.866 + sudo rmmod mlx4_ib mlx5_ib irdma i40iw iw_cxgb4 00:01:20.866 rmmod: ERROR: Module mlx4_ib is not currently loaded 00:01:20.866 rmmod: ERROR: Module mlx5_ib is not currently loaded 00:01:20.866 rmmod: ERROR: Module irdma is not currently loaded 00:01:20.866 rmmod: ERROR: Module i40iw is not currently loaded 00:01:20.866 rmmod: ERROR: Module iw_cxgb4 is not currently loaded 00:01:20.866 + true 00:01:20.866 + for D in $DRIVERS 00:01:20.866 + sudo modprobe ice 00:01:20.866 + exit 0 00:01:20.877 [Pipeline] } 00:01:20.892 [Pipeline] // withEnv 00:01:20.898 [Pipeline] } 00:01:20.916 [Pipeline] // stage 00:01:20.928 [Pipeline] catchError 00:01:20.931 [Pipeline] { 00:01:20.948 [Pipeline] timeout 00:01:20.949 Timeout set to expire in 1 hr 0 min 00:01:20.951 [Pipeline] { 00:01:20.998 [Pipeline] stage 00:01:21.001 [Pipeline] { (Tests) 00:01:21.018 [Pipeline] sh 00:01:21.311 + jbp/jenkins/jjb-config/jobs/scripts/autoruner.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:21.311 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:21.311 + DIR_ROOT=/var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:21.311 + [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest ]] 00:01:21.311 + DIR_SPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:21.311 + DIR_OUTPUT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:21.311 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk ]] 00:01:21.311 + [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:21.311 + mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/output 00:01:21.311 + [[ -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/output ]] 00:01:21.311 + [[ nvmf-tcp-phy-autotest == pkgdep-* ]] 00:01:21.311 + cd /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:01:21.311 + source /etc/os-release 00:01:21.311 ++ NAME='Fedora Linux' 00:01:21.311 ++ VERSION='39 (Cloud Edition)' 00:01:21.311 ++ ID=fedora 00:01:21.311 ++ VERSION_ID=39 00:01:21.311 ++ VERSION_CODENAME= 00:01:21.311 ++ PLATFORM_ID=platform:f39 00:01:21.311 ++ PRETTY_NAME='Fedora Linux 39 (Cloud Edition)' 00:01:21.311 ++ ANSI_COLOR='0;38;2;60;110;180' 00:01:21.311 ++ LOGO=fedora-logo-icon 00:01:21.311 ++ CPE_NAME=cpe:/o:fedoraproject:fedora:39 00:01:21.311 ++ HOME_URL=https://fedoraproject.org/ 00:01:21.311 ++ DOCUMENTATION_URL=https://docs.fedoraproject.org/en-US/fedora/f39/system-administrators-guide/ 00:01:21.311 ++ SUPPORT_URL=https://ask.fedoraproject.org/ 00:01:21.311 ++ BUG_REPORT_URL=https://bugzilla.redhat.com/ 00:01:21.311 ++ REDHAT_BUGZILLA_PRODUCT=Fedora 00:01:21.311 ++ REDHAT_BUGZILLA_PRODUCT_VERSION=39 00:01:21.311 ++ REDHAT_SUPPORT_PRODUCT=Fedora 00:01:21.311 ++ REDHAT_SUPPORT_PRODUCT_VERSION=39 00:01:21.311 ++ SUPPORT_END=2024-11-12 00:01:21.311 ++ VARIANT='Cloud Edition' 00:01:21.311 ++ VARIANT_ID=cloud 00:01:21.311 + uname -a 00:01:21.311 Linux spdk-gp-11 6.8.9-200.fc39.x86_64 #1 SMP PREEMPT_DYNAMIC Wed Jul 24 03:04:40 UTC 2024 x86_64 GNU/Linux 00:01:21.311 + sudo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:01:22.248 Hugepages 00:01:22.248 node hugesize free / total 00:01:22.248 node0 1048576kB 0 / 0 00:01:22.248 node0 2048kB 0 / 0 00:01:22.248 node1 1048576kB 0 / 0 00:01:22.248 node1 2048kB 0 / 0 00:01:22.248 00:01:22.248 Type BDF Vendor Device NUMA Driver Device Block devices 00:01:22.248 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:01:22.248 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:01:22.248 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:01:22.248 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:01:22.248 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:01:22.248 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:01:22.248 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:01:22.248 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:01:22.248 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:01:22.248 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:01:22.248 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:01:22.248 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:01:22.248 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:01:22.248 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:01:22.248 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:01:22.248 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:01:22.248 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:01:22.248 + rm -f /tmp/spdk-ld-path 00:01:22.248 + source autorun-spdk.conf 00:01:22.248 ++ SPDK_RUN_FUNCTIONAL_TEST=1 00:01:22.248 ++ SPDK_TEST_NVMF=1 00:01:22.248 ++ SPDK_TEST_NVME_CLI=1 00:01:22.248 ++ SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:22.248 ++ SPDK_TEST_NVMF_NICS=e810 00:01:22.248 ++ SPDK_TEST_VFIOUSER=1 00:01:22.248 ++ SPDK_RUN_UBSAN=1 00:01:22.248 ++ NET_TYPE=phy 00:01:22.248 ++ SPDK_TEST_NATIVE_DPDK=v23.11 00:01:22.248 ++ SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.248 ++ RUN_NIGHTLY=1 00:01:22.248 + (( SPDK_TEST_NVME_CMB == 1 || SPDK_TEST_NVME_PMR == 1 )) 00:01:22.248 + [[ -n '' ]] 00:01:22.248 + sudo git config --global --add safe.directory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:22.248 + for M in /var/spdk/build-*-manifest.txt 00:01:22.248 + [[ -f /var/spdk/build-kernel-manifest.txt ]] 00:01:22.248 + cp /var/spdk/build-kernel-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:22.508 + for M in /var/spdk/build-*-manifest.txt 00:01:22.508 + [[ -f /var/spdk/build-pkg-manifest.txt ]] 00:01:22.508 + cp /var/spdk/build-pkg-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:22.508 + for M in /var/spdk/build-*-manifest.txt 00:01:22.508 + [[ -f /var/spdk/build-repo-manifest.txt ]] 00:01:22.508 + cp /var/spdk/build-repo-manifest.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/output/ 00:01:22.508 ++ uname 00:01:22.508 + [[ Linux == \L\i\n\u\x ]] 00:01:22.508 + sudo dmesg -T 00:01:22.508 + sudo dmesg --clear 00:01:22.508 + dmesg_pid=2151492 00:01:22.508 + [[ Fedora Linux == FreeBSD ]] 00:01:22.508 + export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:22.508 + sudo dmesg -Tw 00:01:22.508 + UNBIND_ENTIRE_IOMMU_GROUP=yes 00:01:22.508 + [[ -e /var/spdk/dependencies/vhost/spdk_test_image.qcow2 ]] 00:01:22.508 + [[ -x /usr/src/fio-static/fio ]] 00:01:22.508 + export FIO_BIN=/usr/src/fio-static/fio 00:01:22.508 + FIO_BIN=/usr/src/fio-static/fio 00:01:22.508 + [[ '' == \/\v\a\r\/\j\e\n\k\i\n\s\/\w\o\r\k\s\p\a\c\e\/\n\v\m\f\-\t\c\p\-\p\h\y\-\a\u\t\o\t\e\s\t\/\q\e\m\u\_\v\f\i\o\/* ]] 00:01:22.508 + [[ ! -v VFIO_QEMU_BIN ]] 00:01:22.508 + [[ -e /usr/local/qemu/vfio-user-latest ]] 00:01:22.508 + export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:22.508 + VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:01:22.508 + [[ -e /usr/local/qemu/vanilla-latest ]] 00:01:22.508 + export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:22.508 + QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:01:22.508 + spdk/autorun.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/autorun-spdk.conf 00:01:22.508 Test configuration: 00:01:22.508 SPDK_RUN_FUNCTIONAL_TEST=1 00:01:22.508 SPDK_TEST_NVMF=1 00:01:22.508 SPDK_TEST_NVME_CLI=1 00:01:22.508 SPDK_TEST_NVMF_TRANSPORT=tcp 00:01:22.508 SPDK_TEST_NVMF_NICS=e810 00:01:22.508 SPDK_TEST_VFIOUSER=1 00:01:22.508 SPDK_RUN_UBSAN=1 00:01:22.508 NET_TYPE=phy 00:01:22.508 SPDK_TEST_NATIVE_DPDK=v23.11 00:01:22.508 SPDK_RUN_EXTERNAL_DPDK=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.508 RUN_NIGHTLY=1 04:03:12 -- common/autotest_common.sh@1689 -- $ [[ n == y ]] 00:01:22.508 04:03:12 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:01:22.508 04:03:12 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:01:22.508 04:03:12 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:01:22.508 04:03:12 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:01:22.508 04:03:12 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:22.508 04:03:12 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:22.508 04:03:12 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:22.508 04:03:12 -- paths/export.sh@5 -- $ export PATH 00:01:22.508 04:03:12 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:01:22.508 04:03:12 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:01:22.508 04:03:12 -- common/autobuild_common.sh@440 -- $ date +%s 00:01:22.508 04:03:12 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732935792.XXXXXX 00:01:22.508 04:03:12 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732935792.YbT9wR 00:01:22.508 04:03:12 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:01:22.508 04:03:12 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:01:22.508 04:03:12 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.508 04:03:12 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:01:22.508 04:03:12 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:01:22.509 04:03:12 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:01:22.509 04:03:12 -- common/autobuild_common.sh@456 -- $ get_config_params 00:01:22.509 04:03:12 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:01:22.509 04:03:12 -- common/autotest_common.sh@10 -- $ set +x 00:01:22.509 04:03:12 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:01:22.509 04:03:12 -- spdk/autobuild.sh@11 -- $ SPDK_TEST_AUTOBUILD= 00:01:22.509 04:03:12 -- spdk/autobuild.sh@12 -- $ umask 022 00:01:22.509 04:03:12 -- spdk/autobuild.sh@13 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:22.509 04:03:12 -- spdk/autobuild.sh@16 -- $ date -u 00:01:22.509 Sat Nov 30 03:03:12 AM UTC 2024 00:01:22.509 04:03:12 -- spdk/autobuild.sh@17 -- $ git describe --tags 00:01:22.509 LTS-67-gc13c99a5e 00:01:22.509 04:03:13 -- spdk/autobuild.sh@19 -- $ '[' 0 -eq 1 ']' 00:01:22.509 04:03:13 -- spdk/autobuild.sh@23 -- $ '[' 1 -eq 1 ']' 00:01:22.509 04:03:13 -- spdk/autobuild.sh@24 -- $ run_test ubsan echo 'using ubsan' 00:01:22.509 04:03:13 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:01:22.509 04:03:13 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:22.509 04:03:13 -- common/autotest_common.sh@10 -- $ set +x 00:01:22.509 ************************************ 00:01:22.509 START TEST ubsan 00:01:22.509 ************************************ 00:01:22.509 04:03:13 -- common/autotest_common.sh@1114 -- $ echo 'using ubsan' 00:01:22.509 using ubsan 00:01:22.509 00:01:22.509 real 0m0.000s 00:01:22.509 user 0m0.000s 00:01:22.509 sys 0m0.000s 00:01:22.509 04:03:13 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:01:22.509 04:03:13 -- common/autotest_common.sh@10 -- $ set +x 00:01:22.509 ************************************ 00:01:22.509 END TEST ubsan 00:01:22.509 ************************************ 00:01:22.509 04:03:13 -- spdk/autobuild.sh@27 -- $ '[' -n v23.11 ']' 00:01:22.509 04:03:13 -- spdk/autobuild.sh@28 -- $ build_native_dpdk 00:01:22.509 04:03:13 -- common/autobuild_common.sh@432 -- $ run_test build_native_dpdk _build_native_dpdk 00:01:22.509 04:03:13 -- common/autotest_common.sh@1087 -- $ '[' 2 -le 1 ']' 00:01:22.509 04:03:13 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:01:22.509 04:03:13 -- common/autotest_common.sh@10 -- $ set +x 00:01:22.509 ************************************ 00:01:22.509 START TEST build_native_dpdk 00:01:22.509 ************************************ 00:01:22.509 04:03:13 -- common/autotest_common.sh@1114 -- $ _build_native_dpdk 00:01:22.509 04:03:13 -- common/autobuild_common.sh@48 -- $ local external_dpdk_dir 00:01:22.509 04:03:13 -- common/autobuild_common.sh@49 -- $ local external_dpdk_base_dir 00:01:22.509 04:03:13 -- common/autobuild_common.sh@50 -- $ local compiler_version 00:01:22.509 04:03:13 -- common/autobuild_common.sh@51 -- $ local compiler 00:01:22.509 04:03:13 -- common/autobuild_common.sh@52 -- $ local dpdk_kmods 00:01:22.509 04:03:13 -- common/autobuild_common.sh@53 -- $ local repo=dpdk 00:01:22.509 04:03:13 -- common/autobuild_common.sh@55 -- $ compiler=gcc 00:01:22.509 04:03:13 -- common/autobuild_common.sh@61 -- $ export CC=gcc 00:01:22.509 04:03:13 -- common/autobuild_common.sh@61 -- $ CC=gcc 00:01:22.509 04:03:13 -- common/autobuild_common.sh@63 -- $ [[ gcc != *clang* ]] 00:01:22.509 04:03:13 -- common/autobuild_common.sh@63 -- $ [[ gcc != *gcc* ]] 00:01:22.509 04:03:13 -- common/autobuild_common.sh@68 -- $ gcc -dumpversion 00:01:22.509 04:03:13 -- common/autobuild_common.sh@68 -- $ compiler_version=13 00:01:22.509 04:03:13 -- common/autobuild_common.sh@69 -- $ compiler_version=13 00:01:22.509 04:03:13 -- common/autobuild_common.sh@70 -- $ external_dpdk_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.509 04:03:13 -- common/autobuild_common.sh@71 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:22.509 04:03:13 -- common/autobuild_common.sh@71 -- $ external_dpdk_base_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:22.509 04:03:13 -- common/autobuild_common.sh@73 -- $ [[ ! -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk ]] 00:01:22.509 04:03:13 -- common/autobuild_common.sh@82 -- $ orgdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:01:22.509 04:03:13 -- common/autobuild_common.sh@83 -- $ git -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk log --oneline -n 5 00:01:22.509 eeb0605f11 version: 23.11.0 00:01:22.509 238778122a doc: update release notes for 23.11 00:01:22.509 46aa6b3cfc doc: fix description of RSS features 00:01:22.509 dd88f51a57 devtools: forbid DPDK API in cnxk base driver 00:01:22.509 7e421ae345 devtools: support skipping forbid rule check 00:01:22.509 04:03:13 -- common/autobuild_common.sh@85 -- $ dpdk_cflags='-fPIC -g -fcommon' 00:01:22.509 04:03:13 -- common/autobuild_common.sh@86 -- $ dpdk_ldflags= 00:01:22.509 04:03:13 -- common/autobuild_common.sh@87 -- $ dpdk_ver=23.11.0 00:01:22.509 04:03:13 -- common/autobuild_common.sh@89 -- $ [[ gcc == *gcc* ]] 00:01:22.509 04:03:13 -- common/autobuild_common.sh@89 -- $ [[ 13 -ge 5 ]] 00:01:22.509 04:03:13 -- common/autobuild_common.sh@90 -- $ dpdk_cflags+=' -Werror' 00:01:22.509 04:03:13 -- common/autobuild_common.sh@93 -- $ [[ gcc == *gcc* ]] 00:01:22.509 04:03:13 -- common/autobuild_common.sh@93 -- $ [[ 13 -ge 10 ]] 00:01:22.509 04:03:13 -- common/autobuild_common.sh@94 -- $ dpdk_cflags+=' -Wno-stringop-overflow' 00:01:22.509 04:03:13 -- common/autobuild_common.sh@100 -- $ DPDK_DRIVERS=("bus" "bus/pci" "bus/vdev" "mempool/ring" "net/i40e" "net/i40e/base") 00:01:22.509 04:03:13 -- common/autobuild_common.sh@102 -- $ local mlx5_libs_added=n 00:01:22.509 04:03:13 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:22.509 04:03:13 -- common/autobuild_common.sh@103 -- $ [[ 0 -eq 1 ]] 00:01:22.509 04:03:13 -- common/autobuild_common.sh@139 -- $ [[ 0 -eq 1 ]] 00:01:22.509 04:03:13 -- common/autobuild_common.sh@167 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:22.509 04:03:13 -- common/autobuild_common.sh@168 -- $ uname -s 00:01:22.509 04:03:13 -- common/autobuild_common.sh@168 -- $ '[' Linux = Linux ']' 00:01:22.509 04:03:13 -- common/autobuild_common.sh@169 -- $ lt 23.11.0 21.11.0 00:01:22.509 04:03:13 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 21.11.0 00:01:22.509 04:03:13 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:22.509 04:03:13 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:22.509 04:03:13 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:22.509 04:03:13 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:22.509 04:03:13 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:22.509 04:03:13 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:22.509 04:03:13 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:22.509 04:03:13 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:22.509 04:03:13 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:22.509 04:03:13 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:22.509 04:03:13 -- scripts/common.sh@343 -- $ case "$op" in 00:01:22.509 04:03:13 -- scripts/common.sh@344 -- $ : 1 00:01:22.509 04:03:13 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:22.509 04:03:13 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:22.509 04:03:13 -- scripts/common.sh@364 -- $ decimal 23 00:01:22.509 04:03:13 -- scripts/common.sh@352 -- $ local d=23 00:01:22.509 04:03:13 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:22.509 04:03:13 -- scripts/common.sh@354 -- $ echo 23 00:01:22.509 04:03:13 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:22.509 04:03:13 -- scripts/common.sh@365 -- $ decimal 21 00:01:22.509 04:03:13 -- scripts/common.sh@352 -- $ local d=21 00:01:22.509 04:03:13 -- scripts/common.sh@353 -- $ [[ 21 =~ ^[0-9]+$ ]] 00:01:22.509 04:03:13 -- scripts/common.sh@354 -- $ echo 21 00:01:22.509 04:03:13 -- scripts/common.sh@365 -- $ ver2[v]=21 00:01:22.509 04:03:13 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:22.509 04:03:13 -- scripts/common.sh@366 -- $ return 1 00:01:22.509 04:03:13 -- common/autobuild_common.sh@173 -- $ patch -p1 00:01:22.509 patching file config/rte_config.h 00:01:22.509 Hunk #1 succeeded at 60 (offset 1 line). 00:01:22.509 04:03:13 -- common/autobuild_common.sh@176 -- $ lt 23.11.0 24.07.0 00:01:22.509 04:03:13 -- scripts/common.sh@372 -- $ cmp_versions 23.11.0 '<' 24.07.0 00:01:22.509 04:03:13 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:01:22.509 04:03:13 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:01:22.509 04:03:13 -- scripts/common.sh@335 -- $ IFS=.-: 00:01:22.509 04:03:13 -- scripts/common.sh@335 -- $ read -ra ver1 00:01:22.509 04:03:13 -- scripts/common.sh@336 -- $ IFS=.-: 00:01:22.509 04:03:13 -- scripts/common.sh@336 -- $ read -ra ver2 00:01:22.509 04:03:13 -- scripts/common.sh@337 -- $ local 'op=<' 00:01:22.509 04:03:13 -- scripts/common.sh@339 -- $ ver1_l=3 00:01:22.509 04:03:13 -- scripts/common.sh@340 -- $ ver2_l=3 00:01:22.509 04:03:13 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:01:22.509 04:03:13 -- scripts/common.sh@343 -- $ case "$op" in 00:01:22.509 04:03:13 -- scripts/common.sh@344 -- $ : 1 00:01:22.509 04:03:13 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:01:22.509 04:03:13 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:01:22.509 04:03:13 -- scripts/common.sh@364 -- $ decimal 23 00:01:22.509 04:03:13 -- scripts/common.sh@352 -- $ local d=23 00:01:22.509 04:03:13 -- scripts/common.sh@353 -- $ [[ 23 =~ ^[0-9]+$ ]] 00:01:22.509 04:03:13 -- scripts/common.sh@354 -- $ echo 23 00:01:22.509 04:03:13 -- scripts/common.sh@364 -- $ ver1[v]=23 00:01:22.509 04:03:13 -- scripts/common.sh@365 -- $ decimal 24 00:01:22.509 04:03:13 -- scripts/common.sh@352 -- $ local d=24 00:01:22.509 04:03:13 -- scripts/common.sh@353 -- $ [[ 24 =~ ^[0-9]+$ ]] 00:01:22.509 04:03:13 -- scripts/common.sh@354 -- $ echo 24 00:01:22.509 04:03:13 -- scripts/common.sh@365 -- $ ver2[v]=24 00:01:22.509 04:03:13 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:01:22.509 04:03:13 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:01:22.509 04:03:13 -- scripts/common.sh@367 -- $ return 0 00:01:22.509 04:03:13 -- common/autobuild_common.sh@177 -- $ patch -p1 00:01:22.509 patching file lib/pcapng/rte_pcapng.c 00:01:22.509 04:03:13 -- common/autobuild_common.sh@180 -- $ dpdk_kmods=false 00:01:22.509 04:03:13 -- common/autobuild_common.sh@181 -- $ uname -s 00:01:22.509 04:03:13 -- common/autobuild_common.sh@181 -- $ '[' Linux = FreeBSD ']' 00:01:22.509 04:03:13 -- common/autobuild_common.sh@185 -- $ printf %s, bus bus/pci bus/vdev mempool/ring net/i40e net/i40e/base 00:01:22.509 04:03:13 -- common/autobuild_common.sh@185 -- $ meson build-tmp --prefix=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --libdir lib -Denable_docs=false -Denable_kmods=false -Dtests=false -Dc_link_args= '-Dc_args=-fPIC -g -fcommon -Werror -Wno-stringop-overflow' -Dmachine=native -Denable_drivers=bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:26.707 The Meson build system 00:01:26.707 Version: 1.5.0 00:01:26.707 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk 00:01:26.707 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp 00:01:26.707 Build type: native build 00:01:26.707 Program cat found: YES (/usr/bin/cat) 00:01:26.707 Project name: DPDK 00:01:26.707 Project version: 23.11.0 00:01:26.707 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:01:26.707 C linker for the host machine: gcc ld.bfd 2.40-14 00:01:26.707 Host machine cpu family: x86_64 00:01:26.707 Host machine cpu: x86_64 00:01:26.707 Message: ## Building in Developer Mode ## 00:01:26.707 Program pkg-config found: YES (/usr/bin/pkg-config) 00:01:26.707 Program check-symbols.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/check-symbols.sh) 00:01:26.707 Program options-ibverbs-static.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/options-ibverbs-static.sh) 00:01:26.707 Program python3 found: YES (/usr/bin/python3) 00:01:26.707 Program cat found: YES (/usr/bin/cat) 00:01:26.707 config/meson.build:113: WARNING: The "machine" option is deprecated. Please use "cpu_instruction_set" instead. 00:01:26.707 Compiler for C supports arguments -march=native: YES 00:01:26.707 Checking for size of "void *" : 8 00:01:26.707 Checking for size of "void *" : 8 (cached) 00:01:26.707 Library m found: YES 00:01:26.707 Library numa found: YES 00:01:26.707 Has header "numaif.h" : YES 00:01:26.707 Library fdt found: NO 00:01:26.707 Library execinfo found: NO 00:01:26.707 Has header "execinfo.h" : YES 00:01:26.707 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:01:26.707 Run-time dependency libarchive found: NO (tried pkgconfig) 00:01:26.707 Run-time dependency libbsd found: NO (tried pkgconfig) 00:01:26.707 Run-time dependency jansson found: NO (tried pkgconfig) 00:01:26.707 Run-time dependency openssl found: YES 3.1.1 00:01:26.707 Run-time dependency libpcap found: YES 1.10.4 00:01:26.707 Has header "pcap.h" with dependency libpcap: YES 00:01:26.707 Compiler for C supports arguments -Wcast-qual: YES 00:01:26.707 Compiler for C supports arguments -Wdeprecated: YES 00:01:26.707 Compiler for C supports arguments -Wformat: YES 00:01:26.707 Compiler for C supports arguments -Wformat-nonliteral: NO 00:01:26.707 Compiler for C supports arguments -Wformat-security: NO 00:01:26.707 Compiler for C supports arguments -Wmissing-declarations: YES 00:01:26.707 Compiler for C supports arguments -Wmissing-prototypes: YES 00:01:26.707 Compiler for C supports arguments -Wnested-externs: YES 00:01:26.707 Compiler for C supports arguments -Wold-style-definition: YES 00:01:26.707 Compiler for C supports arguments -Wpointer-arith: YES 00:01:26.707 Compiler for C supports arguments -Wsign-compare: YES 00:01:26.707 Compiler for C supports arguments -Wstrict-prototypes: YES 00:01:26.707 Compiler for C supports arguments -Wundef: YES 00:01:26.707 Compiler for C supports arguments -Wwrite-strings: YES 00:01:26.707 Compiler for C supports arguments -Wno-address-of-packed-member: YES 00:01:26.707 Compiler for C supports arguments -Wno-packed-not-aligned: YES 00:01:26.707 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:01:26.707 Compiler for C supports arguments -Wno-zero-length-bounds: YES 00:01:26.707 Program objdump found: YES (/usr/bin/objdump) 00:01:26.707 Compiler for C supports arguments -mavx512f: YES 00:01:26.707 Checking if "AVX512 checking" compiles: YES 00:01:26.707 Fetching value of define "__SSE4_2__" : 1 00:01:26.707 Fetching value of define "__AES__" : 1 00:01:26.707 Fetching value of define "__AVX__" : 1 00:01:26.707 Fetching value of define "__AVX2__" : (undefined) 00:01:26.707 Fetching value of define "__AVX512BW__" : (undefined) 00:01:26.707 Fetching value of define "__AVX512CD__" : (undefined) 00:01:26.707 Fetching value of define "__AVX512DQ__" : (undefined) 00:01:26.707 Fetching value of define "__AVX512F__" : (undefined) 00:01:26.707 Fetching value of define "__AVX512VL__" : (undefined) 00:01:26.707 Fetching value of define "__PCLMUL__" : 1 00:01:26.707 Fetching value of define "__RDRND__" : 1 00:01:26.707 Fetching value of define "__RDSEED__" : (undefined) 00:01:26.707 Fetching value of define "__VPCLMULQDQ__" : (undefined) 00:01:26.707 Fetching value of define "__znver1__" : (undefined) 00:01:26.707 Fetching value of define "__znver2__" : (undefined) 00:01:26.707 Fetching value of define "__znver3__" : (undefined) 00:01:26.707 Fetching value of define "__znver4__" : (undefined) 00:01:26.707 Compiler for C supports arguments -Wno-format-truncation: YES 00:01:26.707 Message: lib/log: Defining dependency "log" 00:01:26.707 Message: lib/kvargs: Defining dependency "kvargs" 00:01:26.707 Message: lib/telemetry: Defining dependency "telemetry" 00:01:26.707 Checking for function "getentropy" : NO 00:01:26.707 Message: lib/eal: Defining dependency "eal" 00:01:26.707 Message: lib/ring: Defining dependency "ring" 00:01:26.707 Message: lib/rcu: Defining dependency "rcu" 00:01:26.707 Message: lib/mempool: Defining dependency "mempool" 00:01:26.707 Message: lib/mbuf: Defining dependency "mbuf" 00:01:26.707 Fetching value of define "__PCLMUL__" : 1 (cached) 00:01:26.707 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:26.707 Compiler for C supports arguments -mpclmul: YES 00:01:26.707 Compiler for C supports arguments -maes: YES 00:01:26.707 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:26.707 Compiler for C supports arguments -mavx512bw: YES 00:01:26.707 Compiler for C supports arguments -mavx512dq: YES 00:01:26.707 Compiler for C supports arguments -mavx512vl: YES 00:01:26.707 Compiler for C supports arguments -mvpclmulqdq: YES 00:01:26.707 Compiler for C supports arguments -mavx2: YES 00:01:26.707 Compiler for C supports arguments -mavx: YES 00:01:26.707 Message: lib/net: Defining dependency "net" 00:01:26.707 Message: lib/meter: Defining dependency "meter" 00:01:26.707 Message: lib/ethdev: Defining dependency "ethdev" 00:01:26.707 Message: lib/pci: Defining dependency "pci" 00:01:26.707 Message: lib/cmdline: Defining dependency "cmdline" 00:01:26.707 Message: lib/metrics: Defining dependency "metrics" 00:01:26.707 Message: lib/hash: Defining dependency "hash" 00:01:26.707 Message: lib/timer: Defining dependency "timer" 00:01:26.707 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:26.707 Fetching value of define "__AVX512VL__" : (undefined) (cached) 00:01:26.707 Fetching value of define "__AVX512CD__" : (undefined) (cached) 00:01:26.707 Fetching value of define "__AVX512BW__" : (undefined) (cached) 00:01:26.707 Compiler for C supports arguments -mavx512f -mavx512vl -mavx512cd -mavx512bw: YES 00:01:26.707 Message: lib/acl: Defining dependency "acl" 00:01:26.707 Message: lib/bbdev: Defining dependency "bbdev" 00:01:26.708 Message: lib/bitratestats: Defining dependency "bitratestats" 00:01:26.708 Run-time dependency libelf found: YES 0.191 00:01:26.708 Message: lib/bpf: Defining dependency "bpf" 00:01:26.708 Message: lib/cfgfile: Defining dependency "cfgfile" 00:01:26.708 Message: lib/compressdev: Defining dependency "compressdev" 00:01:26.708 Message: lib/cryptodev: Defining dependency "cryptodev" 00:01:26.708 Message: lib/distributor: Defining dependency "distributor" 00:01:26.708 Message: lib/dmadev: Defining dependency "dmadev" 00:01:26.708 Message: lib/efd: Defining dependency "efd" 00:01:26.708 Message: lib/eventdev: Defining dependency "eventdev" 00:01:26.708 Message: lib/dispatcher: Defining dependency "dispatcher" 00:01:26.708 Message: lib/gpudev: Defining dependency "gpudev" 00:01:26.708 Message: lib/gro: Defining dependency "gro" 00:01:26.708 Message: lib/gso: Defining dependency "gso" 00:01:26.708 Message: lib/ip_frag: Defining dependency "ip_frag" 00:01:26.708 Message: lib/jobstats: Defining dependency "jobstats" 00:01:26.708 Message: lib/latencystats: Defining dependency "latencystats" 00:01:26.708 Message: lib/lpm: Defining dependency "lpm" 00:01:26.708 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:26.708 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:26.708 Fetching value of define "__AVX512IFMA__" : (undefined) 00:01:26.708 Compiler for C supports arguments -mavx512f -mavx512dq -mavx512ifma: YES 00:01:26.708 Message: lib/member: Defining dependency "member" 00:01:26.708 Message: lib/pcapng: Defining dependency "pcapng" 00:01:26.708 Compiler for C supports arguments -Wno-cast-qual: YES 00:01:26.708 Message: lib/power: Defining dependency "power" 00:01:26.708 Message: lib/rawdev: Defining dependency "rawdev" 00:01:26.708 Message: lib/regexdev: Defining dependency "regexdev" 00:01:26.708 Message: lib/mldev: Defining dependency "mldev" 00:01:26.708 Message: lib/rib: Defining dependency "rib" 00:01:26.708 Message: lib/reorder: Defining dependency "reorder" 00:01:26.708 Message: lib/sched: Defining dependency "sched" 00:01:26.708 Message: lib/security: Defining dependency "security" 00:01:26.708 Message: lib/stack: Defining dependency "stack" 00:01:26.708 Has header "linux/userfaultfd.h" : YES 00:01:26.708 Has header "linux/vduse.h" : YES 00:01:26.708 Message: lib/vhost: Defining dependency "vhost" 00:01:26.708 Message: lib/ipsec: Defining dependency "ipsec" 00:01:26.708 Message: lib/pdcp: Defining dependency "pdcp" 00:01:26.708 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:26.708 Fetching value of define "__AVX512DQ__" : (undefined) (cached) 00:01:26.708 Compiler for C supports arguments -mavx512f -mavx512dq: YES 00:01:26.708 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:26.708 Message: lib/fib: Defining dependency "fib" 00:01:26.708 Message: lib/port: Defining dependency "port" 00:01:26.708 Message: lib/pdump: Defining dependency "pdump" 00:01:26.708 Message: lib/table: Defining dependency "table" 00:01:26.708 Message: lib/pipeline: Defining dependency "pipeline" 00:01:26.708 Message: lib/graph: Defining dependency "graph" 00:01:26.708 Message: lib/node: Defining dependency "node" 00:01:28.613 Compiler for C supports arguments -Wno-format-truncation: YES (cached) 00:01:28.613 Message: drivers/bus/pci: Defining dependency "bus_pci" 00:01:28.613 Message: drivers/bus/vdev: Defining dependency "bus_vdev" 00:01:28.613 Message: drivers/mempool/ring: Defining dependency "mempool_ring" 00:01:28.613 Compiler for C supports arguments -Wno-sign-compare: YES 00:01:28.613 Compiler for C supports arguments -Wno-unused-value: YES 00:01:28.613 Compiler for C supports arguments -Wno-format: YES 00:01:28.613 Compiler for C supports arguments -Wno-format-security: YES 00:01:28.613 Compiler for C supports arguments -Wno-format-nonliteral: YES 00:01:28.613 Compiler for C supports arguments -Wno-strict-aliasing: YES 00:01:28.613 Compiler for C supports arguments -Wno-unused-but-set-variable: YES 00:01:28.613 Compiler for C supports arguments -Wno-unused-parameter: YES 00:01:28.613 Fetching value of define "__AVX512F__" : (undefined) (cached) 00:01:28.613 Compiler for C supports arguments -mavx512f: YES (cached) 00:01:28.613 Compiler for C supports arguments -mavx512bw: YES (cached) 00:01:28.613 Compiler for C supports arguments -march=skylake-avx512: YES 00:01:28.613 Message: drivers/net/i40e: Defining dependency "net_i40e" 00:01:28.613 Has header "sys/epoll.h" : YES 00:01:28.613 Program doxygen found: YES (/usr/local/bin/doxygen) 00:01:28.613 Configuring doxy-api-html.conf using configuration 00:01:28.613 Configuring doxy-api-man.conf using configuration 00:01:28.613 Program mandb found: YES (/usr/bin/mandb) 00:01:28.613 Program sphinx-build found: NO 00:01:28.613 Configuring rte_build_config.h using configuration 00:01:28.613 Message: 00:01:28.613 ================= 00:01:28.613 Applications Enabled 00:01:28.613 ================= 00:01:28.613 00:01:28.613 apps: 00:01:28.613 dumpcap, graph, pdump, proc-info, test-acl, test-bbdev, test-cmdline, test-compress-perf, 00:01:28.613 test-crypto-perf, test-dma-perf, test-eventdev, test-fib, test-flow-perf, test-gpudev, test-mldev, test-pipeline, 00:01:28.613 test-pmd, test-regex, test-sad, test-security-perf, 00:01:28.613 00:01:28.613 Message: 00:01:28.613 ================= 00:01:28.613 Libraries Enabled 00:01:28.613 ================= 00:01:28.613 00:01:28.613 libs: 00:01:28.613 log, kvargs, telemetry, eal, ring, rcu, mempool, mbuf, 00:01:28.613 net, meter, ethdev, pci, cmdline, metrics, hash, timer, 00:01:28.613 acl, bbdev, bitratestats, bpf, cfgfile, compressdev, cryptodev, distributor, 00:01:28.613 dmadev, efd, eventdev, dispatcher, gpudev, gro, gso, ip_frag, 00:01:28.613 jobstats, latencystats, lpm, member, pcapng, power, rawdev, regexdev, 00:01:28.613 mldev, rib, reorder, sched, security, stack, vhost, ipsec, 00:01:28.613 pdcp, fib, port, pdump, table, pipeline, graph, node, 00:01:28.613 00:01:28.613 00:01:28.613 Message: 00:01:28.613 =============== 00:01:28.613 Drivers Enabled 00:01:28.613 =============== 00:01:28.613 00:01:28.613 common: 00:01:28.613 00:01:28.613 bus: 00:01:28.613 pci, vdev, 00:01:28.613 mempool: 00:01:28.613 ring, 00:01:28.613 dma: 00:01:28.613 00:01:28.613 net: 00:01:28.613 i40e, 00:01:28.613 raw: 00:01:28.613 00:01:28.613 crypto: 00:01:28.613 00:01:28.613 compress: 00:01:28.613 00:01:28.613 regex: 00:01:28.613 00:01:28.613 ml: 00:01:28.613 00:01:28.613 vdpa: 00:01:28.613 00:01:28.613 event: 00:01:28.613 00:01:28.613 baseband: 00:01:28.613 00:01:28.613 gpu: 00:01:28.613 00:01:28.613 00:01:28.613 Message: 00:01:28.613 ================= 00:01:28.613 Content Skipped 00:01:28.613 ================= 00:01:28.613 00:01:28.613 apps: 00:01:28.613 00:01:28.613 libs: 00:01:28.613 00:01:28.613 drivers: 00:01:28.613 common/cpt: not in enabled drivers build config 00:01:28.613 common/dpaax: not in enabled drivers build config 00:01:28.613 common/iavf: not in enabled drivers build config 00:01:28.613 common/idpf: not in enabled drivers build config 00:01:28.613 common/mvep: not in enabled drivers build config 00:01:28.613 common/octeontx: not in enabled drivers build config 00:01:28.613 bus/auxiliary: not in enabled drivers build config 00:01:28.613 bus/cdx: not in enabled drivers build config 00:01:28.613 bus/dpaa: not in enabled drivers build config 00:01:28.613 bus/fslmc: not in enabled drivers build config 00:01:28.613 bus/ifpga: not in enabled drivers build config 00:01:28.613 bus/platform: not in enabled drivers build config 00:01:28.613 bus/vmbus: not in enabled drivers build config 00:01:28.613 common/cnxk: not in enabled drivers build config 00:01:28.613 common/mlx5: not in enabled drivers build config 00:01:28.613 common/nfp: not in enabled drivers build config 00:01:28.613 common/qat: not in enabled drivers build config 00:01:28.613 common/sfc_efx: not in enabled drivers build config 00:01:28.613 mempool/bucket: not in enabled drivers build config 00:01:28.613 mempool/cnxk: not in enabled drivers build config 00:01:28.613 mempool/dpaa: not in enabled drivers build config 00:01:28.613 mempool/dpaa2: not in enabled drivers build config 00:01:28.613 mempool/octeontx: not in enabled drivers build config 00:01:28.613 mempool/stack: not in enabled drivers build config 00:01:28.613 dma/cnxk: not in enabled drivers build config 00:01:28.613 dma/dpaa: not in enabled drivers build config 00:01:28.613 dma/dpaa2: not in enabled drivers build config 00:01:28.613 dma/hisilicon: not in enabled drivers build config 00:01:28.613 dma/idxd: not in enabled drivers build config 00:01:28.613 dma/ioat: not in enabled drivers build config 00:01:28.613 dma/skeleton: not in enabled drivers build config 00:01:28.613 net/af_packet: not in enabled drivers build config 00:01:28.613 net/af_xdp: not in enabled drivers build config 00:01:28.613 net/ark: not in enabled drivers build config 00:01:28.613 net/atlantic: not in enabled drivers build config 00:01:28.613 net/avp: not in enabled drivers build config 00:01:28.613 net/axgbe: not in enabled drivers build config 00:01:28.613 net/bnx2x: not in enabled drivers build config 00:01:28.613 net/bnxt: not in enabled drivers build config 00:01:28.613 net/bonding: not in enabled drivers build config 00:01:28.613 net/cnxk: not in enabled drivers build config 00:01:28.613 net/cpfl: not in enabled drivers build config 00:01:28.613 net/cxgbe: not in enabled drivers build config 00:01:28.613 net/dpaa: not in enabled drivers build config 00:01:28.613 net/dpaa2: not in enabled drivers build config 00:01:28.613 net/e1000: not in enabled drivers build config 00:01:28.613 net/ena: not in enabled drivers build config 00:01:28.613 net/enetc: not in enabled drivers build config 00:01:28.613 net/enetfec: not in enabled drivers build config 00:01:28.613 net/enic: not in enabled drivers build config 00:01:28.613 net/failsafe: not in enabled drivers build config 00:01:28.614 net/fm10k: not in enabled drivers build config 00:01:28.614 net/gve: not in enabled drivers build config 00:01:28.614 net/hinic: not in enabled drivers build config 00:01:28.614 net/hns3: not in enabled drivers build config 00:01:28.614 net/iavf: not in enabled drivers build config 00:01:28.614 net/ice: not in enabled drivers build config 00:01:28.614 net/idpf: not in enabled drivers build config 00:01:28.614 net/igc: not in enabled drivers build config 00:01:28.614 net/ionic: not in enabled drivers build config 00:01:28.614 net/ipn3ke: not in enabled drivers build config 00:01:28.614 net/ixgbe: not in enabled drivers build config 00:01:28.614 net/mana: not in enabled drivers build config 00:01:28.614 net/memif: not in enabled drivers build config 00:01:28.614 net/mlx4: not in enabled drivers build config 00:01:28.614 net/mlx5: not in enabled drivers build config 00:01:28.614 net/mvneta: not in enabled drivers build config 00:01:28.614 net/mvpp2: not in enabled drivers build config 00:01:28.614 net/netvsc: not in enabled drivers build config 00:01:28.614 net/nfb: not in enabled drivers build config 00:01:28.614 net/nfp: not in enabled drivers build config 00:01:28.614 net/ngbe: not in enabled drivers build config 00:01:28.614 net/null: not in enabled drivers build config 00:01:28.614 net/octeontx: not in enabled drivers build config 00:01:28.614 net/octeon_ep: not in enabled drivers build config 00:01:28.614 net/pcap: not in enabled drivers build config 00:01:28.614 net/pfe: not in enabled drivers build config 00:01:28.614 net/qede: not in enabled drivers build config 00:01:28.614 net/ring: not in enabled drivers build config 00:01:28.614 net/sfc: not in enabled drivers build config 00:01:28.614 net/softnic: not in enabled drivers build config 00:01:28.614 net/tap: not in enabled drivers build config 00:01:28.614 net/thunderx: not in enabled drivers build config 00:01:28.614 net/txgbe: not in enabled drivers build config 00:01:28.614 net/vdev_netvsc: not in enabled drivers build config 00:01:28.614 net/vhost: not in enabled drivers build config 00:01:28.614 net/virtio: not in enabled drivers build config 00:01:28.614 net/vmxnet3: not in enabled drivers build config 00:01:28.614 raw/cnxk_bphy: not in enabled drivers build config 00:01:28.614 raw/cnxk_gpio: not in enabled drivers build config 00:01:28.614 raw/dpaa2_cmdif: not in enabled drivers build config 00:01:28.614 raw/ifpga: not in enabled drivers build config 00:01:28.614 raw/ntb: not in enabled drivers build config 00:01:28.614 raw/skeleton: not in enabled drivers build config 00:01:28.614 crypto/armv8: not in enabled drivers build config 00:01:28.614 crypto/bcmfs: not in enabled drivers build config 00:01:28.614 crypto/caam_jr: not in enabled drivers build config 00:01:28.614 crypto/ccp: not in enabled drivers build config 00:01:28.614 crypto/cnxk: not in enabled drivers build config 00:01:28.614 crypto/dpaa_sec: not in enabled drivers build config 00:01:28.614 crypto/dpaa2_sec: not in enabled drivers build config 00:01:28.614 crypto/ipsec_mb: not in enabled drivers build config 00:01:28.614 crypto/mlx5: not in enabled drivers build config 00:01:28.614 crypto/mvsam: not in enabled drivers build config 00:01:28.614 crypto/nitrox: not in enabled drivers build config 00:01:28.614 crypto/null: not in enabled drivers build config 00:01:28.614 crypto/octeontx: not in enabled drivers build config 00:01:28.614 crypto/openssl: not in enabled drivers build config 00:01:28.614 crypto/scheduler: not in enabled drivers build config 00:01:28.614 crypto/uadk: not in enabled drivers build config 00:01:28.614 crypto/virtio: not in enabled drivers build config 00:01:28.614 compress/isal: not in enabled drivers build config 00:01:28.614 compress/mlx5: not in enabled drivers build config 00:01:28.614 compress/octeontx: not in enabled drivers build config 00:01:28.614 compress/zlib: not in enabled drivers build config 00:01:28.614 regex/mlx5: not in enabled drivers build config 00:01:28.614 regex/cn9k: not in enabled drivers build config 00:01:28.614 ml/cnxk: not in enabled drivers build config 00:01:28.614 vdpa/ifc: not in enabled drivers build config 00:01:28.614 vdpa/mlx5: not in enabled drivers build config 00:01:28.614 vdpa/nfp: not in enabled drivers build config 00:01:28.614 vdpa/sfc: not in enabled drivers build config 00:01:28.614 event/cnxk: not in enabled drivers build config 00:01:28.614 event/dlb2: not in enabled drivers build config 00:01:28.614 event/dpaa: not in enabled drivers build config 00:01:28.614 event/dpaa2: not in enabled drivers build config 00:01:28.614 event/dsw: not in enabled drivers build config 00:01:28.614 event/opdl: not in enabled drivers build config 00:01:28.614 event/skeleton: not in enabled drivers build config 00:01:28.614 event/sw: not in enabled drivers build config 00:01:28.614 event/octeontx: not in enabled drivers build config 00:01:28.614 baseband/acc: not in enabled drivers build config 00:01:28.614 baseband/fpga_5gnr_fec: not in enabled drivers build config 00:01:28.614 baseband/fpga_lte_fec: not in enabled drivers build config 00:01:28.614 baseband/la12xx: not in enabled drivers build config 00:01:28.614 baseband/null: not in enabled drivers build config 00:01:28.614 baseband/turbo_sw: not in enabled drivers build config 00:01:28.614 gpu/cuda: not in enabled drivers build config 00:01:28.614 00:01:28.614 00:01:28.614 Build targets in project: 220 00:01:28.614 00:01:28.614 DPDK 23.11.0 00:01:28.614 00:01:28.614 User defined options 00:01:28.614 libdir : lib 00:01:28.614 prefix : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:01:28.614 c_args : -fPIC -g -fcommon -Werror -Wno-stringop-overflow 00:01:28.614 c_link_args : 00:01:28.614 enable_docs : false 00:01:28.614 enable_drivers: bus,bus/pci,bus/vdev,mempool/ring,net/i40e,net/i40e/base, 00:01:28.614 enable_kmods : false 00:01:28.614 machine : native 00:01:28.614 tests : false 00:01:28.614 00:01:28.614 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:01:28.614 WARNING: Running the setup command as `meson [options]` instead of `meson setup [options]` is ambiguous and deprecated. 00:01:28.879 04:03:19 -- common/autobuild_common.sh@189 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 00:01:28.879 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:01:28.879 [1/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hypervisor.c.o 00:01:28.879 [2/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_errno.c.o 00:01:28.879 [3/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_version.c.o 00:01:28.879 [4/710] Compiling C object lib/librte_log.a.p/log_log_linux.c.o 00:01:28.879 [5/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_cpuflags.c.o 00:01:28.879 [6/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_class.c.o 00:01:28.879 [7/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_debug.c.o 00:01:28.879 [8/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_hexdump.c.o 00:01:29.141 [9/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_reciprocal.c.o 00:01:29.141 [10/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_string_fns.c.o 00:01:29.141 [11/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_firmware.c.o 00:01:29.141 [12/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_uuid.c.o 00:01:29.141 [13/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_debug.c.o 00:01:29.141 [14/710] Compiling C object lib/librte_kvargs.a.p/kvargs_rte_kvargs.c.o 00:01:29.141 [15/710] Linking static target lib/librte_kvargs.a 00:01:29.141 [16/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_cpuflags.c.o 00:01:29.141 [17/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_data.c.o 00:01:29.141 [18/710] Compiling C object lib/librte_eal.a.p/eal_unix_rte_thread.c.o 00:01:29.141 [19/710] Compiling C object lib/librte_log.a.p/log_log.c.o 00:01:29.141 [20/710] Linking static target lib/librte_log.a 00:01:29.409 [21/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_thread.c.o 00:01:29.409 [22/710] Generating lib/kvargs.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.987 [23/710] Generating lib/log.sym_chk with a custom command (wrapped by meson to capture output) 00:01:29.987 [24/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_config.c.o 00:01:29.987 [25/710] Linking target lib/librte_log.so.24.0 00:01:29.987 [26/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_keepalive.c.o 00:01:29.987 [27/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_file.c.o 00:01:29.987 [28/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_timer.c.o 00:01:29.987 [29/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_timer.c.o 00:01:29.987 [30/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_tailqs.c.o 00:01:29.987 [31/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_filesystem.c.o 00:01:29.987 [32/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_launch.c.o 00:01:29.987 [33/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_mcfg.c.o 00:01:29.987 [34/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_thread.c.o 00:01:29.987 [35/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_spinlock.c.o 00:01:29.987 [36/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_hypervisor.c.o 00:01:30.250 [37/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry_legacy.c.o 00:01:30.250 [38/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_bus.c.o 00:01:30.250 [39/710] Compiling C object lib/librte_eal.a.p/eal_unix_eal_unix_memory.c.o 00:01:30.250 [40/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cpuflags.c.o 00:01:30.250 [41/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_random.c.o 00:01:30.250 [42/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio_mp_sync.c.o 00:01:30.250 [43/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_ctf.c.o 00:01:30.250 [44/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memalloc.c.o 00:01:30.250 [45/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_lcore.c.o 00:01:30.250 [46/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_interrupts.c.o 00:01:30.250 [47/710] Compiling C object lib/librte_eal.a.p/eal_common_hotplug_mp.c.o 00:01:30.250 [48/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_devargs.c.o 00:01:30.250 [49/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dynmem.c.o 00:01:30.250 [50/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_utils.c.o 00:01:30.250 [51/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_thread.c.o 00:01:30.250 [52/710] Generating symbol file lib/librte_log.so.24.0.p/librte_log.so.24.0.symbols 00:01:30.250 [53/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace.c.o 00:01:30.250 [54/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_trace_points.c.o 00:01:30.250 [55/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_mp.c.o 00:01:30.250 [56/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_alarm.c.o 00:01:30.250 [57/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_dev.c.o 00:01:30.250 [58/710] Linking target lib/librte_kvargs.so.24.0 00:01:30.250 [59/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memzone.c.o 00:01:30.250 [60/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_elem.c.o 00:01:30.250 [61/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_dev.c.o 00:01:30.250 [62/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_lcore.c.o 00:01:30.514 [63/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_hugepage_info.c.o 00:01:30.514 [64/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_timer.c.o 00:01:30.514 [65/710] Generating symbol file lib/librte_kvargs.so.24.0.p/librte_kvargs.so.24.0.symbols 00:01:30.514 [66/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_proc.c.o 00:01:30.771 [67/710] Compiling C object lib/librte_eal.a.p/eal_common_malloc_heap.c.o 00:01:30.771 [68/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal.c.o 00:01:30.771 [69/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_memory.c.o 00:01:30.772 [70/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_fbarray.c.o 00:01:30.772 [71/710] Compiling C object lib/librte_pci.a.p/pci_rte_pci.c.o 00:01:30.772 [72/710] Linking static target lib/librte_pci.a 00:01:30.772 [73/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_interrupts.c.o 00:01:31.032 [74/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline.c.o 00:01:31.032 [75/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_service.c.o 00:01:31.032 [76/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_cirbuf.c.o 00:01:31.032 [77/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memalloc.c.o 00:01:31.032 [78/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_portlist.c.o 00:01:31.032 [79/710] Generating lib/pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.032 [80/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_num.c.o 00:01:31.032 [81/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_socket.c.o 00:01:31.032 [82/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_memory.c.o 00:01:31.293 [83/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse.c.o 00:01:31.293 [84/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_cycles.c.o 00:01:31.293 [85/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_vt100.c.o 00:01:31.293 [86/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_os_unix.c.o 00:01:31.293 [87/710] Compiling C object lib/librte_eal.a.p/eal_x86_rte_power_intrinsics.c.o 00:01:31.293 [88/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_string.c.o 00:01:31.293 [89/710] Compiling C object lib/net/libnet_crc_avx512_lib.a.p/net_crc_avx512.c.o 00:01:31.293 [90/710] Linking static target lib/net/libnet_crc_avx512_lib.a 00:01:31.293 [91/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops_default.c.o 00:01:31.293 [92/710] Compiling C object lib/librte_ring.a.p/ring_rte_ring.c.o 00:01:31.293 [93/710] Linking static target lib/librte_ring.a 00:01:31.293 [94/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_pool_ops.c.o 00:01:31.293 [95/710] Compiling C object lib/librte_net.a.p/net_net_crc_sse.c.o 00:01:31.555 [96/710] Compiling C object lib/librte_net.a.p/net_rte_net_crc.c.o 00:01:31.555 [97/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_ptype.c.o 00:01:31.555 [98/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool_ops.c.o 00:01:31.555 [99/710] Compiling C object lib/librte_mempool.a.p/mempool_mempool_trace_points.c.o 00:01:31.555 [100/710] Compiling C object lib/librte_meter.a.p/meter_rte_meter.c.o 00:01:31.555 [101/710] Linking static target lib/librte_meter.a 00:01:31.555 [102/710] Compiling C object lib/librte_eal.a.p/eal_common_rte_malloc.c.o 00:01:31.555 [103/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_profile.c.o 00:01:31.555 [104/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_rdline.c.o 00:01:31.555 [105/710] Compiling C object lib/librte_telemetry.a.p/telemetry_telemetry.c.o 00:01:31.555 [106/710] Compiling C object lib/librte_eal.a.p/eal_common_eal_common_options.c.o 00:01:31.555 [107/710] Linking static target lib/librte_telemetry.a 00:01:31.555 [108/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_class_eth.c.o 00:01:31.555 [109/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf_dyn.c.o 00:01:31.555 [110/710] Compiling C object lib/librte_net.a.p/net_rte_ether.c.o 00:01:31.555 [111/710] Compiling C object lib/librte_net.a.p/net_rte_net.c.o 00:01:31.821 [112/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_telemetry.c.o 00:01:31.821 [113/710] Compiling C object lib/librte_eal.a.p/eal_linux_eal_vfio.c.o 00:01:31.821 [114/710] Linking static target lib/librte_eal.a 00:01:31.821 [115/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_private.c.o 00:01:31.821 [116/710] Generating lib/ring.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.821 [117/710] Generating lib/meter.sym_chk with a custom command (wrapped by meson to capture output) 00:01:31.821 [118/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_cman.c.o 00:01:31.821 [119/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_driver.c.o 00:01:31.821 [120/710] Compiling C object lib/librte_net.a.p/net_rte_arp.c.o 00:01:31.821 [121/710] Linking static target lib/librte_net.a 00:01:32.086 [122/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_common.c.o 00:01:32.086 [123/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8472.c.o 00:01:32.086 [124/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_etheraddr.c.o 00:01:32.086 [125/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8079.c.o 00:01:32.086 [126/710] Compiling C object lib/librte_cmdline.a.p/cmdline_cmdline_parse_ipaddr.c.o 00:01:32.086 [127/710] Linking static target lib/librte_cmdline.a 00:01:32.086 [128/710] Compiling C object lib/librte_mempool.a.p/mempool_rte_mempool.c.o 00:01:32.086 [129/710] Linking static target lib/librte_mempool.a 00:01:32.086 [130/710] Generating lib/telemetry.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.349 [131/710] Linking target lib/librte_telemetry.so.24.0 00:01:32.349 [132/710] Compiling C object lib/librte_cfgfile.a.p/cfgfile_rte_cfgfile.c.o 00:01:32.349 [133/710] Linking static target lib/librte_cfgfile.a 00:01:32.349 [134/710] Compiling C object lib/librte_ethdev.a.p/ethdev_sff_8636.c.o 00:01:32.349 [135/710] Generating lib/net.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.349 [136/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics.c.o 00:01:32.349 [137/710] Compiling C object lib/librte_hash.a.p/hash_rte_fbk_hash.c.o 00:01:32.349 [138/710] Compiling C object lib/librte_metrics.a.p/metrics_rte_metrics_telemetry.c.o 00:01:32.349 [139/710] Linking static target lib/librte_metrics.a 00:01:32.618 [140/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev_telemetry.c.o 00:01:32.618 [141/710] Generating symbol file lib/librte_telemetry.so.24.0.p/librte_telemetry.so.24.0.symbols 00:01:32.618 [142/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_mtr.c.o 00:01:32.618 [143/710] Compiling C object lib/librte_acl.a.p/acl_tb_mem.c.o 00:01:32.618 [144/710] Compiling C object lib/librte_acl.a.p/acl_rte_acl.c.o 00:01:32.880 [145/710] Compiling C object lib/librte_rcu.a.p/rcu_rte_rcu_qsbr.c.o 00:01:32.880 [146/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf.c.o 00:01:32.880 [147/710] Linking static target lib/librte_rcu.a 00:01:32.880 [148/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_dump.c.o 00:01:32.880 [149/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load.c.o 00:01:32.880 [150/710] Generating lib/cfgfile.sym_chk with a custom command (wrapped by meson to capture output) 00:01:32.880 [151/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_stub.c.o 00:01:32.880 [152/710] Compiling C object lib/librte_bitratestats.a.p/bitratestats_rte_bitrate.c.o 00:01:32.880 [153/710] Linking static target lib/librte_bitratestats.a 00:01:32.880 [154/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_tm.c.o 00:01:33.141 [155/710] Generating lib/metrics.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.141 [156/710] Compiling C object lib/librte_acl.a.p/acl_acl_gen.c.o 00:01:33.141 [157/710] Compiling C object lib/librte_timer.a.p/timer_rte_timer.c.o 00:01:33.141 [158/710] Linking static target lib/librte_timer.a 00:01:33.141 [159/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_load_elf.c.o 00:01:33.141 [160/710] Generating lib/mempool.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.141 [161/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_scalar.c.o 00:01:33.141 [162/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev_pmd.c.o 00:01:33.141 [163/710] Generating lib/bitratestats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.141 [164/710] Generating lib/rcu.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.399 [165/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_pmd.c.o 00:01:33.399 [166/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_exec.c.o 00:01:33.399 [167/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_convert.c.o 00:01:33.399 [168/710] Compiling C object lib/librte_bbdev.a.p/bbdev_rte_bbdev.c.o 00:01:33.399 [169/710] Generating lib/cmdline.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.399 [170/710] Linking static target lib/librte_bbdev.a 00:01:33.399 [171/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_compressdev.c.o 00:01:33.661 [172/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_match_sse.c.o 00:01:33.661 [173/710] Compiling C object lib/librte_ethdev.a.p/ethdev_ethdev_trace_points.c.o 00:01:33.661 [174/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev_trace_points.c.o 00:01:33.661 [175/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_cryptodev_trace_points.c.o 00:01:33.661 [176/710] Generating lib/timer.sym_chk with a custom command (wrapped by meson to capture output) 00:01:33.661 [177/710] Compiling C object lib/librte_compressdev.a.p/compressdev_rte_comp.c.o 00:01:33.661 [178/710] Linking static target lib/librte_compressdev.a 00:01:33.661 [179/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor_single.c.o 00:01:33.926 [180/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_private.c.o 00:01:33.926 [181/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_pkt.c.o 00:01:34.188 [182/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_validate.c.o 00:01:34.188 [183/710] Compiling C object lib/librte_hash.a.p/hash_rte_thash.c.o 00:01:34.188 [184/710] Compiling C object lib/librte_distributor.a.p/distributor_rte_distributor.c.o 00:01:34.188 [185/710] Linking static target lib/librte_distributor.a 00:01:34.188 [186/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_ring.c.o 00:01:34.188 [187/710] Generating lib/bbdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.451 [188/710] Compiling C object lib/librte_bpf.a.p/bpf_bpf_jit_x86.c.o 00:01:34.451 [189/710] Linking static target lib/librte_bpf.a 00:01:34.451 [190/710] Generating lib/compressdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.451 [191/710] Compiling C object lib/librte_dmadev.a.p/dmadev_rte_dmadev.c.o 00:01:34.451 [192/710] Compiling C object lib/librte_eventdev.a.p/eventdev_eventdev_trace_points.c.o 00:01:34.451 [193/710] Linking static target lib/librte_dmadev.a 00:01:34.451 [194/710] Generating lib/distributor.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.451 [195/710] Compiling C object lib/librte_dispatcher.a.p/dispatcher_rte_dispatcher.c.o 00:01:34.716 [196/710] Linking static target lib/librte_dispatcher.a 00:01:34.716 [197/710] Compiling C object lib/librte_gso.a.p/gso_gso_tcp4.c.o 00:01:34.716 [198/710] Compiling C object lib/librte_gso.a.p/gso_gso_udp4.c.o 00:01:34.716 [199/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_udp4.c.o 00:01:34.716 [200/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp6.c.o 00:01:34.716 [201/710] Compiling C object lib/librte_gso.a.p/gso_gso_tunnel_tcp4.c.o 00:01:34.716 [202/710] Compiling C object lib/librte_gro.a.p/gro_gro_tcp4.c.o 00:01:34.716 [203/710] Compiling C object lib/librte_power.a.p/power_guest_channel.c.o 00:01:34.716 [204/710] Compiling C object lib/librte_gro.a.p/gro_rte_gro.c.o 00:01:34.716 [205/710] Compiling C object lib/librte_gro.a.p/gro_gro_udp4.c.o 00:01:34.716 [206/710] Compiling C object lib/librte_gso.a.p/gso_rte_gso.c.o 00:01:34.980 [207/710] Compiling C object lib/librte_power.a.p/power_power_common.c.o 00:01:34.980 [208/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_tcp4.c.o 00:01:34.980 [209/710] Generating lib/bpf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.980 [210/710] Compiling C object lib/librte_gpudev.a.p/gpudev_gpudev.c.o 00:01:34.980 [211/710] Linking static target lib/librte_gpudev.a 00:01:34.980 [212/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_reassembly.c.o 00:01:34.980 [213/710] Compiling C object lib/librte_gro.a.p/gro_gro_vxlan_udp4.c.o 00:01:34.980 [214/710] Linking static target lib/librte_gro.a 00:01:34.980 [215/710] Compiling C object lib/librte_power.a.p/power_power_kvm_vm.c.o 00:01:34.980 [216/710] Generating lib/dmadev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:34.980 [217/710] Compiling C object lib/librte_jobstats.a.p/jobstats_rte_jobstats.c.o 00:01:34.980 [218/710] Linking static target lib/librte_jobstats.a 00:01:35.241 [219/710] Compiling C object lib/librte_acl.a.p/acl_acl_bld.c.o 00:01:35.241 [220/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_reassembly.c.o 00:01:35.241 [221/710] Generating lib/dispatcher.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.241 [222/710] Generating lib/gro.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.241 [223/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_dma_adapter.c.o 00:01:35.505 [224/710] Compiling C object lib/librte_latencystats.a.p/latencystats_rte_latencystats.c.o 00:01:35.505 [225/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_ip_frag_internal.c.o 00:01:35.505 [226/710] Linking static target lib/librte_latencystats.a 00:01:35.505 [227/710] Generating lib/jobstats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.505 [228/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ip_frag_common.c.o 00:01:35.505 [229/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv6_fragmentation.c.o 00:01:35.505 [230/710] Compiling C object lib/librte_acl.a.p/acl_acl_run_sse.c.o 00:01:35.505 [231/710] Compiling C object lib/librte_member.a.p/member_rte_member.c.o 00:01:35.766 [232/710] Compiling C object lib/member/libsketch_avx512_tmp.a.p/rte_member_sketch_avx512.c.o 00:01:35.766 [233/710] Linking static target lib/member/libsketch_avx512_tmp.a 00:01:35.766 [234/710] Compiling C object lib/librte_ip_frag.a.p/ip_frag_rte_ipv4_fragmentation.c.o 00:01:35.766 [235/710] Linking static target lib/librte_ip_frag.a 00:01:35.766 [236/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm.c.o 00:01:35.766 [237/710] Generating lib/latencystats.sym_chk with a custom command (wrapped by meson to capture output) 00:01:35.766 [238/710] Compiling C object lib/librte_sched.a.p/sched_rte_approx.c.o 00:01:36.031 [239/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_crypto_adapter.c.o 00:01:36.031 [240/710] Compiling C object lib/librte_power.a.p/power_rte_power.c.o 00:01:36.031 [241/710] Compiling C object lib/librte_power.a.p/power_rte_power_uncore.c.o 00:01:36.031 [242/710] Compiling C object lib/librte_vhost.a.p/vhost_fd_man.c.o 00:01:36.031 [243/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev_pmd.c.o 00:01:36.293 [244/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_tx_adapter.c.o 00:01:36.293 [245/710] Generating lib/ip_frag.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.293 [246/710] Generating lib/gpudev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.294 [247/710] Compiling C object lib/librte_gso.a.p/gso_gso_common.c.o 00:01:36.294 [248/710] Linking static target lib/librte_gso.a 00:01:36.294 [249/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils.c.o 00:01:36.555 [250/710] Compiling C object lib/librte_regexdev.a.p/regexdev_rte_regexdev.c.o 00:01:36.555 [251/710] Linking static target lib/librte_regexdev.a 00:01:36.555 [252/710] Compiling C object lib/librte_power.a.p/power_rte_power_pmd_mgmt.c.o 00:01:36.555 [253/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_eventdev.c.o 00:01:36.555 [254/710] Compiling C object lib/librte_rawdev.a.p/rawdev_rte_rawdev.c.o 00:01:36.555 [255/710] Linking static target lib/librte_rawdev.a 00:01:36.555 [256/710] Compiling C object lib/librte_mldev.a.p/mldev_rte_mldev.c.o 00:01:36.555 [257/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar_bfloat16.c.o 00:01:36.555 [258/710] Generating lib/gso.sym_chk with a custom command (wrapped by meson to capture output) 00:01:36.555 [259/710] Compiling C object lib/librte_member.a.p/member_rte_member_vbf.c.o 00:01:36.815 [260/710] Compiling C object lib/librte_sched.a.p/sched_rte_pie.c.o 00:01:36.815 [261/710] Compiling C object lib/librte_sched.a.p/sched_rte_red.c.o 00:01:36.815 [262/710] Compiling C object lib/librte_mldev.a.p/mldev_mldev_utils_scalar.c.o 00:01:36.815 [263/710] Linking static target lib/librte_mldev.a 00:01:36.815 [264/710] Compiling C object lib/librte_efd.a.p/efd_rte_efd.c.o 00:01:36.815 [265/710] Linking static target lib/librte_efd.a 00:01:36.815 [266/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack.c.o 00:01:36.815 [267/710] Compiling C object lib/librte_pcapng.a.p/pcapng_rte_pcapng.c.o 00:01:36.815 [268/710] Compiling C object lib/acl/libavx2_tmp.a.p/acl_run_avx2.c.o 00:01:36.815 [269/710] Linking static target lib/librte_pcapng.a 00:01:36.815 [270/710] Linking static target lib/acl/libavx2_tmp.a 00:01:36.815 [271/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_std.c.o 00:01:37.078 [272/710] Compiling C object lib/librte_stack.a.p/stack_rte_stack_lf.c.o 00:01:37.078 [273/710] Linking static target lib/librte_stack.a 00:01:37.078 [274/710] Compiling C object lib/librte_member.a.p/member_rte_member_ht.c.o 00:01:37.078 [275/710] Compiling C object lib/librte_lpm.a.p/lpm_rte_lpm6.c.o 00:01:37.078 [276/710] Linking static target lib/librte_lpm.a 00:01:37.078 [277/710] Compiling C object lib/librte_power.a.p/power_power_acpi_cpufreq.c.o 00:01:37.078 [278/710] Compiling C object lib/librte_power.a.p/power_power_amd_pstate_cpufreq.c.o 00:01:37.078 [279/710] Compiling C object lib/librte_power.a.p/power_power_intel_uncore.c.o 00:01:37.343 [280/710] Compiling C object lib/librte_power.a.p/power_power_cppc_cpufreq.c.o 00:01:37.343 [281/710] Generating lib/rawdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.343 [282/710] Generating lib/efd.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.343 [283/710] Generating lib/pcapng.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.343 [284/710] Generating lib/stack.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.343 [285/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib.c.o 00:01:37.343 [286/710] Compiling C object lib/librte_hash.a.p/hash_rte_cuckoo_hash.c.o 00:01:37.343 [287/710] Linking static target lib/librte_hash.a 00:01:37.605 [288/710] Compiling C object lib/acl/libavx512_tmp.a.p/acl_run_avx512.c.o 00:01:37.605 [289/710] Compiling C object lib/librte_vhost.a.p/vhost_vdpa.c.o 00:01:37.605 [290/710] Linking static target lib/acl/libavx512_tmp.a 00:01:37.605 [291/710] Linking static target lib/librte_acl.a 00:01:37.605 [292/710] Compiling C object lib/librte_reorder.a.p/reorder_rte_reorder.c.o 00:01:37.605 [293/710] Linking static target lib/librte_reorder.a 00:01:37.605 [294/710] Compiling C object lib/librte_power.a.p/power_power_pstate_cpufreq.c.o 00:01:37.605 [295/710] Compiling C object lib/librte_vhost.a.p/vhost_iotlb.c.o 00:01:37.605 [296/710] Generating lib/regexdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.605 [297/710] Linking static target lib/librte_power.a 00:01:37.605 [298/710] Generating lib/lpm.sym_chk with a custom command (wrapped by meson to capture output) 00:01:37.605 [299/710] Compiling C object lib/librte_security.a.p/security_rte_security.c.o 00:01:37.605 [300/710] Linking static target lib/librte_security.a 00:01:37.867 [301/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net_ctrl.c.o 00:01:37.867 [302/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ses.c.o 00:01:37.867 [303/710] Compiling C object lib/librte_vhost.a.p/vhost_socket.c.o 00:01:37.867 [304/710] Compiling C object lib/librte_vhost.a.p/vhost_vduse.c.o 00:01:37.867 [305/710] Generating lib/acl.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.132 [306/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_telemetry.c.o 00:01:38.132 [307/710] Compiling C object lib/librte_mbuf.a.p/mbuf_rte_mbuf.c.o 00:01:38.132 [308/710] Linking static target lib/librte_mbuf.a 00:01:38.132 [309/710] Generating lib/reorder.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.132 [310/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_reorder.c.o 00:01:38.132 [311/710] Compiling C object lib/librte_rib.a.p/rib_rte_rib6.c.o 00:01:38.132 [312/710] Linking static target lib/librte_rib.a 00:01:38.132 [313/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_crypto.c.o 00:01:38.132 [314/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_ctrl_pdu.c.o 00:01:38.132 [315/710] Generating lib/hash.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.132 [316/710] Compiling C object lib/librte_ipsec.a.p/ipsec_sa.c.o 00:01:38.398 [317/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_cnt.c.o 00:01:38.398 [318/710] Generating lib/security.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.398 [319/710] Compiling C object lib/librte_table.a.p/table_rte_swx_keycmp.c.o 00:01:38.398 [320/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib.c.o 00:01:38.398 [321/710] Compiling C object lib/fib/libtrie_avx512_tmp.a.p/trie_avx512.c.o 00:01:38.398 [322/710] Compiling C object lib/fib/libdir24_8_avx512_tmp.a.p/dir24_8_avx512.c.o 00:01:38.398 [323/710] Linking static target lib/fib/libtrie_avx512_tmp.a 00:01:38.398 [324/710] Linking static target lib/fib/libdir24_8_avx512_tmp.a 00:01:38.398 [325/710] Generating lib/power.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.661 [326/710] Compiling C object lib/librte_fib.a.p/fib_rte_fib6.c.o 00:01:38.661 [327/710] Generating lib/mldev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.924 [328/710] Generating lib/rib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.924 [329/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_eth_rx_adapter.c.o 00:01:38.924 [330/710] Generating lib/mbuf.sym_chk with a custom command (wrapped by meson to capture output) 00:01:38.924 [331/710] Compiling C object lib/librte_port.a.p/port_rte_port_sched.c.o 00:01:38.924 [332/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_flow.c.o 00:01:38.924 [333/710] Compiling C object lib/librte_pdcp.a.p/pdcp_rte_pdcp.c.o 00:01:39.188 [334/710] Compiling C object lib/librte_member.a.p/member_rte_member_sketch.c.o 00:01:39.188 [335/710] Linking static target lib/librte_member.a 00:01:39.188 [336/710] Compiling C object lib/librte_eventdev.a.p/eventdev_rte_event_timer_adapter.c.o 00:01:39.188 [337/710] Linking static target lib/librte_eventdev.a 00:01:39.449 [338/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_user.c.o 00:01:39.449 [339/710] Compiling C object lib/librte_ipsec.a.p/ipsec_ipsec_sad.c.o 00:01:39.449 [340/710] Compiling C object lib/librte_cryptodev.a.p/cryptodev_rte_cryptodev.c.o 00:01:39.449 [341/710] Linking static target lib/librte_cryptodev.a 00:01:39.449 [342/710] Compiling C object lib/librte_port.a.p/port_rte_port_frag.c.o 00:01:39.711 [343/710] Compiling C object lib/librte_table.a.p/table_rte_table_array.c.o 00:01:39.711 [344/710] Compiling C object lib/librte_port.a.p/port_rte_port_fd.c.o 00:01:39.711 [345/710] Compiling C object lib/librte_ethdev.a.p/ethdev_rte_ethdev.c.o 00:01:39.711 [346/710] Generating lib/member.sym_chk with a custom command (wrapped by meson to capture output) 00:01:39.711 [347/710] Compiling C object lib/librte_port.a.p/port_rte_port_ras.c.o 00:01:39.711 [348/710] Linking static target lib/librte_ethdev.a 00:01:39.711 [349/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_selector.c.o 00:01:39.711 [350/710] Compiling C object lib/librte_port.a.p/port_rte_port_ethdev.c.o 00:01:39.711 [351/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_wm.c.o 00:01:39.711 [352/710] Compiling C object lib/librte_sched.a.p/sched_rte_sched.c.o 00:01:39.711 [353/710] Compiling C object lib/librte_fib.a.p/fib_trie.c.o 00:01:39.711 [354/710] Linking static target lib/librte_sched.a 00:01:39.711 [355/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_learner.c.o 00:01:39.711 [356/710] Compiling C object lib/librte_table.a.p/table_rte_swx_table_em.c.o 00:01:39.711 [357/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_cuckoo.c.o 00:01:39.982 [358/710] Compiling C object lib/librte_fib.a.p/fib_dir24_8.c.o 00:01:39.982 [359/710] Linking static target lib/librte_fib.a 00:01:39.982 [360/710] Compiling C object lib/librte_table.a.p/table_rte_table_acl.c.o 00:01:39.982 [361/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ethdev.c.o 00:01:39.982 [362/710] Compiling C object lib/librte_table.a.p/table_rte_table_stub.c.o 00:01:39.982 [363/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_fd.c.o 00:01:40.244 [364/710] Compiling C object lib/librte_port.a.p/port_rte_port_sym_crypto.c.o 00:01:40.244 [365/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm.c.o 00:01:40.244 [366/710] Compiling C object lib/librte_table.a.p/table_rte_table_lpm_ipv6.c.o 00:01:40.244 [367/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost.c.o 00:01:40.244 [368/710] Compiling C object lib/librte_port.a.p/port_rte_port_eventdev.c.o 00:01:40.244 [369/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_port_in_action.c.o 00:01:40.244 [370/710] Generating lib/sched.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.510 [371/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_outb.c.o 00:01:40.510 [372/710] Compiling C object lib/librte_node.a.p/node_null.c.o 00:01:40.510 [373/710] Generating lib/fib.sym_chk with a custom command (wrapped by meson to capture output) 00:01:40.776 [374/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_ring.c.o 00:01:40.776 [375/710] Compiling C object lib/librte_pdump.a.p/pdump_rte_pdump.c.o 00:01:40.776 [376/710] Linking static target lib/librte_pdump.a 00:01:40.776 [377/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key8.c.o 00:01:40.776 [378/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_worker.c.o 00:01:40.776 [379/710] Compiling C object lib/librte_graph.a.p/graph_graph_ops.c.o 00:01:40.776 [380/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_params.c.o 00:01:41.039 [381/710] Compiling C object lib/librte_graph.a.p/graph_graph_debug.c.o 00:01:41.039 [382/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_ext.c.o 00:01:41.039 [383/710] Compiling C object lib/librte_graph.a.p/graph_graph_populate.c.o 00:01:41.039 [384/710] Compiling C object lib/librte_graph.a.p/graph_node.c.o 00:01:41.039 [385/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key16.c.o 00:01:41.039 [386/710] Compiling C object lib/librte_graph.a.p/graph_graph_pcap.c.o 00:01:41.039 [387/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev_params.c.o 00:01:41.039 [388/710] Compiling C object lib/librte_node.a.p/node_ethdev_ctrl.c.o 00:01:41.039 [389/710] Generating lib/pdump.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.039 [390/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_lru.c.o 00:01:41.302 [391/710] Compiling C object lib/librte_graph.a.p/graph_graph.c.o 00:01:41.302 [392/710] Compiling C object lib/librte_table.a.p/table_rte_table_hash_key32.c.o 00:01:41.302 [393/710] Linking static target lib/librte_table.a 00:01:41.302 [394/710] Generating lib/cryptodev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:41.302 [395/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_pipeline.c.o 00:01:41.569 [396/710] Compiling C object lib/librte_ipsec.a.p/ipsec_esp_inb.c.o 00:01:41.569 [397/710] Linking static target lib/librte_ipsec.a 00:01:41.569 [398/710] Compiling C object lib/librte_node.a.p/node_log.c.o 00:01:41.569 [399/710] Compiling C object lib/librte_node.a.p/node_pkt_drop.c.o 00:01:41.828 [400/710] Compiling C object lib/librte_node.a.p/node_kernel_tx.c.o 00:01:41.828 [401/710] Compiling C object lib/librte_port.a.p/port_rte_swx_port_source_sink.c.o 00:01:42.094 [402/710] Generating lib/ipsec.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.094 [403/710] Compiling C object lib/librte_graph.a.p/graph_graph_stats.c.o 00:01:42.094 [404/710] Generating lib/eal.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.095 [405/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common_uio.c.o 00:01:42.095 [406/710] Compiling C object lib/librte_node.a.p/node_ethdev_rx.c.o 00:01:42.355 [407/710] Compiling C object lib/librte_port.a.p/port_rte_port_ring.c.o 00:01:42.355 [408/710] Compiling C object lib/librte_node.a.p/node_ethdev_tx.c.o 00:01:42.355 [409/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_pci_common.c.o 00:01:42.355 [410/710] Linking target lib/librte_eal.so.24.0 00:01:42.355 [411/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_uio.c.o 00:01:42.355 [412/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci.c.o 00:01:42.355 [413/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_diag.c.o 00:01:42.355 [414/710] Generating lib/table.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.355 [415/710] Generating lib/eventdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:42.355 [416/710] Compiling C object drivers/libtmp_rte_bus_vdev.a.p/bus_vdev_vdev.c.o 00:01:42.355 [417/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ipsec.c.o 00:01:42.616 [418/710] Linking static target drivers/libtmp_rte_bus_vdev.a 00:01:42.616 [419/710] Generating symbol file lib/librte_eal.so.24.0.p/librte_eal.so.24.0.symbols 00:01:42.616 [420/710] Linking target lib/librte_ring.so.24.0 00:01:42.616 [421/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_hmc.c.o 00:01:42.616 [422/710] Linking target lib/librte_meter.so.24.0 00:01:42.879 [423/710] Compiling C object drivers/libtmp_rte_bus_pci.a.p/bus_pci_linux_pci_vfio.c.o 00:01:42.879 [424/710] Compiling C object lib/librte_port.a.p/port_rte_port_source_sink.c.o 00:01:42.879 [425/710] Linking target lib/librte_pci.so.24.0 00:01:42.879 [426/710] Generating symbol file lib/librte_ring.so.24.0.p/librte_ring.so.24.0.symbols 00:01:42.879 [427/710] Linking target lib/librte_timer.so.24.0 00:01:42.879 [428/710] Generating drivers/rte_bus_vdev.pmd.c with a custom command 00:01:42.879 [429/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_dcb.c.o 00:01:42.879 [430/710] Linking target lib/librte_rcu.so.24.0 00:01:42.879 [431/710] Linking target lib/librte_mempool.so.24.0 00:01:42.879 [432/710] Generating symbol file lib/librte_meter.so.24.0.p/librte_meter.so.24.0.symbols 00:01:43.143 [433/710] Linking target lib/librte_acl.so.24.0 00:01:43.143 [434/710] Linking target lib/librte_cfgfile.so.24.0 00:01:43.143 [435/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_ctl.c.o 00:01:43.143 [436/710] Generating symbol file lib/librte_pci.so.24.0.p/librte_pci.so.24.0.symbols 00:01:43.143 [437/710] Linking target lib/librte_dmadev.so.24.0 00:01:43.143 [438/710] Generating symbol file lib/librte_timer.so.24.0.p/librte_timer.so.24.0.symbols 00:01:43.143 [439/710] Linking target lib/librte_jobstats.so.24.0 00:01:43.143 [440/710] Linking target lib/librte_rawdev.so.24.0 00:01:43.143 [441/710] Linking static target lib/librte_port.a 00:01:43.143 [442/710] Linking static target drivers/libtmp_rte_bus_pci.a 00:01:43.143 [443/710] Generating symbol file lib/librte_rcu.so.24.0.p/librte_rcu.so.24.0.symbols 00:01:43.143 [444/710] Linking target lib/librte_stack.so.24.0 00:01:43.143 [445/710] Generating symbol file lib/librte_mempool.so.24.0.p/librte_mempool.so.24.0.symbols 00:01:43.143 [446/710] Compiling C object drivers/librte_bus_vdev.a.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:43.143 [447/710] Compiling C object drivers/librte_bus_vdev.so.24.0.p/meson-generated_.._rte_bus_vdev.pmd.c.o 00:01:43.143 [448/710] Linking static target drivers/librte_bus_vdev.a 00:01:43.143 [449/710] Generating symbol file lib/librte_acl.so.24.0.p/librte_acl.so.24.0.symbols 00:01:43.406 [450/710] Compiling C object lib/librte_graph.a.p/graph_rte_graph_model_mcore_dispatch.c.o 00:01:43.406 [451/710] Linking target lib/librte_mbuf.so.24.0 00:01:43.406 [452/710] Linking target lib/librte_rib.so.24.0 00:01:43.406 [453/710] Linking static target lib/librte_graph.a 00:01:43.406 [454/710] Compiling C object lib/librte_node.a.p/node_kernel_rx.c.o 00:01:43.406 [455/710] Generating symbol file lib/librte_dmadev.so.24.0.p/librte_dmadev.so.24.0.symbols 00:01:43.406 [456/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_lan_hmc.c.o 00:01:43.406 [457/710] Compiling C object lib/librte_node.a.p/node_ip4_reassembly.c.o 00:01:43.406 [458/710] Generating symbol file lib/librte_mbuf.so.24.0.p/librte_mbuf.so.24.0.symbols 00:01:43.406 [459/710] Generating symbol file lib/librte_rib.so.24.0.p/librte_rib.so.24.0.symbols 00:01:43.671 [460/710] Generating drivers/rte_bus_pci.pmd.c with a custom command 00:01:43.671 [461/710] Linking target lib/librte_bbdev.so.24.0 00:01:43.671 [462/710] Linking target lib/librte_net.so.24.0 00:01:43.671 [463/710] Compiling C object app/dpdk-graph.p/graph_cli.c.o 00:01:43.671 [464/710] Generating drivers/rte_bus_vdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.671 [465/710] Linking target lib/librte_compressdev.so.24.0 00:01:43.671 [466/710] Linking target lib/librte_cryptodev.so.24.0 00:01:43.671 [467/710] Linking target lib/librte_distributor.so.24.0 00:01:43.671 [468/710] Compiling C object app/dpdk-graph.p/graph_conn.c.o 00:01:43.671 [469/710] Compiling C object drivers/libtmp_rte_mempool_ring.a.p/mempool_ring_rte_mempool_ring.c.o 00:01:43.671 [470/710] Linking target lib/librte_gpudev.so.24.0 00:01:43.671 [471/710] Linking target lib/librte_regexdev.so.24.0 00:01:43.671 [472/710] Linking target lib/librte_mldev.so.24.0 00:01:43.671 [473/710] Compiling C object drivers/librte_bus_pci.a.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:43.671 [474/710] Linking target lib/librte_reorder.so.24.0 00:01:43.671 [475/710] Linking static target drivers/librte_bus_pci.a 00:01:43.937 [476/710] Compiling C object drivers/librte_bus_pci.so.24.0.p/meson-generated_.._rte_bus_pci.pmd.c.o 00:01:43.937 [477/710] Linking target lib/librte_sched.so.24.0 00:01:43.937 [478/710] Linking target lib/librte_fib.so.24.0 00:01:43.937 [479/710] Compiling C object app/dpdk-graph.p/graph_ethdev_rx.c.o 00:01:43.937 [480/710] Linking static target drivers/libtmp_rte_mempool_ring.a 00:01:43.937 [481/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_vf_representor.c.o 00:01:43.937 [482/710] Generating symbol file lib/librte_net.so.24.0.p/librte_net.so.24.0.symbols 00:01:43.937 [483/710] Linking target drivers/librte_bus_vdev.so.24.0 00:01:43.937 [484/710] Linking target lib/librte_cmdline.so.24.0 00:01:43.937 [485/710] Generating symbol file lib/librte_cryptodev.so.24.0.p/librte_cryptodev.so.24.0.symbols 00:01:43.938 [486/710] Linking target lib/librte_hash.so.24.0 00:01:43.938 [487/710] Generating lib/port.sym_chk with a custom command (wrapped by meson to capture output) 00:01:43.938 [488/710] Generating symbol file lib/librte_reorder.so.24.0.p/librte_reorder.so.24.0.symbols 00:01:43.938 [489/710] Linking target lib/librte_security.so.24.0 00:01:43.938 [490/710] Generating symbol file lib/librte_sched.so.24.0.p/librte_sched.so.24.0.symbols 00:01:44.196 [491/710] Compiling C object app/dpdk-graph.p/graph_graph.c.o 00:01:44.196 [492/710] Generating symbol file drivers/librte_bus_vdev.so.24.0.p/librte_bus_vdev.so.24.0.symbols 00:01:44.196 [493/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_tm.c.o 00:01:44.196 [494/710] Generating lib/graph.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.196 [495/710] Generating symbol file lib/librte_hash.so.24.0.p/librte_hash.so.24.0.symbols 00:01:44.196 [496/710] Generating drivers/rte_mempool_ring.pmd.c with a custom command 00:01:44.196 [497/710] Compiling C object app/dpdk-graph.p/graph_ethdev.c.o 00:01:44.196 [498/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_hash.c.o 00:01:44.196 [499/710] Generating symbol file lib/librte_security.so.24.0.p/librte_security.so.24.0.symbols 00:01:44.196 [500/710] Compiling C object drivers/librte_mempool_ring.a.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:44.196 [501/710] Linking target lib/librte_efd.so.24.0 00:01:44.196 [502/710] Linking static target drivers/librte_mempool_ring.a 00:01:44.196 [503/710] Compiling C object app/dpdk-dumpcap.p/dumpcap_main.c.o 00:01:44.196 [504/710] Linking target lib/librte_lpm.so.24.0 00:01:44.196 [505/710] Compiling C object drivers/librte_mempool_ring.so.24.0.p/meson-generated_.._rte_mempool_ring.pmd.c.o 00:01:44.196 [506/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_recycle_mbufs_vec_common.c.o 00:01:44.196 [507/710] Linking target lib/librte_member.so.24.0 00:01:44.460 [508/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_pf.c.o 00:01:44.460 [509/710] Linking target lib/librte_ipsec.so.24.0 00:01:44.460 [510/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_cmdline_test.c.o 00:01:44.460 [511/710] Linking target drivers/librte_mempool_ring.so.24.0 00:01:44.460 [512/710] Compiling C object app/dpdk-test-cmdline.p/test-cmdline_commands.c.o 00:01:44.460 [513/710] Generating symbol file lib/librte_lpm.so.24.0.p/librte_lpm.so.24.0.symbols 00:01:44.460 [514/710] Generating symbol file lib/librte_ipsec.so.24.0.p/librte_ipsec.so.24.0.symbols 00:01:44.460 [515/710] Compiling C object app/dpdk-graph.p/graph_ip6_route.c.o 00:01:44.460 [516/710] Compiling C object app/dpdk-graph.p/graph_ip4_route.c.o 00:01:44.460 [517/710] Generating drivers/rte_bus_pci.sym_chk with a custom command (wrapped by meson to capture output) 00:01:44.717 [518/710] Compiling C object app/dpdk-graph.p/graph_mempool.c.o 00:01:44.717 [519/710] Linking target drivers/librte_bus_pci.so.24.0 00:01:44.717 [520/710] Compiling C object app/dpdk-graph.p/graph_main.c.o 00:01:44.717 [521/710] Compiling C object lib/librte_node.a.p/node_ip4_local.c.o 00:01:44.717 [522/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline_spec.c.o 00:01:44.717 [523/710] Compiling C object app/dpdk-graph.p/graph_l3fwd.c.o 00:01:44.978 [524/710] Generating symbol file drivers/librte_bus_pci.so.24.0.p/librte_bus_pci.so.24.0.symbols 00:01:45.243 [525/710] Compiling C object app/dpdk-graph.p/graph_utils.c.o 00:01:45.243 [526/710] Compiling C object lib/librte_node.a.p/node_udp4_input.c.o 00:01:45.243 [527/710] Compiling C object drivers/net/i40e/libi40e_avx512_lib.a.p/i40e_rxtx_vec_avx512.c.o 00:01:45.243 [528/710] Linking static target drivers/net/i40e/libi40e_avx512_lib.a 00:01:45.243 [529/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_fdir.c.o 00:01:45.565 [530/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_main.c.o 00:01:45.565 [531/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_test.c.o 00:01:45.565 [532/710] Compiling C object app/dpdk-graph.p/graph_neigh.c.o 00:01:45.822 [533/710] Compiling C object drivers/net/i40e/libi40e_avx2_lib.a.p/i40e_rxtx_vec_avx2.c.o 00:01:45.822 [534/710] Linking static target drivers/net/i40e/libi40e_avx2_lib.a 00:01:45.822 [535/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_adminq.c.o 00:01:45.822 [536/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_options_parse.c.o 00:01:45.822 [537/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_parser.c.o 00:01:45.822 [538/710] Compiling C object app/dpdk-test-acl.p/test-acl_main.c.o 00:01:45.822 [539/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_common.c.o 00:01:45.822 [540/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_main.c.o 00:01:45.822 [541/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_common.c.o 00:01:46.083 [542/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vectors.c.o 00:01:46.345 [543/710] Compiling C object lib/librte_node.a.p/node_pkt_cls.c.o 00:01:46.345 [544/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_vector_parsing.c.o 00:01:46.345 [545/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_options_parsing.c.o 00:01:46.604 [546/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_ops.c.o 00:01:46.604 [547/710] Compiling C object app/dpdk-pdump.p/pdump_main.c.o 00:01:46.604 [548/710] Compiling C object drivers/net/i40e/base/libi40e_base.a.p/i40e_nvm.c.o 00:01:46.604 [549/710] Linking static target drivers/net/i40e/base/libi40e_base.a 00:01:46.604 [550/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_main.c.o 00:01:46.604 [551/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_main.c.o 00:01:46.604 [552/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_flow.c.o 00:01:46.864 [553/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_main.c.o 00:01:46.864 [554/710] Compiling C object app/dpdk-proc-info.p/proc-info_main.c.o 00:01:46.864 [555/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_test.c.o 00:01:46.864 [556/710] Compiling C object lib/librte_node.a.p/node_ip6_lookup.c.o 00:01:46.864 [557/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_vector.c.o 00:01:46.864 [558/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_evt_options.c.o 00:01:47.122 [559/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_parser.c.o 00:01:47.122 [560/710] Generating lib/ethdev.sym_chk with a custom command (wrapped by meson to capture output) 00:01:47.390 [561/710] Linking target lib/librte_ethdev.so.24.0 00:01:47.390 [562/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_common.c.o 00:01:47.390 [563/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_rte_pmd_i40e.c.o 00:01:47.650 [564/710] Generating symbol file lib/librte_ethdev.so.24.0.p/librte_ethdev.so.24.0.symbols 00:01:47.650 [565/710] Linking target lib/librte_metrics.so.24.0 00:01:47.650 [566/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_flow_gen.c.o 00:01:47.913 [567/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_atq.c.o 00:01:47.913 [568/710] Linking target lib/librte_bpf.so.24.0 00:01:47.913 [569/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_items_gen.c.o 00:01:47.913 [570/710] Generating symbol file lib/librte_metrics.so.24.0.p/librte_metrics.so.24.0.symbols 00:01:47.913 [571/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_main.c.o 00:01:47.913 [572/710] Linking target lib/librte_eventdev.so.24.0 00:01:47.913 [573/710] Linking target lib/librte_gro.so.24.0 00:01:47.913 [574/710] Compiling C object app/dpdk-test-gpudev.p/test-gpudev_main.c.o 00:01:47.913 [575/710] Linking target lib/librte_bitratestats.so.24.0 00:01:47.913 [576/710] Linking target lib/librte_gso.so.24.0 00:01:47.913 [577/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_order_queue.c.o 00:01:47.913 [578/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_common.c.o 00:01:47.913 [579/710] Linking target lib/librte_ip_frag.so.24.0 00:01:47.913 [580/710] Linking target lib/librte_latencystats.so.24.0 00:01:47.913 [581/710] Generating symbol file lib/librte_bpf.so.24.0.p/librte_bpf.so.24.0.symbols 00:01:47.913 [582/710] Linking target lib/librte_pcapng.so.24.0 00:01:48.177 [583/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_device_ops.c.o 00:01:48.177 [584/710] Linking target lib/librte_power.so.24.0 00:01:48.177 [585/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_actions_gen.c.o 00:01:48.177 [586/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_ml_options.c.o 00:01:48.177 [587/710] Generating symbol file lib/librte_eventdev.so.24.0.p/librte_eventdev.so.24.0.symbols 00:01:48.177 [588/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_ordered.c.o 00:01:48.177 [589/710] Linking target lib/librte_dispatcher.so.24.0 00:01:48.177 [590/710] Generating symbol file lib/librte_ip_frag.so.24.0.p/librte_ip_frag.so.24.0.symbols 00:01:48.177 [591/710] Generating symbol file lib/librte_pcapng.so.24.0.p/librte_pcapng.so.24.0.symbols 00:01:48.177 [592/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_interleave.c.o 00:01:48.436 [593/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_model_ops.c.o 00:01:48.436 [594/710] Linking target lib/librte_pdump.so.24.0 00:01:48.436 [595/710] Linking target lib/librte_port.so.24.0 00:01:48.436 [596/710] Linking target lib/librte_graph.so.24.0 00:01:48.436 [597/710] Compiling C object lib/librte_node.a.p/node_ip4_lookup.c.o 00:01:48.436 [598/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_queue.c.o 00:01:48.436 [599/710] Compiling C object app/dpdk-test-dma-perf.p/test-dma-perf_benchmark.c.o 00:01:48.436 [600/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_atq.c.o 00:01:48.436 [601/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx_vec_sse.c.o 00:01:48.436 [602/710] Compiling C object lib/librte_pdcp.a.p/pdcp_pdcp_process.c.o 00:01:48.436 [603/710] Linking static target lib/librte_pdcp.a 00:01:48.436 [604/710] Compiling C object app/dpdk-test-fib.p/test-fib_main.c.o 00:01:48.698 [605/710] Generating symbol file lib/librte_port.so.24.0.p/librte_port.so.24.0.symbols 00:01:48.698 [606/710] Generating symbol file lib/librte_graph.so.24.0.p/librte_graph.so.24.0.symbols 00:01:48.698 [607/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_pipeline_common.c.o 00:01:48.698 [608/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_stats.c.o 00:01:48.698 [609/710] Linking target lib/librte_table.so.24.0 00:01:48.698 [610/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_config.c.o 00:01:48.961 [611/710] Generating symbol file lib/librte_table.so.24.0.p/librte_table.so.24.0.symbols 00:01:48.961 [612/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_common.c.o 00:01:48.961 [613/710] Generating lib/pdcp.sym_chk with a custom command (wrapped by meson to capture output) 00:01:49.226 [614/710] Linking target lib/librte_pdcp.so.24.0 00:01:49.226 [615/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_verify.c.o 00:01:49.226 [616/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev.c.o 00:01:49.226 [617/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_throughput.c.o 00:01:49.488 [618/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_init.c.o 00:01:49.488 [619/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_main.c.o 00:01:49.488 [620/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_acl.c.o 00:01:49.488 [621/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_pmd_cyclecount.c.o 00:01:49.488 [622/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_stub.c.o 00:01:49.488 [623/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm_ipv6.c.o 00:01:49.488 [624/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_lpm.c.o 00:01:49.749 [625/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_pipeline_hash.c.o 00:01:49.749 [626/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_cman.c.o 00:01:49.749 [627/710] Compiling C object app/dpdk-testpmd.p/test-pmd_5tswap.c.o 00:01:49.749 [628/710] Compiling C object app/dpdk-test-flow-perf.p/test-flow-perf_main.c.o 00:01:49.749 [629/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmd_flex_item.c.o 00:01:50.007 [630/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_rxtx.c.o 00:01:50.007 [631/710] Compiling C object app/dpdk-testpmd.p/test-pmd_iofwd.c.o 00:01:50.007 [632/710] Compiling C object app/dpdk-testpmd.p/test-pmd_flowgen.c.o 00:01:50.266 [633/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macfwd.c.o 00:01:50.266 [634/710] Compiling C object app/dpdk-test-pipeline.p/test-pipeline_runtime.c.o 00:01:50.266 [635/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_mtr.c.o 00:01:50.266 [636/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_tm.c.o 00:01:50.525 [637/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_throughput.c.o 00:01:50.525 [638/710] Compiling C object app/dpdk-test-crypto-perf.p/test-crypto-perf_cperf_test_latency.c.o 00:01:50.525 [639/710] Compiling C object app/dpdk-testpmd.p/test-pmd_macswap.c.o 00:01:50.525 [640/710] Compiling C object app/dpdk-testpmd.p/test-pmd_ieee1588fwd.c.o 00:01:50.525 [641/710] Compiling C object app/dpdk-testpmd.p/test-pmd_recycle_mbufs.c.o 00:01:50.783 [642/710] Compiling C object app/dpdk-testpmd.p/test-pmd_rxonly.c.o 00:01:50.783 [643/710] Compiling C object app/dpdk-testpmd.p/test-pmd_shared_rxq_fwd.c.o 00:01:50.783 [644/710] Compiling C object app/dpdk-testpmd.p/test-pmd_bpf_cmd.c.o 00:01:50.783 [645/710] Compiling C object app/dpdk-testpmd.p/test-pmd_icmpecho.c.o 00:01:50.783 [646/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_queue.c.o 00:01:51.042 [647/710] Compiling C object drivers/libtmp_rte_net_i40e.a.p/net_i40e_i40e_ethdev.c.o 00:01:51.042 [648/710] Compiling C object app/dpdk-test-security-perf.p/test-security-perf_test_security_perf.c.o 00:01:51.042 [649/710] Linking static target drivers/libtmp_rte_net_i40e.a 00:01:51.042 [650/710] Compiling C object app/dpdk-test-sad.p/test-sad_main.c.o 00:01:51.301 [651/710] Compiling C object app/dpdk-testpmd.p/test-pmd_util.c.o 00:01:51.301 [652/710] Compiling C object app/dpdk-testpmd.p/test-pmd_parameters.c.o 00:01:51.301 [653/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_atq.c.o 00:01:51.559 [654/710] Compiling C object app/dpdk-test-regex.p/test-regex_main.c.o 00:01:51.559 [655/710] Compiling C object app/dpdk-testpmd.p/.._drivers_net_i40e_i40e_testpmd.c.o 00:01:51.559 [656/710] Generating drivers/rte_net_i40e.pmd.c with a custom command 00:01:51.559 [657/710] Compiling C object drivers/librte_net_i40e.a.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:51.559 [658/710] Compiling C object drivers/librte_net_i40e.so.24.0.p/meson-generated_.._rte_net_i40e.pmd.c.o 00:01:51.559 [659/710] Linking static target drivers/librte_net_i40e.a 00:01:51.559 [660/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_cyclecount.c.o 00:01:51.559 [661/710] Compiling C object app/dpdk-testpmd.p/test-pmd_csumonly.c.o 00:01:51.817 [662/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_common.c.o 00:01:51.817 [663/710] Compiling C object app/dpdk-test-security-perf.p/test_test_cryptodev_security_ipsec.c.o 00:01:52.075 [664/710] Generating drivers/rte_net_i40e.sym_chk with a custom command (wrapped by meson to capture output) 00:01:52.386 [665/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline.c.o 00:01:52.386 [666/710] Linking target drivers/librte_net_i40e.so.24.0 00:01:52.386 [667/710] Compiling C object app/dpdk-test-compress-perf.p/test-compress-perf_comp_perf_test_verify.c.o 00:01:52.386 [668/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_swx_pipeline.c.o 00:01:52.386 [669/710] Compiling C object app/dpdk-testpmd.p/test-pmd_noisy_vnf.c.o 00:01:52.650 [670/710] Compiling C object app/dpdk-testpmd.p/test-pmd_testpmd.c.o 00:01:52.908 [671/710] Compiling C object lib/librte_node.a.p/node_ip6_rewrite.c.o 00:01:53.165 [672/710] Compiling C object lib/librte_node.a.p/node_ip4_rewrite.c.o 00:01:53.165 [673/710] Linking static target lib/librte_node.a 00:01:53.423 [674/710] Compiling C object app/dpdk-testpmd.p/test-pmd_txonly.c.o 00:01:53.423 [675/710] Generating lib/node.sym_chk with a custom command (wrapped by meson to capture output) 00:01:53.681 [676/710] Linking target lib/librte_node.so.24.0 00:01:54.613 [677/710] Compiling C object app/dpdk-test-mldev.p/test-mldev_test_inference_common.c.o 00:01:54.870 [678/710] Compiling C object app/dpdk-test-eventdev.p/test-eventdev_test_perf_common.c.o 00:01:55.128 [679/710] Compiling C object app/dpdk-testpmd.p/test-pmd_config.c.o 00:01:56.504 [680/710] Compiling C object app/dpdk-testpmd.p/test-pmd_cmdline_flow.c.o 00:01:56.761 [681/710] Compiling C object app/dpdk-test-bbdev.p/test-bbdev_test_bbdev_perf.c.o 00:02:03.317 [682/710] Compiling C object lib/librte_vhost.a.p/vhost_vhost_crypto.c.o 00:02:35.374 [683/710] Compiling C object lib/librte_vhost.a.p/vhost_virtio_net.c.o 00:02:35.374 [684/710] Linking static target lib/librte_vhost.a 00:02:35.374 [685/710] Generating lib/vhost.sym_chk with a custom command (wrapped by meson to capture output) 00:02:35.374 [686/710] Linking target lib/librte_vhost.so.24.0 00:02:50.241 [687/710] Compiling C object lib/librte_pipeline.a.p/pipeline_rte_table_action.c.o 00:02:50.241 [688/710] Linking static target lib/librte_pipeline.a 00:02:50.499 [689/710] Linking target app/dpdk-pdump 00:02:50.499 [690/710] Linking target app/dpdk-test-gpudev 00:02:50.499 [691/710] Linking target app/dpdk-test-fib 00:02:50.499 [692/710] Linking target app/dpdk-test-cmdline 00:02:50.499 [693/710] Linking target app/dpdk-test-sad 00:02:50.499 [694/710] Linking target app/dpdk-test-regex 00:02:50.499 [695/710] Linking target app/dpdk-proc-info 00:02:50.499 [696/710] Linking target app/dpdk-dumpcap 00:02:50.499 [697/710] Linking target app/dpdk-test-acl 00:02:50.499 [698/710] Linking target app/dpdk-test-security-perf 00:02:50.499 [699/710] Linking target app/dpdk-graph 00:02:50.499 [700/710] Linking target app/dpdk-test-pipeline 00:02:50.499 [701/710] Linking target app/dpdk-test-dma-perf 00:02:50.499 [702/710] Linking target app/dpdk-test-flow-perf 00:02:50.499 [703/710] Linking target app/dpdk-test-crypto-perf 00:02:50.499 [704/710] Linking target app/dpdk-test-bbdev 00:02:50.499 [705/710] Linking target app/dpdk-test-mldev 00:02:50.499 [706/710] Linking target app/dpdk-test-compress-perf 00:02:50.499 [707/710] Linking target app/dpdk-test-eventdev 00:02:50.499 [708/710] Linking target app/dpdk-testpmd 00:02:53.030 [709/710] Generating lib/pipeline.sym_chk with a custom command (wrapped by meson to capture output) 00:02:53.030 [710/710] Linking target lib/librte_pipeline.so.24.0 00:02:53.030 04:04:43 -- common/autobuild_common.sh@190 -- $ ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp -j48 install 00:02:53.030 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp' 00:02:53.030 [0/1] Installing files. 00:02:53.030 Installing subdir /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples 00:02:53.030 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:53.030 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/timer/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/timer 00:02:53.030 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool 00:02:53.030 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:53.030 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:53.030 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/lib/rte_ethtool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/lib 00:02:53.030 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:53.030 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:53.030 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/ethapp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ethtool/ethtool-app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ethtool/ethtool-app 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec-secgw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/rt.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep0.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ep1.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/esp.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/event_helper.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/flow.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp6.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_process.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/ipsec_worker.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/sp4.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/run_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/bypass_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/linux_test.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/load_env.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_ipv6opts.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aescbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs_secgw.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/pkttest.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_null_header_reconstruct.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/data_rxtx.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesctr_sha1_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_aescbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/trs_3descbc_sha1_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipsec-secgw/test/tun_aesgcm_common_defs.sh to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipsec-secgw/test 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_crypto 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ptpclient/ptpclient.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ptpclient 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/perf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-power/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-power 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.031 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/em_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_fib.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v4.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_route.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_default_v6.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_sequential.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_acl_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em_hlm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/l3fwd_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd/lpm_route_parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/l2fwd-cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-cat/cat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-cat 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bbdev_app/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bbdev_app 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/rxtx_callbacks/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/rxtx_callbacks 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_aes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ecdsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_ccm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_xts.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_cmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_tdes.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_rsa.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_sha.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_gcm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_dev_self_test.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/fips_validation/fips_validation_hmac.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/fips_validation 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/service_cores/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/service_cores 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/dma/dmafwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/dma 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l3fwd-graph/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l3fwd-graph 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ipv4_multicast/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ipv4_multicast 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/shm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-keepalive/ka-agent/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-keepalive/ka-agent 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:53.032 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/rte_policer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_meter/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_meter 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-crypto/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-crypto 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bond/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bond 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/pkt_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/altivec/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/altivec 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/sse/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/sse 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/common/neon/port_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/common/neon 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/link_status_interrupt/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/link_status_interrupt 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/skeleton/basicfwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/skeleton 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/pipeline_worker_tx.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/eventdev_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/eventdev_pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/obj.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_group_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd_macswp_pcap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec_sa.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/varbit.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_nexthop_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/learner.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ipsec.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/pcap.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/selector.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/packet.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/meter.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.033 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/fib_routing_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.293 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/hash_func.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.293 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/mirroring.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/vxlan_table.txt to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/ethdev.io to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/recirculation.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/registers.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/pipeline/examples/rss.spec to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/pipeline/examples 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/node.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_node/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_node 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/shared 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/server_node_efd/efd_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/server_node_efd/efd_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_reassembly/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_reassembly 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-macsec/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-macsec 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/parse_obj_list.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/cmdline/commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/cmdline 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/packet_ordering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/packet_ordering 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-jobstats/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-jobstats 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vdpa/vdpa_blk_compact.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vdpa 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/hotplug_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/hotplug_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/simple_mp/mp_commands.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/simple_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/symmetric_mp/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/symmetric_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/shared/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/shared 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_client/client.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_client 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/multi_process/client_server_mp/mp_server/args.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/multi_process/client_server_mp/mp_server 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk_spec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost_blk/vhost_blk_compat.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost_blk 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:53.294 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_fragmentation/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_fragmentation 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/flow_blocks.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/flow_filtering/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/flow_filtering 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/virtio_net.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vhost/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vhost 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/helloworld/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/helloworld 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/app_thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/args.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_pie.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cmdline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/cfg_file.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_red.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/profile_ov.cfg to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/stats.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/qos_sched/init.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/qos_sched 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/pipeline.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/parser.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tap.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/swq.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/mempool.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/tmgr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/conn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/link.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/cryptodev.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route_ecmp.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/firewall.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/flow_crypto.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/route.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/rss.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/tap.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ip_pipeline/examples/l2fwd.cli to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ip_pipeline/examples 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/distributor/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/distributor 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/power_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_x86.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.295 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/vm_power_cli.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_monitor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/oob_monitor_nop.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/channel_manager.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/vm_power_cli_guest.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vm_power_manager/guest_cli/parse.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vm_power_manager/guest_cli 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/ntb_fwd.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/ntb/commands.list to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/ntb 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t2.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/README to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/dummy.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t3.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/bpf/t1.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/bpf 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_generic.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_event_internal_port.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_common.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/l2fwd-event/l2fwd_poll.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/l2fwd-event 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/Makefile to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:53.296 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/examples/vmdq_dcb/main.c to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/share/dpdk/examples/vmdq_dcb 00:02:53.296 Installing lib/librte_log.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_kvargs.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_telemetry.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_eal.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_rcu.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_mempool.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_mbuf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_net.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_meter.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_ethdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_cmdline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_metrics.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_hash.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_timer.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_acl.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_bbdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_bitratestats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_bpf.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_cfgfile.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_compressdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_cryptodev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_distributor.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_dmadev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_efd.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_eventdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_dispatcher.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_gpudev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_gro.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_gso.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_ip_frag.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_jobstats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_latencystats.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.296 Installing lib/librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_lpm.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_member.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_pcapng.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_power.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_rawdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_regexdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_mldev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_rib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_reorder.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_sched.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_security.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.297 Installing lib/librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_stack.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_vhost.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_ipsec.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_pdcp.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_fib.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_port.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_pdump.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_table.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_pipeline.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_graph.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_node.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing lib/librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing drivers/librte_bus_pci.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing drivers/librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.867 Installing drivers/librte_bus_vdev.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing drivers/librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.867 Installing drivers/librte_mempool_ring.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing drivers/librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.867 Installing drivers/librte_net_i40e.a to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:53.867 Installing drivers/librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0 00:02:53.867 Installing app/dpdk-dumpcap to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-graph to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-pdump to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-proc-info to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-acl to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-bbdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-cmdline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-compress-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-crypto-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-dma-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-eventdev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-fib to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-flow-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-gpudev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.867 Installing app/dpdk-test-mldev to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.868 Installing app/dpdk-test-pipeline to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.868 Installing app/dpdk-testpmd to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.868 Installing app/dpdk-test-regex to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.868 Installing app/dpdk-test-sad to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.868 Installing app/dpdk-test-security-perf to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/rte_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/log/rte_log.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/kvargs/rte_kvargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/telemetry/rte_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/generic/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include/generic 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cpuflags.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_cycles.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_io.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_memcpy.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_pause.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_power_intrinsics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_prefetch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rtm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_rwlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_spinlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_vect.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_atomic_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_32.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/x86/include/rte_byteorder_64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_alarm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitmap.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bitops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_branch_prediction.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_bus.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_class.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_compat.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_debug.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_dev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_devargs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_memconfig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_eal_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_errno.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_epoll.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_fbarray.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hexdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_hypervisor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_interrupts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_keepalive.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.868 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_launch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_lock_annotations.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_malloc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_mcslock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memory.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_memzone.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_feature_defs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pci_dev_features.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_per_lcore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_pflock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_random.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_reciprocal.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqcount.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_seqlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_service_component.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_stdatomic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_string_fns.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_tailq.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_thread.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_ticketlock.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_time.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_trace_point_register.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_uuid.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_version.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/include/rte_vfio.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eal/linux/include/rte_os.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_c11_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_generic_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_hts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_peek_zc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ring/rte_ring_rts_elem_pvt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rcu/rte_rcu_qsbr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mempool/rte_mempool_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_ptype.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_pool_ops.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mbuf/rte_mbuf_dyn.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ip.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_udp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_tls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_dtls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_esp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_sctp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_icmp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_arp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ether.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_macsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_vxlan.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gre.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_gtp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_net_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_mpls.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_higig.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ecpri.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_pdcp_hdr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_geneve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_l2tpv2.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ppp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/net/rte_ib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/meter/rte_meter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_cman.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_dev_info.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_flow_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.869 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_mtr_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_tm_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_ethdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ethdev/rte_eth_ctrl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pci/rte_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_num.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_ipaddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_etheraddr.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_string.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_rdline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_vt100.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_socket.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_cirbuf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cmdline/cmdline_parse_portlist.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/metrics/rte_metrics_telemetry.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_fbk_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash_crc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_jhash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_sw.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_crc_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/hash/rte_thash_x86_gfni.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/timer/rte_timer.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/acl/rte_acl_osdep.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bbdev/rte_bbdev_op.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bitratestats/rte_bitrate.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/bpf_def.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/bpf/rte_bpf_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cfgfile/rte_cfgfile.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_compressdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/compressdev/rte_comp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_sym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_crypto_asym.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/cryptodev/rte_cryptodev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/distributor/rte_distributor.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dmadev/rte_dmadev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/efd/rte_efd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_crypto_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_dma_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_rx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_eth_tx_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_event_timer_adapter.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_trace_fp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/eventdev/rte_eventdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/dispatcher/rte_dispatcher.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gpudev/rte_gpudev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gro/rte_gro.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/gso/rte_gso.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ip_frag/rte_ip_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/jobstats/rte_jobstats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/latencystats/rte_latencystats.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_altivec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_neon.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_scalar.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sse.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/lpm/rte_lpm_sve.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/member/rte_member.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pcapng/rte_pcapng.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.870 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_guest_channel.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_pmd_mgmt.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/power/rte_power_uncore.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rawdev/rte_rawdev_pmd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/regexdev/rte_regexdev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/mldev/rte_mldev_core.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/rib/rte_rib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/reorder/rte_reorder.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_approx.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_red.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_sched_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/sched/rte_pie.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/security/rte_security_driver.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_std.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_generic.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_c11.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/stack/rte_stack_lf_stubs.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vdpa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_async.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/vhost/rte_vhost_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sa.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_sad.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/ipsec/rte_ipsec_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdcp/rte_pdcp_group.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/fib/rte_fib6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_frag.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ras.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sched.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_sym_crypto.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_port_eventdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ethdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_fd.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_ring.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/port/rte_swx_port_source_sink.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pdump/rte_pdump.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_em.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_learner.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_selector.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_swx_table_wm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_acl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_array.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_cuckoo.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_lpm_ipv6.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_stub.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_lru_x86.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/table/rte_table_hash_func_arm64.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_port_in_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_table_action.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ipsec.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_pipeline.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_extern.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/pipeline/rte_swx_ctl.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_mcore_dispatch.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.871 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_model_rtc.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/graph/rte_graph_worker_common.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_eth_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip4_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_ip6_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/lib/node/rte_node_udp4_input_api.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/pci/rte_bus_pci.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/bus/vdev/rte_bus_vdev.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/drivers/net/i40e/rte_pmd_i40e.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/buildtools/dpdk-cmdline-gen.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-devbind.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-pmdinfo.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-telemetry.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-hugepages.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/usertools/dpdk-rss-flows.py to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/bin 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/rte_build_config.h to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk-libs.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:53.872 Installing /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build-tmp/meson-private/libdpdk.pc to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig 00:02:53.872 Installing symlink pointing to librte_log.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so.24 00:02:53.872 Installing symlink pointing to librte_log.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_log.so 00:02:53.872 Installing symlink pointing to librte_kvargs.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so.24 00:02:53.872 Installing symlink pointing to librte_kvargs.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_kvargs.so 00:02:53.872 Installing symlink pointing to librte_telemetry.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so.24 00:02:53.872 Installing symlink pointing to librte_telemetry.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_telemetry.so 00:02:53.872 Installing symlink pointing to librte_eal.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so.24 00:02:53.872 Installing symlink pointing to librte_eal.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eal.so 00:02:53.872 Installing symlink pointing to librte_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so.24 00:02:53.872 Installing symlink pointing to librte_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ring.so 00:02:53.872 Installing symlink pointing to librte_rcu.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so.24 00:02:53.872 Installing symlink pointing to librte_rcu.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rcu.so 00:02:53.872 Installing symlink pointing to librte_mempool.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so.24 00:02:53.872 Installing symlink pointing to librte_mempool.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mempool.so 00:02:53.872 Installing symlink pointing to librte_mbuf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so.24 00:02:53.872 Installing symlink pointing to librte_mbuf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mbuf.so 00:02:53.872 Installing symlink pointing to librte_net.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so.24 00:02:53.872 Installing symlink pointing to librte_net.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_net.so 00:02:53.872 Installing symlink pointing to librte_meter.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so.24 00:02:53.872 Installing symlink pointing to librte_meter.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_meter.so 00:02:53.872 Installing symlink pointing to librte_ethdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so.24 00:02:53.872 Installing symlink pointing to librte_ethdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ethdev.so 00:02:53.872 Installing symlink pointing to librte_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so.24 00:02:53.872 Installing symlink pointing to librte_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pci.so 00:02:53.872 Installing symlink pointing to librte_cmdline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so.24 00:02:53.872 Installing symlink pointing to librte_cmdline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cmdline.so 00:02:53.872 Installing symlink pointing to librte_metrics.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so.24 00:02:53.872 Installing symlink pointing to librte_metrics.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_metrics.so 00:02:53.872 Installing symlink pointing to librte_hash.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so.24 00:02:53.872 Installing symlink pointing to librte_hash.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_hash.so 00:02:53.872 Installing symlink pointing to librte_timer.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so.24 00:02:53.872 Installing symlink pointing to librte_timer.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_timer.so 00:02:53.872 Installing symlink pointing to librte_acl.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so.24 00:02:53.872 Installing symlink pointing to librte_acl.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_acl.so 00:02:53.872 Installing symlink pointing to librte_bbdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so.24 00:02:53.872 Installing symlink pointing to librte_bbdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bbdev.so 00:02:53.872 Installing symlink pointing to librte_bitratestats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so.24 00:02:53.872 Installing symlink pointing to librte_bitratestats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bitratestats.so 00:02:53.872 Installing symlink pointing to librte_bpf.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so.24 00:02:53.872 Installing symlink pointing to librte_bpf.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_bpf.so 00:02:53.872 Installing symlink pointing to librte_cfgfile.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so.24 00:02:53.872 Installing symlink pointing to librte_cfgfile.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cfgfile.so 00:02:53.872 Installing symlink pointing to librte_compressdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so.24 00:02:53.872 Installing symlink pointing to librte_compressdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_compressdev.so 00:02:53.872 Installing symlink pointing to librte_cryptodev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so.24 00:02:53.872 Installing symlink pointing to librte_cryptodev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_cryptodev.so 00:02:53.872 Installing symlink pointing to librte_distributor.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so.24 00:02:53.872 Installing symlink pointing to librte_distributor.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_distributor.so 00:02:53.872 Installing symlink pointing to librte_dmadev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so.24 00:02:53.872 Installing symlink pointing to librte_dmadev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dmadev.so 00:02:53.872 Installing symlink pointing to librte_efd.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so.24 00:02:53.872 Installing symlink pointing to librte_efd.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_efd.so 00:02:53.872 Installing symlink pointing to librte_eventdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so.24 00:02:53.872 Installing symlink pointing to librte_eventdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_eventdev.so 00:02:53.872 Installing symlink pointing to librte_dispatcher.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so.24 00:02:53.872 Installing symlink pointing to librte_dispatcher.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_dispatcher.so 00:02:53.872 Installing symlink pointing to librte_gpudev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so.24 00:02:53.873 Installing symlink pointing to librte_gpudev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gpudev.so 00:02:53.873 Installing symlink pointing to librte_gro.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so.24 00:02:53.873 Installing symlink pointing to librte_gro.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gro.so 00:02:53.873 Installing symlink pointing to librte_gso.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so.24 00:02:53.873 Installing symlink pointing to librte_gso.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_gso.so 00:02:53.873 Installing symlink pointing to librte_ip_frag.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so.24 00:02:53.873 Installing symlink pointing to librte_ip_frag.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ip_frag.so 00:02:53.873 Installing symlink pointing to librte_jobstats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so.24 00:02:53.873 Installing symlink pointing to librte_jobstats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_jobstats.so 00:02:53.873 Installing symlink pointing to librte_latencystats.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so.24 00:02:53.873 Installing symlink pointing to librte_latencystats.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_latencystats.so 00:02:53.873 Installing symlink pointing to librte_lpm.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so.24 00:02:53.873 Installing symlink pointing to librte_lpm.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_lpm.so 00:02:53.873 Installing symlink pointing to librte_member.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so.24 00:02:53.873 Installing symlink pointing to librte_member.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_member.so 00:02:53.873 Installing symlink pointing to librte_pcapng.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so.24 00:02:53.873 Installing symlink pointing to librte_pcapng.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pcapng.so 00:02:53.873 Installing symlink pointing to librte_power.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so.24 00:02:53.873 Installing symlink pointing to librte_power.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_power.so 00:02:53.873 Installing symlink pointing to librte_rawdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so.24 00:02:53.873 Installing symlink pointing to librte_rawdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rawdev.so 00:02:53.873 Installing symlink pointing to librte_regexdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so.24 00:02:53.873 Installing symlink pointing to librte_regexdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_regexdev.so 00:02:53.873 './librte_bus_pci.so' -> 'dpdk/pmds-24.0/librte_bus_pci.so' 00:02:53.873 './librte_bus_pci.so.24' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24' 00:02:53.873 './librte_bus_pci.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_pci.so.24.0' 00:02:53.873 './librte_bus_vdev.so' -> 'dpdk/pmds-24.0/librte_bus_vdev.so' 00:02:53.873 './librte_bus_vdev.so.24' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24' 00:02:53.873 './librte_bus_vdev.so.24.0' -> 'dpdk/pmds-24.0/librte_bus_vdev.so.24.0' 00:02:53.873 './librte_mempool_ring.so' -> 'dpdk/pmds-24.0/librte_mempool_ring.so' 00:02:53.873 './librte_mempool_ring.so.24' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24' 00:02:53.873 './librte_mempool_ring.so.24.0' -> 'dpdk/pmds-24.0/librte_mempool_ring.so.24.0' 00:02:53.873 './librte_net_i40e.so' -> 'dpdk/pmds-24.0/librte_net_i40e.so' 00:02:53.873 './librte_net_i40e.so.24' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24' 00:02:53.873 './librte_net_i40e.so.24.0' -> 'dpdk/pmds-24.0/librte_net_i40e.so.24.0' 00:02:53.873 Installing symlink pointing to librte_mldev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so.24 00:02:53.873 Installing symlink pointing to librte_mldev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_mldev.so 00:02:53.873 Installing symlink pointing to librte_rib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so.24 00:02:53.873 Installing symlink pointing to librte_rib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_rib.so 00:02:53.873 Installing symlink pointing to librte_reorder.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so.24 00:02:53.873 Installing symlink pointing to librte_reorder.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_reorder.so 00:02:53.873 Installing symlink pointing to librte_sched.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so.24 00:02:53.873 Installing symlink pointing to librte_sched.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_sched.so 00:02:53.873 Installing symlink pointing to librte_security.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so.24 00:02:53.873 Installing symlink pointing to librte_security.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_security.so 00:02:53.873 Installing symlink pointing to librte_stack.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so.24 00:02:53.873 Installing symlink pointing to librte_stack.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_stack.so 00:02:53.873 Installing symlink pointing to librte_vhost.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so.24 00:02:53.873 Installing symlink pointing to librte_vhost.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_vhost.so 00:02:53.873 Installing symlink pointing to librte_ipsec.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so.24 00:02:53.873 Installing symlink pointing to librte_ipsec.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_ipsec.so 00:02:53.873 Installing symlink pointing to librte_pdcp.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so.24 00:02:53.873 Installing symlink pointing to librte_pdcp.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdcp.so 00:02:53.873 Installing symlink pointing to librte_fib.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so.24 00:02:53.873 Installing symlink pointing to librte_fib.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_fib.so 00:02:53.873 Installing symlink pointing to librte_port.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so.24 00:02:53.873 Installing symlink pointing to librte_port.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_port.so 00:02:53.873 Installing symlink pointing to librte_pdump.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so.24 00:02:53.873 Installing symlink pointing to librte_pdump.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pdump.so 00:02:53.873 Installing symlink pointing to librte_table.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so.24 00:02:53.873 Installing symlink pointing to librte_table.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_table.so 00:02:53.873 Installing symlink pointing to librte_pipeline.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so.24 00:02:53.873 Installing symlink pointing to librte_pipeline.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_pipeline.so 00:02:53.873 Installing symlink pointing to librte_graph.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so.24 00:02:53.873 Installing symlink pointing to librte_graph.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_graph.so 00:02:53.873 Installing symlink pointing to librte_node.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so.24 00:02:53.873 Installing symlink pointing to librte_node.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/librte_node.so 00:02:53.873 Installing symlink pointing to librte_bus_pci.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24 00:02:53.873 Installing symlink pointing to librte_bus_pci.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:02:53.873 Installing symlink pointing to librte_bus_vdev.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24 00:02:53.873 Installing symlink pointing to librte_bus_vdev.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:02:53.873 Installing symlink pointing to librte_mempool_ring.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24 00:02:53.873 Installing symlink pointing to librte_mempool_ring.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:02:53.873 Installing symlink pointing to librte_net_i40e.so.24.0 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24 00:02:53.873 Installing symlink pointing to librte_net_i40e.so.24 to /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:02:53.873 Running custom install script '/bin/sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/config/../buildtools/symlink-drivers-solibs.sh lib dpdk/pmds-24.0' 00:02:54.131 04:04:44 -- common/autobuild_common.sh@192 -- $ uname -s 00:02:54.131 04:04:44 -- common/autobuild_common.sh@192 -- $ [[ Linux == \F\r\e\e\B\S\D ]] 00:02:54.131 04:04:44 -- common/autobuild_common.sh@203 -- $ cat 00:02:54.131 04:04:44 -- common/autobuild_common.sh@208 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:02:54.131 00:02:54.131 real 1m31.470s 00:02:54.131 user 18m4.156s 00:02:54.131 sys 2m9.007s 00:02:54.131 04:04:44 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:02:54.131 04:04:44 -- common/autotest_common.sh@10 -- $ set +x 00:02:54.131 ************************************ 00:02:54.131 END TEST build_native_dpdk 00:02:54.131 ************************************ 00:02:54.131 04:04:44 -- spdk/autobuild.sh@31 -- $ case "$SPDK_TEST_AUTOBUILD" in 00:02:54.131 04:04:44 -- spdk/autobuild.sh@47 -- $ [[ 0 -eq 1 ]] 00:02:54.131 04:04:44 -- spdk/autobuild.sh@51 -- $ [[ 0 -eq 1 ]] 00:02:54.131 04:04:44 -- spdk/autobuild.sh@55 -- $ [[ -n '' ]] 00:02:54.131 04:04:44 -- spdk/autobuild.sh@57 -- $ [[ 0 -eq 1 ]] 00:02:54.131 04:04:44 -- spdk/autobuild.sh@59 -- $ [[ 0 -eq 1 ]] 00:02:54.131 04:04:44 -- spdk/autobuild.sh@62 -- $ [[ 0 -eq 1 ]] 00:02:54.131 04:04:44 -- spdk/autobuild.sh@67 -- $ /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/configure --enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build --with-shared 00:02:54.131 Using /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/pkgconfig for additional libs... 00:02:54.131 DPDK libraries: /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:02:54.131 DPDK includes: //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:02:54.131 Using default SPDK env in /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:02:54.390 Using 'verbs' RDMA provider 00:03:04.988 Configuring ISA-L (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l/spdk-isal.log)...done. 00:03:13.100 Configuring ISA-L-crypto (logfile: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/isa-l-crypto/spdk-isal-crypto.log)...done. 00:03:13.100 Creating mk/config.mk...done. 00:03:13.100 Creating mk/cc.flags.mk...done. 00:03:13.100 Type 'make' to build. 00:03:13.100 04:05:03 -- spdk/autobuild.sh@69 -- $ run_test make make -j48 00:03:13.100 04:05:03 -- common/autotest_common.sh@1087 -- $ '[' 3 -le 1 ']' 00:03:13.100 04:05:03 -- common/autotest_common.sh@1093 -- $ xtrace_disable 00:03:13.100 04:05:03 -- common/autotest_common.sh@10 -- $ set +x 00:03:13.100 ************************************ 00:03:13.100 START TEST make 00:03:13.100 ************************************ 00:03:13.100 04:05:03 -- common/autotest_common.sh@1114 -- $ make -j48 00:03:13.362 make[1]: Nothing to be done for 'all'. 00:03:15.275 The Meson build system 00:03:15.275 Version: 1.5.0 00:03:15.275 Source dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user 00:03:15.275 Build dir: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:15.275 Build type: native build 00:03:15.275 Project name: libvfio-user 00:03:15.275 Project version: 0.0.1 00:03:15.275 C compiler for the host machine: gcc (gcc 13.3.1 "gcc (GCC) 13.3.1 20240522 (Red Hat 13.3.1-1)") 00:03:15.275 C linker for the host machine: gcc ld.bfd 2.40-14 00:03:15.275 Host machine cpu family: x86_64 00:03:15.275 Host machine cpu: x86_64 00:03:15.275 Run-time dependency threads found: YES 00:03:15.275 Library dl found: YES 00:03:15.275 Found pkg-config: YES (/usr/bin/pkg-config) 1.9.5 00:03:15.275 Run-time dependency json-c found: YES 0.17 00:03:15.275 Run-time dependency cmocka found: YES 1.1.7 00:03:15.275 Program pytest-3 found: NO 00:03:15.275 Program flake8 found: NO 00:03:15.275 Program misspell-fixer found: NO 00:03:15.275 Program restructuredtext-lint found: NO 00:03:15.275 Program valgrind found: YES (/usr/bin/valgrind) 00:03:15.275 Compiler for C supports arguments -Wno-missing-field-initializers: YES 00:03:15.275 Compiler for C supports arguments -Wmissing-declarations: YES 00:03:15.275 Compiler for C supports arguments -Wwrite-strings: YES 00:03:15.275 ../libvfio-user/test/meson.build:20: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:15.275 Program test-lspci.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-lspci.sh) 00:03:15.275 Program test-linkage.sh found: YES (/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/libvfio-user/test/test-linkage.sh) 00:03:15.275 ../libvfio-user/test/py/meson.build:16: WARNING: Project targets '>= 0.53.0' but uses feature introduced in '0.57.0': exclude_suites arg in add_test_setup. 00:03:15.275 Build targets in project: 8 00:03:15.275 WARNING: Project specifies a minimum meson_version '>= 0.53.0' but uses features which were added in newer versions: 00:03:15.275 * 0.57.0: {'exclude_suites arg in add_test_setup'} 00:03:15.275 00:03:15.275 libvfio-user 0.0.1 00:03:15.275 00:03:15.275 User defined options 00:03:15.275 buildtype : debug 00:03:15.275 default_library: shared 00:03:15.275 libdir : /usr/local/lib 00:03:15.275 00:03:15.275 Found ninja-1.11.1.git.kitware.jobserver-1 at /usr/local/bin/ninja 00:03:15.858 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:16.123 [1/37] Compiling C object lib/libvfio-user.so.0.0.1.p/irq.c.o 00:03:16.123 [2/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci.c.o 00:03:16.123 [3/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran.c.o 00:03:16.123 [4/37] Compiling C object samples/client.p/.._lib_migration.c.o 00:03:16.123 [5/37] Compiling C object samples/shadow_ioeventfd_server.p/shadow_ioeventfd_server.c.o 00:03:16.123 [6/37] Compiling C object samples/gpio-pci-idio-16.p/gpio-pci-idio-16.c.o 00:03:16.123 [7/37] Compiling C object samples/lspci.p/lspci.c.o 00:03:16.123 [8/37] Compiling C object test/unit_tests.p/.._lib_irq.c.o 00:03:16.123 [9/37] Compiling C object lib/libvfio-user.so.0.0.1.p/tran_sock.c.o 00:03:16.123 [10/37] Compiling C object samples/null.p/null.c.o 00:03:16.123 [11/37] Compiling C object test/unit_tests.p/.._lib_tran_pipe.c.o 00:03:16.123 [12/37] Compiling C object test/unit_tests.p/.._lib_pci.c.o 00:03:16.123 [13/37] Compiling C object lib/libvfio-user.so.0.0.1.p/migration.c.o 00:03:16.123 [14/37] Compiling C object samples/client.p/.._lib_tran.c.o 00:03:16.123 [15/37] Compiling C object lib/libvfio-user.so.0.0.1.p/pci_caps.c.o 00:03:16.123 [16/37] Compiling C object test/unit_tests.p/.._lib_migration.c.o 00:03:16.123 [17/37] Compiling C object test/unit_tests.p/unit-tests.c.o 00:03:16.123 [18/37] Compiling C object lib/libvfio-user.so.0.0.1.p/dma.c.o 00:03:16.123 [19/37] Compiling C object test/unit_tests.p/mocks.c.o 00:03:16.384 [20/37] Compiling C object test/unit_tests.p/.._lib_tran.c.o 00:03:16.384 [21/37] Compiling C object samples/server.p/server.c.o 00:03:16.384 [22/37] Compiling C object test/unit_tests.p/.._lib_tran_sock.c.o 00:03:16.384 [23/37] Compiling C object samples/client.p/.._lib_tran_sock.c.o 00:03:16.384 [24/37] Compiling C object test/unit_tests.p/.._lib_dma.c.o 00:03:16.384 [25/37] Compiling C object test/unit_tests.p/.._lib_pci_caps.c.o 00:03:16.384 [26/37] Compiling C object samples/client.p/client.c.o 00:03:16.384 [27/37] Linking target samples/client 00:03:16.384 [28/37] Compiling C object lib/libvfio-user.so.0.0.1.p/libvfio-user.c.o 00:03:16.384 [29/37] Linking target lib/libvfio-user.so.0.0.1 00:03:16.648 [30/37] Compiling C object test/unit_tests.p/.._lib_libvfio-user.c.o 00:03:16.648 [31/37] Linking target test/unit_tests 00:03:16.648 [32/37] Generating symbol file lib/libvfio-user.so.0.0.1.p/libvfio-user.so.0.0.1.symbols 00:03:16.648 [33/37] Linking target samples/null 00:03:16.648 [34/37] Linking target samples/server 00:03:16.648 [35/37] Linking target samples/lspci 00:03:16.911 [36/37] Linking target samples/shadow_ioeventfd_server 00:03:16.911 [37/37] Linking target samples/gpio-pci-idio-16 00:03:16.911 INFO: autodetecting backend as ninja 00:03:16.911 INFO: calculating backend command to run: /usr/local/bin/ninja -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:16.911 DESTDIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user meson install --quiet -C /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug 00:03:17.851 ninja: Entering directory `/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/build-debug' 00:03:17.851 ninja: no work to do. 00:03:30.049 CC lib/log/log.o 00:03:30.049 CC lib/log/log_flags.o 00:03:30.049 CC lib/log/log_deprecated.o 00:03:30.049 CC lib/ut_mock/mock.o 00:03:30.049 CC lib/ut/ut.o 00:03:30.049 LIB libspdk_ut_mock.a 00:03:30.049 SO libspdk_ut_mock.so.5.0 00:03:30.049 LIB libspdk_log.a 00:03:30.049 LIB libspdk_ut.a 00:03:30.049 SO libspdk_ut.so.1.0 00:03:30.049 SO libspdk_log.so.6.1 00:03:30.049 SYMLINK libspdk_ut_mock.so 00:03:30.049 SYMLINK libspdk_ut.so 00:03:30.049 SYMLINK libspdk_log.so 00:03:30.049 CC lib/dma/dma.o 00:03:30.049 CXX lib/trace_parser/trace.o 00:03:30.049 CC lib/ioat/ioat.o 00:03:30.049 CC lib/util/base64.o 00:03:30.049 CC lib/util/bit_array.o 00:03:30.049 CC lib/util/cpuset.o 00:03:30.049 CC lib/util/crc16.o 00:03:30.049 CC lib/util/crc32.o 00:03:30.049 CC lib/util/crc32c.o 00:03:30.049 CC lib/util/crc32_ieee.o 00:03:30.049 CC lib/util/crc64.o 00:03:30.049 CC lib/util/dif.o 00:03:30.049 CC lib/util/fd.o 00:03:30.049 CC lib/util/file.o 00:03:30.049 CC lib/util/hexlify.o 00:03:30.049 CC lib/util/iov.o 00:03:30.049 CC lib/util/math.o 00:03:30.049 CC lib/util/pipe.o 00:03:30.049 CC lib/util/strerror_tls.o 00:03:30.049 CC lib/util/string.o 00:03:30.049 CC lib/util/uuid.o 00:03:30.049 CC lib/util/fd_group.o 00:03:30.049 CC lib/util/xor.o 00:03:30.049 CC lib/util/zipf.o 00:03:30.049 CC lib/vfio_user/host/vfio_user_pci.o 00:03:30.049 CC lib/vfio_user/host/vfio_user.o 00:03:30.049 LIB libspdk_dma.a 00:03:30.049 SO libspdk_dma.so.3.0 00:03:30.049 SYMLINK libspdk_dma.so 00:03:30.049 LIB libspdk_ioat.a 00:03:30.049 SO libspdk_ioat.so.6.0 00:03:30.049 LIB libspdk_vfio_user.a 00:03:30.049 SO libspdk_vfio_user.so.4.0 00:03:30.049 SYMLINK libspdk_ioat.so 00:03:30.049 SYMLINK libspdk_vfio_user.so 00:03:30.049 LIB libspdk_util.a 00:03:30.049 SO libspdk_util.so.8.0 00:03:30.049 SYMLINK libspdk_util.so 00:03:30.049 CC lib/rdma/common.o 00:03:30.049 CC lib/vmd/vmd.o 00:03:30.049 CC lib/rdma/rdma_verbs.o 00:03:30.049 CC lib/env_dpdk/env.o 00:03:30.049 CC lib/idxd/idxd.o 00:03:30.049 CC lib/vmd/led.o 00:03:30.049 CC lib/json/json_parse.o 00:03:30.049 CC lib/idxd/idxd_user.o 00:03:30.049 CC lib/env_dpdk/memory.o 00:03:30.049 CC lib/conf/conf.o 00:03:30.049 CC lib/json/json_util.o 00:03:30.049 CC lib/env_dpdk/pci.o 00:03:30.049 CC lib/idxd/idxd_kernel.o 00:03:30.049 CC lib/json/json_write.o 00:03:30.049 CC lib/env_dpdk/init.o 00:03:30.049 CC lib/env_dpdk/threads.o 00:03:30.049 CC lib/env_dpdk/pci_ioat.o 00:03:30.049 CC lib/env_dpdk/pci_virtio.o 00:03:30.049 CC lib/env_dpdk/pci_vmd.o 00:03:30.049 CC lib/env_dpdk/pci_idxd.o 00:03:30.049 CC lib/env_dpdk/pci_event.o 00:03:30.049 CC lib/env_dpdk/sigbus_handler.o 00:03:30.049 CC lib/env_dpdk/pci_dpdk.o 00:03:30.049 CC lib/env_dpdk/pci_dpdk_2207.o 00:03:30.049 CC lib/env_dpdk/pci_dpdk_2211.o 00:03:30.049 LIB libspdk_trace_parser.a 00:03:30.049 SO libspdk_trace_parser.so.4.0 00:03:30.049 SYMLINK libspdk_trace_parser.so 00:03:30.049 LIB libspdk_rdma.a 00:03:30.049 LIB libspdk_json.a 00:03:30.049 SO libspdk_rdma.so.5.0 00:03:30.049 SO libspdk_json.so.5.1 00:03:30.049 LIB libspdk_conf.a 00:03:30.049 SO libspdk_conf.so.5.0 00:03:30.049 SYMLINK libspdk_rdma.so 00:03:30.049 SYMLINK libspdk_json.so 00:03:30.049 SYMLINK libspdk_conf.so 00:03:30.049 CC lib/jsonrpc/jsonrpc_server.o 00:03:30.049 CC lib/jsonrpc/jsonrpc_server_tcp.o 00:03:30.049 CC lib/jsonrpc/jsonrpc_client.o 00:03:30.049 CC lib/jsonrpc/jsonrpc_client_tcp.o 00:03:30.049 LIB libspdk_idxd.a 00:03:30.049 SO libspdk_idxd.so.11.0 00:03:30.049 SYMLINK libspdk_idxd.so 00:03:30.049 LIB libspdk_vmd.a 00:03:30.049 SO libspdk_vmd.so.5.0 00:03:30.049 SYMLINK libspdk_vmd.so 00:03:30.049 LIB libspdk_jsonrpc.a 00:03:30.049 SO libspdk_jsonrpc.so.5.1 00:03:30.049 SYMLINK libspdk_jsonrpc.so 00:03:30.049 CC lib/rpc/rpc.o 00:03:30.307 LIB libspdk_rpc.a 00:03:30.307 SO libspdk_rpc.so.5.0 00:03:30.307 SYMLINK libspdk_rpc.so 00:03:30.564 CC lib/trace/trace.o 00:03:30.564 CC lib/notify/notify.o 00:03:30.564 CC lib/sock/sock.o 00:03:30.564 CC lib/notify/notify_rpc.o 00:03:30.564 CC lib/sock/sock_rpc.o 00:03:30.564 CC lib/trace/trace_flags.o 00:03:30.564 CC lib/trace/trace_rpc.o 00:03:30.564 LIB libspdk_notify.a 00:03:30.822 SO libspdk_notify.so.5.0 00:03:30.822 LIB libspdk_trace.a 00:03:30.822 SYMLINK libspdk_notify.so 00:03:30.822 SO libspdk_trace.so.9.0 00:03:30.822 SYMLINK libspdk_trace.so 00:03:30.822 LIB libspdk_sock.a 00:03:30.822 CC lib/thread/thread.o 00:03:30.822 CC lib/thread/iobuf.o 00:03:31.079 SO libspdk_sock.so.8.0 00:03:31.079 SYMLINK libspdk_sock.so 00:03:31.079 CC lib/nvme/nvme_ctrlr_cmd.o 00:03:31.079 CC lib/nvme/nvme_ctrlr.o 00:03:31.079 CC lib/nvme/nvme_fabric.o 00:03:31.079 CC lib/nvme/nvme_ns_cmd.o 00:03:31.079 CC lib/nvme/nvme_ns.o 00:03:31.079 CC lib/nvme/nvme_pcie_common.o 00:03:31.079 CC lib/nvme/nvme_pcie.o 00:03:31.079 CC lib/nvme/nvme_qpair.o 00:03:31.079 CC lib/nvme/nvme.o 00:03:31.079 CC lib/nvme/nvme_quirks.o 00:03:31.079 CC lib/nvme/nvme_transport.o 00:03:31.079 CC lib/nvme/nvme_discovery.o 00:03:31.079 CC lib/nvme/nvme_ctrlr_ocssd_cmd.o 00:03:31.079 CC lib/nvme/nvme_ns_ocssd_cmd.o 00:03:31.079 CC lib/nvme/nvme_tcp.o 00:03:31.079 CC lib/nvme/nvme_opal.o 00:03:31.079 CC lib/nvme/nvme_io_msg.o 00:03:31.079 CC lib/nvme/nvme_poll_group.o 00:03:31.079 CC lib/nvme/nvme_zns.o 00:03:31.079 CC lib/nvme/nvme_cuse.o 00:03:31.079 CC lib/nvme/nvme_vfio_user.o 00:03:31.079 CC lib/nvme/nvme_rdma.o 00:03:31.337 LIB libspdk_env_dpdk.a 00:03:31.337 SO libspdk_env_dpdk.so.13.0 00:03:31.594 SYMLINK libspdk_env_dpdk.so 00:03:32.524 LIB libspdk_thread.a 00:03:32.524 SO libspdk_thread.so.9.0 00:03:32.524 SYMLINK libspdk_thread.so 00:03:32.783 CC lib/vfu_tgt/tgt_endpoint.o 00:03:32.783 CC lib/init/json_config.o 00:03:32.783 CC lib/accel/accel.o 00:03:32.783 CC lib/vfu_tgt/tgt_rpc.o 00:03:32.783 CC lib/init/subsystem.o 00:03:32.783 CC lib/virtio/virtio.o 00:03:32.783 CC lib/accel/accel_rpc.o 00:03:32.783 CC lib/init/subsystem_rpc.o 00:03:32.783 CC lib/virtio/virtio_vhost_user.o 00:03:32.783 CC lib/accel/accel_sw.o 00:03:32.783 CC lib/init/rpc.o 00:03:32.783 CC lib/virtio/virtio_vfio_user.o 00:03:32.783 CC lib/blob/blobstore.o 00:03:32.783 CC lib/virtio/virtio_pci.o 00:03:32.783 CC lib/blob/request.o 00:03:32.783 CC lib/blob/zeroes.o 00:03:32.783 CC lib/blob/blob_bs_dev.o 00:03:33.041 LIB libspdk_init.a 00:03:33.041 SO libspdk_init.so.4.0 00:03:33.041 SYMLINK libspdk_init.so 00:03:33.041 LIB libspdk_vfu_tgt.a 00:03:33.041 LIB libspdk_virtio.a 00:03:33.041 SO libspdk_vfu_tgt.so.2.0 00:03:33.041 SO libspdk_virtio.so.6.0 00:03:33.300 SYMLINK libspdk_vfu_tgt.so 00:03:33.300 SYMLINK libspdk_virtio.so 00:03:33.300 CC lib/event/app.o 00:03:33.300 CC lib/event/reactor.o 00:03:33.300 CC lib/event/log_rpc.o 00:03:33.300 CC lib/event/app_rpc.o 00:03:33.300 CC lib/event/scheduler_static.o 00:03:33.559 LIB libspdk_nvme.a 00:03:33.559 SO libspdk_nvme.so.12.0 00:03:33.559 LIB libspdk_event.a 00:03:33.559 SO libspdk_event.so.12.0 00:03:33.818 SYMLINK libspdk_event.so 00:03:33.818 SYMLINK libspdk_nvme.so 00:03:33.818 LIB libspdk_accel.a 00:03:33.818 SO libspdk_accel.so.14.0 00:03:33.818 SYMLINK libspdk_accel.so 00:03:34.076 CC lib/bdev/bdev.o 00:03:34.076 CC lib/bdev/bdev_rpc.o 00:03:34.076 CC lib/bdev/bdev_zone.o 00:03:34.076 CC lib/bdev/part.o 00:03:34.076 CC lib/bdev/scsi_nvme.o 00:03:35.466 LIB libspdk_blob.a 00:03:35.466 SO libspdk_blob.so.10.1 00:03:35.466 SYMLINK libspdk_blob.so 00:03:35.724 CC lib/blobfs/blobfs.o 00:03:35.724 CC lib/blobfs/tree.o 00:03:35.724 CC lib/lvol/lvol.o 00:03:36.659 LIB libspdk_blobfs.a 00:03:36.659 SO libspdk_blobfs.so.9.0 00:03:36.659 LIB libspdk_lvol.a 00:03:36.659 SYMLINK libspdk_blobfs.so 00:03:36.659 SO libspdk_lvol.so.9.1 00:03:36.659 LIB libspdk_bdev.a 00:03:36.659 SYMLINK libspdk_lvol.so 00:03:36.659 SO libspdk_bdev.so.14.0 00:03:36.659 SYMLINK libspdk_bdev.so 00:03:36.923 CC lib/nvmf/ctrlr.o 00:03:36.923 CC lib/nvmf/ctrlr_discovery.o 00:03:36.923 CC lib/scsi/dev.o 00:03:36.923 CC lib/nvmf/ctrlr_bdev.o 00:03:36.923 CC lib/scsi/lun.o 00:03:36.923 CC lib/nvmf/subsystem.o 00:03:36.923 CC lib/scsi/port.o 00:03:36.923 CC lib/nvmf/nvmf.o 00:03:36.923 CC lib/scsi/scsi.o 00:03:36.923 CC lib/nvmf/nvmf_rpc.o 00:03:36.923 CC lib/nbd/nbd.o 00:03:36.923 CC lib/scsi/scsi_bdev.o 00:03:36.923 CC lib/ublk/ublk.o 00:03:36.923 CC lib/ftl/ftl_core.o 00:03:36.923 CC lib/ublk/ublk_rpc.o 00:03:36.923 CC lib/ftl/ftl_init.o 00:03:36.923 CC lib/nvmf/transport.o 00:03:36.923 CC lib/nbd/nbd_rpc.o 00:03:36.923 CC lib/scsi/scsi_pr.o 00:03:36.923 CC lib/ftl/ftl_layout.o 00:03:36.923 CC lib/nvmf/vfio_user.o 00:03:36.923 CC lib/nvmf/tcp.o 00:03:36.923 CC lib/scsi/scsi_rpc.o 00:03:36.923 CC lib/scsi/task.o 00:03:36.923 CC lib/ftl/ftl_debug.o 00:03:36.923 CC lib/nvmf/rdma.o 00:03:36.923 CC lib/ftl/ftl_io.o 00:03:36.923 CC lib/ftl/ftl_sb.o 00:03:36.923 CC lib/ftl/ftl_l2p.o 00:03:36.923 CC lib/ftl/ftl_l2p_flat.o 00:03:36.923 CC lib/ftl/ftl_nv_cache.o 00:03:36.923 CC lib/ftl/ftl_band.o 00:03:36.923 CC lib/ftl/ftl_band_ops.o 00:03:36.923 CC lib/ftl/ftl_writer.o 00:03:36.923 CC lib/ftl/ftl_rq.o 00:03:36.923 CC lib/ftl/ftl_reloc.o 00:03:36.923 CC lib/ftl/ftl_l2p_cache.o 00:03:36.923 CC lib/ftl/ftl_p2l.o 00:03:36.923 CC lib/ftl/mngt/ftl_mngt.o 00:03:36.923 CC lib/ftl/mngt/ftl_mngt_bdev.o 00:03:36.923 CC lib/ftl/mngt/ftl_mngt_shutdown.o 00:03:36.923 CC lib/ftl/mngt/ftl_mngt_startup.o 00:03:36.923 CC lib/ftl/mngt/ftl_mngt_md.o 00:03:36.923 CC lib/ftl/mngt/ftl_mngt_misc.o 00:03:36.923 CC lib/ftl/mngt/ftl_mngt_ioch.o 00:03:36.923 CC lib/ftl/mngt/ftl_mngt_l2p.o 00:03:36.923 CC lib/ftl/mngt/ftl_mngt_band.o 00:03:36.923 CC lib/ftl/mngt/ftl_mngt_self_test.o 00:03:37.182 CC lib/ftl/mngt/ftl_mngt_p2l.o 00:03:37.182 CC lib/ftl/mngt/ftl_mngt_recovery.o 00:03:37.182 CC lib/ftl/mngt/ftl_mngt_upgrade.o 00:03:37.182 CC lib/ftl/utils/ftl_conf.o 00:03:37.182 CC lib/ftl/utils/ftl_md.o 00:03:37.182 CC lib/ftl/utils/ftl_mempool.o 00:03:37.182 CC lib/ftl/utils/ftl_bitmap.o 00:03:37.182 CC lib/ftl/utils/ftl_property.o 00:03:37.182 CC lib/ftl/utils/ftl_layout_tracker_bdev.o 00:03:37.182 CC lib/ftl/upgrade/ftl_layout_upgrade.o 00:03:37.182 CC lib/ftl/upgrade/ftl_sb_upgrade.o 00:03:37.182 CC lib/ftl/upgrade/ftl_p2l_upgrade.o 00:03:37.182 CC lib/ftl/upgrade/ftl_band_upgrade.o 00:03:37.182 CC lib/ftl/upgrade/ftl_chunk_upgrade.o 00:03:37.182 CC lib/ftl/upgrade/ftl_sb_v3.o 00:03:37.182 CC lib/ftl/upgrade/ftl_sb_v5.o 00:03:37.182 CC lib/ftl/nvc/ftl_nvc_dev.o 00:03:37.182 CC lib/ftl/nvc/ftl_nvc_bdev_vss.o 00:03:37.182 CC lib/ftl/base/ftl_base_dev.o 00:03:37.441 CC lib/ftl/base/ftl_base_bdev.o 00:03:37.441 CC lib/ftl/ftl_trace.o 00:03:37.699 LIB libspdk_nbd.a 00:03:37.699 SO libspdk_nbd.so.6.0 00:03:37.699 LIB libspdk_scsi.a 00:03:37.699 SYMLINK libspdk_nbd.so 00:03:37.699 SO libspdk_scsi.so.8.0 00:03:37.699 SYMLINK libspdk_scsi.so 00:03:37.699 LIB libspdk_ublk.a 00:03:37.957 SO libspdk_ublk.so.2.0 00:03:37.957 SYMLINK libspdk_ublk.so 00:03:37.957 CC lib/vhost/vhost.o 00:03:37.957 CC lib/iscsi/conn.o 00:03:37.957 CC lib/vhost/vhost_rpc.o 00:03:37.957 CC lib/iscsi/init_grp.o 00:03:37.957 CC lib/vhost/vhost_scsi.o 00:03:37.957 CC lib/iscsi/iscsi.o 00:03:37.957 CC lib/vhost/vhost_blk.o 00:03:37.957 CC lib/iscsi/md5.o 00:03:37.957 CC lib/vhost/rte_vhost_user.o 00:03:37.957 CC lib/iscsi/param.o 00:03:37.957 CC lib/iscsi/portal_grp.o 00:03:37.957 CC lib/iscsi/tgt_node.o 00:03:37.957 CC lib/iscsi/iscsi_subsystem.o 00:03:37.957 CC lib/iscsi/iscsi_rpc.o 00:03:37.957 CC lib/iscsi/task.o 00:03:38.216 LIB libspdk_ftl.a 00:03:38.216 SO libspdk_ftl.so.8.0 00:03:38.474 SYMLINK libspdk_ftl.so 00:03:39.041 LIB libspdk_vhost.a 00:03:39.041 SO libspdk_vhost.so.7.1 00:03:39.299 SYMLINK libspdk_vhost.so 00:03:39.299 LIB libspdk_iscsi.a 00:03:39.299 SO libspdk_iscsi.so.7.0 00:03:39.299 LIB libspdk_nvmf.a 00:03:39.557 SO libspdk_nvmf.so.17.0 00:03:39.557 SYMLINK libspdk_iscsi.so 00:03:39.557 SYMLINK libspdk_nvmf.so 00:03:39.815 CC module/env_dpdk/env_dpdk_rpc.o 00:03:39.815 CC module/vfu_device/vfu_virtio.o 00:03:39.815 CC module/vfu_device/vfu_virtio_blk.o 00:03:39.815 CC module/vfu_device/vfu_virtio_scsi.o 00:03:39.815 CC module/vfu_device/vfu_virtio_rpc.o 00:03:39.815 CC module/scheduler/dpdk_governor/dpdk_governor.o 00:03:39.815 CC module/accel/ioat/accel_ioat.o 00:03:39.815 CC module/accel/iaa/accel_iaa.o 00:03:39.815 CC module/accel/ioat/accel_ioat_rpc.o 00:03:39.815 CC module/accel/dsa/accel_dsa.o 00:03:39.815 CC module/accel/dsa/accel_dsa_rpc.o 00:03:39.815 CC module/accel/iaa/accel_iaa_rpc.o 00:03:39.815 CC module/accel/error/accel_error.o 00:03:39.815 CC module/accel/error/accel_error_rpc.o 00:03:39.815 CC module/sock/posix/posix.o 00:03:39.815 CC module/scheduler/gscheduler/gscheduler.o 00:03:39.815 CC module/blob/bdev/blob_bdev.o 00:03:39.815 CC module/scheduler/dynamic/scheduler_dynamic.o 00:03:39.815 LIB libspdk_env_dpdk_rpc.a 00:03:40.074 SO libspdk_env_dpdk_rpc.so.5.0 00:03:40.074 SYMLINK libspdk_env_dpdk_rpc.so 00:03:40.074 LIB libspdk_scheduler_dpdk_governor.a 00:03:40.074 LIB libspdk_scheduler_gscheduler.a 00:03:40.074 SO libspdk_scheduler_gscheduler.so.3.0 00:03:40.074 SO libspdk_scheduler_dpdk_governor.so.3.0 00:03:40.074 LIB libspdk_accel_error.a 00:03:40.074 LIB libspdk_accel_ioat.a 00:03:40.074 LIB libspdk_scheduler_dynamic.a 00:03:40.074 LIB libspdk_accel_iaa.a 00:03:40.074 SO libspdk_accel_error.so.1.0 00:03:40.074 SO libspdk_accel_ioat.so.5.0 00:03:40.074 SYMLINK libspdk_scheduler_dpdk_governor.so 00:03:40.074 SYMLINK libspdk_scheduler_gscheduler.so 00:03:40.074 SO libspdk_scheduler_dynamic.so.3.0 00:03:40.074 SO libspdk_accel_iaa.so.2.0 00:03:40.074 LIB libspdk_accel_dsa.a 00:03:40.074 SYMLINK libspdk_accel_error.so 00:03:40.074 SYMLINK libspdk_accel_ioat.so 00:03:40.074 SYMLINK libspdk_scheduler_dynamic.so 00:03:40.074 LIB libspdk_blob_bdev.a 00:03:40.074 SO libspdk_accel_dsa.so.4.0 00:03:40.074 SYMLINK libspdk_accel_iaa.so 00:03:40.074 SO libspdk_blob_bdev.so.10.1 00:03:40.074 SYMLINK libspdk_accel_dsa.so 00:03:40.074 SYMLINK libspdk_blob_bdev.so 00:03:40.332 CC module/bdev/lvol/vbdev_lvol.o 00:03:40.332 CC module/bdev/malloc/bdev_malloc.o 00:03:40.332 CC module/bdev/nvme/bdev_nvme.o 00:03:40.332 CC module/bdev/null/bdev_null.o 00:03:40.332 CC module/bdev/zone_block/vbdev_zone_block.o 00:03:40.332 CC module/bdev/ftl/bdev_ftl.o 00:03:40.332 CC module/bdev/malloc/bdev_malloc_rpc.o 00:03:40.332 CC module/bdev/null/bdev_null_rpc.o 00:03:40.332 CC module/bdev/nvme/bdev_nvme_rpc.o 00:03:40.332 CC module/bdev/zone_block/vbdev_zone_block_rpc.o 00:03:40.332 CC module/bdev/lvol/vbdev_lvol_rpc.o 00:03:40.332 CC module/bdev/ftl/bdev_ftl_rpc.o 00:03:40.332 CC module/bdev/error/vbdev_error.o 00:03:40.332 CC module/bdev/delay/vbdev_delay.o 00:03:40.332 CC module/bdev/nvme/nvme_rpc.o 00:03:40.332 CC module/bdev/aio/bdev_aio.o 00:03:40.332 CC module/bdev/passthru/vbdev_passthru.o 00:03:40.332 CC module/bdev/error/vbdev_error_rpc.o 00:03:40.332 CC module/bdev/gpt/gpt.o 00:03:40.332 CC module/blobfs/bdev/blobfs_bdev.o 00:03:40.332 CC module/bdev/raid/bdev_raid.o 00:03:40.332 CC module/blobfs/bdev/blobfs_bdev_rpc.o 00:03:40.332 CC module/bdev/delay/vbdev_delay_rpc.o 00:03:40.332 CC module/bdev/nvme/bdev_mdns_client.o 00:03:40.332 CC module/bdev/passthru/vbdev_passthru_rpc.o 00:03:40.332 CC module/bdev/gpt/vbdev_gpt.o 00:03:40.332 CC module/bdev/aio/bdev_aio_rpc.o 00:03:40.332 CC module/bdev/nvme/vbdev_opal.o 00:03:40.332 CC module/bdev/raid/bdev_raid_rpc.o 00:03:40.332 CC module/bdev/split/vbdev_split.o 00:03:40.332 CC module/bdev/nvme/vbdev_opal_rpc.o 00:03:40.333 CC module/bdev/split/vbdev_split_rpc.o 00:03:40.333 CC module/bdev/raid/bdev_raid_sb.o 00:03:40.333 CC module/bdev/nvme/bdev_nvme_cuse_rpc.o 00:03:40.333 CC module/bdev/raid/raid0.o 00:03:40.333 CC module/bdev/virtio/bdev_virtio_scsi.o 00:03:40.333 CC module/bdev/raid/raid1.o 00:03:40.333 CC module/bdev/iscsi/bdev_iscsi.o 00:03:40.333 CC module/bdev/virtio/bdev_virtio_blk.o 00:03:40.333 CC module/bdev/raid/concat.o 00:03:40.333 CC module/bdev/virtio/bdev_virtio_rpc.o 00:03:40.333 CC module/bdev/iscsi/bdev_iscsi_rpc.o 00:03:40.591 LIB libspdk_vfu_device.a 00:03:40.591 SO libspdk_vfu_device.so.2.0 00:03:40.591 SYMLINK libspdk_vfu_device.so 00:03:40.850 LIB libspdk_blobfs_bdev.a 00:03:40.850 LIB libspdk_sock_posix.a 00:03:40.850 LIB libspdk_bdev_split.a 00:03:40.850 SO libspdk_bdev_split.so.5.0 00:03:40.850 SO libspdk_sock_posix.so.5.0 00:03:40.850 SO libspdk_blobfs_bdev.so.5.0 00:03:40.850 SYMLINK libspdk_bdev_split.so 00:03:40.850 SYMLINK libspdk_blobfs_bdev.so 00:03:40.850 SYMLINK libspdk_sock_posix.so 00:03:40.850 LIB libspdk_bdev_gpt.a 00:03:40.850 SO libspdk_bdev_gpt.so.5.0 00:03:40.850 LIB libspdk_bdev_error.a 00:03:40.850 LIB libspdk_bdev_null.a 00:03:40.850 SO libspdk_bdev_error.so.5.0 00:03:40.850 SO libspdk_bdev_null.so.5.0 00:03:40.850 LIB libspdk_bdev_aio.a 00:03:40.850 LIB libspdk_bdev_ftl.a 00:03:40.850 SYMLINK libspdk_bdev_gpt.so 00:03:40.850 LIB libspdk_bdev_malloc.a 00:03:40.850 SO libspdk_bdev_aio.so.5.0 00:03:40.850 LIB libspdk_bdev_passthru.a 00:03:40.850 SO libspdk_bdev_ftl.so.5.0 00:03:40.850 SO libspdk_bdev_malloc.so.5.0 00:03:40.850 LIB libspdk_bdev_zone_block.a 00:03:40.850 SYMLINK libspdk_bdev_error.so 00:03:40.850 SYMLINK libspdk_bdev_null.so 00:03:40.850 SO libspdk_bdev_passthru.so.5.0 00:03:40.850 SO libspdk_bdev_zone_block.so.5.0 00:03:41.109 LIB libspdk_bdev_delay.a 00:03:41.109 SYMLINK libspdk_bdev_aio.so 00:03:41.109 SYMLINK libspdk_bdev_ftl.so 00:03:41.109 LIB libspdk_bdev_iscsi.a 00:03:41.109 SYMLINK libspdk_bdev_malloc.so 00:03:41.109 SO libspdk_bdev_delay.so.5.0 00:03:41.109 SYMLINK libspdk_bdev_passthru.so 00:03:41.109 SO libspdk_bdev_iscsi.so.5.0 00:03:41.109 SYMLINK libspdk_bdev_zone_block.so 00:03:41.109 LIB libspdk_bdev_lvol.a 00:03:41.109 SYMLINK libspdk_bdev_delay.so 00:03:41.109 SO libspdk_bdev_lvol.so.5.0 00:03:41.109 SYMLINK libspdk_bdev_iscsi.so 00:03:41.109 LIB libspdk_bdev_virtio.a 00:03:41.109 SYMLINK libspdk_bdev_lvol.so 00:03:41.109 SO libspdk_bdev_virtio.so.5.0 00:03:41.109 SYMLINK libspdk_bdev_virtio.so 00:03:41.367 LIB libspdk_bdev_raid.a 00:03:41.367 SO libspdk_bdev_raid.so.5.0 00:03:41.626 SYMLINK libspdk_bdev_raid.so 00:03:43.000 LIB libspdk_bdev_nvme.a 00:03:43.000 SO libspdk_bdev_nvme.so.6.0 00:03:43.000 SYMLINK libspdk_bdev_nvme.so 00:03:43.000 CC module/event/subsystems/vmd/vmd.o 00:03:43.000 CC module/event/subsystems/sock/sock.o 00:03:43.000 CC module/event/subsystems/vmd/vmd_rpc.o 00:03:43.000 CC module/event/subsystems/vhost_blk/vhost_blk.o 00:03:43.000 CC module/event/subsystems/iobuf/iobuf.o 00:03:43.000 CC module/event/subsystems/iobuf/iobuf_rpc.o 00:03:43.000 CC module/event/subsystems/vfu_tgt/vfu_tgt.o 00:03:43.000 CC module/event/subsystems/scheduler/scheduler.o 00:03:43.259 LIB libspdk_event_sock.a 00:03:43.259 LIB libspdk_event_vhost_blk.a 00:03:43.259 LIB libspdk_event_vmd.a 00:03:43.259 LIB libspdk_event_scheduler.a 00:03:43.259 LIB libspdk_event_vfu_tgt.a 00:03:43.259 LIB libspdk_event_iobuf.a 00:03:43.259 SO libspdk_event_sock.so.4.0 00:03:43.259 SO libspdk_event_vhost_blk.so.2.0 00:03:43.259 SO libspdk_event_vmd.so.5.0 00:03:43.259 SO libspdk_event_scheduler.so.3.0 00:03:43.259 SO libspdk_event_vfu_tgt.so.2.0 00:03:43.259 SO libspdk_event_iobuf.so.2.0 00:03:43.259 SYMLINK libspdk_event_sock.so 00:03:43.259 SYMLINK libspdk_event_vhost_blk.so 00:03:43.259 SYMLINK libspdk_event_scheduler.so 00:03:43.259 SYMLINK libspdk_event_vfu_tgt.so 00:03:43.259 SYMLINK libspdk_event_vmd.so 00:03:43.259 SYMLINK libspdk_event_iobuf.so 00:03:43.517 CC module/event/subsystems/accel/accel.o 00:03:43.517 LIB libspdk_event_accel.a 00:03:43.517 SO libspdk_event_accel.so.5.0 00:03:43.775 SYMLINK libspdk_event_accel.so 00:03:43.775 CC module/event/subsystems/bdev/bdev.o 00:03:44.047 LIB libspdk_event_bdev.a 00:03:44.047 SO libspdk_event_bdev.so.5.0 00:03:44.047 SYMLINK libspdk_event_bdev.so 00:03:44.047 CC module/event/subsystems/scsi/scsi.o 00:03:44.047 CC module/event/subsystems/nbd/nbd.o 00:03:44.047 CC module/event/subsystems/ublk/ublk.o 00:03:44.047 CC module/event/subsystems/nvmf/nvmf_rpc.o 00:03:44.047 CC module/event/subsystems/nvmf/nvmf_tgt.o 00:03:44.305 LIB libspdk_event_nbd.a 00:03:44.305 LIB libspdk_event_ublk.a 00:03:44.305 SO libspdk_event_ublk.so.2.0 00:03:44.305 SO libspdk_event_nbd.so.5.0 00:03:44.305 LIB libspdk_event_scsi.a 00:03:44.305 SO libspdk_event_scsi.so.5.0 00:03:44.305 SYMLINK libspdk_event_nbd.so 00:03:44.305 SYMLINK libspdk_event_ublk.so 00:03:44.305 SYMLINK libspdk_event_scsi.so 00:03:44.305 LIB libspdk_event_nvmf.a 00:03:44.305 SO libspdk_event_nvmf.so.5.0 00:03:44.305 SYMLINK libspdk_event_nvmf.so 00:03:44.579 CC module/event/subsystems/vhost_scsi/vhost_scsi.o 00:03:44.579 CC module/event/subsystems/iscsi/iscsi.o 00:03:44.579 LIB libspdk_event_vhost_scsi.a 00:03:44.579 SO libspdk_event_vhost_scsi.so.2.0 00:03:44.579 LIB libspdk_event_iscsi.a 00:03:44.579 SO libspdk_event_iscsi.so.5.0 00:03:44.579 SYMLINK libspdk_event_vhost_scsi.so 00:03:44.579 SYMLINK libspdk_event_iscsi.so 00:03:44.851 SO libspdk.so.5.0 00:03:44.851 SYMLINK libspdk.so 00:03:44.851 CC test/rpc_client/rpc_client_test.o 00:03:44.851 TEST_HEADER include/spdk/accel.h 00:03:44.851 CC app/spdk_nvme_discover/discovery_aer.o 00:03:44.851 TEST_HEADER include/spdk/accel_module.h 00:03:44.851 CC app/trace_record/trace_record.o 00:03:44.851 CC app/spdk_nvme_perf/perf.o 00:03:44.851 CC app/spdk_nvme_identify/identify.o 00:03:44.851 TEST_HEADER include/spdk/assert.h 00:03:44.851 CC app/spdk_top/spdk_top.o 00:03:44.851 CXX app/trace/trace.o 00:03:44.851 TEST_HEADER include/spdk/barrier.h 00:03:44.851 CC app/spdk_lspci/spdk_lspci.o 00:03:44.851 TEST_HEADER include/spdk/base64.h 00:03:44.851 TEST_HEADER include/spdk/bdev.h 00:03:44.851 TEST_HEADER include/spdk/bdev_module.h 00:03:44.851 TEST_HEADER include/spdk/bdev_zone.h 00:03:44.851 TEST_HEADER include/spdk/bit_array.h 00:03:44.851 TEST_HEADER include/spdk/bit_pool.h 00:03:44.851 TEST_HEADER include/spdk/blob_bdev.h 00:03:44.851 TEST_HEADER include/spdk/blobfs_bdev.h 00:03:44.851 TEST_HEADER include/spdk/blobfs.h 00:03:45.112 TEST_HEADER include/spdk/blob.h 00:03:45.112 TEST_HEADER include/spdk/conf.h 00:03:45.112 TEST_HEADER include/spdk/config.h 00:03:45.112 TEST_HEADER include/spdk/cpuset.h 00:03:45.112 TEST_HEADER include/spdk/crc16.h 00:03:45.112 TEST_HEADER include/spdk/crc32.h 00:03:45.112 CC examples/interrupt_tgt/interrupt_tgt.o 00:03:45.112 TEST_HEADER include/spdk/crc64.h 00:03:45.112 CC app/nvmf_tgt/nvmf_main.o 00:03:45.112 TEST_HEADER include/spdk/dif.h 00:03:45.112 TEST_HEADER include/spdk/dma.h 00:03:45.112 CC app/spdk_dd/spdk_dd.o 00:03:45.112 TEST_HEADER include/spdk/endian.h 00:03:45.112 CC app/iscsi_tgt/iscsi_tgt.o 00:03:45.112 TEST_HEADER include/spdk/env_dpdk.h 00:03:45.113 CC test/app/jsoncat/jsoncat.o 00:03:45.113 TEST_HEADER include/spdk/env.h 00:03:45.113 CC test/app/histogram_perf/histogram_perf.o 00:03:45.113 TEST_HEADER include/spdk/event.h 00:03:45.113 CC test/app/stub/stub.o 00:03:45.113 CC examples/nvme/hello_world/hello_world.o 00:03:45.113 CC test/env/pci/pci_ut.o 00:03:45.113 CC examples/ioat/verify/verify.o 00:03:45.113 TEST_HEADER include/spdk/fd_group.h 00:03:45.113 CC test/env/vtophys/vtophys.o 00:03:45.113 CC examples/sock/hello_world/hello_sock.o 00:03:45.113 CC app/vhost/vhost.o 00:03:45.113 CC test/env/memory/memory_ut.o 00:03:45.113 TEST_HEADER include/spdk/fd.h 00:03:45.113 CC examples/idxd/perf/perf.o 00:03:45.113 TEST_HEADER include/spdk/file.h 00:03:45.113 CC test/env/env_dpdk_post_init/env_dpdk_post_init.o 00:03:45.113 CC test/nvme/aer/aer.o 00:03:45.113 CC examples/accel/perf/accel_perf.o 00:03:45.113 CC examples/ioat/perf/perf.o 00:03:45.113 CC app/fio/nvme/fio_plugin.o 00:03:45.113 TEST_HEADER include/spdk/ftl.h 00:03:45.113 CC test/thread/poller_perf/poller_perf.o 00:03:45.113 CC examples/vmd/lsvmd/lsvmd.o 00:03:45.113 TEST_HEADER include/spdk/gpt_spec.h 00:03:45.113 TEST_HEADER include/spdk/hexlify.h 00:03:45.113 CC examples/util/zipf/zipf.o 00:03:45.113 TEST_HEADER include/spdk/histogram_data.h 00:03:45.113 CC test/event/event_perf/event_perf.o 00:03:45.113 TEST_HEADER include/spdk/idxd.h 00:03:45.113 TEST_HEADER include/spdk/idxd_spec.h 00:03:45.113 TEST_HEADER include/spdk/init.h 00:03:45.113 TEST_HEADER include/spdk/ioat.h 00:03:45.113 TEST_HEADER include/spdk/ioat_spec.h 00:03:45.113 TEST_HEADER include/spdk/iscsi_spec.h 00:03:45.113 TEST_HEADER include/spdk/json.h 00:03:45.113 CC app/spdk_tgt/spdk_tgt.o 00:03:45.113 TEST_HEADER include/spdk/jsonrpc.h 00:03:45.113 TEST_HEADER include/spdk/likely.h 00:03:45.113 TEST_HEADER include/spdk/log.h 00:03:45.113 TEST_HEADER include/spdk/lvol.h 00:03:45.113 CC test/dma/test_dma/test_dma.o 00:03:45.113 CC examples/blob/hello_world/hello_blob.o 00:03:45.113 TEST_HEADER include/spdk/memory.h 00:03:45.113 CC test/bdev/bdevio/bdevio.o 00:03:45.113 CC test/app/bdev_svc/bdev_svc.o 00:03:45.113 CC test/accel/dif/dif.o 00:03:45.113 TEST_HEADER include/spdk/mmio.h 00:03:45.113 CC examples/bdev/hello_world/hello_bdev.o 00:03:45.113 CC examples/thread/thread/thread_ex.o 00:03:45.113 CC test/blobfs/mkfs/mkfs.o 00:03:45.113 CC examples/blob/cli/blobcli.o 00:03:45.113 TEST_HEADER include/spdk/nbd.h 00:03:45.113 CC examples/bdev/bdevperf/bdevperf.o 00:03:45.113 TEST_HEADER include/spdk/notify.h 00:03:45.113 TEST_HEADER include/spdk/nvme.h 00:03:45.113 TEST_HEADER include/spdk/nvme_intel.h 00:03:45.113 CC examples/nvmf/nvmf/nvmf.o 00:03:45.113 TEST_HEADER include/spdk/nvme_ocssd.h 00:03:45.113 TEST_HEADER include/spdk/nvme_ocssd_spec.h 00:03:45.113 TEST_HEADER include/spdk/nvme_spec.h 00:03:45.113 CC test/app/fuzz/nvme_fuzz/nvme_fuzz.o 00:03:45.113 TEST_HEADER include/spdk/nvme_zns.h 00:03:45.113 CC test/lvol/esnap/esnap.o 00:03:45.113 TEST_HEADER include/spdk/nvmf_cmd.h 00:03:45.113 CC test/env/mem_callbacks/mem_callbacks.o 00:03:45.113 TEST_HEADER include/spdk/nvmf_fc_spec.h 00:03:45.113 TEST_HEADER include/spdk/nvmf.h 00:03:45.113 TEST_HEADER include/spdk/nvmf_spec.h 00:03:45.113 TEST_HEADER include/spdk/nvmf_transport.h 00:03:45.113 TEST_HEADER include/spdk/opal.h 00:03:45.113 TEST_HEADER include/spdk/opal_spec.h 00:03:45.113 TEST_HEADER include/spdk/pci_ids.h 00:03:45.113 TEST_HEADER include/spdk/pipe.h 00:03:45.113 TEST_HEADER include/spdk/queue.h 00:03:45.113 TEST_HEADER include/spdk/reduce.h 00:03:45.113 TEST_HEADER include/spdk/rpc.h 00:03:45.113 TEST_HEADER include/spdk/scheduler.h 00:03:45.113 TEST_HEADER include/spdk/scsi.h 00:03:45.113 TEST_HEADER include/spdk/scsi_spec.h 00:03:45.113 TEST_HEADER include/spdk/sock.h 00:03:45.113 TEST_HEADER include/spdk/stdinc.h 00:03:45.113 TEST_HEADER include/spdk/string.h 00:03:45.113 TEST_HEADER include/spdk/thread.h 00:03:45.113 TEST_HEADER include/spdk/trace.h 00:03:45.113 TEST_HEADER include/spdk/trace_parser.h 00:03:45.113 TEST_HEADER include/spdk/tree.h 00:03:45.113 TEST_HEADER include/spdk/ublk.h 00:03:45.113 LINK spdk_lspci 00:03:45.113 TEST_HEADER include/spdk/util.h 00:03:45.113 TEST_HEADER include/spdk/uuid.h 00:03:45.113 TEST_HEADER include/spdk/version.h 00:03:45.113 TEST_HEADER include/spdk/vfio_user_pci.h 00:03:45.113 TEST_HEADER include/spdk/vfio_user_spec.h 00:03:45.373 TEST_HEADER include/spdk/vhost.h 00:03:45.373 TEST_HEADER include/spdk/vmd.h 00:03:45.373 TEST_HEADER include/spdk/xor.h 00:03:45.373 TEST_HEADER include/spdk/zipf.h 00:03:45.373 CXX test/cpp_headers/accel.o 00:03:45.373 LINK rpc_client_test 00:03:45.373 LINK jsoncat 00:03:45.373 LINK lsvmd 00:03:45.373 LINK spdk_nvme_discover 00:03:45.373 LINK histogram_perf 00:03:45.373 LINK vtophys 00:03:45.373 LINK poller_perf 00:03:45.373 LINK event_perf 00:03:45.373 LINK zipf 00:03:45.373 LINK nvmf_tgt 00:03:45.373 LINK interrupt_tgt 00:03:45.373 LINK stub 00:03:45.373 LINK env_dpdk_post_init 00:03:45.373 LINK vhost 00:03:45.373 LINK iscsi_tgt 00:03:45.373 LINK spdk_trace_record 00:03:45.373 LINK bdev_svc 00:03:45.373 LINK hello_world 00:03:45.373 LINK verify 00:03:45.373 LINK ioat_perf 00:03:45.638 LINK spdk_tgt 00:03:45.638 LINK mkfs 00:03:45.638 LINK hello_sock 00:03:45.638 LINK hello_blob 00:03:45.638 LINK aer 00:03:45.638 LINK hello_bdev 00:03:45.638 LINK thread 00:03:45.638 CXX test/cpp_headers/accel_module.o 00:03:45.638 CXX test/cpp_headers/assert.o 00:03:45.638 CXX test/cpp_headers/barrier.o 00:03:45.638 CXX test/cpp_headers/base64.o 00:03:45.638 CC examples/vmd/led/led.o 00:03:45.638 CC test/event/reactor/reactor.o 00:03:45.638 CC examples/nvme/reconnect/reconnect.o 00:03:45.638 LINK idxd_perf 00:03:45.638 LINK nvmf 00:03:45.638 LINK spdk_dd 00:03:45.638 LINK spdk_trace 00:03:45.638 CXX test/cpp_headers/bdev.o 00:03:45.638 CC test/app/fuzz/iscsi_fuzz/iscsi_fuzz.o 00:03:45.638 CXX test/cpp_headers/bdev_module.o 00:03:45.897 CC examples/nvme/nvme_manage/nvme_manage.o 00:03:45.897 CC test/nvme/reset/reset.o 00:03:45.898 LINK pci_ut 00:03:45.898 CC test/nvme/sgl/sgl.o 00:03:45.898 CXX test/cpp_headers/bdev_zone.o 00:03:45.898 LINK test_dma 00:03:45.898 CC test/nvme/e2edp/nvme_dp.o 00:03:45.898 CC app/fio/bdev/fio_plugin.o 00:03:45.898 CC test/nvme/overhead/overhead.o 00:03:45.898 CC test/event/reactor_perf/reactor_perf.o 00:03:45.898 LINK dif 00:03:45.898 LINK bdevio 00:03:45.898 CC test/app/fuzz/vhost_fuzz/vhost_fuzz_rpc.o 00:03:45.898 CXX test/cpp_headers/bit_array.o 00:03:45.898 CC test/nvme/err_injection/err_injection.o 00:03:45.898 LINK accel_perf 00:03:45.898 LINK nvme_fuzz 00:03:45.898 CC test/nvme/startup/startup.o 00:03:45.898 CC test/nvme/reserve/reserve.o 00:03:45.898 LINK led 00:03:45.898 CXX test/cpp_headers/bit_pool.o 00:03:45.898 LINK reactor 00:03:45.898 CC test/app/fuzz/vhost_fuzz/vhost_fuzz.o 00:03:45.898 CXX test/cpp_headers/blob_bdev.o 00:03:45.898 CC test/nvme/simple_copy/simple_copy.o 00:03:46.159 CC test/nvme/connect_stress/connect_stress.o 00:03:46.159 LINK spdk_nvme 00:03:46.159 LINK blobcli 00:03:46.159 CC test/nvme/boot_partition/boot_partition.o 00:03:46.159 CC test/nvme/compliance/nvme_compliance.o 00:03:46.159 CC test/nvme/fused_ordering/fused_ordering.o 00:03:46.159 CC test/event/app_repeat/app_repeat.o 00:03:46.159 CC test/nvme/doorbell_aers/doorbell_aers.o 00:03:46.159 CXX test/cpp_headers/blobfs_bdev.o 00:03:46.159 CC test/event/scheduler/scheduler.o 00:03:46.159 LINK reactor_perf 00:03:46.159 CC test/nvme/fdp/fdp.o 00:03:46.159 CC examples/nvme/arbitration/arbitration.o 00:03:46.159 CXX test/cpp_headers/blobfs.o 00:03:46.159 CXX test/cpp_headers/blob.o 00:03:46.159 CXX test/cpp_headers/conf.o 00:03:46.159 CXX test/cpp_headers/config.o 00:03:46.159 CC examples/nvme/hotplug/hotplug.o 00:03:46.159 CC examples/nvme/cmb_copy/cmb_copy.o 00:03:46.159 LINK reset 00:03:46.159 CXX test/cpp_headers/cpuset.o 00:03:46.159 CXX test/cpp_headers/crc16.o 00:03:46.159 CXX test/cpp_headers/crc32.o 00:03:46.159 CC examples/nvme/abort/abort.o 00:03:46.424 CXX test/cpp_headers/crc64.o 00:03:46.424 CC test/nvme/cuse/cuse.o 00:03:46.424 CXX test/cpp_headers/dif.o 00:03:46.424 CXX test/cpp_headers/dma.o 00:03:46.424 LINK err_injection 00:03:46.424 LINK startup 00:03:46.424 LINK mem_callbacks 00:03:46.424 LINK sgl 00:03:46.424 CXX test/cpp_headers/endian.o 00:03:46.424 LINK reserve 00:03:46.424 CC examples/nvme/pmr_persistence/pmr_persistence.o 00:03:46.424 LINK reconnect 00:03:46.424 LINK nvme_dp 00:03:46.424 LINK overhead 00:03:46.424 LINK boot_partition 00:03:46.424 CXX test/cpp_headers/env_dpdk.o 00:03:46.424 LINK app_repeat 00:03:46.424 CXX test/cpp_headers/env.o 00:03:46.424 LINK connect_stress 00:03:46.424 LINK simple_copy 00:03:46.424 LINK fused_ordering 00:03:46.424 CXX test/cpp_headers/event.o 00:03:46.424 CXX test/cpp_headers/fd_group.o 00:03:46.424 LINK spdk_nvme_perf 00:03:46.424 LINK doorbell_aers 00:03:46.424 LINK spdk_nvme_identify 00:03:46.688 CXX test/cpp_headers/fd.o 00:03:46.688 CXX test/cpp_headers/file.o 00:03:46.688 LINK bdevperf 00:03:46.688 CXX test/cpp_headers/ftl.o 00:03:46.688 CXX test/cpp_headers/gpt_spec.o 00:03:46.688 CXX test/cpp_headers/hexlify.o 00:03:46.688 LINK scheduler 00:03:46.688 LINK spdk_top 00:03:46.688 CXX test/cpp_headers/histogram_data.o 00:03:46.688 CXX test/cpp_headers/idxd.o 00:03:46.688 CXX test/cpp_headers/idxd_spec.o 00:03:46.688 CXX test/cpp_headers/init.o 00:03:46.688 LINK cmb_copy 00:03:46.688 CXX test/cpp_headers/ioat.o 00:03:46.688 CXX test/cpp_headers/ioat_spec.o 00:03:46.688 CXX test/cpp_headers/iscsi_spec.o 00:03:46.688 CXX test/cpp_headers/json.o 00:03:46.688 CXX test/cpp_headers/jsonrpc.o 00:03:46.688 CXX test/cpp_headers/likely.o 00:03:46.688 CXX test/cpp_headers/log.o 00:03:46.688 CXX test/cpp_headers/lvol.o 00:03:46.688 CXX test/cpp_headers/memory.o 00:03:46.688 CXX test/cpp_headers/mmio.o 00:03:46.688 LINK nvme_manage 00:03:46.688 CXX test/cpp_headers/nbd.o 00:03:46.688 LINK nvme_compliance 00:03:46.688 LINK pmr_persistence 00:03:46.688 CXX test/cpp_headers/notify.o 00:03:46.688 CXX test/cpp_headers/nvme.o 00:03:46.688 CXX test/cpp_headers/nvme_intel.o 00:03:46.688 CXX test/cpp_headers/nvme_ocssd.o 00:03:46.688 LINK hotplug 00:03:46.688 LINK memory_ut 00:03:46.688 CXX test/cpp_headers/nvme_ocssd_spec.o 00:03:46.688 LINK vhost_fuzz 00:03:46.688 CXX test/cpp_headers/nvme_spec.o 00:03:46.688 CXX test/cpp_headers/nvme_zns.o 00:03:46.688 LINK spdk_bdev 00:03:46.688 LINK fdp 00:03:46.947 CXX test/cpp_headers/nvmf_cmd.o 00:03:46.947 CXX test/cpp_headers/nvmf_fc_spec.o 00:03:46.947 CXX test/cpp_headers/nvmf.o 00:03:46.947 CXX test/cpp_headers/nvmf_spec.o 00:03:46.947 CXX test/cpp_headers/nvmf_transport.o 00:03:46.947 LINK arbitration 00:03:46.947 CXX test/cpp_headers/opal.o 00:03:46.947 CXX test/cpp_headers/opal_spec.o 00:03:46.947 CXX test/cpp_headers/pci_ids.o 00:03:46.947 CXX test/cpp_headers/pipe.o 00:03:46.947 CXX test/cpp_headers/queue.o 00:03:46.947 CXX test/cpp_headers/reduce.o 00:03:46.947 CXX test/cpp_headers/rpc.o 00:03:46.947 CXX test/cpp_headers/scheduler.o 00:03:46.947 CXX test/cpp_headers/scsi.o 00:03:46.947 LINK abort 00:03:46.947 CXX test/cpp_headers/scsi_spec.o 00:03:46.947 CXX test/cpp_headers/sock.o 00:03:46.947 CXX test/cpp_headers/stdinc.o 00:03:46.947 CXX test/cpp_headers/string.o 00:03:46.947 CXX test/cpp_headers/thread.o 00:03:46.947 CXX test/cpp_headers/trace.o 00:03:46.947 CXX test/cpp_headers/trace_parser.o 00:03:46.947 CXX test/cpp_headers/tree.o 00:03:46.947 CXX test/cpp_headers/ublk.o 00:03:46.947 CXX test/cpp_headers/util.o 00:03:46.947 CXX test/cpp_headers/uuid.o 00:03:47.210 CXX test/cpp_headers/version.o 00:03:47.210 CXX test/cpp_headers/vfio_user_pci.o 00:03:47.210 CXX test/cpp_headers/vfio_user_spec.o 00:03:47.210 CXX test/cpp_headers/vhost.o 00:03:47.210 CXX test/cpp_headers/vmd.o 00:03:47.210 CXX test/cpp_headers/xor.o 00:03:47.210 CXX test/cpp_headers/zipf.o 00:03:47.776 LINK cuse 00:03:48.034 LINK iscsi_fuzz 00:03:50.606 LINK esnap 00:03:50.864 00:03:50.864 real 0m37.730s 00:03:50.864 user 7m16.177s 00:03:50.864 sys 1m36.883s 00:03:50.864 04:05:41 -- common/autotest_common.sh@1115 -- $ xtrace_disable 00:03:50.864 04:05:41 -- common/autotest_common.sh@10 -- $ set +x 00:03:50.864 ************************************ 00:03:50.864 END TEST make 00:03:50.864 ************************************ 00:03:50.864 04:05:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:03:50.864 04:05:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:03:50.864 04:05:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:03:50.864 04:05:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:03:50.864 04:05:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:03:50.864 04:05:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:03:50.864 04:05:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:03:50.864 04:05:41 -- scripts/common.sh@335 -- # IFS=.-: 00:03:50.864 04:05:41 -- scripts/common.sh@335 -- # read -ra ver1 00:03:50.864 04:05:41 -- scripts/common.sh@336 -- # IFS=.-: 00:03:50.864 04:05:41 -- scripts/common.sh@336 -- # read -ra ver2 00:03:50.864 04:05:41 -- scripts/common.sh@337 -- # local 'op=<' 00:03:50.864 04:05:41 -- scripts/common.sh@339 -- # ver1_l=2 00:03:50.864 04:05:41 -- scripts/common.sh@340 -- # ver2_l=1 00:03:50.864 04:05:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:03:50.864 04:05:41 -- scripts/common.sh@343 -- # case "$op" in 00:03:50.864 04:05:41 -- scripts/common.sh@344 -- # : 1 00:03:50.864 04:05:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:03:50.864 04:05:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:03:50.864 04:05:41 -- scripts/common.sh@364 -- # decimal 1 00:03:50.864 04:05:41 -- scripts/common.sh@352 -- # local d=1 00:03:50.864 04:05:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:03:50.864 04:05:41 -- scripts/common.sh@354 -- # echo 1 00:03:50.864 04:05:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:03:50.864 04:05:41 -- scripts/common.sh@365 -- # decimal 2 00:03:50.864 04:05:41 -- scripts/common.sh@352 -- # local d=2 00:03:50.864 04:05:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:03:50.864 04:05:41 -- scripts/common.sh@354 -- # echo 2 00:03:50.864 04:05:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:03:50.864 04:05:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:03:50.864 04:05:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:03:50.864 04:05:41 -- scripts/common.sh@367 -- # return 0 00:03:50.864 04:05:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:03:50.864 04:05:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:03:50.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.864 --rc genhtml_branch_coverage=1 00:03:50.864 --rc genhtml_function_coverage=1 00:03:50.864 --rc genhtml_legend=1 00:03:50.864 --rc geninfo_all_blocks=1 00:03:50.864 --rc geninfo_unexecuted_blocks=1 00:03:50.864 00:03:50.864 ' 00:03:50.864 04:05:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:03:50.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.864 --rc genhtml_branch_coverage=1 00:03:50.864 --rc genhtml_function_coverage=1 00:03:50.864 --rc genhtml_legend=1 00:03:50.864 --rc geninfo_all_blocks=1 00:03:50.864 --rc geninfo_unexecuted_blocks=1 00:03:50.864 00:03:50.864 ' 00:03:50.864 04:05:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:03:50.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.864 --rc genhtml_branch_coverage=1 00:03:50.864 --rc genhtml_function_coverage=1 00:03:50.864 --rc genhtml_legend=1 00:03:50.864 --rc geninfo_all_blocks=1 00:03:50.864 --rc geninfo_unexecuted_blocks=1 00:03:50.864 00:03:50.864 ' 00:03:50.864 04:05:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:03:50.864 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:03:50.864 --rc genhtml_branch_coverage=1 00:03:50.864 --rc genhtml_function_coverage=1 00:03:50.864 --rc genhtml_legend=1 00:03:50.864 --rc geninfo_all_blocks=1 00:03:50.864 --rc geninfo_unexecuted_blocks=1 00:03:50.864 00:03:50.864 ' 00:03:50.864 04:05:41 -- spdk/autotest.sh@25 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:03:50.864 04:05:41 -- nvmf/common.sh@7 -- # uname -s 00:03:50.864 04:05:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:03:50.864 04:05:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:03:50.864 04:05:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:03:50.864 04:05:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:03:50.864 04:05:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:03:50.864 04:05:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:03:50.864 04:05:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:03:50.864 04:05:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:03:50.864 04:05:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:03:50.864 04:05:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:03:50.864 04:05:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:03:50.864 04:05:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:03:50.864 04:05:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:03:50.864 04:05:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:03:50.864 04:05:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:03:50.864 04:05:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:03:50.864 04:05:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:03:50.864 04:05:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:03:50.864 04:05:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:03:50.864 04:05:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:50.864 04:05:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:50.865 04:05:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:50.865 04:05:41 -- paths/export.sh@5 -- # export PATH 00:03:50.865 04:05:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:03:50.865 04:05:41 -- nvmf/common.sh@46 -- # : 0 00:03:50.865 04:05:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:03:50.865 04:05:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:03:50.865 04:05:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:03:50.865 04:05:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:03:50.865 04:05:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:03:50.865 04:05:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:03:50.865 04:05:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:03:50.865 04:05:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:03:50.865 04:05:41 -- spdk/autotest.sh@27 -- # '[' 0 -ne 0 ']' 00:03:50.865 04:05:41 -- spdk/autotest.sh@32 -- # uname -s 00:03:50.865 04:05:41 -- spdk/autotest.sh@32 -- # '[' Linux = Linux ']' 00:03:50.865 04:05:41 -- spdk/autotest.sh@33 -- # old_core_pattern='|/usr/lib/systemd/systemd-coredump %P %u %g %s %t %c %h' 00:03:50.865 04:05:41 -- spdk/autotest.sh@34 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:50.865 04:05:41 -- spdk/autotest.sh@39 -- # echo '|/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/core-collector.sh %P %s %t' 00:03:50.865 04:05:41 -- spdk/autotest.sh@40 -- # echo /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/coredumps 00:03:50.865 04:05:41 -- spdk/autotest.sh@44 -- # modprobe nbd 00:03:50.865 04:05:41 -- spdk/autotest.sh@46 -- # type -P udevadm 00:03:50.865 04:05:41 -- spdk/autotest.sh@46 -- # udevadm=/usr/sbin/udevadm 00:03:50.865 04:05:41 -- spdk/autotest.sh@48 -- # udevadm_pid=2205958 00:03:50.865 04:05:41 -- spdk/autotest.sh@47 -- # /usr/sbin/udevadm monitor --property 00:03:50.865 04:05:41 -- spdk/autotest.sh@51 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:50.865 04:05:41 -- spdk/autotest.sh@54 -- # echo 2205960 00:03:50.865 04:05:41 -- spdk/autotest.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-load -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:50.865 04:05:41 -- spdk/autotest.sh@56 -- # echo 2205961 00:03:50.865 04:05:41 -- spdk/autotest.sh@58 -- # [[ ............................... != QEMU ]] 00:03:50.865 04:05:41 -- spdk/autotest.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-vmstat -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power 00:03:50.865 04:05:41 -- spdk/autotest.sh@60 -- # echo 2205962 00:03:50.865 04:05:41 -- spdk/autotest.sh@59 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-cpu-temp -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:50.865 04:05:41 -- spdk/autotest.sh@62 -- # echo 2205963 00:03:50.865 04:05:41 -- spdk/autotest.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/collect-bmc-pm -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power -l 00:03:50.865 04:05:41 -- spdk/autotest.sh@66 -- # trap 'autotest_cleanup || :; exit 1' SIGINT SIGTERM EXIT 00:03:50.865 04:05:41 -- spdk/autotest.sh@68 -- # timing_enter autotest 00:03:50.865 04:05:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:03:50.865 04:05:41 -- common/autotest_common.sh@10 -- # set +x 00:03:50.865 04:05:41 -- spdk/autotest.sh@70 -- # create_test_list 00:03:50.865 04:05:41 -- common/autotest_common.sh@746 -- # xtrace_disable 00:03:50.865 04:05:41 -- common/autotest_common.sh@10 -- # set +x 00:03:50.865 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-bmc-pm.bmc.pm.log 00:03:51.123 Redirecting to /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/power/collect-cpu-temp.pm.log 00:03:51.123 04:05:41 -- spdk/autotest.sh@72 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/autotest.sh 00:03:51.123 04:05:41 -- spdk/autotest.sh@72 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:51.123 04:05:41 -- spdk/autotest.sh@72 -- # src=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:51.123 04:05:41 -- spdk/autotest.sh@73 -- # out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:03:51.123 04:05:41 -- spdk/autotest.sh@74 -- # cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:03:51.123 04:05:41 -- spdk/autotest.sh@76 -- # freebsd_update_contigmem_mod 00:03:51.123 04:05:41 -- common/autotest_common.sh@1450 -- # uname 00:03:51.123 04:05:41 -- common/autotest_common.sh@1450 -- # '[' Linux = FreeBSD ']' 00:03:51.123 04:05:41 -- spdk/autotest.sh@77 -- # freebsd_set_maxsock_buf 00:03:51.123 04:05:41 -- common/autotest_common.sh@1470 -- # uname 00:03:51.123 04:05:41 -- common/autotest_common.sh@1470 -- # [[ Linux = FreeBSD ]] 00:03:51.123 04:05:41 -- spdk/autotest.sh@79 -- # [[ y == y ]] 00:03:51.123 04:05:41 -- spdk/autotest.sh@81 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 --version 00:03:51.123 lcov: LCOV version 1.15 00:03:51.123 04:05:41 -- spdk/autotest.sh@83 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -i -t Baseline -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info 00:03:54.410 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno:no functions found 00:03:54.410 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_p2l_upgrade.gcno 00:03:54.410 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno:no functions found 00:03:54.410 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_band_upgrade.gcno 00:03:54.410 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno:no functions found 00:03:54.410 geninfo: WARNING: GCOV did not produce any data for /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/ftl/upgrade/ftl_chunk_upgrade.gcno 00:04:26.486 04:06:14 -- spdk/autotest.sh@87 -- # timing_enter pre_cleanup 00:04:26.486 04:06:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:04:26.486 04:06:14 -- common/autotest_common.sh@10 -- # set +x 00:04:26.486 04:06:14 -- spdk/autotest.sh@89 -- # rm -f 00:04:26.486 04:06:14 -- spdk/autotest.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:26.486 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:04:26.486 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:04:26.486 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:04:26.486 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:04:26.486 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:04:26.486 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:04:26.486 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:04:26.486 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:04:26.486 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:04:26.486 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:04:26.486 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:04:26.486 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:04:26.486 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:04:26.486 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:04:26.486 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:04:26.486 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:04:26.486 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:04:26.486 04:06:15 -- spdk/autotest.sh@94 -- # get_zoned_devs 00:04:26.486 04:06:15 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:26.486 04:06:15 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:26.486 04:06:15 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:26.487 04:06:15 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:26.487 04:06:15 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:26.487 04:06:15 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:26.487 04:06:15 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:26.487 04:06:15 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:26.487 04:06:15 -- spdk/autotest.sh@96 -- # (( 0 > 0 )) 00:04:26.487 04:06:15 -- spdk/autotest.sh@108 -- # ls /dev/nvme0n1 00:04:26.487 04:06:15 -- spdk/autotest.sh@108 -- # grep -v p 00:04:26.487 04:06:15 -- spdk/autotest.sh@108 -- # for dev in $(ls /dev/nvme*n* | grep -v p || true) 00:04:26.487 04:06:15 -- spdk/autotest.sh@110 -- # [[ -z '' ]] 00:04:26.487 04:06:15 -- spdk/autotest.sh@111 -- # block_in_use /dev/nvme0n1 00:04:26.487 04:06:15 -- scripts/common.sh@380 -- # local block=/dev/nvme0n1 pt 00:04:26.487 04:06:15 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py /dev/nvme0n1 00:04:26.487 No valid GPT data, bailing 00:04:26.487 04:06:15 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:26.487 04:06:15 -- scripts/common.sh@393 -- # pt= 00:04:26.487 04:06:15 -- scripts/common.sh@394 -- # return 1 00:04:26.487 04:06:15 -- spdk/autotest.sh@112 -- # dd if=/dev/zero of=/dev/nvme0n1 bs=1M count=1 00:04:26.487 1+0 records in 00:04:26.487 1+0 records out 00:04:26.487 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00205056 s, 511 MB/s 00:04:26.487 04:06:15 -- spdk/autotest.sh@116 -- # sync 00:04:26.487 04:06:15 -- spdk/autotest.sh@118 -- # xtrace_disable_per_cmd reap_spdk_processes 00:04:26.487 04:06:15 -- common/autotest_common.sh@22 -- # eval 'reap_spdk_processes 12> /dev/null' 00:04:26.487 04:06:15 -- common/autotest_common.sh@22 -- # reap_spdk_processes 00:04:27.051 04:06:17 -- spdk/autotest.sh@122 -- # uname -s 00:04:27.051 04:06:17 -- spdk/autotest.sh@122 -- # '[' Linux = Linux ']' 00:04:27.052 04:06:17 -- spdk/autotest.sh@123 -- # run_test setup.sh /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:27.052 04:06:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.052 04:06:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.052 04:06:17 -- common/autotest_common.sh@10 -- # set +x 00:04:27.052 ************************************ 00:04:27.052 START TEST setup.sh 00:04:27.052 ************************************ 00:04:27.052 04:06:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/test-setup.sh 00:04:27.052 * Looking for test storage... 00:04:27.052 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:27.052 04:06:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:27.052 04:06:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:27.052 04:06:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:27.310 04:06:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:27.310 04:06:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:27.310 04:06:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:27.310 04:06:17 -- scripts/common.sh@335 -- # IFS=.-: 00:04:27.310 04:06:17 -- scripts/common.sh@335 -- # read -ra ver1 00:04:27.310 04:06:17 -- scripts/common.sh@336 -- # IFS=.-: 00:04:27.310 04:06:17 -- scripts/common.sh@336 -- # read -ra ver2 00:04:27.310 04:06:17 -- scripts/common.sh@337 -- # local 'op=<' 00:04:27.310 04:06:17 -- scripts/common.sh@339 -- # ver1_l=2 00:04:27.310 04:06:17 -- scripts/common.sh@340 -- # ver2_l=1 00:04:27.310 04:06:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:27.310 04:06:17 -- scripts/common.sh@343 -- # case "$op" in 00:04:27.310 04:06:17 -- scripts/common.sh@344 -- # : 1 00:04:27.310 04:06:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:27.310 04:06:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:27.310 04:06:17 -- scripts/common.sh@364 -- # decimal 1 00:04:27.310 04:06:17 -- scripts/common.sh@352 -- # local d=1 00:04:27.310 04:06:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:27.310 04:06:17 -- scripts/common.sh@354 -- # echo 1 00:04:27.310 04:06:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:27.310 04:06:17 -- scripts/common.sh@365 -- # decimal 2 00:04:27.310 04:06:17 -- scripts/common.sh@352 -- # local d=2 00:04:27.310 04:06:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:27.310 04:06:17 -- scripts/common.sh@354 -- # echo 2 00:04:27.310 04:06:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:27.310 04:06:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:27.310 04:06:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:27.310 04:06:17 -- scripts/common.sh@367 -- # return 0 00:04:27.310 04:06:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:27.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.310 --rc genhtml_branch_coverage=1 00:04:27.310 --rc genhtml_function_coverage=1 00:04:27.310 --rc genhtml_legend=1 00:04:27.310 --rc geninfo_all_blocks=1 00:04:27.310 --rc geninfo_unexecuted_blocks=1 00:04:27.310 00:04:27.310 ' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:27.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.310 --rc genhtml_branch_coverage=1 00:04:27.310 --rc genhtml_function_coverage=1 00:04:27.310 --rc genhtml_legend=1 00:04:27.310 --rc geninfo_all_blocks=1 00:04:27.310 --rc geninfo_unexecuted_blocks=1 00:04:27.310 00:04:27.310 ' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:27.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.310 --rc genhtml_branch_coverage=1 00:04:27.310 --rc genhtml_function_coverage=1 00:04:27.310 --rc genhtml_legend=1 00:04:27.310 --rc geninfo_all_blocks=1 00:04:27.310 --rc geninfo_unexecuted_blocks=1 00:04:27.310 00:04:27.310 ' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:27.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.310 --rc genhtml_branch_coverage=1 00:04:27.310 --rc genhtml_function_coverage=1 00:04:27.310 --rc genhtml_legend=1 00:04:27.310 --rc geninfo_all_blocks=1 00:04:27.310 --rc geninfo_unexecuted_blocks=1 00:04:27.310 00:04:27.310 ' 00:04:27.310 04:06:17 -- setup/test-setup.sh@10 -- # uname -s 00:04:27.310 04:06:17 -- setup/test-setup.sh@10 -- # [[ Linux == Linux ]] 00:04:27.310 04:06:17 -- setup/test-setup.sh@12 -- # run_test acl /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:27.310 04:06:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:27.310 04:06:17 -- common/autotest_common.sh@10 -- # set +x 00:04:27.310 ************************************ 00:04:27.310 START TEST acl 00:04:27.310 ************************************ 00:04:27.310 04:06:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/acl.sh 00:04:27.310 * Looking for test storage... 00:04:27.310 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:27.310 04:06:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:27.310 04:06:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:27.310 04:06:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:27.310 04:06:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:27.310 04:06:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:27.310 04:06:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:27.310 04:06:17 -- scripts/common.sh@335 -- # IFS=.-: 00:04:27.310 04:06:17 -- scripts/common.sh@335 -- # read -ra ver1 00:04:27.310 04:06:17 -- scripts/common.sh@336 -- # IFS=.-: 00:04:27.310 04:06:17 -- scripts/common.sh@336 -- # read -ra ver2 00:04:27.310 04:06:17 -- scripts/common.sh@337 -- # local 'op=<' 00:04:27.310 04:06:17 -- scripts/common.sh@339 -- # ver1_l=2 00:04:27.310 04:06:17 -- scripts/common.sh@340 -- # ver2_l=1 00:04:27.310 04:06:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:27.310 04:06:17 -- scripts/common.sh@343 -- # case "$op" in 00:04:27.310 04:06:17 -- scripts/common.sh@344 -- # : 1 00:04:27.310 04:06:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:27.310 04:06:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:27.310 04:06:17 -- scripts/common.sh@364 -- # decimal 1 00:04:27.310 04:06:17 -- scripts/common.sh@352 -- # local d=1 00:04:27.310 04:06:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:27.310 04:06:17 -- scripts/common.sh@354 -- # echo 1 00:04:27.310 04:06:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:27.310 04:06:17 -- scripts/common.sh@365 -- # decimal 2 00:04:27.310 04:06:17 -- scripts/common.sh@352 -- # local d=2 00:04:27.310 04:06:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:27.310 04:06:17 -- scripts/common.sh@354 -- # echo 2 00:04:27.310 04:06:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:27.310 04:06:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:27.310 04:06:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:27.310 04:06:17 -- scripts/common.sh@367 -- # return 0 00:04:27.310 04:06:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:27.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.310 --rc genhtml_branch_coverage=1 00:04:27.310 --rc genhtml_function_coverage=1 00:04:27.310 --rc genhtml_legend=1 00:04:27.310 --rc geninfo_all_blocks=1 00:04:27.310 --rc geninfo_unexecuted_blocks=1 00:04:27.310 00:04:27.310 ' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:27.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.310 --rc genhtml_branch_coverage=1 00:04:27.310 --rc genhtml_function_coverage=1 00:04:27.310 --rc genhtml_legend=1 00:04:27.310 --rc geninfo_all_blocks=1 00:04:27.310 --rc geninfo_unexecuted_blocks=1 00:04:27.310 00:04:27.310 ' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:27.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.310 --rc genhtml_branch_coverage=1 00:04:27.310 --rc genhtml_function_coverage=1 00:04:27.310 --rc genhtml_legend=1 00:04:27.310 --rc geninfo_all_blocks=1 00:04:27.310 --rc geninfo_unexecuted_blocks=1 00:04:27.310 00:04:27.310 ' 00:04:27.310 04:06:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:27.310 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:27.310 --rc genhtml_branch_coverage=1 00:04:27.310 --rc genhtml_function_coverage=1 00:04:27.310 --rc genhtml_legend=1 00:04:27.310 --rc geninfo_all_blocks=1 00:04:27.310 --rc geninfo_unexecuted_blocks=1 00:04:27.310 00:04:27.310 ' 00:04:27.310 04:06:17 -- setup/acl.sh@10 -- # get_zoned_devs 00:04:27.310 04:06:17 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:27.310 04:06:17 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:27.310 04:06:17 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:27.310 04:06:17 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:27.310 04:06:17 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:27.311 04:06:17 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:27.311 04:06:17 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:27.311 04:06:17 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:27.311 04:06:17 -- setup/acl.sh@12 -- # devs=() 00:04:27.311 04:06:17 -- setup/acl.sh@12 -- # declare -a devs 00:04:27.311 04:06:17 -- setup/acl.sh@13 -- # drivers=() 00:04:27.311 04:06:17 -- setup/acl.sh@13 -- # declare -A drivers 00:04:27.311 04:06:17 -- setup/acl.sh@51 -- # setup reset 00:04:27.311 04:06:17 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:27.311 04:06:17 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:29.208 04:06:19 -- setup/acl.sh@52 -- # collect_setup_devs 00:04:29.208 04:06:19 -- setup/acl.sh@16 -- # local dev driver 00:04:29.208 04:06:19 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:29.208 04:06:19 -- setup/acl.sh@15 -- # setup output status 00:04:29.208 04:06:19 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:29.208 04:06:19 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:04:29.774 Hugepages 00:04:29.774 node hugesize free / total 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # continue 00:04:29.774 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # continue 00:04:29.774 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # [[ 1048576kB == *:*:*.* ]] 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # continue 00:04:29.774 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:29.774 00:04:29.774 Type BDF Vendor Device NUMA Driver Device Block devices 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # [[ 2048kB == *:*:*.* ]] 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # continue 00:04:29.774 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:00:04.0 == *:*:*.* ]] 00:04:29.774 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:29.774 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:29.774 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:00:04.1 == *:*:*.* ]] 00:04:29.774 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:29.774 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:29.774 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:00:04.2 == *:*:*.* ]] 00:04:29.774 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:29.774 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:29.774 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:29.774 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:00:04.3 == *:*:*.* ]] 00:04:29.774 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:29.774 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:29.774 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:00:04.4 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:00:04.5 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:00:04.6 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:00:04.7 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:80:04.0 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:80:04.1 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:80:04.2 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:80:04.3 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:80:04.4 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:80:04.5 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:80:04.6 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.031 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:80:04.7 == *:*:*.* ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # [[ ioatdma == nvme ]] 00:04:30.031 04:06:20 -- setup/acl.sh@20 -- # continue 00:04:30.031 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.032 04:06:20 -- setup/acl.sh@19 -- # [[ 0000:88:00.0 == *:*:*.* ]] 00:04:30.032 04:06:20 -- setup/acl.sh@20 -- # [[ nvme == nvme ]] 00:04:30.032 04:06:20 -- setup/acl.sh@21 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:30.032 04:06:20 -- setup/acl.sh@22 -- # devs+=("$dev") 00:04:30.032 04:06:20 -- setup/acl.sh@22 -- # drivers["$dev"]=nvme 00:04:30.032 04:06:20 -- setup/acl.sh@18 -- # read -r _ dev _ _ _ driver _ 00:04:30.032 04:06:20 -- setup/acl.sh@24 -- # (( 1 > 0 )) 00:04:30.032 04:06:20 -- setup/acl.sh@54 -- # run_test denied denied 00:04:30.032 04:06:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:30.032 04:06:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:30.032 04:06:20 -- common/autotest_common.sh@10 -- # set +x 00:04:30.032 ************************************ 00:04:30.032 START TEST denied 00:04:30.032 ************************************ 00:04:30.032 04:06:20 -- common/autotest_common.sh@1114 -- # denied 00:04:30.032 04:06:20 -- setup/acl.sh@38 -- # PCI_BLOCKED=' 0000:88:00.0' 00:04:30.032 04:06:20 -- setup/acl.sh@38 -- # setup output config 00:04:30.032 04:06:20 -- setup/acl.sh@39 -- # grep 'Skipping denied controller at 0000:88:00.0' 00:04:30.032 04:06:20 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:30.032 04:06:20 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:31.409 0000:88:00.0 (8086 0a54): Skipping denied controller at 0000:88:00.0 00:04:31.409 04:06:21 -- setup/acl.sh@40 -- # verify 0000:88:00.0 00:04:31.409 04:06:21 -- setup/acl.sh@28 -- # local dev driver 00:04:31.409 04:06:21 -- setup/acl.sh@30 -- # for dev in "$@" 00:04:31.409 04:06:21 -- setup/acl.sh@31 -- # [[ -e /sys/bus/pci/devices/0000:88:00.0 ]] 00:04:31.409 04:06:22 -- setup/acl.sh@32 -- # readlink -f /sys/bus/pci/devices/0000:88:00.0/driver 00:04:31.409 04:06:22 -- setup/acl.sh@32 -- # driver=/sys/bus/pci/drivers/nvme 00:04:31.409 04:06:22 -- setup/acl.sh@33 -- # [[ nvme == \n\v\m\e ]] 00:04:31.409 04:06:22 -- setup/acl.sh@41 -- # setup reset 00:04:31.409 04:06:22 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:31.409 04:06:22 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:33.939 00:04:33.939 real 0m3.808s 00:04:33.939 user 0m1.074s 00:04:33.939 sys 0m1.848s 00:04:33.939 04:06:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:33.939 04:06:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.939 ************************************ 00:04:33.939 END TEST denied 00:04:33.939 ************************************ 00:04:33.939 04:06:24 -- setup/acl.sh@55 -- # run_test allowed allowed 00:04:33.939 04:06:24 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:33.939 04:06:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:33.939 04:06:24 -- common/autotest_common.sh@10 -- # set +x 00:04:33.939 ************************************ 00:04:33.939 START TEST allowed 00:04:33.939 ************************************ 00:04:33.939 04:06:24 -- common/autotest_common.sh@1114 -- # allowed 00:04:33.939 04:06:24 -- setup/acl.sh@45 -- # PCI_ALLOWED=0000:88:00.0 00:04:33.939 04:06:24 -- setup/acl.sh@45 -- # setup output config 00:04:33.939 04:06:24 -- setup/acl.sh@46 -- # grep -E '0000:88:00.0 .*: nvme -> .*' 00:04:33.940 04:06:24 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:33.940 04:06:24 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:36.472 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:36.472 04:06:26 -- setup/acl.sh@47 -- # verify 00:04:36.472 04:06:26 -- setup/acl.sh@28 -- # local dev driver 00:04:36.472 04:06:26 -- setup/acl.sh@48 -- # setup reset 00:04:36.472 04:06:26 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:36.472 04:06:26 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:37.847 00:04:37.848 real 0m4.118s 00:04:37.848 user 0m1.118s 00:04:37.848 sys 0m1.871s 00:04:37.848 04:06:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.848 04:06:28 -- common/autotest_common.sh@10 -- # set +x 00:04:37.848 ************************************ 00:04:37.848 END TEST allowed 00:04:37.848 ************************************ 00:04:37.848 00:04:37.848 real 0m10.766s 00:04:37.848 user 0m3.335s 00:04:37.848 sys 0m5.509s 00:04:37.848 04:06:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:37.848 04:06:28 -- common/autotest_common.sh@10 -- # set +x 00:04:37.848 ************************************ 00:04:37.848 END TEST acl 00:04:37.848 ************************************ 00:04:38.107 04:06:28 -- setup/test-setup.sh@13 -- # run_test hugepages /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:38.107 04:06:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.107 04:06:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.107 04:06:28 -- common/autotest_common.sh@10 -- # set +x 00:04:38.107 ************************************ 00:04:38.107 START TEST hugepages 00:04:38.107 ************************************ 00:04:38.107 04:06:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/hugepages.sh 00:04:38.107 * Looking for test storage... 00:04:38.107 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:38.107 04:06:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:38.107 04:06:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:38.107 04:06:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:38.107 04:06:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:38.107 04:06:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:38.107 04:06:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:38.107 04:06:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:38.107 04:06:28 -- scripts/common.sh@335 -- # IFS=.-: 00:04:38.107 04:06:28 -- scripts/common.sh@335 -- # read -ra ver1 00:04:38.107 04:06:28 -- scripts/common.sh@336 -- # IFS=.-: 00:04:38.107 04:06:28 -- scripts/common.sh@336 -- # read -ra ver2 00:04:38.107 04:06:28 -- scripts/common.sh@337 -- # local 'op=<' 00:04:38.107 04:06:28 -- scripts/common.sh@339 -- # ver1_l=2 00:04:38.107 04:06:28 -- scripts/common.sh@340 -- # ver2_l=1 00:04:38.107 04:06:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:38.107 04:06:28 -- scripts/common.sh@343 -- # case "$op" in 00:04:38.107 04:06:28 -- scripts/common.sh@344 -- # : 1 00:04:38.107 04:06:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:38.107 04:06:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:38.107 04:06:28 -- scripts/common.sh@364 -- # decimal 1 00:04:38.107 04:06:28 -- scripts/common.sh@352 -- # local d=1 00:04:38.107 04:06:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:38.107 04:06:28 -- scripts/common.sh@354 -- # echo 1 00:04:38.107 04:06:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:38.107 04:06:28 -- scripts/common.sh@365 -- # decimal 2 00:04:38.107 04:06:28 -- scripts/common.sh@352 -- # local d=2 00:04:38.107 04:06:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:38.107 04:06:28 -- scripts/common.sh@354 -- # echo 2 00:04:38.107 04:06:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:38.107 04:06:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:38.107 04:06:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:38.107 04:06:28 -- scripts/common.sh@367 -- # return 0 00:04:38.107 04:06:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:38.107 04:06:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:38.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.107 --rc genhtml_branch_coverage=1 00:04:38.107 --rc genhtml_function_coverage=1 00:04:38.107 --rc genhtml_legend=1 00:04:38.107 --rc geninfo_all_blocks=1 00:04:38.107 --rc geninfo_unexecuted_blocks=1 00:04:38.107 00:04:38.107 ' 00:04:38.107 04:06:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:38.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.107 --rc genhtml_branch_coverage=1 00:04:38.107 --rc genhtml_function_coverage=1 00:04:38.107 --rc genhtml_legend=1 00:04:38.107 --rc geninfo_all_blocks=1 00:04:38.107 --rc geninfo_unexecuted_blocks=1 00:04:38.107 00:04:38.107 ' 00:04:38.107 04:06:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:38.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.107 --rc genhtml_branch_coverage=1 00:04:38.107 --rc genhtml_function_coverage=1 00:04:38.107 --rc genhtml_legend=1 00:04:38.107 --rc geninfo_all_blocks=1 00:04:38.107 --rc geninfo_unexecuted_blocks=1 00:04:38.107 00:04:38.107 ' 00:04:38.107 04:06:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:38.107 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:38.107 --rc genhtml_branch_coverage=1 00:04:38.107 --rc genhtml_function_coverage=1 00:04:38.107 --rc genhtml_legend=1 00:04:38.107 --rc geninfo_all_blocks=1 00:04:38.107 --rc geninfo_unexecuted_blocks=1 00:04:38.107 00:04:38.107 ' 00:04:38.107 04:06:28 -- setup/hugepages.sh@10 -- # nodes_sys=() 00:04:38.108 04:06:28 -- setup/hugepages.sh@10 -- # declare -a nodes_sys 00:04:38.108 04:06:28 -- setup/hugepages.sh@12 -- # declare -i default_hugepages=0 00:04:38.108 04:06:28 -- setup/hugepages.sh@13 -- # declare -i no_nodes=0 00:04:38.108 04:06:28 -- setup/hugepages.sh@14 -- # declare -i nr_hugepages=0 00:04:38.108 04:06:28 -- setup/hugepages.sh@16 -- # get_meminfo Hugepagesize 00:04:38.108 04:06:28 -- setup/common.sh@17 -- # local get=Hugepagesize 00:04:38.108 04:06:28 -- setup/common.sh@18 -- # local node= 00:04:38.108 04:06:28 -- setup/common.sh@19 -- # local var val 00:04:38.108 04:06:28 -- setup/common.sh@20 -- # local mem_f mem 00:04:38.108 04:06:28 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:38.108 04:06:28 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:38.108 04:06:28 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:38.108 04:06:28 -- setup/common.sh@28 -- # mapfile -t mem 00:04:38.108 04:06:28 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 40515428 kB' 'MemAvailable: 44288980 kB' 'Buffers: 2708 kB' 'Cached: 13249000 kB' 'SwapCached: 0 kB' 'Active: 9964920 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563736 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 481004 kB' 'Mapped: 184472 kB' 'Shmem: 9086116 kB' 'KReclaimable: 203564 kB' 'Slab: 727824 kB' 'SReclaimable: 203564 kB' 'SUnreclaim: 524260 kB' 'KernelStack: 12752 kB' 'PageTables: 7956 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 36559288 kB' 'Committed_AS: 10612776 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198152 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 2048' 'HugePages_Free: 2048' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 4194304 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.108 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.108 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # continue 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # IFS=': ' 00:04:38.109 04:06:28 -- setup/common.sh@31 -- # read -r var val _ 00:04:38.109 04:06:28 -- setup/common.sh@32 -- # [[ Hugepagesize == \H\u\g\e\p\a\g\e\s\i\z\e ]] 00:04:38.109 04:06:28 -- setup/common.sh@33 -- # echo 2048 00:04:38.109 04:06:28 -- setup/common.sh@33 -- # return 0 00:04:38.109 04:06:28 -- setup/hugepages.sh@16 -- # default_hugepages=2048 00:04:38.109 04:06:28 -- setup/hugepages.sh@17 -- # default_huge_nr=/sys/kernel/mm/hugepages/hugepages-2048kB/nr_hugepages 00:04:38.109 04:06:28 -- setup/hugepages.sh@18 -- # global_huge_nr=/proc/sys/vm/nr_hugepages 00:04:38.109 04:06:28 -- setup/hugepages.sh@21 -- # unset -v HUGE_EVEN_ALLOC 00:04:38.109 04:06:28 -- setup/hugepages.sh@22 -- # unset -v HUGEMEM 00:04:38.109 04:06:28 -- setup/hugepages.sh@23 -- # unset -v HUGENODE 00:04:38.109 04:06:28 -- setup/hugepages.sh@24 -- # unset -v NRHUGE 00:04:38.109 04:06:28 -- setup/hugepages.sh@207 -- # get_nodes 00:04:38.109 04:06:28 -- setup/hugepages.sh@27 -- # local node 00:04:38.109 04:06:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:38.109 04:06:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=2048 00:04:38.109 04:06:28 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:38.109 04:06:28 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:38.109 04:06:28 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:38.109 04:06:28 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:38.109 04:06:28 -- setup/hugepages.sh@208 -- # clear_hp 00:04:38.109 04:06:28 -- setup/hugepages.sh@37 -- # local node hp 00:04:38.109 04:06:28 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:38.109 04:06:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:38.109 04:06:28 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.109 04:06:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:38.109 04:06:28 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.109 04:06:28 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:38.109 04:06:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:38.109 04:06:28 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.109 04:06:28 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:38.109 04:06:28 -- setup/hugepages.sh@41 -- # echo 0 00:04:38.109 04:06:28 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:38.109 04:06:28 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:38.109 04:06:28 -- setup/hugepages.sh@210 -- # run_test default_setup default_setup 00:04:38.109 04:06:28 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:38.109 04:06:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:38.109 04:06:28 -- common/autotest_common.sh@10 -- # set +x 00:04:38.109 ************************************ 00:04:38.109 START TEST default_setup 00:04:38.109 ************************************ 00:04:38.109 04:06:28 -- common/autotest_common.sh@1114 -- # default_setup 00:04:38.109 04:06:28 -- setup/hugepages.sh@136 -- # get_test_nr_hugepages 2097152 0 00:04:38.109 04:06:28 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:38.109 04:06:28 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:38.109 04:06:28 -- setup/hugepages.sh@51 -- # shift 00:04:38.109 04:06:28 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:38.109 04:06:28 -- setup/hugepages.sh@52 -- # local node_ids 00:04:38.109 04:06:28 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:38.109 04:06:28 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:38.109 04:06:28 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:38.109 04:06:28 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:38.109 04:06:28 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:38.109 04:06:28 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:38.109 04:06:28 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:38.109 04:06:28 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:38.109 04:06:28 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:38.109 04:06:28 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:38.109 04:06:28 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:38.109 04:06:28 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:38.109 04:06:28 -- setup/hugepages.sh@73 -- # return 0 00:04:38.109 04:06:28 -- setup/hugepages.sh@137 -- # setup output 00:04:38.109 04:06:28 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:38.109 04:06:28 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:39.486 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:39.486 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:39.486 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:39.486 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:39.486 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:39.486 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:39.486 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:39.486 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:39.486 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:04:39.486 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:04:39.486 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:04:39.486 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:04:39.486 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:04:39.486 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:04:39.486 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:04:39.486 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:04:40.423 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:04:40.423 04:06:31 -- setup/hugepages.sh@138 -- # verify_nr_hugepages 00:04:40.423 04:06:31 -- setup/hugepages.sh@89 -- # local node 00:04:40.423 04:06:31 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:40.423 04:06:31 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:40.423 04:06:31 -- setup/hugepages.sh@92 -- # local surp 00:04:40.423 04:06:31 -- setup/hugepages.sh@93 -- # local resv 00:04:40.423 04:06:31 -- setup/hugepages.sh@94 -- # local anon 00:04:40.423 04:06:31 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:40.423 04:06:31 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:40.423 04:06:31 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:40.423 04:06:31 -- setup/common.sh@18 -- # local node= 00:04:40.423 04:06:31 -- setup/common.sh@19 -- # local var val 00:04:40.423 04:06:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.423 04:06:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.423 04:06:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.423 04:06:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.423 04:06:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.423 04:06:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.423 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.423 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.423 04:06:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42647592 kB' 'MemAvailable: 46421176 kB' 'Buffers: 2708 kB' 'Cached: 13249084 kB' 'SwapCached: 0 kB' 'Active: 9965092 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563908 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480944 kB' 'Mapped: 183544 kB' 'Shmem: 9086200 kB' 'KReclaimable: 203628 kB' 'Slab: 727884 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524256 kB' 'KernelStack: 12720 kB' 'PageTables: 7844 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615028 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:40.423 04:06:31 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.423 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.423 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.423 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.423 04:06:31 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.685 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.685 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:40.686 04:06:31 -- setup/common.sh@33 -- # echo 0 00:04:40.686 04:06:31 -- setup/common.sh@33 -- # return 0 00:04:40.686 04:06:31 -- setup/hugepages.sh@97 -- # anon=0 00:04:40.686 04:06:31 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:40.686 04:06:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:40.686 04:06:31 -- setup/common.sh@18 -- # local node= 00:04:40.686 04:06:31 -- setup/common.sh@19 -- # local var val 00:04:40.686 04:06:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.686 04:06:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.686 04:06:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.686 04:06:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.686 04:06:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.686 04:06:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42651192 kB' 'MemAvailable: 46424776 kB' 'Buffers: 2708 kB' 'Cached: 13249084 kB' 'SwapCached: 0 kB' 'Active: 9964364 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563180 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480264 kB' 'Mapped: 183652 kB' 'Shmem: 9086200 kB' 'KReclaimable: 203628 kB' 'Slab: 728196 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524568 kB' 'KernelStack: 12768 kB' 'PageTables: 7900 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615040 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198264 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.686 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.686 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.687 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.687 04:06:31 -- setup/common.sh@33 -- # echo 0 00:04:40.687 04:06:31 -- setup/common.sh@33 -- # return 0 00:04:40.687 04:06:31 -- setup/hugepages.sh@99 -- # surp=0 00:04:40.687 04:06:31 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:40.687 04:06:31 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:40.687 04:06:31 -- setup/common.sh@18 -- # local node= 00:04:40.687 04:06:31 -- setup/common.sh@19 -- # local var val 00:04:40.687 04:06:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.687 04:06:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.687 04:06:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.687 04:06:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.687 04:06:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.687 04:06:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.687 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42651592 kB' 'MemAvailable: 46425176 kB' 'Buffers: 2708 kB' 'Cached: 13249100 kB' 'SwapCached: 0 kB' 'Active: 9964512 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563328 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480380 kB' 'Mapped: 183544 kB' 'Shmem: 9086216 kB' 'KReclaimable: 203628 kB' 'Slab: 728160 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524532 kB' 'KernelStack: 12784 kB' 'PageTables: 7944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615052 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.688 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.688 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:40.689 04:06:31 -- setup/common.sh@33 -- # echo 0 00:04:40.689 04:06:31 -- setup/common.sh@33 -- # return 0 00:04:40.689 04:06:31 -- setup/hugepages.sh@100 -- # resv=0 00:04:40.689 04:06:31 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:40.689 nr_hugepages=1024 00:04:40.689 04:06:31 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:40.689 resv_hugepages=0 00:04:40.689 04:06:31 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:40.689 surplus_hugepages=0 00:04:40.689 04:06:31 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:40.689 anon_hugepages=0 00:04:40.689 04:06:31 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:40.689 04:06:31 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:40.689 04:06:31 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:40.689 04:06:31 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:40.689 04:06:31 -- setup/common.sh@18 -- # local node= 00:04:40.689 04:06:31 -- setup/common.sh@19 -- # local var val 00:04:40.689 04:06:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.689 04:06:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.689 04:06:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:40.689 04:06:31 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:40.689 04:06:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.689 04:06:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42652016 kB' 'MemAvailable: 46425600 kB' 'Buffers: 2708 kB' 'Cached: 13249116 kB' 'SwapCached: 0 kB' 'Active: 9964520 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563336 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480392 kB' 'Mapped: 183544 kB' 'Shmem: 9086232 kB' 'KReclaimable: 203628 kB' 'Slab: 728160 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524532 kB' 'KernelStack: 12784 kB' 'PageTables: 7944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10614700 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.689 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.689 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.690 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:40.690 04:06:31 -- setup/common.sh@33 -- # echo 1024 00:04:40.690 04:06:31 -- setup/common.sh@33 -- # return 0 00:04:40.690 04:06:31 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:40.690 04:06:31 -- setup/hugepages.sh@112 -- # get_nodes 00:04:40.690 04:06:31 -- setup/hugepages.sh@27 -- # local node 00:04:40.690 04:06:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:40.690 04:06:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:40.690 04:06:31 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:40.690 04:06:31 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:40.690 04:06:31 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:40.690 04:06:31 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:40.690 04:06:31 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:40.690 04:06:31 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:40.690 04:06:31 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:40.690 04:06:31 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:40.690 04:06:31 -- setup/common.sh@18 -- # local node=0 00:04:40.690 04:06:31 -- setup/common.sh@19 -- # local var val 00:04:40.690 04:06:31 -- setup/common.sh@20 -- # local mem_f mem 00:04:40.690 04:06:31 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:40.690 04:06:31 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:40.690 04:06:31 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:40.690 04:06:31 -- setup/common.sh@28 -- # mapfile -t mem 00:04:40.690 04:06:31 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.690 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19355828 kB' 'MemUsed: 13519096 kB' 'SwapCached: 0 kB' 'Active: 6488040 kB' 'Inactive: 3601144 kB' 'Active(anon): 6353832 kB' 'Inactive(anon): 0 kB' 'Active(file): 134208 kB' 'Inactive(file): 3601144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9775256 kB' 'Mapped: 65480 kB' 'AnonPages: 317160 kB' 'Shmem: 6039904 kB' 'KernelStack: 7960 kB' 'PageTables: 4936 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132428 kB' 'Slab: 450992 kB' 'SReclaimable: 132428 kB' 'SUnreclaim: 318564 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # continue 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # IFS=': ' 00:04:40.691 04:06:31 -- setup/common.sh@31 -- # read -r var val _ 00:04:40.691 04:06:31 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:40.691 04:06:31 -- setup/common.sh@33 -- # echo 0 00:04:40.691 04:06:31 -- setup/common.sh@33 -- # return 0 00:04:40.691 04:06:31 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:40.691 04:06:31 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:40.691 04:06:31 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:40.691 04:06:31 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:40.691 04:06:31 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:40.691 node0=1024 expecting 1024 00:04:40.692 04:06:31 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:40.692 00:04:40.692 real 0m2.498s 00:04:40.692 user 0m0.652s 00:04:40.692 sys 0m0.921s 00:04:40.692 04:06:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:40.692 04:06:31 -- common/autotest_common.sh@10 -- # set +x 00:04:40.692 ************************************ 00:04:40.692 END TEST default_setup 00:04:40.692 ************************************ 00:04:40.692 04:06:31 -- setup/hugepages.sh@211 -- # run_test per_node_1G_alloc per_node_1G_alloc 00:04:40.692 04:06:31 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:40.692 04:06:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:40.692 04:06:31 -- common/autotest_common.sh@10 -- # set +x 00:04:40.692 ************************************ 00:04:40.692 START TEST per_node_1G_alloc 00:04:40.692 ************************************ 00:04:40.692 04:06:31 -- common/autotest_common.sh@1114 -- # per_node_1G_alloc 00:04:40.692 04:06:31 -- setup/hugepages.sh@143 -- # local IFS=, 00:04:40.692 04:06:31 -- setup/hugepages.sh@145 -- # get_test_nr_hugepages 1048576 0 1 00:04:40.692 04:06:31 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:40.692 04:06:31 -- setup/hugepages.sh@50 -- # (( 3 > 1 )) 00:04:40.692 04:06:31 -- setup/hugepages.sh@51 -- # shift 00:04:40.692 04:06:31 -- setup/hugepages.sh@52 -- # node_ids=('0' '1') 00:04:40.692 04:06:31 -- setup/hugepages.sh@52 -- # local node_ids 00:04:40.692 04:06:31 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:40.692 04:06:31 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:40.692 04:06:31 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 1 00:04:40.692 04:06:31 -- setup/hugepages.sh@62 -- # user_nodes=('0' '1') 00:04:40.692 04:06:31 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:40.692 04:06:31 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:40.692 04:06:31 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:40.692 04:06:31 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:40.692 04:06:31 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:40.692 04:06:31 -- setup/hugepages.sh@69 -- # (( 2 > 0 )) 00:04:40.692 04:06:31 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:40.692 04:06:31 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:40.692 04:06:31 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:40.692 04:06:31 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=512 00:04:40.692 04:06:31 -- setup/hugepages.sh@73 -- # return 0 00:04:40.692 04:06:31 -- setup/hugepages.sh@146 -- # NRHUGE=512 00:04:40.692 04:06:31 -- setup/hugepages.sh@146 -- # HUGENODE=0,1 00:04:40.692 04:06:31 -- setup/hugepages.sh@146 -- # setup output 00:04:40.692 04:06:31 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:40.692 04:06:31 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:42.069 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:42.069 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:42.069 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:42.069 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:42.069 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:42.069 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:42.069 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:42.069 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:42.069 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:42.069 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:42.069 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:42.069 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:42.069 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:42.069 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:42.069 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:42.069 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:42.069 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:42.069 04:06:32 -- setup/hugepages.sh@147 -- # nr_hugepages=1024 00:04:42.069 04:06:32 -- setup/hugepages.sh@147 -- # verify_nr_hugepages 00:04:42.069 04:06:32 -- setup/hugepages.sh@89 -- # local node 00:04:42.069 04:06:32 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:42.069 04:06:32 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:42.069 04:06:32 -- setup/hugepages.sh@92 -- # local surp 00:04:42.069 04:06:32 -- setup/hugepages.sh@93 -- # local resv 00:04:42.069 04:06:32 -- setup/hugepages.sh@94 -- # local anon 00:04:42.069 04:06:32 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:42.069 04:06:32 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:42.069 04:06:32 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:42.069 04:06:32 -- setup/common.sh@18 -- # local node= 00:04:42.069 04:06:32 -- setup/common.sh@19 -- # local var val 00:04:42.069 04:06:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.069 04:06:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.069 04:06:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.069 04:06:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.069 04:06:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.069 04:06:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.069 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.069 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42654956 kB' 'MemAvailable: 46428540 kB' 'Buffers: 2708 kB' 'Cached: 13249176 kB' 'SwapCached: 0 kB' 'Active: 9964880 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563696 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480696 kB' 'Mapped: 183524 kB' 'Shmem: 9086292 kB' 'KReclaimable: 203628 kB' 'Slab: 728136 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524508 kB' 'KernelStack: 12784 kB' 'PageTables: 7948 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615248 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.070 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.070 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:42.071 04:06:32 -- setup/common.sh@33 -- # echo 0 00:04:42.071 04:06:32 -- setup/common.sh@33 -- # return 0 00:04:42.071 04:06:32 -- setup/hugepages.sh@97 -- # anon=0 00:04:42.071 04:06:32 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:42.071 04:06:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.071 04:06:32 -- setup/common.sh@18 -- # local node= 00:04:42.071 04:06:32 -- setup/common.sh@19 -- # local var val 00:04:42.071 04:06:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.071 04:06:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.071 04:06:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.071 04:06:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.071 04:06:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.071 04:06:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42657192 kB' 'MemAvailable: 46430776 kB' 'Buffers: 2708 kB' 'Cached: 13249180 kB' 'SwapCached: 0 kB' 'Active: 9964852 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563668 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480660 kB' 'Mapped: 183600 kB' 'Shmem: 9086296 kB' 'KReclaimable: 203628 kB' 'Slab: 728204 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524576 kB' 'KernelStack: 12784 kB' 'PageTables: 7944 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615260 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.071 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.071 04:06:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.072 04:06:32 -- setup/common.sh@33 -- # echo 0 00:04:42.072 04:06:32 -- setup/common.sh@33 -- # return 0 00:04:42.072 04:06:32 -- setup/hugepages.sh@99 -- # surp=0 00:04:42.072 04:06:32 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:42.072 04:06:32 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:42.072 04:06:32 -- setup/common.sh@18 -- # local node= 00:04:42.072 04:06:32 -- setup/common.sh@19 -- # local var val 00:04:42.072 04:06:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.072 04:06:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.072 04:06:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.072 04:06:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.072 04:06:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.072 04:06:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42657380 kB' 'MemAvailable: 46430964 kB' 'Buffers: 2708 kB' 'Cached: 13249192 kB' 'SwapCached: 0 kB' 'Active: 9964752 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563568 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480488 kB' 'Mapped: 183524 kB' 'Shmem: 9086308 kB' 'KReclaimable: 203628 kB' 'Slab: 728180 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524552 kB' 'KernelStack: 12784 kB' 'PageTables: 7936 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615276 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.072 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.072 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.073 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.073 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:42.073 04:06:32 -- setup/common.sh@33 -- # echo 0 00:04:42.073 04:06:32 -- setup/common.sh@33 -- # return 0 00:04:42.073 04:06:32 -- setup/hugepages.sh@100 -- # resv=0 00:04:42.073 04:06:32 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:42.073 nr_hugepages=1024 00:04:42.073 04:06:32 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:42.073 resv_hugepages=0 00:04:42.073 04:06:32 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:42.073 surplus_hugepages=0 00:04:42.073 04:06:32 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:42.073 anon_hugepages=0 00:04:42.073 04:06:32 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:42.073 04:06:32 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:42.074 04:06:32 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:42.074 04:06:32 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:42.074 04:06:32 -- setup/common.sh@18 -- # local node= 00:04:42.074 04:06:32 -- setup/common.sh@19 -- # local var val 00:04:42.074 04:06:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.074 04:06:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.074 04:06:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:42.074 04:06:32 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:42.074 04:06:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.074 04:06:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42657348 kB' 'MemAvailable: 46430932 kB' 'Buffers: 2708 kB' 'Cached: 13249204 kB' 'SwapCached: 0 kB' 'Active: 9964724 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563540 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480448 kB' 'Mapped: 183524 kB' 'Shmem: 9086320 kB' 'KReclaimable: 203628 kB' 'Slab: 728180 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524552 kB' 'KernelStack: 12768 kB' 'PageTables: 7888 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615288 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.074 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.074 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:42.075 04:06:32 -- setup/common.sh@33 -- # echo 1024 00:04:42.075 04:06:32 -- setup/common.sh@33 -- # return 0 00:04:42.075 04:06:32 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:42.075 04:06:32 -- setup/hugepages.sh@112 -- # get_nodes 00:04:42.075 04:06:32 -- setup/hugepages.sh@27 -- # local node 00:04:42.075 04:06:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.075 04:06:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:42.075 04:06:32 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:42.075 04:06:32 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:42.075 04:06:32 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:42.075 04:06:32 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:42.075 04:06:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:42.075 04:06:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:42.075 04:06:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:42.075 04:06:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.075 04:06:32 -- setup/common.sh@18 -- # local node=0 00:04:42.075 04:06:32 -- setup/common.sh@19 -- # local var val 00:04:42.075 04:06:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.075 04:06:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.075 04:06:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:42.075 04:06:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:42.075 04:06:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.075 04:06:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20418860 kB' 'MemUsed: 12456064 kB' 'SwapCached: 0 kB' 'Active: 6488000 kB' 'Inactive: 3601144 kB' 'Active(anon): 6353792 kB' 'Inactive(anon): 0 kB' 'Active(file): 134208 kB' 'Inactive(file): 3601144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9775260 kB' 'Mapped: 65468 kB' 'AnonPages: 317024 kB' 'Shmem: 6039908 kB' 'KernelStack: 7960 kB' 'PageTables: 4868 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132428 kB' 'Slab: 450940 kB' 'SReclaimable: 132428 kB' 'SUnreclaim: 318512 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.075 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.075 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@33 -- # echo 0 00:04:42.076 04:06:32 -- setup/common.sh@33 -- # return 0 00:04:42.076 04:06:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:42.076 04:06:32 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:42.076 04:06:32 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:42.076 04:06:32 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:42.076 04:06:32 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:42.076 04:06:32 -- setup/common.sh@18 -- # local node=1 00:04:42.076 04:06:32 -- setup/common.sh@19 -- # local var val 00:04:42.076 04:06:32 -- setup/common.sh@20 -- # local mem_f mem 00:04:42.076 04:06:32 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:42.076 04:06:32 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:42.076 04:06:32 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:42.076 04:06:32 -- setup/common.sh@28 -- # mapfile -t mem 00:04:42.076 04:06:32 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 22237732 kB' 'MemUsed: 5423016 kB' 'SwapCached: 0 kB' 'Active: 3476552 kB' 'Inactive: 163264 kB' 'Active(anon): 3209576 kB' 'Inactive(anon): 0 kB' 'Active(file): 266976 kB' 'Inactive(file): 163264 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3476680 kB' 'Mapped: 118056 kB' 'AnonPages: 163200 kB' 'Shmem: 3046440 kB' 'KernelStack: 4808 kB' 'PageTables: 3020 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71200 kB' 'Slab: 277240 kB' 'SReclaimable: 71200 kB' 'SUnreclaim: 206040 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.076 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.076 04:06:32 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # continue 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # IFS=': ' 00:04:42.077 04:06:32 -- setup/common.sh@31 -- # read -r var val _ 00:04:42.077 04:06:32 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:42.077 04:06:32 -- setup/common.sh@33 -- # echo 0 00:04:42.077 04:06:32 -- setup/common.sh@33 -- # return 0 00:04:42.077 04:06:32 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:42.077 04:06:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:42.077 04:06:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:42.077 04:06:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:42.077 04:06:32 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:42.077 node0=512 expecting 512 00:04:42.077 04:06:32 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:42.077 04:06:32 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:42.077 04:06:32 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:42.077 04:06:32 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:42.077 node1=512 expecting 512 00:04:42.077 04:06:32 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:42.077 00:04:42.077 real 0m1.445s 00:04:42.077 user 0m0.581s 00:04:42.077 sys 0m0.828s 00:04:42.077 04:06:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:42.077 04:06:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.077 ************************************ 00:04:42.077 END TEST per_node_1G_alloc 00:04:42.077 ************************************ 00:04:42.077 04:06:32 -- setup/hugepages.sh@212 -- # run_test even_2G_alloc even_2G_alloc 00:04:42.077 04:06:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:42.077 04:06:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:42.077 04:06:32 -- common/autotest_common.sh@10 -- # set +x 00:04:42.077 ************************************ 00:04:42.077 START TEST even_2G_alloc 00:04:42.077 ************************************ 00:04:42.077 04:06:32 -- common/autotest_common.sh@1114 -- # even_2G_alloc 00:04:42.077 04:06:32 -- setup/hugepages.sh@152 -- # get_test_nr_hugepages 2097152 00:04:42.077 04:06:32 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:42.077 04:06:32 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:42.077 04:06:32 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:42.077 04:06:32 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:42.077 04:06:32 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:42.077 04:06:32 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:42.077 04:06:32 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:42.078 04:06:32 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:42.078 04:06:32 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:42.078 04:06:32 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:42.078 04:06:32 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:42.078 04:06:32 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:42.078 04:06:32 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:42.078 04:06:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:42.078 04:06:32 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:42.078 04:06:32 -- setup/hugepages.sh@83 -- # : 512 00:04:42.078 04:06:32 -- setup/hugepages.sh@84 -- # : 1 00:04:42.078 04:06:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:42.078 04:06:32 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:42.078 04:06:32 -- setup/hugepages.sh@83 -- # : 0 00:04:42.078 04:06:32 -- setup/hugepages.sh@84 -- # : 0 00:04:42.078 04:06:32 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:42.078 04:06:32 -- setup/hugepages.sh@153 -- # NRHUGE=1024 00:04:42.078 04:06:32 -- setup/hugepages.sh@153 -- # HUGE_EVEN_ALLOC=yes 00:04:42.078 04:06:32 -- setup/hugepages.sh@153 -- # setup output 00:04:42.078 04:06:32 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:42.078 04:06:32 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:43.452 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:43.452 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:43.452 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:43.452 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:43.452 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:43.452 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:43.452 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:43.452 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:43.452 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:43.452 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:43.452 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:43.452 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:43.452 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:43.452 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:43.452 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:43.452 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:43.452 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:43.452 04:06:34 -- setup/hugepages.sh@154 -- # verify_nr_hugepages 00:04:43.452 04:06:34 -- setup/hugepages.sh@89 -- # local node 00:04:43.452 04:06:34 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:43.452 04:06:34 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:43.452 04:06:34 -- setup/hugepages.sh@92 -- # local surp 00:04:43.452 04:06:34 -- setup/hugepages.sh@93 -- # local resv 00:04:43.452 04:06:34 -- setup/hugepages.sh@94 -- # local anon 00:04:43.452 04:06:34 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:43.452 04:06:34 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:43.452 04:06:34 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:43.452 04:06:34 -- setup/common.sh@18 -- # local node= 00:04:43.452 04:06:34 -- setup/common.sh@19 -- # local var val 00:04:43.452 04:06:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.452 04:06:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.452 04:06:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.452 04:06:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.452 04:06:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.452 04:06:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.452 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.452 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42687324 kB' 'MemAvailable: 46460908 kB' 'Buffers: 2708 kB' 'Cached: 13249268 kB' 'SwapCached: 0 kB' 'Active: 9964716 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563532 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480340 kB' 'Mapped: 183536 kB' 'Shmem: 9086384 kB' 'KReclaimable: 203628 kB' 'Slab: 728280 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524652 kB' 'KernelStack: 12784 kB' 'PageTables: 7904 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615472 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.453 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.453 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:43.454 04:06:34 -- setup/common.sh@33 -- # echo 0 00:04:43.454 04:06:34 -- setup/common.sh@33 -- # return 0 00:04:43.454 04:06:34 -- setup/hugepages.sh@97 -- # anon=0 00:04:43.454 04:06:34 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:43.454 04:06:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.454 04:06:34 -- setup/common.sh@18 -- # local node= 00:04:43.454 04:06:34 -- setup/common.sh@19 -- # local var val 00:04:43.454 04:06:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.454 04:06:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.454 04:06:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.454 04:06:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.454 04:06:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.454 04:06:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42689260 kB' 'MemAvailable: 46462844 kB' 'Buffers: 2708 kB' 'Cached: 13249272 kB' 'SwapCached: 0 kB' 'Active: 9965208 kB' 'Inactive: 3764408 kB' 'Active(anon): 9564024 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480860 kB' 'Mapped: 183604 kB' 'Shmem: 9086388 kB' 'KReclaimable: 203628 kB' 'Slab: 728344 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524716 kB' 'KernelStack: 12832 kB' 'PageTables: 7992 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615484 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198328 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.454 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.454 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.455 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.455 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.749 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.749 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.750 04:06:34 -- setup/common.sh@33 -- # echo 0 00:04:43.750 04:06:34 -- setup/common.sh@33 -- # return 0 00:04:43.750 04:06:34 -- setup/hugepages.sh@99 -- # surp=0 00:04:43.750 04:06:34 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:43.750 04:06:34 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:43.750 04:06:34 -- setup/common.sh@18 -- # local node= 00:04:43.750 04:06:34 -- setup/common.sh@19 -- # local var val 00:04:43.750 04:06:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.750 04:06:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.750 04:06:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.750 04:06:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.750 04:06:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.750 04:06:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42692016 kB' 'MemAvailable: 46465600 kB' 'Buffers: 2708 kB' 'Cached: 13249284 kB' 'SwapCached: 0 kB' 'Active: 9965028 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563844 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480636 kB' 'Mapped: 183524 kB' 'Shmem: 9086400 kB' 'KReclaimable: 203628 kB' 'Slab: 728376 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524748 kB' 'KernelStack: 12816 kB' 'PageTables: 7940 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615500 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.750 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.750 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.751 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.751 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:43.752 04:06:34 -- setup/common.sh@33 -- # echo 0 00:04:43.752 04:06:34 -- setup/common.sh@33 -- # return 0 00:04:43.752 04:06:34 -- setup/hugepages.sh@100 -- # resv=0 00:04:43.752 04:06:34 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:43.752 nr_hugepages=1024 00:04:43.752 04:06:34 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:43.752 resv_hugepages=0 00:04:43.752 04:06:34 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:43.752 surplus_hugepages=0 00:04:43.752 04:06:34 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:43.752 anon_hugepages=0 00:04:43.752 04:06:34 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:43.752 04:06:34 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:43.752 04:06:34 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:43.752 04:06:34 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:43.752 04:06:34 -- setup/common.sh@18 -- # local node= 00:04:43.752 04:06:34 -- setup/common.sh@19 -- # local var val 00:04:43.752 04:06:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.752 04:06:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.752 04:06:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:43.752 04:06:34 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:43.752 04:06:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.752 04:06:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42692016 kB' 'MemAvailable: 46465600 kB' 'Buffers: 2708 kB' 'Cached: 13249296 kB' 'SwapCached: 0 kB' 'Active: 9965020 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563836 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480604 kB' 'Mapped: 183524 kB' 'Shmem: 9086412 kB' 'KReclaimable: 203628 kB' 'Slab: 728376 kB' 'SReclaimable: 203628 kB' 'SUnreclaim: 524748 kB' 'KernelStack: 12800 kB' 'PageTables: 7892 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10615516 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198344 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.752 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.752 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.753 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.753 04:06:34 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:43.754 04:06:34 -- setup/common.sh@33 -- # echo 1024 00:04:43.754 04:06:34 -- setup/common.sh@33 -- # return 0 00:04:43.754 04:06:34 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:43.754 04:06:34 -- setup/hugepages.sh@112 -- # get_nodes 00:04:43.754 04:06:34 -- setup/hugepages.sh@27 -- # local node 00:04:43.754 04:06:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:43.754 04:06:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:43.754 04:06:34 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:43.754 04:06:34 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:43.754 04:06:34 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:43.754 04:06:34 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:43.754 04:06:34 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:43.754 04:06:34 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:43.754 04:06:34 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:43.754 04:06:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.754 04:06:34 -- setup/common.sh@18 -- # local node=0 00:04:43.754 04:06:34 -- setup/common.sh@19 -- # local var val 00:04:43.754 04:06:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.754 04:06:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.754 04:06:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:43.754 04:06:34 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:43.754 04:06:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.754 04:06:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20445784 kB' 'MemUsed: 12429140 kB' 'SwapCached: 0 kB' 'Active: 6488796 kB' 'Inactive: 3601144 kB' 'Active(anon): 6354588 kB' 'Inactive(anon): 0 kB' 'Active(file): 134208 kB' 'Inactive(file): 3601144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9775268 kB' 'Mapped: 65472 kB' 'AnonPages: 317836 kB' 'Shmem: 6039916 kB' 'KernelStack: 7992 kB' 'PageTables: 5016 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132428 kB' 'Slab: 451052 kB' 'SReclaimable: 132428 kB' 'SUnreclaim: 318624 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.754 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.754 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.755 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.755 04:06:34 -- setup/common.sh@33 -- # echo 0 00:04:43.755 04:06:34 -- setup/common.sh@33 -- # return 0 00:04:43.755 04:06:34 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:43.755 04:06:34 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:43.755 04:06:34 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:43.755 04:06:34 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:43.755 04:06:34 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:43.755 04:06:34 -- setup/common.sh@18 -- # local node=1 00:04:43.755 04:06:34 -- setup/common.sh@19 -- # local var val 00:04:43.755 04:06:34 -- setup/common.sh@20 -- # local mem_f mem 00:04:43.755 04:06:34 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:43.755 04:06:34 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:43.755 04:06:34 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:43.755 04:06:34 -- setup/common.sh@28 -- # mapfile -t mem 00:04:43.755 04:06:34 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.755 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 22246436 kB' 'MemUsed: 5414312 kB' 'SwapCached: 0 kB' 'Active: 3476244 kB' 'Inactive: 163264 kB' 'Active(anon): 3209268 kB' 'Inactive(anon): 0 kB' 'Active(file): 266976 kB' 'Inactive(file): 163264 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3476764 kB' 'Mapped: 118052 kB' 'AnonPages: 162804 kB' 'Shmem: 3046524 kB' 'KernelStack: 4840 kB' 'PageTables: 2924 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71200 kB' 'Slab: 277324 kB' 'SReclaimable: 71200 kB' 'SUnreclaim: 206124 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.756 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.756 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # continue 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # IFS=': ' 00:04:43.757 04:06:34 -- setup/common.sh@31 -- # read -r var val _ 00:04:43.757 04:06:34 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:43.757 04:06:34 -- setup/common.sh@33 -- # echo 0 00:04:43.757 04:06:34 -- setup/common.sh@33 -- # return 0 00:04:43.757 04:06:34 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:43.757 04:06:34 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:43.757 04:06:34 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:43.757 04:06:34 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:43.757 04:06:34 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:43.757 node0=512 expecting 512 00:04:43.757 04:06:34 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:43.757 04:06:34 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:43.757 04:06:34 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:43.757 04:06:34 -- setup/hugepages.sh@128 -- # echo 'node1=512 expecting 512' 00:04:43.757 node1=512 expecting 512 00:04:43.757 04:06:34 -- setup/hugepages.sh@130 -- # [[ 512 == \5\1\2 ]] 00:04:43.757 00:04:43.757 real 0m1.517s 00:04:43.757 user 0m0.614s 00:04:43.757 sys 0m0.867s 00:04:43.757 04:06:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:43.757 04:06:34 -- common/autotest_common.sh@10 -- # set +x 00:04:43.757 ************************************ 00:04:43.757 END TEST even_2G_alloc 00:04:43.757 ************************************ 00:04:43.757 04:06:34 -- setup/hugepages.sh@213 -- # run_test odd_alloc odd_alloc 00:04:43.757 04:06:34 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:43.757 04:06:34 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:43.757 04:06:34 -- common/autotest_common.sh@10 -- # set +x 00:04:43.757 ************************************ 00:04:43.757 START TEST odd_alloc 00:04:43.757 ************************************ 00:04:43.757 04:06:34 -- common/autotest_common.sh@1114 -- # odd_alloc 00:04:43.757 04:06:34 -- setup/hugepages.sh@159 -- # get_test_nr_hugepages 2098176 00:04:43.757 04:06:34 -- setup/hugepages.sh@49 -- # local size=2098176 00:04:43.757 04:06:34 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:43.757 04:06:34 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:43.757 04:06:34 -- setup/hugepages.sh@57 -- # nr_hugepages=1025 00:04:43.757 04:06:34 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:43.757 04:06:34 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:43.757 04:06:34 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:43.757 04:06:34 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1025 00:04:43.757 04:06:34 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:43.757 04:06:34 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:43.757 04:06:34 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:43.757 04:06:34 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:43.757 04:06:34 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:43.757 04:06:34 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:43.757 04:06:34 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=512 00:04:43.757 04:06:34 -- setup/hugepages.sh@83 -- # : 513 00:04:43.757 04:06:34 -- setup/hugepages.sh@84 -- # : 1 00:04:43.757 04:06:34 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:43.757 04:06:34 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=513 00:04:43.757 04:06:34 -- setup/hugepages.sh@83 -- # : 0 00:04:43.757 04:06:34 -- setup/hugepages.sh@84 -- # : 0 00:04:43.757 04:06:34 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:43.757 04:06:34 -- setup/hugepages.sh@160 -- # HUGEMEM=2049 00:04:43.757 04:06:34 -- setup/hugepages.sh@160 -- # HUGE_EVEN_ALLOC=yes 00:04:43.757 04:06:34 -- setup/hugepages.sh@160 -- # setup output 00:04:43.757 04:06:34 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:43.757 04:06:34 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:45.135 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:45.135 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:45.135 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:45.135 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:45.135 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:45.135 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:45.135 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:45.135 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:45.135 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:45.135 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:45.135 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:45.135 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:45.135 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:45.135 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:45.135 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:45.135 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:45.135 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:45.135 04:06:35 -- setup/hugepages.sh@161 -- # verify_nr_hugepages 00:04:45.135 04:06:35 -- setup/hugepages.sh@89 -- # local node 00:04:45.135 04:06:35 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:45.135 04:06:35 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:45.135 04:06:35 -- setup/hugepages.sh@92 -- # local surp 00:04:45.135 04:06:35 -- setup/hugepages.sh@93 -- # local resv 00:04:45.135 04:06:35 -- setup/hugepages.sh@94 -- # local anon 00:04:45.135 04:06:35 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:45.135 04:06:35 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:45.135 04:06:35 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:45.135 04:06:35 -- setup/common.sh@18 -- # local node= 00:04:45.135 04:06:35 -- setup/common.sh@19 -- # local var val 00:04:45.135 04:06:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.135 04:06:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.135 04:06:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.135 04:06:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.135 04:06:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.135 04:06:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42679468 kB' 'MemAvailable: 46453056 kB' 'Buffers: 2708 kB' 'Cached: 13249356 kB' 'SwapCached: 0 kB' 'Active: 9963172 kB' 'Inactive: 3764408 kB' 'Active(anon): 9561988 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478752 kB' 'Mapped: 182544 kB' 'Shmem: 9086472 kB' 'KReclaimable: 203636 kB' 'Slab: 728432 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524796 kB' 'KernelStack: 12736 kB' 'PageTables: 7620 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10602128 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198312 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.135 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.135 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:45.136 04:06:35 -- setup/common.sh@33 -- # echo 0 00:04:45.136 04:06:35 -- setup/common.sh@33 -- # return 0 00:04:45.136 04:06:35 -- setup/hugepages.sh@97 -- # anon=0 00:04:45.136 04:06:35 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:45.136 04:06:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.136 04:06:35 -- setup/common.sh@18 -- # local node= 00:04:45.136 04:06:35 -- setup/common.sh@19 -- # local var val 00:04:45.136 04:06:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.136 04:06:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.136 04:06:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.136 04:06:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.136 04:06:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.136 04:06:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42681160 kB' 'MemAvailable: 46454748 kB' 'Buffers: 2708 kB' 'Cached: 13249360 kB' 'SwapCached: 0 kB' 'Active: 9963316 kB' 'Inactive: 3764408 kB' 'Active(anon): 9562132 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478960 kB' 'Mapped: 182544 kB' 'Shmem: 9086476 kB' 'KReclaimable: 203636 kB' 'Slab: 728420 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524784 kB' 'KernelStack: 12720 kB' 'PageTables: 7548 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10602136 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198280 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.136 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.136 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.137 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.137 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.138 04:06:35 -- setup/common.sh@33 -- # echo 0 00:04:45.138 04:06:35 -- setup/common.sh@33 -- # return 0 00:04:45.138 04:06:35 -- setup/hugepages.sh@99 -- # surp=0 00:04:45.138 04:06:35 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:45.138 04:06:35 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:45.138 04:06:35 -- setup/common.sh@18 -- # local node= 00:04:45.138 04:06:35 -- setup/common.sh@19 -- # local var val 00:04:45.138 04:06:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.138 04:06:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.138 04:06:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.138 04:06:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.138 04:06:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.138 04:06:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42681492 kB' 'MemAvailable: 46455080 kB' 'Buffers: 2708 kB' 'Cached: 13249372 kB' 'SwapCached: 0 kB' 'Active: 9962844 kB' 'Inactive: 3764408 kB' 'Active(anon): 9561660 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478392 kB' 'Mapped: 182460 kB' 'Shmem: 9086488 kB' 'KReclaimable: 203636 kB' 'Slab: 728460 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524824 kB' 'KernelStack: 12768 kB' 'PageTables: 7628 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10602152 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.138 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.138 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:45.139 04:06:35 -- setup/common.sh@33 -- # echo 0 00:04:45.139 04:06:35 -- setup/common.sh@33 -- # return 0 00:04:45.139 04:06:35 -- setup/hugepages.sh@100 -- # resv=0 00:04:45.139 04:06:35 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1025 00:04:45.139 nr_hugepages=1025 00:04:45.139 04:06:35 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:45.139 resv_hugepages=0 00:04:45.139 04:06:35 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:45.139 surplus_hugepages=0 00:04:45.139 04:06:35 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:45.139 anon_hugepages=0 00:04:45.139 04:06:35 -- setup/hugepages.sh@107 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:45.139 04:06:35 -- setup/hugepages.sh@109 -- # (( 1025 == nr_hugepages )) 00:04:45.139 04:06:35 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:45.139 04:06:35 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:45.139 04:06:35 -- setup/common.sh@18 -- # local node= 00:04:45.139 04:06:35 -- setup/common.sh@19 -- # local var val 00:04:45.139 04:06:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.139 04:06:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.139 04:06:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:45.139 04:06:35 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:45.139 04:06:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.139 04:06:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42681944 kB' 'MemAvailable: 46455532 kB' 'Buffers: 2708 kB' 'Cached: 13249388 kB' 'SwapCached: 0 kB' 'Active: 9962884 kB' 'Inactive: 3764408 kB' 'Active(anon): 9561700 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 478400 kB' 'Mapped: 182460 kB' 'Shmem: 9086504 kB' 'KReclaimable: 203636 kB' 'Slab: 728460 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524824 kB' 'KernelStack: 12768 kB' 'PageTables: 7628 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37606840 kB' 'Committed_AS: 10602168 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198296 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1025' 'HugePages_Free: 1025' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2099200 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.139 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.139 04:06:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.140 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.140 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:45.141 04:06:35 -- setup/common.sh@33 -- # echo 1025 00:04:45.141 04:06:35 -- setup/common.sh@33 -- # return 0 00:04:45.141 04:06:35 -- setup/hugepages.sh@110 -- # (( 1025 == nr_hugepages + surp + resv )) 00:04:45.141 04:06:35 -- setup/hugepages.sh@112 -- # get_nodes 00:04:45.141 04:06:35 -- setup/hugepages.sh@27 -- # local node 00:04:45.141 04:06:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.141 04:06:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:45.141 04:06:35 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:45.141 04:06:35 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=513 00:04:45.141 04:06:35 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:45.141 04:06:35 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:45.141 04:06:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:45.141 04:06:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:45.141 04:06:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:45.141 04:06:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.141 04:06:35 -- setup/common.sh@18 -- # local node=0 00:04:45.141 04:06:35 -- setup/common.sh@19 -- # local var val 00:04:45.141 04:06:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.141 04:06:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.141 04:06:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:45.141 04:06:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:45.141 04:06:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.141 04:06:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20441692 kB' 'MemUsed: 12433232 kB' 'SwapCached: 0 kB' 'Active: 6487088 kB' 'Inactive: 3601144 kB' 'Active(anon): 6352880 kB' 'Inactive(anon): 0 kB' 'Active(file): 134208 kB' 'Inactive(file): 3601144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9775272 kB' 'Mapped: 64436 kB' 'AnonPages: 316144 kB' 'Shmem: 6039920 kB' 'KernelStack: 7960 kB' 'PageTables: 4732 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132436 kB' 'Slab: 451144 kB' 'SReclaimable: 132436 kB' 'SUnreclaim: 318708 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.141 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.141 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@33 -- # echo 0 00:04:45.142 04:06:35 -- setup/common.sh@33 -- # return 0 00:04:45.142 04:06:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:45.142 04:06:35 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:45.142 04:06:35 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:45.142 04:06:35 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:45.142 04:06:35 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:45.142 04:06:35 -- setup/common.sh@18 -- # local node=1 00:04:45.142 04:06:35 -- setup/common.sh@19 -- # local var val 00:04:45.142 04:06:35 -- setup/common.sh@20 -- # local mem_f mem 00:04:45.142 04:06:35 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:45.142 04:06:35 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:45.142 04:06:35 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:45.142 04:06:35 -- setup/common.sh@28 -- # mapfile -t mem 00:04:45.142 04:06:35 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 22240000 kB' 'MemUsed: 5420748 kB' 'SwapCached: 0 kB' 'Active: 3475556 kB' 'Inactive: 163264 kB' 'Active(anon): 3208580 kB' 'Inactive(anon): 0 kB' 'Active(file): 266976 kB' 'Inactive(file): 163264 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3476852 kB' 'Mapped: 118024 kB' 'AnonPages: 161972 kB' 'Shmem: 3046612 kB' 'KernelStack: 4776 kB' 'PageTables: 2800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71200 kB' 'Slab: 277316 kB' 'SReclaimable: 71200 kB' 'SUnreclaim: 206116 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 513' 'HugePages_Free: 513' 'HugePages_Surp: 0' 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.142 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.142 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # continue 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # IFS=': ' 00:04:45.143 04:06:35 -- setup/common.sh@31 -- # read -r var val _ 00:04:45.143 04:06:35 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:45.143 04:06:35 -- setup/common.sh@33 -- # echo 0 00:04:45.143 04:06:35 -- setup/common.sh@33 -- # return 0 00:04:45.143 04:06:35 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:45.143 04:06:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:45.143 04:06:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:45.143 04:06:35 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 513' 00:04:45.143 node0=512 expecting 513 00:04:45.143 04:06:35 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:45.143 04:06:35 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:45.143 04:06:35 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:45.143 04:06:35 -- setup/hugepages.sh@128 -- # echo 'node1=513 expecting 512' 00:04:45.143 node1=513 expecting 512 00:04:45.143 04:06:35 -- setup/hugepages.sh@130 -- # [[ 512 513 == \5\1\2\ \5\1\3 ]] 00:04:45.143 00:04:45.143 real 0m1.508s 00:04:45.143 user 0m0.621s 00:04:45.143 sys 0m0.853s 00:04:45.143 04:06:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:45.143 04:06:35 -- common/autotest_common.sh@10 -- # set +x 00:04:45.143 ************************************ 00:04:45.143 END TEST odd_alloc 00:04:45.143 ************************************ 00:04:45.143 04:06:35 -- setup/hugepages.sh@214 -- # run_test custom_alloc custom_alloc 00:04:45.143 04:06:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:45.143 04:06:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:45.143 04:06:35 -- common/autotest_common.sh@10 -- # set +x 00:04:45.143 ************************************ 00:04:45.143 START TEST custom_alloc 00:04:45.143 ************************************ 00:04:45.143 04:06:35 -- common/autotest_common.sh@1114 -- # custom_alloc 00:04:45.143 04:06:35 -- setup/hugepages.sh@167 -- # local IFS=, 00:04:45.143 04:06:35 -- setup/hugepages.sh@169 -- # local node 00:04:45.143 04:06:35 -- setup/hugepages.sh@170 -- # nodes_hp=() 00:04:45.143 04:06:35 -- setup/hugepages.sh@170 -- # local nodes_hp 00:04:45.143 04:06:35 -- setup/hugepages.sh@172 -- # local nr_hugepages=0 _nr_hugepages=0 00:04:45.143 04:06:35 -- setup/hugepages.sh@174 -- # get_test_nr_hugepages 1048576 00:04:45.143 04:06:35 -- setup/hugepages.sh@49 -- # local size=1048576 00:04:45.143 04:06:35 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@57 -- # nr_hugepages=512 00:04:45.143 04:06:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:45.143 04:06:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:45.143 04:06:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.143 04:06:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=512 00:04:45.143 04:06:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.143 04:06:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.143 04:06:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.143 04:06:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@74 -- # (( 0 > 0 )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:45.143 04:06:35 -- setup/hugepages.sh@83 -- # : 256 00:04:45.143 04:06:35 -- setup/hugepages.sh@84 -- # : 1 00:04:45.143 04:06:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@82 -- # nodes_test[_no_nodes - 1]=256 00:04:45.143 04:06:35 -- setup/hugepages.sh@83 -- # : 0 00:04:45.143 04:06:35 -- setup/hugepages.sh@84 -- # : 0 00:04:45.143 04:06:35 -- setup/hugepages.sh@81 -- # (( _no_nodes > 0 )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@175 -- # nodes_hp[0]=512 00:04:45.143 04:06:35 -- setup/hugepages.sh@176 -- # (( 2 > 1 )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@177 -- # get_test_nr_hugepages 2097152 00:04:45.143 04:06:35 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:45.143 04:06:35 -- setup/hugepages.sh@50 -- # (( 1 > 1 )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:45.143 04:06:35 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:45.143 04:06:35 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 00:04:45.143 04:06:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:45.143 04:06:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.143 04:06:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:45.143 04:06:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.402 04:06:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.402 04:06:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.402 04:06:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:45.402 04:06:35 -- setup/hugepages.sh@74 -- # (( 1 > 0 )) 00:04:45.402 04:06:35 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:45.402 04:06:35 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:45.402 04:06:35 -- setup/hugepages.sh@78 -- # return 0 00:04:45.402 04:06:35 -- setup/hugepages.sh@178 -- # nodes_hp[1]=1024 00:04:45.402 04:06:35 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:45.402 04:06:35 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:45.402 04:06:35 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:45.402 04:06:35 -- setup/hugepages.sh@181 -- # for node in "${!nodes_hp[@]}" 00:04:45.402 04:06:35 -- setup/hugepages.sh@182 -- # HUGENODE+=("nodes_hp[$node]=${nodes_hp[node]}") 00:04:45.402 04:06:35 -- setup/hugepages.sh@183 -- # (( _nr_hugepages += nodes_hp[node] )) 00:04:45.402 04:06:35 -- setup/hugepages.sh@186 -- # get_test_nr_hugepages_per_node 00:04:45.402 04:06:35 -- setup/hugepages.sh@62 -- # user_nodes=() 00:04:45.402 04:06:35 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:45.402 04:06:35 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:45.402 04:06:35 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:45.402 04:06:35 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:45.402 04:06:35 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:45.402 04:06:35 -- setup/hugepages.sh@69 -- # (( 0 > 0 )) 00:04:45.402 04:06:35 -- setup/hugepages.sh@74 -- # (( 2 > 0 )) 00:04:45.402 04:06:35 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:45.402 04:06:35 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=512 00:04:45.402 04:06:35 -- setup/hugepages.sh@75 -- # for _no_nodes in "${!nodes_hp[@]}" 00:04:45.402 04:06:35 -- setup/hugepages.sh@76 -- # nodes_test[_no_nodes]=1024 00:04:45.402 04:06:35 -- setup/hugepages.sh@78 -- # return 0 00:04:45.402 04:06:35 -- setup/hugepages.sh@187 -- # HUGENODE='nodes_hp[0]=512,nodes_hp[1]=1024' 00:04:45.402 04:06:35 -- setup/hugepages.sh@187 -- # setup output 00:04:45.402 04:06:35 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:45.402 04:06:35 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:46.338 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:46.338 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:46.338 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:46.338 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:46.338 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:46.338 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:46.338 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:46.338 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:46.338 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:46.338 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:46.338 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:46.338 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:46.338 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:46.338 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:46.338 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:46.338 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:46.338 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:46.600 04:06:37 -- setup/hugepages.sh@188 -- # nr_hugepages=1536 00:04:46.600 04:06:37 -- setup/hugepages.sh@188 -- # verify_nr_hugepages 00:04:46.600 04:06:37 -- setup/hugepages.sh@89 -- # local node 00:04:46.600 04:06:37 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:46.600 04:06:37 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:46.600 04:06:37 -- setup/hugepages.sh@92 -- # local surp 00:04:46.600 04:06:37 -- setup/hugepages.sh@93 -- # local resv 00:04:46.600 04:06:37 -- setup/hugepages.sh@94 -- # local anon 00:04:46.600 04:06:37 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:46.600 04:06:37 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:46.600 04:06:37 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:46.600 04:06:37 -- setup/common.sh@18 -- # local node= 00:04:46.600 04:06:37 -- setup/common.sh@19 -- # local var val 00:04:46.600 04:06:37 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.600 04:06:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.600 04:06:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.601 04:06:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.601 04:06:37 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.601 04:06:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 41637400 kB' 'MemAvailable: 45410988 kB' 'Buffers: 2708 kB' 'Cached: 13249456 kB' 'SwapCached: 0 kB' 'Active: 9964240 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563056 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479680 kB' 'Mapped: 182480 kB' 'Shmem: 9086572 kB' 'KReclaimable: 203636 kB' 'Slab: 728216 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524580 kB' 'KernelStack: 12784 kB' 'PageTables: 7664 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10602224 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.601 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.601 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:46.602 04:06:37 -- setup/common.sh@33 -- # echo 0 00:04:46.602 04:06:37 -- setup/common.sh@33 -- # return 0 00:04:46.602 04:06:37 -- setup/hugepages.sh@97 -- # anon=0 00:04:46.602 04:06:37 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:46.602 04:06:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.602 04:06:37 -- setup/common.sh@18 -- # local node= 00:04:46.602 04:06:37 -- setup/common.sh@19 -- # local var val 00:04:46.602 04:06:37 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.602 04:06:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.602 04:06:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.602 04:06:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.602 04:06:37 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.602 04:06:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 41637680 kB' 'MemAvailable: 45411268 kB' 'Buffers: 2708 kB' 'Cached: 13249460 kB' 'SwapCached: 0 kB' 'Active: 9963804 kB' 'Inactive: 3764408 kB' 'Active(anon): 9562620 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479268 kB' 'Mapped: 182560 kB' 'Shmem: 9086576 kB' 'KReclaimable: 203636 kB' 'Slab: 728276 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524640 kB' 'KernelStack: 12784 kB' 'PageTables: 7652 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10602236 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.602 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.602 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.603 04:06:37 -- setup/common.sh@33 -- # echo 0 00:04:46.603 04:06:37 -- setup/common.sh@33 -- # return 0 00:04:46.603 04:06:37 -- setup/hugepages.sh@99 -- # surp=0 00:04:46.603 04:06:37 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:46.603 04:06:37 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:46.603 04:06:37 -- setup/common.sh@18 -- # local node= 00:04:46.603 04:06:37 -- setup/common.sh@19 -- # local var val 00:04:46.603 04:06:37 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.603 04:06:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.603 04:06:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.603 04:06:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.603 04:06:37 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.603 04:06:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 41636924 kB' 'MemAvailable: 45410512 kB' 'Buffers: 2708 kB' 'Cached: 13249472 kB' 'SwapCached: 0 kB' 'Active: 9963644 kB' 'Inactive: 3764408 kB' 'Active(anon): 9562460 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479072 kB' 'Mapped: 182464 kB' 'Shmem: 9086588 kB' 'KReclaimable: 203636 kB' 'Slab: 728292 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524656 kB' 'KernelStack: 12768 kB' 'PageTables: 7600 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10602252 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.603 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.603 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.604 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.604 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:46.605 04:06:37 -- setup/common.sh@33 -- # echo 0 00:04:46.605 04:06:37 -- setup/common.sh@33 -- # return 0 00:04:46.605 04:06:37 -- setup/hugepages.sh@100 -- # resv=0 00:04:46.605 04:06:37 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1536 00:04:46.605 nr_hugepages=1536 00:04:46.605 04:06:37 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:46.605 resv_hugepages=0 00:04:46.605 04:06:37 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:46.605 surplus_hugepages=0 00:04:46.605 04:06:37 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:46.605 anon_hugepages=0 00:04:46.605 04:06:37 -- setup/hugepages.sh@107 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:46.605 04:06:37 -- setup/hugepages.sh@109 -- # (( 1536 == nr_hugepages )) 00:04:46.605 04:06:37 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:46.605 04:06:37 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:46.605 04:06:37 -- setup/common.sh@18 -- # local node= 00:04:46.605 04:06:37 -- setup/common.sh@19 -- # local var val 00:04:46.605 04:06:37 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.605 04:06:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.605 04:06:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:46.605 04:06:37 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:46.605 04:06:37 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.605 04:06:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 41639296 kB' 'MemAvailable: 45412884 kB' 'Buffers: 2708 kB' 'Cached: 13249484 kB' 'SwapCached: 0 kB' 'Active: 9963756 kB' 'Inactive: 3764408 kB' 'Active(anon): 9562572 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479124 kB' 'Mapped: 182464 kB' 'Shmem: 9086600 kB' 'KReclaimable: 203636 kB' 'Slab: 728276 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524640 kB' 'KernelStack: 12784 kB' 'PageTables: 7648 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37083576 kB' 'Committed_AS: 10602268 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1536' 'HugePages_Free: 1536' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 3145728 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.605 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.605 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.606 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.606 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:46.606 04:06:37 -- setup/common.sh@33 -- # echo 1536 00:04:46.606 04:06:37 -- setup/common.sh@33 -- # return 0 00:04:46.606 04:06:37 -- setup/hugepages.sh@110 -- # (( 1536 == nr_hugepages + surp + resv )) 00:04:46.606 04:06:37 -- setup/hugepages.sh@112 -- # get_nodes 00:04:46.606 04:06:37 -- setup/hugepages.sh@27 -- # local node 00:04:46.606 04:06:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:46.606 04:06:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=512 00:04:46.606 04:06:37 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:46.606 04:06:37 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:46.606 04:06:37 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:46.606 04:06:37 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:46.606 04:06:37 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:46.607 04:06:37 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:46.607 04:06:37 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:46.607 04:06:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.607 04:06:37 -- setup/common.sh@18 -- # local node=0 00:04:46.607 04:06:37 -- setup/common.sh@19 -- # local var val 00:04:46.607 04:06:37 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.607 04:06:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.607 04:06:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:46.607 04:06:37 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:46.607 04:06:37 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.607 04:06:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 20432656 kB' 'MemUsed: 12442268 kB' 'SwapCached: 0 kB' 'Active: 6487616 kB' 'Inactive: 3601144 kB' 'Active(anon): 6353408 kB' 'Inactive(anon): 0 kB' 'Active(file): 134208 kB' 'Inactive(file): 3601144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9775336 kB' 'Mapped: 64440 kB' 'AnonPages: 316568 kB' 'Shmem: 6039984 kB' 'KernelStack: 7960 kB' 'PageTables: 4800 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132436 kB' 'Slab: 450944 kB' 'SReclaimable: 132436 kB' 'SUnreclaim: 318508 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 512' 'HugePages_Free: 512' 'HugePages_Surp: 0' 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.607 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.607 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@33 -- # echo 0 00:04:46.608 04:06:37 -- setup/common.sh@33 -- # return 0 00:04:46.608 04:06:37 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:46.608 04:06:37 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:46.608 04:06:37 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:46.608 04:06:37 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 1 00:04:46.608 04:06:37 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:46.608 04:06:37 -- setup/common.sh@18 -- # local node=1 00:04:46.608 04:06:37 -- setup/common.sh@19 -- # local var val 00:04:46.608 04:06:37 -- setup/common.sh@20 -- # local mem_f mem 00:04:46.608 04:06:37 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:46.608 04:06:37 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node1/meminfo ]] 00:04:46.608 04:06:37 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node1/meminfo 00:04:46.608 04:06:37 -- setup/common.sh@28 -- # mapfile -t mem 00:04:46.608 04:06:37 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 27660748 kB' 'MemFree: 21204636 kB' 'MemUsed: 6456112 kB' 'SwapCached: 0 kB' 'Active: 3476128 kB' 'Inactive: 163264 kB' 'Active(anon): 3209152 kB' 'Inactive(anon): 0 kB' 'Active(file): 266976 kB' 'Inactive(file): 163264 kB' 'Unevictable: 0 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 3476876 kB' 'Mapped: 118024 kB' 'AnonPages: 162548 kB' 'Shmem: 3046636 kB' 'KernelStack: 4808 kB' 'PageTables: 2848 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 71200 kB' 'Slab: 277328 kB' 'SReclaimable: 71200 kB' 'SUnreclaim: 206128 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.608 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.608 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # continue 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # IFS=': ' 00:04:46.609 04:06:37 -- setup/common.sh@31 -- # read -r var val _ 00:04:46.609 04:06:37 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:46.609 04:06:37 -- setup/common.sh@33 -- # echo 0 00:04:46.609 04:06:37 -- setup/common.sh@33 -- # return 0 00:04:46.609 04:06:37 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:46.609 04:06:37 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:46.609 04:06:37 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:46.609 04:06:37 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:46.609 04:06:37 -- setup/hugepages.sh@128 -- # echo 'node0=512 expecting 512' 00:04:46.609 node0=512 expecting 512 00:04:46.609 04:06:37 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:46.609 04:06:37 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:46.609 04:06:37 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:46.609 04:06:37 -- setup/hugepages.sh@128 -- # echo 'node1=1024 expecting 1024' 00:04:46.609 node1=1024 expecting 1024 00:04:46.609 04:06:37 -- setup/hugepages.sh@130 -- # [[ 512,1024 == \5\1\2\,\1\0\2\4 ]] 00:04:46.609 00:04:46.609 real 0m1.459s 00:04:46.609 user 0m0.633s 00:04:46.609 sys 0m0.794s 00:04:46.609 04:06:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:46.609 04:06:37 -- common/autotest_common.sh@10 -- # set +x 00:04:46.609 ************************************ 00:04:46.609 END TEST custom_alloc 00:04:46.609 ************************************ 00:04:46.867 04:06:37 -- setup/hugepages.sh@215 -- # run_test no_shrink_alloc no_shrink_alloc 00:04:46.867 04:06:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:46.867 04:06:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:46.867 04:06:37 -- common/autotest_common.sh@10 -- # set +x 00:04:46.867 ************************************ 00:04:46.867 START TEST no_shrink_alloc 00:04:46.867 ************************************ 00:04:46.867 04:06:37 -- common/autotest_common.sh@1114 -- # no_shrink_alloc 00:04:46.867 04:06:37 -- setup/hugepages.sh@195 -- # get_test_nr_hugepages 2097152 0 00:04:46.867 04:06:37 -- setup/hugepages.sh@49 -- # local size=2097152 00:04:46.867 04:06:37 -- setup/hugepages.sh@50 -- # (( 2 > 1 )) 00:04:46.867 04:06:37 -- setup/hugepages.sh@51 -- # shift 00:04:46.867 04:06:37 -- setup/hugepages.sh@52 -- # node_ids=('0') 00:04:46.867 04:06:37 -- setup/hugepages.sh@52 -- # local node_ids 00:04:46.867 04:06:37 -- setup/hugepages.sh@55 -- # (( size >= default_hugepages )) 00:04:46.867 04:06:37 -- setup/hugepages.sh@57 -- # nr_hugepages=1024 00:04:46.867 04:06:37 -- setup/hugepages.sh@58 -- # get_test_nr_hugepages_per_node 0 00:04:46.867 04:06:37 -- setup/hugepages.sh@62 -- # user_nodes=('0') 00:04:46.867 04:06:37 -- setup/hugepages.sh@62 -- # local user_nodes 00:04:46.867 04:06:37 -- setup/hugepages.sh@64 -- # local _nr_hugepages=1024 00:04:46.867 04:06:37 -- setup/hugepages.sh@65 -- # local _no_nodes=2 00:04:46.867 04:06:37 -- setup/hugepages.sh@67 -- # nodes_test=() 00:04:46.867 04:06:37 -- setup/hugepages.sh@67 -- # local -g nodes_test 00:04:46.867 04:06:37 -- setup/hugepages.sh@69 -- # (( 1 > 0 )) 00:04:46.867 04:06:37 -- setup/hugepages.sh@70 -- # for _no_nodes in "${user_nodes[@]}" 00:04:46.867 04:06:37 -- setup/hugepages.sh@71 -- # nodes_test[_no_nodes]=1024 00:04:46.867 04:06:37 -- setup/hugepages.sh@73 -- # return 0 00:04:46.867 04:06:37 -- setup/hugepages.sh@198 -- # setup output 00:04:46.867 04:06:37 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:46.867 04:06:37 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:47.803 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:47.803 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:47.803 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:47.803 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:47.803 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:47.803 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:47.803 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:47.803 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:47.803 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:47.803 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:47.803 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:47.803 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:47.803 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:47.803 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:47.803 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:47.803 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:47.803 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:48.065 04:06:38 -- setup/hugepages.sh@199 -- # verify_nr_hugepages 00:04:48.065 04:06:38 -- setup/hugepages.sh@89 -- # local node 00:04:48.065 04:06:38 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:48.065 04:06:38 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:48.065 04:06:38 -- setup/hugepages.sh@92 -- # local surp 00:04:48.065 04:06:38 -- setup/hugepages.sh@93 -- # local resv 00:04:48.065 04:06:38 -- setup/hugepages.sh@94 -- # local anon 00:04:48.065 04:06:38 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:48.065 04:06:38 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:48.065 04:06:38 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:48.065 04:06:38 -- setup/common.sh@18 -- # local node= 00:04:48.065 04:06:38 -- setup/common.sh@19 -- # local var val 00:04:48.065 04:06:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.065 04:06:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.065 04:06:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.065 04:06:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.065 04:06:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.065 04:06:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42672740 kB' 'MemAvailable: 46446328 kB' 'Buffers: 2708 kB' 'Cached: 13249548 kB' 'SwapCached: 0 kB' 'Active: 9963780 kB' 'Inactive: 3764408 kB' 'Active(anon): 9562596 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479188 kB' 'Mapped: 182584 kB' 'Shmem: 9086664 kB' 'KReclaimable: 203636 kB' 'Slab: 728280 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524644 kB' 'KernelStack: 12768 kB' 'PageTables: 7612 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10602448 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198392 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.065 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.065 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:48.066 04:06:38 -- setup/common.sh@33 -- # echo 0 00:04:48.066 04:06:38 -- setup/common.sh@33 -- # return 0 00:04:48.066 04:06:38 -- setup/hugepages.sh@97 -- # anon=0 00:04:48.066 04:06:38 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:48.066 04:06:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.066 04:06:38 -- setup/common.sh@18 -- # local node= 00:04:48.066 04:06:38 -- setup/common.sh@19 -- # local var val 00:04:48.066 04:06:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.066 04:06:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.066 04:06:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.066 04:06:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.066 04:06:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.066 04:06:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42673776 kB' 'MemAvailable: 46447364 kB' 'Buffers: 2708 kB' 'Cached: 13249552 kB' 'SwapCached: 0 kB' 'Active: 9964072 kB' 'Inactive: 3764408 kB' 'Active(anon): 9562888 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479516 kB' 'Mapped: 182544 kB' 'Shmem: 9086668 kB' 'KReclaimable: 203636 kB' 'Slab: 728264 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524628 kB' 'KernelStack: 12800 kB' 'PageTables: 7696 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10602456 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.066 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.066 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.067 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.067 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.067 04:06:38 -- setup/common.sh@33 -- # echo 0 00:04:48.067 04:06:38 -- setup/common.sh@33 -- # return 0 00:04:48.067 04:06:38 -- setup/hugepages.sh@99 -- # surp=0 00:04:48.067 04:06:38 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:48.067 04:06:38 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:48.067 04:06:38 -- setup/common.sh@18 -- # local node= 00:04:48.067 04:06:38 -- setup/common.sh@19 -- # local var val 00:04:48.067 04:06:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.067 04:06:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.068 04:06:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.068 04:06:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.068 04:06:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.068 04:06:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42674892 kB' 'MemAvailable: 46448480 kB' 'Buffers: 2708 kB' 'Cached: 13249560 kB' 'SwapCached: 0 kB' 'Active: 9963712 kB' 'Inactive: 3764408 kB' 'Active(anon): 9562528 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479072 kB' 'Mapped: 182468 kB' 'Shmem: 9086676 kB' 'KReclaimable: 203636 kB' 'Slab: 728256 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524620 kB' 'KernelStack: 12784 kB' 'PageTables: 7640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10602472 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.068 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.068 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:48.069 04:06:38 -- setup/common.sh@33 -- # echo 0 00:04:48.069 04:06:38 -- setup/common.sh@33 -- # return 0 00:04:48.069 04:06:38 -- setup/hugepages.sh@100 -- # resv=0 00:04:48.069 04:06:38 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:48.069 nr_hugepages=1024 00:04:48.069 04:06:38 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:48.069 resv_hugepages=0 00:04:48.069 04:06:38 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:48.069 surplus_hugepages=0 00:04:48.069 04:06:38 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:48.069 anon_hugepages=0 00:04:48.069 04:06:38 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:48.069 04:06:38 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:48.069 04:06:38 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:48.069 04:06:38 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:48.069 04:06:38 -- setup/common.sh@18 -- # local node= 00:04:48.069 04:06:38 -- setup/common.sh@19 -- # local var val 00:04:48.069 04:06:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.069 04:06:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.069 04:06:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:48.069 04:06:38 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:48.069 04:06:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.069 04:06:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42671844 kB' 'MemAvailable: 46445432 kB' 'Buffers: 2708 kB' 'Cached: 13249564 kB' 'SwapCached: 0 kB' 'Active: 9963832 kB' 'Inactive: 3764408 kB' 'Active(anon): 9562648 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479184 kB' 'Mapped: 182468 kB' 'Shmem: 9086680 kB' 'KReclaimable: 203636 kB' 'Slab: 728256 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524620 kB' 'KernelStack: 12784 kB' 'PageTables: 7640 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10602488 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198360 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.069 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.069 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.070 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.070 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:48.070 04:06:38 -- setup/common.sh@33 -- # echo 1024 00:04:48.070 04:06:38 -- setup/common.sh@33 -- # return 0 00:04:48.070 04:06:38 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:48.070 04:06:38 -- setup/hugepages.sh@112 -- # get_nodes 00:04:48.071 04:06:38 -- setup/hugepages.sh@27 -- # local node 00:04:48.071 04:06:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.071 04:06:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:48.071 04:06:38 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:48.071 04:06:38 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:48.071 04:06:38 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:48.071 04:06:38 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:48.071 04:06:38 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:48.071 04:06:38 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:48.071 04:06:38 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:48.071 04:06:38 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:48.071 04:06:38 -- setup/common.sh@18 -- # local node=0 00:04:48.071 04:06:38 -- setup/common.sh@19 -- # local var val 00:04:48.071 04:06:38 -- setup/common.sh@20 -- # local mem_f mem 00:04:48.071 04:06:38 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:48.071 04:06:38 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:48.071 04:06:38 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:48.071 04:06:38 -- setup/common.sh@28 -- # mapfile -t mem 00:04:48.071 04:06:38 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19366648 kB' 'MemUsed: 13508276 kB' 'SwapCached: 0 kB' 'Active: 6487192 kB' 'Inactive: 3601144 kB' 'Active(anon): 6352984 kB' 'Inactive(anon): 0 kB' 'Active(file): 134208 kB' 'Inactive(file): 3601144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9775420 kB' 'Mapped: 64444 kB' 'AnonPages: 316056 kB' 'Shmem: 6040068 kB' 'KernelStack: 7928 kB' 'PageTables: 4652 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132436 kB' 'Slab: 450824 kB' 'SReclaimable: 132436 kB' 'SUnreclaim: 318388 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.071 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.071 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.072 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.072 04:06:38 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.072 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.072 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.072 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.072 04:06:38 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.072 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.072 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.072 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.072 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.072 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.072 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.072 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.072 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.072 04:06:38 -- setup/common.sh@32 -- # continue 00:04:48.072 04:06:38 -- setup/common.sh@31 -- # IFS=': ' 00:04:48.072 04:06:38 -- setup/common.sh@31 -- # read -r var val _ 00:04:48.072 04:06:38 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:48.072 04:06:38 -- setup/common.sh@33 -- # echo 0 00:04:48.072 04:06:38 -- setup/common.sh@33 -- # return 0 00:04:48.072 04:06:38 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:48.072 04:06:38 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:48.072 04:06:38 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:48.072 04:06:38 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:48.072 04:06:38 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:48.072 node0=1024 expecting 1024 00:04:48.072 04:06:38 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:48.072 04:06:38 -- setup/hugepages.sh@202 -- # CLEAR_HUGE=no 00:04:48.072 04:06:38 -- setup/hugepages.sh@202 -- # NRHUGE=512 00:04:48.072 04:06:38 -- setup/hugepages.sh@202 -- # setup output 00:04:48.072 04:06:38 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:48.072 04:06:38 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:04:49.454 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:49.454 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:04:49.454 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:49.454 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:49.454 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:49.454 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:49.454 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:49.454 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:49.454 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:49.454 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:04:49.454 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:04:49.454 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:04:49.454 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:04:49.454 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:04:49.454 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:04:49.454 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:04:49.454 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:04:49.454 INFO: Requested 512 hugepages but 1024 already allocated on node0 00:04:49.454 04:06:39 -- setup/hugepages.sh@204 -- # verify_nr_hugepages 00:04:49.454 04:06:39 -- setup/hugepages.sh@89 -- # local node 00:04:49.454 04:06:39 -- setup/hugepages.sh@90 -- # local sorted_t 00:04:49.454 04:06:39 -- setup/hugepages.sh@91 -- # local sorted_s 00:04:49.454 04:06:39 -- setup/hugepages.sh@92 -- # local surp 00:04:49.454 04:06:39 -- setup/hugepages.sh@93 -- # local resv 00:04:49.454 04:06:39 -- setup/hugepages.sh@94 -- # local anon 00:04:49.454 04:06:39 -- setup/hugepages.sh@96 -- # [[ always [madvise] never != *\[\n\e\v\e\r\]* ]] 00:04:49.454 04:06:39 -- setup/hugepages.sh@97 -- # get_meminfo AnonHugePages 00:04:49.454 04:06:39 -- setup/common.sh@17 -- # local get=AnonHugePages 00:04:49.454 04:06:39 -- setup/common.sh@18 -- # local node= 00:04:49.454 04:06:39 -- setup/common.sh@19 -- # local var val 00:04:49.454 04:06:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.454 04:06:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.454 04:06:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.454 04:06:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.454 04:06:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.454 04:06:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42675352 kB' 'MemAvailable: 46448940 kB' 'Buffers: 2708 kB' 'Cached: 13249624 kB' 'SwapCached: 0 kB' 'Active: 9964752 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563568 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479960 kB' 'Mapped: 182580 kB' 'Shmem: 9086740 kB' 'KReclaimable: 203636 kB' 'Slab: 728224 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524588 kB' 'KernelStack: 12800 kB' 'PageTables: 7660 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10602652 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ MemTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ MemFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ MemAvailable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Buffers == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Cached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ SwapCached == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Active == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Inactive == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Active(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Active(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Unevictable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Mlocked == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ SwapTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ SwapFree == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Zswap == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Zswapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Dirty == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Writeback == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ AnonPages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Mapped == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.454 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.454 04:06:39 -- setup/common.sh@32 -- # [[ Shmem == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ KReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Slab == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ SReclaimable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ KernelStack == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ PageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ SecPageTables == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Bounce == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ CommitLimit == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Committed_AS == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Percpu == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \A\n\o\n\H\u\g\e\P\a\g\e\s ]] 00:04:49.455 04:06:39 -- setup/common.sh@33 -- # echo 0 00:04:49.455 04:06:39 -- setup/common.sh@33 -- # return 0 00:04:49.455 04:06:39 -- setup/hugepages.sh@97 -- # anon=0 00:04:49.455 04:06:39 -- setup/hugepages.sh@99 -- # get_meminfo HugePages_Surp 00:04:49.455 04:06:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.455 04:06:39 -- setup/common.sh@18 -- # local node= 00:04:49.455 04:06:39 -- setup/common.sh@19 -- # local var val 00:04:49.455 04:06:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.455 04:06:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.455 04:06:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.455 04:06:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.455 04:06:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.455 04:06:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42677556 kB' 'MemAvailable: 46451144 kB' 'Buffers: 2708 kB' 'Cached: 13249628 kB' 'SwapCached: 0 kB' 'Active: 9964316 kB' 'Inactive: 3764408 kB' 'Active(anon): 9563132 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479508 kB' 'Mapped: 182556 kB' 'Shmem: 9086744 kB' 'KReclaimable: 203636 kB' 'Slab: 728200 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524564 kB' 'KernelStack: 12816 kB' 'PageTables: 7588 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10602664 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.455 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.455 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.456 04:06:39 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.456 04:06:39 -- setup/common.sh@33 -- # echo 0 00:04:49.456 04:06:39 -- setup/common.sh@33 -- # return 0 00:04:49.456 04:06:39 -- setup/hugepages.sh@99 -- # surp=0 00:04:49.456 04:06:39 -- setup/hugepages.sh@100 -- # get_meminfo HugePages_Rsvd 00:04:49.456 04:06:39 -- setup/common.sh@17 -- # local get=HugePages_Rsvd 00:04:49.456 04:06:39 -- setup/common.sh@18 -- # local node= 00:04:49.456 04:06:39 -- setup/common.sh@19 -- # local var val 00:04:49.456 04:06:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.456 04:06:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.456 04:06:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.456 04:06:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.456 04:06:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.456 04:06:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.456 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42678584 kB' 'MemAvailable: 46452172 kB' 'Buffers: 2708 kB' 'Cached: 13249640 kB' 'SwapCached: 0 kB' 'Active: 9964140 kB' 'Inactive: 3764408 kB' 'Active(anon): 9562956 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 479304 kB' 'Mapped: 182480 kB' 'Shmem: 9086756 kB' 'KReclaimable: 203636 kB' 'Slab: 728184 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524548 kB' 'KernelStack: 12800 kB' 'PageTables: 7536 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10602676 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198376 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.457 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.457 04:06:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ HugePages_Rsvd == \H\u\g\e\P\a\g\e\s\_\R\s\v\d ]] 00:04:49.458 04:06:39 -- setup/common.sh@33 -- # echo 0 00:04:49.458 04:06:39 -- setup/common.sh@33 -- # return 0 00:04:49.458 04:06:39 -- setup/hugepages.sh@100 -- # resv=0 00:04:49.458 04:06:39 -- setup/hugepages.sh@102 -- # echo nr_hugepages=1024 00:04:49.458 nr_hugepages=1024 00:04:49.458 04:06:39 -- setup/hugepages.sh@103 -- # echo resv_hugepages=0 00:04:49.458 resv_hugepages=0 00:04:49.458 04:06:39 -- setup/hugepages.sh@104 -- # echo surplus_hugepages=0 00:04:49.458 surplus_hugepages=0 00:04:49.458 04:06:39 -- setup/hugepages.sh@105 -- # echo anon_hugepages=0 00:04:49.458 anon_hugepages=0 00:04:49.458 04:06:39 -- setup/hugepages.sh@107 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:49.458 04:06:39 -- setup/hugepages.sh@109 -- # (( 1024 == nr_hugepages )) 00:04:49.458 04:06:39 -- setup/hugepages.sh@110 -- # get_meminfo HugePages_Total 00:04:49.458 04:06:39 -- setup/common.sh@17 -- # local get=HugePages_Total 00:04:49.458 04:06:39 -- setup/common.sh@18 -- # local node= 00:04:49.458 04:06:39 -- setup/common.sh@19 -- # local var val 00:04:49.458 04:06:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.458 04:06:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.458 04:06:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node/meminfo ]] 00:04:49.458 04:06:39 -- setup/common.sh@25 -- # [[ -n '' ]] 00:04:49.458 04:06:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.458 04:06:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 60535672 kB' 'MemFree: 42677060 kB' 'MemAvailable: 46450648 kB' 'Buffers: 2708 kB' 'Cached: 13249652 kB' 'SwapCached: 0 kB' 'Active: 9965688 kB' 'Inactive: 3764408 kB' 'Active(anon): 9564504 kB' 'Inactive(anon): 0 kB' 'Active(file): 401184 kB' 'Inactive(file): 3764408 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'SwapTotal: 8388604 kB' 'SwapFree: 8388604 kB' 'Zswap: 0 kB' 'Zswapped: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'AnonPages: 480876 kB' 'Mapped: 182484 kB' 'Shmem: 9086768 kB' 'KReclaimable: 203636 kB' 'Slab: 728184 kB' 'SReclaimable: 203636 kB' 'SUnreclaim: 524548 kB' 'KernelStack: 12960 kB' 'PageTables: 7708 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'CommitLimit: 37607864 kB' 'Committed_AS: 10605592 kB' 'VmallocTotal: 34359738367 kB' 'VmallocUsed: 198408 kB' 'VmallocChunk: 0 kB' 'Percpu: 34560 kB' 'HardwareCorrupted: 0 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'CmaTotal: 0 kB' 'CmaFree: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Rsvd: 0' 'HugePages_Surp: 0' 'Hugepagesize: 2048 kB' 'Hugetlb: 2097152 kB' 'DirectMap4k: 1955420 kB' 'DirectMap2M: 13692928 kB' 'DirectMap1G: 54525952 kB' 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ MemAvailable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ Buffers == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ Cached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.458 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.458 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ SwapTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ SwapFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Zswap == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Zswapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ CommitLimit == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Committed_AS == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ VmallocTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ VmallocUsed == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ VmallocChunk == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Percpu == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ HardwareCorrupted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ CmaTotal == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ CmaFree == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.459 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.459 04:06:39 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\T\o\t\a\l ]] 00:04:49.459 04:06:39 -- setup/common.sh@33 -- # echo 1024 00:04:49.459 04:06:39 -- setup/common.sh@33 -- # return 0 00:04:49.459 04:06:39 -- setup/hugepages.sh@110 -- # (( 1024 == nr_hugepages + surp + resv )) 00:04:49.459 04:06:39 -- setup/hugepages.sh@112 -- # get_nodes 00:04:49.459 04:06:39 -- setup/hugepages.sh@27 -- # local node 00:04:49.459 04:06:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.459 04:06:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=1024 00:04:49.459 04:06:39 -- setup/hugepages.sh@29 -- # for node in /sys/devices/system/node/node+([0-9]) 00:04:49.459 04:06:39 -- setup/hugepages.sh@30 -- # nodes_sys[${node##*node}]=0 00:04:49.459 04:06:39 -- setup/hugepages.sh@32 -- # no_nodes=2 00:04:49.459 04:06:39 -- setup/hugepages.sh@33 -- # (( no_nodes > 0 )) 00:04:49.459 04:06:39 -- setup/hugepages.sh@115 -- # for node in "${!nodes_test[@]}" 00:04:49.459 04:06:39 -- setup/hugepages.sh@116 -- # (( nodes_test[node] += resv )) 00:04:49.460 04:06:39 -- setup/hugepages.sh@117 -- # get_meminfo HugePages_Surp 0 00:04:49.460 04:06:39 -- setup/common.sh@17 -- # local get=HugePages_Surp 00:04:49.460 04:06:39 -- setup/common.sh@18 -- # local node=0 00:04:49.460 04:06:39 -- setup/common.sh@19 -- # local var val 00:04:49.460 04:06:39 -- setup/common.sh@20 -- # local mem_f mem 00:04:49.460 04:06:39 -- setup/common.sh@22 -- # mem_f=/proc/meminfo 00:04:49.460 04:06:39 -- setup/common.sh@23 -- # [[ -e /sys/devices/system/node/node0/meminfo ]] 00:04:49.460 04:06:39 -- setup/common.sh@24 -- # mem_f=/sys/devices/system/node/node0/meminfo 00:04:49.460 04:06:39 -- setup/common.sh@28 -- # mapfile -t mem 00:04:49.460 04:06:39 -- setup/common.sh@29 -- # mem=("${mem[@]#Node +([0-9]) }") 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@16 -- # printf '%s\n' 'MemTotal: 32874924 kB' 'MemFree: 19376612 kB' 'MemUsed: 13498312 kB' 'SwapCached: 0 kB' 'Active: 6488476 kB' 'Inactive: 3601144 kB' 'Active(anon): 6354268 kB' 'Inactive(anon): 0 kB' 'Active(file): 134208 kB' 'Inactive(file): 3601144 kB' 'Unevictable: 3072 kB' 'Mlocked: 0 kB' 'Dirty: 0 kB' 'Writeback: 0 kB' 'FilePages: 9775492 kB' 'Mapped: 64452 kB' 'AnonPages: 317252 kB' 'Shmem: 6040140 kB' 'KernelStack: 8216 kB' 'PageTables: 5280 kB' 'SecPageTables: 0 kB' 'NFS_Unstable: 0 kB' 'Bounce: 0 kB' 'WritebackTmp: 0 kB' 'KReclaimable: 132436 kB' 'Slab: 450736 kB' 'SReclaimable: 132436 kB' 'SUnreclaim: 318300 kB' 'AnonHugePages: 0 kB' 'ShmemHugePages: 0 kB' 'ShmemPmdMapped: 0 kB' 'FileHugePages: 0 kB' 'FilePmdMapped: 0 kB' 'Unaccepted: 0 kB' 'HugePages_Total: 1024' 'HugePages_Free: 1024' 'HugePages_Surp: 0' 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ MemTotal == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ MemFree == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ MemUsed == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ SwapCached == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Active == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Inactive == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Active(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Inactive(anon) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Active(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Inactive(file) == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Unevictable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Mlocked == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Dirty == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Writeback == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ FilePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Mapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ AnonPages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Shmem == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ KernelStack == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ PageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ SecPageTables == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ NFS_Unstable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:39 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # [[ Bounce == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:39 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ WritebackTmp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ KReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ Slab == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ SReclaimable == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ SUnreclaim == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ AnonHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ ShmemHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ ShmemPmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ FileHugePages == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ FilePmdMapped == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ Unaccepted == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # [[ HugePages_Total == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.460 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.460 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.461 04:06:40 -- setup/common.sh@32 -- # [[ HugePages_Free == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.461 04:06:40 -- setup/common.sh@32 -- # continue 00:04:49.461 04:06:40 -- setup/common.sh@31 -- # IFS=': ' 00:04:49.461 04:06:40 -- setup/common.sh@31 -- # read -r var val _ 00:04:49.461 04:06:40 -- setup/common.sh@32 -- # [[ HugePages_Surp == \H\u\g\e\P\a\g\e\s\_\S\u\r\p ]] 00:04:49.461 04:06:40 -- setup/common.sh@33 -- # echo 0 00:04:49.461 04:06:40 -- setup/common.sh@33 -- # return 0 00:04:49.461 04:06:40 -- setup/hugepages.sh@117 -- # (( nodes_test[node] += 0 )) 00:04:49.461 04:06:40 -- setup/hugepages.sh@126 -- # for node in "${!nodes_test[@]}" 00:04:49.461 04:06:40 -- setup/hugepages.sh@127 -- # sorted_t[nodes_test[node]]=1 00:04:49.461 04:06:40 -- setup/hugepages.sh@127 -- # sorted_s[nodes_sys[node]]=1 00:04:49.461 04:06:40 -- setup/hugepages.sh@128 -- # echo 'node0=1024 expecting 1024' 00:04:49.461 node0=1024 expecting 1024 00:04:49.461 04:06:40 -- setup/hugepages.sh@130 -- # [[ 1024 == \1\0\2\4 ]] 00:04:49.461 00:04:49.461 real 0m2.770s 00:04:49.461 user 0m1.126s 00:04:49.461 sys 0m1.567s 00:04:49.461 04:06:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.461 04:06:40 -- common/autotest_common.sh@10 -- # set +x 00:04:49.461 ************************************ 00:04:49.461 END TEST no_shrink_alloc 00:04:49.461 ************************************ 00:04:49.461 04:06:40 -- setup/hugepages.sh@217 -- # clear_hp 00:04:49.461 04:06:40 -- setup/hugepages.sh@37 -- # local node hp 00:04:49.461 04:06:40 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:49.461 04:06:40 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.461 04:06:40 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.461 04:06:40 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.461 04:06:40 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.461 04:06:40 -- setup/hugepages.sh@39 -- # for node in "${!nodes_sys[@]}" 00:04:49.461 04:06:40 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.461 04:06:40 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.461 04:06:40 -- setup/hugepages.sh@40 -- # for hp in "/sys/devices/system/node/node$node/hugepages/hugepages-"* 00:04:49.461 04:06:40 -- setup/hugepages.sh@41 -- # echo 0 00:04:49.461 04:06:40 -- setup/hugepages.sh@45 -- # export CLEAR_HUGE=yes 00:04:49.461 04:06:40 -- setup/hugepages.sh@45 -- # CLEAR_HUGE=yes 00:04:49.461 00:04:49.461 real 0m11.538s 00:04:49.461 user 0m4.409s 00:04:49.461 sys 0m6.023s 00:04:49.461 04:06:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:49.461 04:06:40 -- common/autotest_common.sh@10 -- # set +x 00:04:49.461 ************************************ 00:04:49.461 END TEST hugepages 00:04:49.461 ************************************ 00:04:49.461 04:06:40 -- setup/test-setup.sh@14 -- # run_test driver /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:49.461 04:06:40 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:49.461 04:06:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:49.461 04:06:40 -- common/autotest_common.sh@10 -- # set +x 00:04:49.461 ************************************ 00:04:49.461 START TEST driver 00:04:49.461 ************************************ 00:04:49.461 04:06:40 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/driver.sh 00:04:49.776 * Looking for test storage... 00:04:49.776 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:49.776 04:06:40 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:49.776 04:06:40 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:49.776 04:06:40 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:49.776 04:06:40 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:49.776 04:06:40 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:49.776 04:06:40 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:49.776 04:06:40 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:49.776 04:06:40 -- scripts/common.sh@335 -- # IFS=.-: 00:04:49.776 04:06:40 -- scripts/common.sh@335 -- # read -ra ver1 00:04:49.776 04:06:40 -- scripts/common.sh@336 -- # IFS=.-: 00:04:49.776 04:06:40 -- scripts/common.sh@336 -- # read -ra ver2 00:04:49.776 04:06:40 -- scripts/common.sh@337 -- # local 'op=<' 00:04:49.776 04:06:40 -- scripts/common.sh@339 -- # ver1_l=2 00:04:49.776 04:06:40 -- scripts/common.sh@340 -- # ver2_l=1 00:04:49.776 04:06:40 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:49.776 04:06:40 -- scripts/common.sh@343 -- # case "$op" in 00:04:49.776 04:06:40 -- scripts/common.sh@344 -- # : 1 00:04:49.776 04:06:40 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:49.776 04:06:40 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:49.776 04:06:40 -- scripts/common.sh@364 -- # decimal 1 00:04:49.776 04:06:40 -- scripts/common.sh@352 -- # local d=1 00:04:49.776 04:06:40 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:49.776 04:06:40 -- scripts/common.sh@354 -- # echo 1 00:04:49.776 04:06:40 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:49.776 04:06:40 -- scripts/common.sh@365 -- # decimal 2 00:04:49.776 04:06:40 -- scripts/common.sh@352 -- # local d=2 00:04:49.776 04:06:40 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:49.776 04:06:40 -- scripts/common.sh@354 -- # echo 2 00:04:49.776 04:06:40 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:49.776 04:06:40 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:49.776 04:06:40 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:49.776 04:06:40 -- scripts/common.sh@367 -- # return 0 00:04:49.776 04:06:40 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:49.776 04:06:40 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:49.776 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.776 --rc genhtml_branch_coverage=1 00:04:49.776 --rc genhtml_function_coverage=1 00:04:49.776 --rc genhtml_legend=1 00:04:49.776 --rc geninfo_all_blocks=1 00:04:49.776 --rc geninfo_unexecuted_blocks=1 00:04:49.776 00:04:49.776 ' 00:04:49.776 04:06:40 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:49.776 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.776 --rc genhtml_branch_coverage=1 00:04:49.776 --rc genhtml_function_coverage=1 00:04:49.776 --rc genhtml_legend=1 00:04:49.776 --rc geninfo_all_blocks=1 00:04:49.776 --rc geninfo_unexecuted_blocks=1 00:04:49.776 00:04:49.776 ' 00:04:49.776 04:06:40 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:49.776 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.776 --rc genhtml_branch_coverage=1 00:04:49.776 --rc genhtml_function_coverage=1 00:04:49.776 --rc genhtml_legend=1 00:04:49.776 --rc geninfo_all_blocks=1 00:04:49.776 --rc geninfo_unexecuted_blocks=1 00:04:49.776 00:04:49.776 ' 00:04:49.776 04:06:40 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:49.776 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:49.776 --rc genhtml_branch_coverage=1 00:04:49.776 --rc genhtml_function_coverage=1 00:04:49.776 --rc genhtml_legend=1 00:04:49.776 --rc geninfo_all_blocks=1 00:04:49.776 --rc geninfo_unexecuted_blocks=1 00:04:49.776 00:04:49.776 ' 00:04:49.777 04:06:40 -- setup/driver.sh@68 -- # setup reset 00:04:49.777 04:06:40 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:49.777 04:06:40 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:52.332 04:06:42 -- setup/driver.sh@69 -- # run_test guess_driver guess_driver 00:04:52.332 04:06:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:52.332 04:06:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:52.332 04:06:42 -- common/autotest_common.sh@10 -- # set +x 00:04:52.332 ************************************ 00:04:52.332 START TEST guess_driver 00:04:52.332 ************************************ 00:04:52.332 04:06:42 -- common/autotest_common.sh@1114 -- # guess_driver 00:04:52.332 04:06:42 -- setup/driver.sh@46 -- # local driver setup_driver marker 00:04:52.332 04:06:42 -- setup/driver.sh@47 -- # local fail=0 00:04:52.332 04:06:42 -- setup/driver.sh@49 -- # pick_driver 00:04:52.332 04:06:42 -- setup/driver.sh@36 -- # vfio 00:04:52.332 04:06:42 -- setup/driver.sh@21 -- # local iommu_grups 00:04:52.332 04:06:42 -- setup/driver.sh@22 -- # local unsafe_vfio 00:04:52.332 04:06:42 -- setup/driver.sh@24 -- # [[ -e /sys/module/vfio/parameters/enable_unsafe_noiommu_mode ]] 00:04:52.332 04:06:42 -- setup/driver.sh@25 -- # unsafe_vfio=N 00:04:52.332 04:06:42 -- setup/driver.sh@27 -- # iommu_groups=(/sys/kernel/iommu_groups/*) 00:04:52.332 04:06:42 -- setup/driver.sh@29 -- # (( 141 > 0 )) 00:04:52.332 04:06:42 -- setup/driver.sh@30 -- # is_driver vfio_pci 00:04:52.332 04:06:42 -- setup/driver.sh@14 -- # mod vfio_pci 00:04:52.332 04:06:42 -- setup/driver.sh@12 -- # dep vfio_pci 00:04:52.332 04:06:42 -- setup/driver.sh@11 -- # modprobe --show-depends vfio_pci 00:04:52.332 04:06:42 -- setup/driver.sh@12 -- # [[ insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/virt/lib/irqbypass.ko.xz 00:04:52.332 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:52.332 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:52.332 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/iommu/iommufd/iommufd.ko.xz 00:04:52.332 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio.ko.xz 00:04:52.332 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/vfio_iommu_type1.ko.xz 00:04:52.332 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci-core.ko.xz 00:04:52.332 insmod /lib/modules/6.8.9-200.fc39.x86_64/kernel/drivers/vfio/pci/vfio-pci.ko.xz == *\.\k\o* ]] 00:04:52.332 04:06:42 -- setup/driver.sh@30 -- # return 0 00:04:52.332 04:06:42 -- setup/driver.sh@37 -- # echo vfio-pci 00:04:52.332 04:06:42 -- setup/driver.sh@49 -- # driver=vfio-pci 00:04:52.332 04:06:42 -- setup/driver.sh@51 -- # [[ vfio-pci == \N\o\ \v\a\l\i\d\ \d\r\i\v\e\r\ \f\o\u\n\d ]] 00:04:52.332 04:06:42 -- setup/driver.sh@56 -- # echo 'Looking for driver=vfio-pci' 00:04:52.332 Looking for driver=vfio-pci 00:04:52.332 04:06:42 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:52.332 04:06:42 -- setup/driver.sh@45 -- # setup output config 00:04:52.332 04:06:42 -- setup/common.sh@9 -- # [[ output == output ]] 00:04:52.332 04:06:42 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:04:53.268 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.268 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.268 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:43 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:43 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:43 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:53.527 04:06:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:53.527 04:06:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:53.527 04:06:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.462 04:06:44 -- setup/driver.sh@58 -- # [[ -> == \-\> ]] 00:04:54.462 04:06:44 -- setup/driver.sh@61 -- # [[ vfio-pci == vfio-pci ]] 00:04:54.462 04:06:44 -- setup/driver.sh@57 -- # read -r _ _ _ _ marker setup_driver 00:04:54.462 04:06:45 -- setup/driver.sh@64 -- # (( fail == 0 )) 00:04:54.462 04:06:45 -- setup/driver.sh@65 -- # setup reset 00:04:54.462 04:06:45 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:54.462 04:06:45 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:56.990 00:04:56.990 real 0m4.751s 00:04:56.990 user 0m1.082s 00:04:56.990 sys 0m1.850s 00:04:56.990 04:06:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.990 04:06:47 -- common/autotest_common.sh@10 -- # set +x 00:04:56.990 ************************************ 00:04:56.990 END TEST guess_driver 00:04:56.990 ************************************ 00:04:56.990 00:04:56.990 real 0m7.469s 00:04:56.990 user 0m1.738s 00:04:56.990 sys 0m2.989s 00:04:56.990 04:06:47 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:04:56.990 04:06:47 -- common/autotest_common.sh@10 -- # set +x 00:04:56.990 ************************************ 00:04:56.990 END TEST driver 00:04:56.990 ************************************ 00:04:56.990 04:06:47 -- setup/test-setup.sh@15 -- # run_test devices /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:56.990 04:06:47 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:56.990 04:06:47 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:56.990 04:06:47 -- common/autotest_common.sh@10 -- # set +x 00:04:56.990 ************************************ 00:04:56.990 START TEST devices 00:04:56.990 ************************************ 00:04:56.990 04:06:47 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/devices.sh 00:04:56.990 * Looking for test storage... 00:04:56.991 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup 00:04:56.991 04:06:47 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:04:56.991 04:06:47 -- common/autotest_common.sh@1690 -- # lcov --version 00:04:56.991 04:06:47 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:04:57.249 04:06:47 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:04:57.249 04:06:47 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:04:57.249 04:06:47 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:04:57.249 04:06:47 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:04:57.249 04:06:47 -- scripts/common.sh@335 -- # IFS=.-: 00:04:57.249 04:06:47 -- scripts/common.sh@335 -- # read -ra ver1 00:04:57.249 04:06:47 -- scripts/common.sh@336 -- # IFS=.-: 00:04:57.249 04:06:47 -- scripts/common.sh@336 -- # read -ra ver2 00:04:57.249 04:06:47 -- scripts/common.sh@337 -- # local 'op=<' 00:04:57.249 04:06:47 -- scripts/common.sh@339 -- # ver1_l=2 00:04:57.249 04:06:47 -- scripts/common.sh@340 -- # ver2_l=1 00:04:57.249 04:06:47 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:04:57.249 04:06:47 -- scripts/common.sh@343 -- # case "$op" in 00:04:57.249 04:06:47 -- scripts/common.sh@344 -- # : 1 00:04:57.249 04:06:47 -- scripts/common.sh@363 -- # (( v = 0 )) 00:04:57.249 04:06:47 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:04:57.249 04:06:47 -- scripts/common.sh@364 -- # decimal 1 00:04:57.249 04:06:47 -- scripts/common.sh@352 -- # local d=1 00:04:57.249 04:06:47 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:04:57.249 04:06:47 -- scripts/common.sh@354 -- # echo 1 00:04:57.249 04:06:47 -- scripts/common.sh@364 -- # ver1[v]=1 00:04:57.249 04:06:47 -- scripts/common.sh@365 -- # decimal 2 00:04:57.249 04:06:47 -- scripts/common.sh@352 -- # local d=2 00:04:57.249 04:06:47 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:04:57.249 04:06:47 -- scripts/common.sh@354 -- # echo 2 00:04:57.249 04:06:47 -- scripts/common.sh@365 -- # ver2[v]=2 00:04:57.249 04:06:47 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:04:57.249 04:06:47 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:04:57.249 04:06:47 -- scripts/common.sh@367 -- # return 0 00:04:57.249 04:06:47 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:04:57.249 04:06:47 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:04:57.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.249 --rc genhtml_branch_coverage=1 00:04:57.249 --rc genhtml_function_coverage=1 00:04:57.249 --rc genhtml_legend=1 00:04:57.249 --rc geninfo_all_blocks=1 00:04:57.249 --rc geninfo_unexecuted_blocks=1 00:04:57.249 00:04:57.249 ' 00:04:57.249 04:06:47 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:04:57.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.249 --rc genhtml_branch_coverage=1 00:04:57.249 --rc genhtml_function_coverage=1 00:04:57.249 --rc genhtml_legend=1 00:04:57.249 --rc geninfo_all_blocks=1 00:04:57.249 --rc geninfo_unexecuted_blocks=1 00:04:57.249 00:04:57.250 ' 00:04:57.250 04:06:47 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:04:57.250 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.250 --rc genhtml_branch_coverage=1 00:04:57.250 --rc genhtml_function_coverage=1 00:04:57.250 --rc genhtml_legend=1 00:04:57.250 --rc geninfo_all_blocks=1 00:04:57.250 --rc geninfo_unexecuted_blocks=1 00:04:57.250 00:04:57.250 ' 00:04:57.250 04:06:47 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:04:57.250 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:04:57.250 --rc genhtml_branch_coverage=1 00:04:57.250 --rc genhtml_function_coverage=1 00:04:57.250 --rc genhtml_legend=1 00:04:57.250 --rc geninfo_all_blocks=1 00:04:57.250 --rc geninfo_unexecuted_blocks=1 00:04:57.250 00:04:57.250 ' 00:04:57.250 04:06:47 -- setup/devices.sh@190 -- # trap cleanup EXIT 00:04:57.250 04:06:47 -- setup/devices.sh@192 -- # setup reset 00:04:57.250 04:06:47 -- setup/common.sh@9 -- # [[ reset == output ]] 00:04:57.250 04:06:47 -- setup/common.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:04:58.625 04:06:49 -- setup/devices.sh@194 -- # get_zoned_devs 00:04:58.625 04:06:49 -- common/autotest_common.sh@1664 -- # zoned_devs=() 00:04:58.625 04:06:49 -- common/autotest_common.sh@1664 -- # local -gA zoned_devs 00:04:58.625 04:06:49 -- common/autotest_common.sh@1665 -- # local nvme bdf 00:04:58.625 04:06:49 -- common/autotest_common.sh@1667 -- # for nvme in /sys/block/nvme* 00:04:58.625 04:06:49 -- common/autotest_common.sh@1668 -- # is_block_zoned nvme0n1 00:04:58.625 04:06:49 -- common/autotest_common.sh@1657 -- # local device=nvme0n1 00:04:58.625 04:06:49 -- common/autotest_common.sh@1659 -- # [[ -e /sys/block/nvme0n1/queue/zoned ]] 00:04:58.625 04:06:49 -- common/autotest_common.sh@1660 -- # [[ none != none ]] 00:04:58.625 04:06:49 -- setup/devices.sh@196 -- # blocks=() 00:04:58.625 04:06:49 -- setup/devices.sh@196 -- # declare -a blocks 00:04:58.625 04:06:49 -- setup/devices.sh@197 -- # blocks_to_pci=() 00:04:58.625 04:06:49 -- setup/devices.sh@197 -- # declare -A blocks_to_pci 00:04:58.625 04:06:49 -- setup/devices.sh@198 -- # min_disk_size=3221225472 00:04:58.625 04:06:49 -- setup/devices.sh@200 -- # for block in "/sys/block/nvme"!(*c*) 00:04:58.625 04:06:49 -- setup/devices.sh@201 -- # ctrl=nvme0n1 00:04:58.625 04:06:49 -- setup/devices.sh@201 -- # ctrl=nvme0 00:04:58.625 04:06:49 -- setup/devices.sh@202 -- # pci=0000:88:00.0 00:04:58.625 04:06:49 -- setup/devices.sh@203 -- # [[ '' == *\0\0\0\0\:\8\8\:\0\0\.\0* ]] 00:04:58.625 04:06:49 -- setup/devices.sh@204 -- # block_in_use nvme0n1 00:04:58.625 04:06:49 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:04:58.625 04:06:49 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:04:58.625 No valid GPT data, bailing 00:04:58.625 04:06:49 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:04:58.625 04:06:49 -- scripts/common.sh@393 -- # pt= 00:04:58.625 04:06:49 -- scripts/common.sh@394 -- # return 1 00:04:58.625 04:06:49 -- setup/devices.sh@204 -- # sec_size_to_bytes nvme0n1 00:04:58.625 04:06:49 -- setup/common.sh@76 -- # local dev=nvme0n1 00:04:58.625 04:06:49 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:04:58.625 04:06:49 -- setup/common.sh@80 -- # echo 1000204886016 00:04:58.625 04:06:49 -- setup/devices.sh@204 -- # (( 1000204886016 >= min_disk_size )) 00:04:58.625 04:06:49 -- setup/devices.sh@205 -- # blocks+=("${block##*/}") 00:04:58.625 04:06:49 -- setup/devices.sh@206 -- # blocks_to_pci["${block##*/}"]=0000:88:00.0 00:04:58.625 04:06:49 -- setup/devices.sh@209 -- # (( 1 > 0 )) 00:04:58.625 04:06:49 -- setup/devices.sh@211 -- # declare -r test_disk=nvme0n1 00:04:58.625 04:06:49 -- setup/devices.sh@213 -- # run_test nvme_mount nvme_mount 00:04:58.625 04:06:49 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:04:58.625 04:06:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:04:58.625 04:06:49 -- common/autotest_common.sh@10 -- # set +x 00:04:58.625 ************************************ 00:04:58.626 START TEST nvme_mount 00:04:58.626 ************************************ 00:04:58.626 04:06:49 -- common/autotest_common.sh@1114 -- # nvme_mount 00:04:58.626 04:06:49 -- setup/devices.sh@95 -- # nvme_disk=nvme0n1 00:04:58.626 04:06:49 -- setup/devices.sh@96 -- # nvme_disk_p=nvme0n1p1 00:04:58.626 04:06:49 -- setup/devices.sh@97 -- # nvme_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:04:58.626 04:06:49 -- setup/devices.sh@98 -- # nvme_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:04:58.626 04:06:49 -- setup/devices.sh@101 -- # partition_drive nvme0n1 1 00:04:58.626 04:06:49 -- setup/common.sh@39 -- # local disk=nvme0n1 00:04:58.626 04:06:49 -- setup/common.sh@40 -- # local part_no=1 00:04:58.626 04:06:49 -- setup/common.sh@41 -- # local size=1073741824 00:04:58.626 04:06:49 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:04:58.626 04:06:49 -- setup/common.sh@44 -- # parts=() 00:04:58.626 04:06:49 -- setup/common.sh@44 -- # local parts 00:04:58.626 04:06:49 -- setup/common.sh@46 -- # (( part = 1 )) 00:04:58.626 04:06:49 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:58.626 04:06:49 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:04:58.626 04:06:49 -- setup/common.sh@46 -- # (( part++ )) 00:04:58.626 04:06:49 -- setup/common.sh@46 -- # (( part <= part_no )) 00:04:58.626 04:06:49 -- setup/common.sh@51 -- # (( size /= 512 )) 00:04:58.626 04:06:49 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:04:58.626 04:06:49 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 00:04:59.999 Creating new GPT entries in memory. 00:04:59.999 GPT data structures destroyed! You may now partition the disk using fdisk or 00:04:59.999 other utilities. 00:04:59.999 04:06:50 -- setup/common.sh@57 -- # (( part = 1 )) 00:04:59.999 04:06:50 -- setup/common.sh@57 -- # (( part <= part_no )) 00:04:59.999 04:06:50 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:04:59.999 04:06:50 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:04:59.999 04:06:50 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:00.933 Creating new GPT entries in memory. 00:05:00.933 The operation has completed successfully. 00:05:00.933 04:06:51 -- setup/common.sh@57 -- # (( part++ )) 00:05:00.933 04:06:51 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:00.933 04:06:51 -- setup/common.sh@62 -- # wait 2226625 00:05:00.933 04:06:51 -- setup/devices.sh@102 -- # mkfs /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:00.933 04:06:51 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1p1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size= 00:05:00.933 04:06:51 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:00.933 04:06:51 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1p1 ]] 00:05:00.933 04:06:51 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1p1 00:05:00.933 04:06:51 -- setup/common.sh@72 -- # mount /dev/nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:00.933 04:06:51 -- setup/devices.sh@105 -- # verify 0000:88:00.0 nvme0n1:nvme0n1p1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:00.933 04:06:51 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:00.933 04:06:51 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1p1 00:05:00.933 04:06:51 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:00.933 04:06:51 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:00.933 04:06:51 -- setup/devices.sh@53 -- # local found=0 00:05:00.933 04:06:51 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:00.933 04:06:51 -- setup/devices.sh@56 -- # : 00:05:00.933 04:06:51 -- setup/devices.sh@59 -- # local pci status 00:05:00.933 04:06:51 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:00.933 04:06:51 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:00.933 04:06:51 -- setup/devices.sh@47 -- # setup output config 00:05:00.933 04:06:51 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:00.933 04:06:51 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:01.867 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.867 04:06:52 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1p1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1\p\1* ]] 00:05:01.867 04:06:52 -- setup/devices.sh@63 -- # found=1 00:05:01.867 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.867 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.867 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.867 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.867 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.867 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.867 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.867 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.867 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.867 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.867 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.867 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.867 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.867 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.867 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:01.867 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:01.867 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.135 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.135 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.135 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.135 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.135 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.135 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.135 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.135 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.135 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.135 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.135 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.135 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.135 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.135 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.135 04:06:52 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:02.135 04:06:52 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.135 04:06:52 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:02.135 04:06:52 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:02.135 04:06:52 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.135 04:06:52 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:02.135 04:06:52 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:02.135 04:06:52 -- setup/devices.sh@110 -- # cleanup_nvme 00:05:02.135 04:06:52 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.135 04:06:52 -- setup/devices.sh@21 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.135 04:06:52 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:02.135 04:06:52 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:02.135 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:02.135 04:06:52 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:02.135 04:06:52 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:02.394 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:02.394 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:02.394 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:02.394 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:02.394 04:06:52 -- setup/devices.sh@113 -- # mkfs /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 1024M 00:05:02.394 04:06:52 -- setup/common.sh@66 -- # local dev=/dev/nvme0n1 mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount size=1024M 00:05:02.394 04:06:52 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.394 04:06:52 -- setup/common.sh@70 -- # [[ -e /dev/nvme0n1 ]] 00:05:02.394 04:06:52 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/nvme0n1 1024M 00:05:02.652 04:06:53 -- setup/common.sh@72 -- # mount /dev/nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.652 04:06:53 -- setup/devices.sh@116 -- # verify 0000:88:00.0 nvme0n1:nvme0n1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:02.652 04:06:53 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:02.652 04:06:53 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme0n1 00:05:02.652 04:06:53 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:02.652 04:06:53 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:02.652 04:06:53 -- setup/devices.sh@53 -- # local found=0 00:05:02.652 04:06:53 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:02.652 04:06:53 -- setup/devices.sh@56 -- # : 00:05:02.652 04:06:53 -- setup/devices.sh@59 -- # local pci status 00:05:02.652 04:06:53 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:02.652 04:06:53 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:02.652 04:06:53 -- setup/devices.sh@47 -- # setup output config 00:05:02.652 04:06:53 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:02.652 04:06:53 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ Active devices: mount@nvme0n1:nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\0\n\1* ]] 00:05:03.588 04:06:54 -- setup/devices.sh@63 -- # found=1 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.588 04:06:54 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:03.588 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.847 04:06:54 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:03.847 04:06:54 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount ]] 00:05:03.847 04:06:54 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.847 04:06:54 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme ]] 00:05:03.847 04:06:54 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount/test_nvme 00:05:03.847 04:06:54 -- setup/devices.sh@123 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:03.847 04:06:54 -- setup/devices.sh@125 -- # verify 0000:88:00.0 data@nvme0n1 '' '' 00:05:03.847 04:06:54 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:03.847 04:06:54 -- setup/devices.sh@49 -- # local mounts=data@nvme0n1 00:05:03.847 04:06:54 -- setup/devices.sh@50 -- # local mount_point= 00:05:03.847 04:06:54 -- setup/devices.sh@51 -- # local test_file= 00:05:03.847 04:06:54 -- setup/devices.sh@53 -- # local found=0 00:05:03.847 04:06:54 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:03.847 04:06:54 -- setup/devices.sh@59 -- # local pci status 00:05:03.847 04:06:54 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:03.847 04:06:54 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:03.847 04:06:54 -- setup/devices.sh@47 -- # setup output config 00:05:03.847 04:06:54 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:03.847 04:06:54 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ Active devices: data@nvme0n1, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\d\a\t\a\@\n\v\m\e\0\n\1* ]] 00:05:05.222 04:06:55 -- setup/devices.sh@63 -- # found=1 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:05.222 04:06:55 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:05.222 04:06:55 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:05.222 04:06:55 -- setup/devices.sh@68 -- # return 0 00:05:05.222 04:06:55 -- setup/devices.sh@128 -- # cleanup_nvme 00:05:05.222 04:06:55 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:05.222 04:06:55 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:05.222 04:06:55 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:05.222 /dev/nvme0n1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:05.222 00:05:05.222 real 0m6.475s 00:05:05.222 user 0m1.534s 00:05:05.222 sys 0m2.535s 00:05:05.222 04:06:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:05.222 04:06:55 -- common/autotest_common.sh@10 -- # set +x 00:05:05.222 ************************************ 00:05:05.222 END TEST nvme_mount 00:05:05.222 ************************************ 00:05:05.222 04:06:55 -- setup/devices.sh@214 -- # run_test dm_mount dm_mount 00:05:05.222 04:06:55 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:05.222 04:06:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:05.223 04:06:55 -- common/autotest_common.sh@10 -- # set +x 00:05:05.223 ************************************ 00:05:05.223 START TEST dm_mount 00:05:05.223 ************************************ 00:05:05.223 04:06:55 -- common/autotest_common.sh@1114 -- # dm_mount 00:05:05.223 04:06:55 -- setup/devices.sh@144 -- # pv=nvme0n1 00:05:05.223 04:06:55 -- setup/devices.sh@145 -- # pv0=nvme0n1p1 00:05:05.223 04:06:55 -- setup/devices.sh@146 -- # pv1=nvme0n1p2 00:05:05.223 04:06:55 -- setup/devices.sh@148 -- # partition_drive nvme0n1 00:05:05.223 04:06:55 -- setup/common.sh@39 -- # local disk=nvme0n1 00:05:05.223 04:06:55 -- setup/common.sh@40 -- # local part_no=2 00:05:05.223 04:06:55 -- setup/common.sh@41 -- # local size=1073741824 00:05:05.223 04:06:55 -- setup/common.sh@43 -- # local part part_start=0 part_end=0 00:05:05.223 04:06:55 -- setup/common.sh@44 -- # parts=() 00:05:05.223 04:06:55 -- setup/common.sh@44 -- # local parts 00:05:05.223 04:06:55 -- setup/common.sh@46 -- # (( part = 1 )) 00:05:05.223 04:06:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.223 04:06:55 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:05.223 04:06:55 -- setup/common.sh@46 -- # (( part++ )) 00:05:05.223 04:06:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.223 04:06:55 -- setup/common.sh@47 -- # parts+=("${disk}p$part") 00:05:05.223 04:06:55 -- setup/common.sh@46 -- # (( part++ )) 00:05:05.223 04:06:55 -- setup/common.sh@46 -- # (( part <= part_no )) 00:05:05.223 04:06:55 -- setup/common.sh@51 -- # (( size /= 512 )) 00:05:05.223 04:06:55 -- setup/common.sh@56 -- # sgdisk /dev/nvme0n1 --zap-all 00:05:05.223 04:06:55 -- setup/common.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/sync_dev_uevents.sh block/partition nvme0n1p1 nvme0n1p2 00:05:06.156 Creating new GPT entries in memory. 00:05:06.156 GPT data structures destroyed! You may now partition the disk using fdisk or 00:05:06.156 other utilities. 00:05:06.156 04:06:56 -- setup/common.sh@57 -- # (( part = 1 )) 00:05:06.156 04:06:56 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:06.156 04:06:56 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:06.156 04:06:56 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:06.156 04:06:56 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=1:2048:2099199 00:05:07.532 Creating new GPT entries in memory. 00:05:07.532 The operation has completed successfully. 00:05:07.532 04:06:57 -- setup/common.sh@57 -- # (( part++ )) 00:05:07.532 04:06:57 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:07.532 04:06:57 -- setup/common.sh@58 -- # (( part_start = part_start == 0 ? 2048 : part_end + 1 )) 00:05:07.532 04:06:57 -- setup/common.sh@59 -- # (( part_end = part_start + size - 1 )) 00:05:07.532 04:06:57 -- setup/common.sh@60 -- # flock /dev/nvme0n1 sgdisk /dev/nvme0n1 --new=2:2099200:4196351 00:05:08.467 The operation has completed successfully. 00:05:08.467 04:06:58 -- setup/common.sh@57 -- # (( part++ )) 00:05:08.467 04:06:58 -- setup/common.sh@57 -- # (( part <= part_no )) 00:05:08.467 04:06:58 -- setup/common.sh@62 -- # wait 2229091 00:05:08.467 04:06:58 -- setup/devices.sh@150 -- # dm_name=nvme_dm_test 00:05:08.467 04:06:58 -- setup/devices.sh@151 -- # dm_mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.467 04:06:58 -- setup/devices.sh@152 -- # dm_dummy_test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:08.467 04:06:58 -- setup/devices.sh@155 -- # dmsetup create nvme_dm_test 00:05:08.467 04:06:58 -- setup/devices.sh@160 -- # for t in {1..5} 00:05:08.467 04:06:58 -- setup/devices.sh@161 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:08.467 04:06:58 -- setup/devices.sh@161 -- # break 00:05:08.467 04:06:58 -- setup/devices.sh@164 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:08.467 04:06:58 -- setup/devices.sh@165 -- # readlink -f /dev/mapper/nvme_dm_test 00:05:08.467 04:06:58 -- setup/devices.sh@165 -- # dm=/dev/dm-0 00:05:08.467 04:06:58 -- setup/devices.sh@166 -- # dm=dm-0 00:05:08.467 04:06:58 -- setup/devices.sh@168 -- # [[ -e /sys/class/block/nvme0n1p1/holders/dm-0 ]] 00:05:08.467 04:06:58 -- setup/devices.sh@169 -- # [[ -e /sys/class/block/nvme0n1p2/holders/dm-0 ]] 00:05:08.467 04:06:58 -- setup/devices.sh@171 -- # mkfs /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.467 04:06:58 -- setup/common.sh@66 -- # local dev=/dev/mapper/nvme_dm_test mount=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount size= 00:05:08.467 04:06:58 -- setup/common.sh@68 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.467 04:06:58 -- setup/common.sh@70 -- # [[ -e /dev/mapper/nvme_dm_test ]] 00:05:08.467 04:06:58 -- setup/common.sh@71 -- # mkfs.ext4 -qF /dev/mapper/nvme_dm_test 00:05:08.467 04:06:58 -- setup/common.sh@72 -- # mount /dev/mapper/nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.467 04:06:58 -- setup/devices.sh@174 -- # verify 0000:88:00.0 nvme0n1:nvme_dm_test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:08.467 04:06:58 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:08.467 04:06:58 -- setup/devices.sh@49 -- # local mounts=nvme0n1:nvme_dm_test 00:05:08.467 04:06:58 -- setup/devices.sh@50 -- # local mount_point=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:08.467 04:06:58 -- setup/devices.sh@51 -- # local test_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:08.467 04:06:58 -- setup/devices.sh@53 -- # local found=0 00:05:08.467 04:06:58 -- setup/devices.sh@55 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:08.467 04:06:58 -- setup/devices.sh@56 -- # : 00:05:08.467 04:06:58 -- setup/devices.sh@59 -- # local pci status 00:05:08.467 04:06:58 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:08.467 04:06:58 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:08.467 04:06:58 -- setup/devices.sh@47 -- # setup output config 00:05:08.467 04:06:58 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:08.467 04:06:58 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:09.843 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.843 04:07:00 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0,mount@nvme0n1:nvme_dm_test, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\n\v\m\e\0\n\1\:\n\v\m\e\_\d\m\_\t\e\s\t* ]] 00:05:09.843 04:07:00 -- setup/devices.sh@63 -- # found=1 00:05:09.843 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.843 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:09.844 04:07:00 -- setup/devices.sh@68 -- # [[ -n /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount ]] 00:05:09.844 04:07:00 -- setup/devices.sh@71 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.844 04:07:00 -- setup/devices.sh@73 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm ]] 00:05:09.844 04:07:00 -- setup/devices.sh@74 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount/test_dm 00:05:09.844 04:07:00 -- setup/devices.sh@182 -- # umount /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:09.844 04:07:00 -- setup/devices.sh@184 -- # verify 0000:88:00.0 holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 '' '' 00:05:09.844 04:07:00 -- setup/devices.sh@48 -- # local dev=0000:88:00.0 00:05:09.844 04:07:00 -- setup/devices.sh@49 -- # local mounts=holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0 00:05:09.844 04:07:00 -- setup/devices.sh@50 -- # local mount_point= 00:05:09.844 04:07:00 -- setup/devices.sh@51 -- # local test_file= 00:05:09.844 04:07:00 -- setup/devices.sh@53 -- # local found=0 00:05:09.844 04:07:00 -- setup/devices.sh@55 -- # [[ -n '' ]] 00:05:09.844 04:07:00 -- setup/devices.sh@59 -- # local pci status 00:05:09.844 04:07:00 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:09.844 04:07:00 -- setup/devices.sh@47 -- # PCI_ALLOWED=0000:88:00.0 00:05:09.844 04:07:00 -- setup/devices.sh@47 -- # setup output config 00:05:09.844 04:07:00 -- setup/common.sh@9 -- # [[ output == output ]] 00:05:09.844 04:07:00 -- setup/common.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh config 00:05:10.778 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:88:00.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.778 04:07:01 -- setup/devices.sh@62 -- # [[ Active devices: holder@nvme0n1p1:dm-0,holder@nvme0n1p2:dm-0, so not binding PCI dev == *\A\c\t\i\v\e\ \d\e\v\i\c\e\s\:\ *\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\1\:\d\m\-\0\,\h\o\l\d\e\r\@\n\v\m\e\0\n\1\p\2\:\d\m\-\0* ]] 00:05:10.778 04:07:01 -- setup/devices.sh@63 -- # found=1 00:05:10.778 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.778 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.778 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:10.778 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.0 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:10.778 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.035 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.035 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.035 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.1 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.035 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.035 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.035 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.035 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.2 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.035 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.036 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.3 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.036 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.036 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.4 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.036 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.036 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.5 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.036 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.036 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.6 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.036 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:00:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.036 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@62 -- # [[ 0000:80:04.7 == \0\0\0\0\:\8\8\:\0\0\.\0 ]] 00:05:11.036 04:07:01 -- setup/devices.sh@60 -- # read -r pci _ _ status 00:05:11.036 04:07:01 -- setup/devices.sh@66 -- # (( found == 1 )) 00:05:11.036 04:07:01 -- setup/devices.sh@68 -- # [[ -n '' ]] 00:05:11.036 04:07:01 -- setup/devices.sh@68 -- # return 0 00:05:11.036 04:07:01 -- setup/devices.sh@187 -- # cleanup_dm 00:05:11.036 04:07:01 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:11.036 04:07:01 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:11.036 04:07:01 -- setup/devices.sh@37 -- # dmsetup remove --force nvme_dm_test 00:05:11.294 04:07:01 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:11.294 04:07:01 -- setup/devices.sh@40 -- # wipefs --all /dev/nvme0n1p1 00:05:11.294 /dev/nvme0n1p1: 2 bytes were erased at offset 0x00000438 (ext4): 53 ef 00:05:11.294 04:07:01 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:11.294 04:07:01 -- setup/devices.sh@43 -- # wipefs --all /dev/nvme0n1p2 00:05:11.294 00:05:11.294 real 0m5.989s 00:05:11.294 user 0m1.035s 00:05:11.294 sys 0m1.822s 00:05:11.294 04:07:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.294 04:07:01 -- common/autotest_common.sh@10 -- # set +x 00:05:11.294 ************************************ 00:05:11.294 END TEST dm_mount 00:05:11.294 ************************************ 00:05:11.294 04:07:01 -- setup/devices.sh@1 -- # cleanup 00:05:11.294 04:07:01 -- setup/devices.sh@11 -- # cleanup_nvme 00:05:11.294 04:07:01 -- setup/devices.sh@20 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/nvme_mount 00:05:11.294 04:07:01 -- setup/devices.sh@24 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:11.294 04:07:01 -- setup/devices.sh@25 -- # wipefs --all /dev/nvme0n1p1 00:05:11.294 04:07:01 -- setup/devices.sh@27 -- # [[ -b /dev/nvme0n1 ]] 00:05:11.294 04:07:01 -- setup/devices.sh@28 -- # wipefs --all /dev/nvme0n1 00:05:11.552 /dev/nvme0n1: 8 bytes were erased at offset 0x00000200 (gpt): 45 46 49 20 50 41 52 54 00:05:11.552 /dev/nvme0n1: 8 bytes were erased at offset 0xe8e0db5e00 (gpt): 45 46 49 20 50 41 52 54 00:05:11.552 /dev/nvme0n1: 2 bytes were erased at offset 0x000001fe (PMBR): 55 aa 00:05:11.552 /dev/nvme0n1: calling ioctl to re-read partition table: Success 00:05:11.552 04:07:01 -- setup/devices.sh@12 -- # cleanup_dm 00:05:11.552 04:07:01 -- setup/devices.sh@33 -- # mountpoint -q /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/setup/dm_mount 00:05:11.552 04:07:01 -- setup/devices.sh@36 -- # [[ -L /dev/mapper/nvme_dm_test ]] 00:05:11.552 04:07:01 -- setup/devices.sh@39 -- # [[ -b /dev/nvme0n1p1 ]] 00:05:11.552 04:07:01 -- setup/devices.sh@42 -- # [[ -b /dev/nvme0n1p2 ]] 00:05:11.552 04:07:01 -- setup/devices.sh@14 -- # [[ -b /dev/nvme0n1 ]] 00:05:11.552 04:07:01 -- setup/devices.sh@15 -- # wipefs --all /dev/nvme0n1 00:05:11.552 00:05:11.552 real 0m14.446s 00:05:11.552 user 0m3.279s 00:05:11.552 sys 0m5.401s 00:05:11.552 04:07:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.552 04:07:02 -- common/autotest_common.sh@10 -- # set +x 00:05:11.552 ************************************ 00:05:11.552 END TEST devices 00:05:11.552 ************************************ 00:05:11.552 00:05:11.552 real 0m44.467s 00:05:11.552 user 0m12.901s 00:05:11.552 sys 0m20.056s 00:05:11.552 04:07:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:11.552 04:07:02 -- common/autotest_common.sh@10 -- # set +x 00:05:11.552 ************************************ 00:05:11.552 END TEST setup.sh 00:05:11.552 ************************************ 00:05:11.552 04:07:02 -- spdk/autotest.sh@126 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh status 00:05:12.488 Hugepages 00:05:12.488 node hugesize free / total 00:05:12.488 node0 1048576kB 0 / 0 00:05:12.488 node0 2048kB 2048 / 2048 00:05:12.488 node1 1048576kB 0 / 0 00:05:12.488 node1 2048kB 0 / 0 00:05:12.488 00:05:12.488 Type BDF Vendor Device NUMA Driver Device Block devices 00:05:12.488 I/OAT 0000:00:04.0 8086 0e20 0 ioatdma - - 00:05:12.488 I/OAT 0000:00:04.1 8086 0e21 0 ioatdma - - 00:05:12.488 I/OAT 0000:00:04.2 8086 0e22 0 ioatdma - - 00:05:12.488 I/OAT 0000:00:04.3 8086 0e23 0 ioatdma - - 00:05:12.488 I/OAT 0000:00:04.4 8086 0e24 0 ioatdma - - 00:05:12.488 I/OAT 0000:00:04.5 8086 0e25 0 ioatdma - - 00:05:12.488 I/OAT 0000:00:04.6 8086 0e26 0 ioatdma - - 00:05:12.488 I/OAT 0000:00:04.7 8086 0e27 0 ioatdma - - 00:05:12.488 I/OAT 0000:80:04.0 8086 0e20 1 ioatdma - - 00:05:12.488 I/OAT 0000:80:04.1 8086 0e21 1 ioatdma - - 00:05:12.488 I/OAT 0000:80:04.2 8086 0e22 1 ioatdma - - 00:05:12.488 I/OAT 0000:80:04.3 8086 0e23 1 ioatdma - - 00:05:12.488 I/OAT 0000:80:04.4 8086 0e24 1 ioatdma - - 00:05:12.488 I/OAT 0000:80:04.5 8086 0e25 1 ioatdma - - 00:05:12.488 I/OAT 0000:80:04.6 8086 0e26 1 ioatdma - - 00:05:12.488 I/OAT 0000:80:04.7 8086 0e27 1 ioatdma - - 00:05:12.488 NVMe 0000:88:00.0 8086 0a54 1 nvme nvme0 nvme0n1 00:05:12.488 04:07:03 -- spdk/autotest.sh@128 -- # uname -s 00:05:12.488 04:07:03 -- spdk/autotest.sh@128 -- # [[ Linux == Linux ]] 00:05:12.488 04:07:03 -- spdk/autotest.sh@130 -- # nvme_namespace_revert 00:05:12.488 04:07:03 -- common/autotest_common.sh@1526 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:13.861 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:13.861 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:13.861 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:13.861 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:13.861 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:13.861 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:13.861 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:13.861 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:13.861 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:13.861 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:13.861 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:13.861 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:13.861 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:13.861 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:13.861 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:13.861 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:14.795 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:15.052 04:07:05 -- common/autotest_common.sh@1527 -- # sleep 1 00:05:15.986 04:07:06 -- common/autotest_common.sh@1528 -- # bdfs=() 00:05:15.986 04:07:06 -- common/autotest_common.sh@1528 -- # local bdfs 00:05:15.986 04:07:06 -- common/autotest_common.sh@1529 -- # bdfs=($(get_nvme_bdfs)) 00:05:15.986 04:07:06 -- common/autotest_common.sh@1529 -- # get_nvme_bdfs 00:05:15.986 04:07:06 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:15.986 04:07:06 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:15.986 04:07:06 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:15.986 04:07:06 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:15.986 04:07:06 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:15.986 04:07:06 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:15.986 04:07:06 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:15.986 04:07:06 -- common/autotest_common.sh@1531 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:05:17.361 Waiting for block devices as requested 00:05:17.361 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:05:17.361 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:17.361 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:17.361 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:17.620 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:17.620 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:17.620 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:17.620 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:17.878 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:17.878 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:05:17.878 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:05:17.878 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:05:18.137 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:05:18.137 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:05:18.137 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:05:18.137 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:05:18.395 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:05:18.395 04:07:08 -- common/autotest_common.sh@1533 -- # for bdf in "${bdfs[@]}" 00:05:18.395 04:07:08 -- common/autotest_common.sh@1534 -- # get_nvme_ctrlr_from_bdf 0000:88:00.0 00:05:18.395 04:07:08 -- common/autotest_common.sh@1497 -- # readlink -f /sys/class/nvme/nvme0 00:05:18.395 04:07:08 -- common/autotest_common.sh@1497 -- # grep 0000:88:00.0/nvme/nvme 00:05:18.395 04:07:08 -- common/autotest_common.sh@1497 -- # bdf_sysfs_path=/sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:18.395 04:07:08 -- common/autotest_common.sh@1498 -- # [[ -z /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 ]] 00:05:18.395 04:07:08 -- common/autotest_common.sh@1502 -- # basename /sys/devices/pci0000:80/0000:80:03.0/0000:88:00.0/nvme/nvme0 00:05:18.395 04:07:08 -- common/autotest_common.sh@1502 -- # printf '%s\n' nvme0 00:05:18.395 04:07:08 -- common/autotest_common.sh@1534 -- # nvme_ctrlr=/dev/nvme0 00:05:18.395 04:07:08 -- common/autotest_common.sh@1535 -- # [[ -z /dev/nvme0 ]] 00:05:18.395 04:07:08 -- common/autotest_common.sh@1540 -- # nvme id-ctrl /dev/nvme0 00:05:18.395 04:07:08 -- common/autotest_common.sh@1540 -- # grep oacs 00:05:18.395 04:07:08 -- common/autotest_common.sh@1540 -- # cut -d: -f2 00:05:18.395 04:07:08 -- common/autotest_common.sh@1540 -- # oacs=' 0xf' 00:05:18.395 04:07:08 -- common/autotest_common.sh@1541 -- # oacs_ns_manage=8 00:05:18.395 04:07:08 -- common/autotest_common.sh@1543 -- # [[ 8 -ne 0 ]] 00:05:18.395 04:07:08 -- common/autotest_common.sh@1549 -- # nvme id-ctrl /dev/nvme0 00:05:18.395 04:07:08 -- common/autotest_common.sh@1549 -- # grep unvmcap 00:05:18.395 04:07:08 -- common/autotest_common.sh@1549 -- # cut -d: -f2 00:05:18.395 04:07:08 -- common/autotest_common.sh@1549 -- # unvmcap=' 0' 00:05:18.395 04:07:08 -- common/autotest_common.sh@1550 -- # [[ 0 -eq 0 ]] 00:05:18.395 04:07:08 -- common/autotest_common.sh@1552 -- # continue 00:05:18.395 04:07:08 -- spdk/autotest.sh@133 -- # timing_exit pre_cleanup 00:05:18.395 04:07:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:18.395 04:07:08 -- common/autotest_common.sh@10 -- # set +x 00:05:18.395 04:07:08 -- spdk/autotest.sh@136 -- # timing_enter afterboot 00:05:18.395 04:07:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:18.395 04:07:08 -- common/autotest_common.sh@10 -- # set +x 00:05:18.395 04:07:08 -- spdk/autotest.sh@137 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:05:19.770 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:19.770 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:19.770 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:19.770 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:19.770 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:19.770 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:19.770 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:19.770 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:19.770 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:05:19.770 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:05:19.770 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:05:19.770 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:05:19.770 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:05:19.770 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:05:19.770 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:05:19.770 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:05:20.704 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:05:20.704 04:07:11 -- spdk/autotest.sh@138 -- # timing_exit afterboot 00:05:20.704 04:07:11 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:20.704 04:07:11 -- common/autotest_common.sh@10 -- # set +x 00:05:20.704 04:07:11 -- spdk/autotest.sh@142 -- # opal_revert_cleanup 00:05:20.704 04:07:11 -- common/autotest_common.sh@1586 -- # mapfile -t bdfs 00:05:20.704 04:07:11 -- common/autotest_common.sh@1586 -- # get_nvme_bdfs_by_id 0x0a54 00:05:20.704 04:07:11 -- common/autotest_common.sh@1572 -- # bdfs=() 00:05:20.704 04:07:11 -- common/autotest_common.sh@1572 -- # local bdfs 00:05:20.704 04:07:11 -- common/autotest_common.sh@1574 -- # get_nvme_bdfs 00:05:20.704 04:07:11 -- common/autotest_common.sh@1508 -- # bdfs=() 00:05:20.704 04:07:11 -- common/autotest_common.sh@1508 -- # local bdfs 00:05:20.704 04:07:11 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:05:20.704 04:07:11 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:05:20.704 04:07:11 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:05:20.704 04:07:11 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:05:20.704 04:07:11 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:05:20.704 04:07:11 -- common/autotest_common.sh@1574 -- # for bdf in $(get_nvme_bdfs) 00:05:20.704 04:07:11 -- common/autotest_common.sh@1575 -- # cat /sys/bus/pci/devices/0000:88:00.0/device 00:05:20.704 04:07:11 -- common/autotest_common.sh@1575 -- # device=0x0a54 00:05:20.704 04:07:11 -- common/autotest_common.sh@1576 -- # [[ 0x0a54 == \0\x\0\a\5\4 ]] 00:05:20.704 04:07:11 -- common/autotest_common.sh@1577 -- # bdfs+=($bdf) 00:05:20.704 04:07:11 -- common/autotest_common.sh@1581 -- # printf '%s\n' 0000:88:00.0 00:05:20.704 04:07:11 -- common/autotest_common.sh@1587 -- # [[ -z 0000:88:00.0 ]] 00:05:20.704 04:07:11 -- common/autotest_common.sh@1592 -- # spdk_tgt_pid=2234512 00:05:20.704 04:07:11 -- common/autotest_common.sh@1591 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:20.704 04:07:11 -- common/autotest_common.sh@1593 -- # waitforlisten 2234512 00:05:20.704 04:07:11 -- common/autotest_common.sh@829 -- # '[' -z 2234512 ']' 00:05:20.704 04:07:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:20.704 04:07:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:20.704 04:07:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:20.704 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:20.704 04:07:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:20.704 04:07:11 -- common/autotest_common.sh@10 -- # set +x 00:05:20.963 [2024-11-30 04:07:11.367847] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:20.963 [2024-11-30 04:07:11.367934] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2234512 ] 00:05:20.963 EAL: No free 2048 kB hugepages reported on node 1 00:05:20.963 [2024-11-30 04:07:11.425951] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:20.963 [2024-11-30 04:07:11.511850] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:20.963 [2024-11-30 04:07:11.512046] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:21.897 04:07:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:21.897 04:07:12 -- common/autotest_common.sh@862 -- # return 0 00:05:21.897 04:07:12 -- common/autotest_common.sh@1595 -- # bdf_id=0 00:05:21.897 04:07:12 -- common/autotest_common.sh@1596 -- # for bdf in "${bdfs[@]}" 00:05:21.897 04:07:12 -- common/autotest_common.sh@1597 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b nvme0 -t pcie -a 0000:88:00.0 00:05:25.231 nvme0n1 00:05:25.231 04:07:15 -- common/autotest_common.sh@1599 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_opal_revert -b nvme0 -p test 00:05:25.231 [2024-11-30 04:07:15.699576] nvme_opal.c:2059:spdk_opal_cmd_revert_tper: *ERROR*: Error on starting admin SP session with error 18 00:05:25.231 [2024-11-30 04:07:15.699619] vbdev_opal_rpc.c: 134:rpc_bdev_nvme_opal_revert: *ERROR*: Revert TPer failure: 18 00:05:25.231 request: 00:05:25.231 { 00:05:25.231 "nvme_ctrlr_name": "nvme0", 00:05:25.231 "password": "test", 00:05:25.231 "method": "bdev_nvme_opal_revert", 00:05:25.231 "req_id": 1 00:05:25.231 } 00:05:25.231 Got JSON-RPC error response 00:05:25.231 response: 00:05:25.231 { 00:05:25.231 "code": -32603, 00:05:25.231 "message": "Internal error" 00:05:25.231 } 00:05:25.231 04:07:15 -- common/autotest_common.sh@1599 -- # true 00:05:25.231 04:07:15 -- common/autotest_common.sh@1600 -- # (( ++bdf_id )) 00:05:25.231 04:07:15 -- common/autotest_common.sh@1603 -- # killprocess 2234512 00:05:25.231 04:07:15 -- common/autotest_common.sh@936 -- # '[' -z 2234512 ']' 00:05:25.231 04:07:15 -- common/autotest_common.sh@940 -- # kill -0 2234512 00:05:25.231 04:07:15 -- common/autotest_common.sh@941 -- # uname 00:05:25.231 04:07:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:25.231 04:07:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2234512 00:05:25.231 04:07:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:25.231 04:07:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:25.231 04:07:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2234512' 00:05:25.231 killing process with pid 2234512 00:05:25.231 04:07:15 -- common/autotest_common.sh@955 -- # kill 2234512 00:05:25.231 04:07:15 -- common/autotest_common.sh@960 -- # wait 2234512 00:05:27.187 04:07:17 -- spdk/autotest.sh@148 -- # '[' 0 -eq 1 ']' 00:05:27.187 04:07:17 -- spdk/autotest.sh@152 -- # '[' 1 -eq 1 ']' 00:05:27.187 04:07:17 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:27.187 04:07:17 -- spdk/autotest.sh@153 -- # [[ 0 -eq 1 ]] 00:05:27.187 04:07:17 -- spdk/autotest.sh@160 -- # timing_enter lib 00:05:27.187 04:07:17 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:27.187 04:07:17 -- common/autotest_common.sh@10 -- # set +x 00:05:27.187 04:07:17 -- spdk/autotest.sh@162 -- # run_test env /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:27.187 04:07:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.187 04:07:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.187 04:07:17 -- common/autotest_common.sh@10 -- # set +x 00:05:27.187 ************************************ 00:05:27.187 START TEST env 00:05:27.187 ************************************ 00:05:27.187 04:07:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env.sh 00:05:27.187 * Looking for test storage... 00:05:27.187 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env 00:05:27.187 04:07:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:27.187 04:07:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:27.187 04:07:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:27.187 04:07:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:27.187 04:07:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:27.187 04:07:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:27.187 04:07:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:27.187 04:07:17 -- scripts/common.sh@335 -- # IFS=.-: 00:05:27.187 04:07:17 -- scripts/common.sh@335 -- # read -ra ver1 00:05:27.187 04:07:17 -- scripts/common.sh@336 -- # IFS=.-: 00:05:27.187 04:07:17 -- scripts/common.sh@336 -- # read -ra ver2 00:05:27.187 04:07:17 -- scripts/common.sh@337 -- # local 'op=<' 00:05:27.187 04:07:17 -- scripts/common.sh@339 -- # ver1_l=2 00:05:27.187 04:07:17 -- scripts/common.sh@340 -- # ver2_l=1 00:05:27.187 04:07:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:27.187 04:07:17 -- scripts/common.sh@343 -- # case "$op" in 00:05:27.187 04:07:17 -- scripts/common.sh@344 -- # : 1 00:05:27.187 04:07:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:27.187 04:07:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:27.187 04:07:17 -- scripts/common.sh@364 -- # decimal 1 00:05:27.187 04:07:17 -- scripts/common.sh@352 -- # local d=1 00:05:27.187 04:07:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:27.187 04:07:17 -- scripts/common.sh@354 -- # echo 1 00:05:27.187 04:07:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:27.187 04:07:17 -- scripts/common.sh@365 -- # decimal 2 00:05:27.187 04:07:17 -- scripts/common.sh@352 -- # local d=2 00:05:27.187 04:07:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:27.187 04:07:17 -- scripts/common.sh@354 -- # echo 2 00:05:27.187 04:07:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:27.187 04:07:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:27.187 04:07:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:27.187 04:07:17 -- scripts/common.sh@367 -- # return 0 00:05:27.187 04:07:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:27.187 04:07:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:27.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.187 --rc genhtml_branch_coverage=1 00:05:27.187 --rc genhtml_function_coverage=1 00:05:27.187 --rc genhtml_legend=1 00:05:27.187 --rc geninfo_all_blocks=1 00:05:27.187 --rc geninfo_unexecuted_blocks=1 00:05:27.187 00:05:27.187 ' 00:05:27.187 04:07:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:27.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.187 --rc genhtml_branch_coverage=1 00:05:27.187 --rc genhtml_function_coverage=1 00:05:27.187 --rc genhtml_legend=1 00:05:27.187 --rc geninfo_all_blocks=1 00:05:27.187 --rc geninfo_unexecuted_blocks=1 00:05:27.187 00:05:27.187 ' 00:05:27.187 04:07:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:27.187 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.187 --rc genhtml_branch_coverage=1 00:05:27.187 --rc genhtml_function_coverage=1 00:05:27.187 --rc genhtml_legend=1 00:05:27.187 --rc geninfo_all_blocks=1 00:05:27.187 --rc geninfo_unexecuted_blocks=1 00:05:27.187 00:05:27.187 ' 00:05:27.188 04:07:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:27.188 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:27.188 --rc genhtml_branch_coverage=1 00:05:27.188 --rc genhtml_function_coverage=1 00:05:27.188 --rc genhtml_legend=1 00:05:27.188 --rc geninfo_all_blocks=1 00:05:27.188 --rc geninfo_unexecuted_blocks=1 00:05:27.188 00:05:27.188 ' 00:05:27.188 04:07:17 -- env/env.sh@10 -- # run_test env_memory /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:27.188 04:07:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.188 04:07:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.188 04:07:17 -- common/autotest_common.sh@10 -- # set +x 00:05:27.188 ************************************ 00:05:27.188 START TEST env_memory 00:05:27.188 ************************************ 00:05:27.188 04:07:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/memory/memory_ut 00:05:27.188 00:05:27.188 00:05:27.188 CUnit - A unit testing framework for C - Version 2.1-3 00:05:27.188 http://cunit.sourceforge.net/ 00:05:27.188 00:05:27.188 00:05:27.188 Suite: memory 00:05:27.188 Test: alloc and free memory map ...[2024-11-30 04:07:17.715150] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 283:spdk_mem_map_alloc: *ERROR*: Initial mem_map notify failed 00:05:27.188 passed 00:05:27.188 Test: mem map translation ...[2024-11-30 04:07:17.735118] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=2097152 len=1234 00:05:27.188 [2024-11-30 04:07:17.735140] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 590:spdk_mem_map_set_translation: *ERROR*: invalid spdk_mem_map_set_translation parameters, vaddr=1234 len=2097152 00:05:27.188 [2024-11-30 04:07:17.735187] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 584:spdk_mem_map_set_translation: *ERROR*: invalid usermode virtual address 281474976710656 00:05:27.188 [2024-11-30 04:07:17.735198] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 600:spdk_mem_map_set_translation: *ERROR*: could not get 0xffffffe00000 map 00:05:27.188 passed 00:05:27.188 Test: mem map registration ...[2024-11-30 04:07:17.778118] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x200000 len=1234 00:05:27.188 [2024-11-30 04:07:17.778140] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/memory.c: 346:spdk_mem_register: *ERROR*: invalid spdk_mem_register parameters, vaddr=0x4d2 len=2097152 00:05:27.188 passed 00:05:27.447 Test: mem map adjacent registrations ...passed 00:05:27.447 00:05:27.447 Run Summary: Type Total Ran Passed Failed Inactive 00:05:27.447 suites 1 1 n/a 0 0 00:05:27.447 tests 4 4 4 0 0 00:05:27.447 asserts 152 152 152 0 n/a 00:05:27.447 00:05:27.447 Elapsed time = 0.147 seconds 00:05:27.447 00:05:27.447 real 0m0.155s 00:05:27.447 user 0m0.144s 00:05:27.447 sys 0m0.011s 00:05:27.447 04:07:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:27.447 04:07:17 -- common/autotest_common.sh@10 -- # set +x 00:05:27.447 ************************************ 00:05:27.447 END TEST env_memory 00:05:27.447 ************************************ 00:05:27.447 04:07:17 -- env/env.sh@11 -- # run_test env_vtophys /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:27.447 04:07:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:27.447 04:07:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:27.447 04:07:17 -- common/autotest_common.sh@10 -- # set +x 00:05:27.447 ************************************ 00:05:27.447 START TEST env_vtophys 00:05:27.447 ************************************ 00:05:27.447 04:07:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/vtophys/vtophys 00:05:27.447 EAL: lib.eal log level changed from notice to debug 00:05:27.447 EAL: Detected lcore 0 as core 0 on socket 0 00:05:27.447 EAL: Detected lcore 1 as core 1 on socket 0 00:05:27.447 EAL: Detected lcore 2 as core 2 on socket 0 00:05:27.447 EAL: Detected lcore 3 as core 3 on socket 0 00:05:27.447 EAL: Detected lcore 4 as core 4 on socket 0 00:05:27.447 EAL: Detected lcore 5 as core 5 on socket 0 00:05:27.447 EAL: Detected lcore 6 as core 8 on socket 0 00:05:27.447 EAL: Detected lcore 7 as core 9 on socket 0 00:05:27.447 EAL: Detected lcore 8 as core 10 on socket 0 00:05:27.447 EAL: Detected lcore 9 as core 11 on socket 0 00:05:27.447 EAL: Detected lcore 10 as core 12 on socket 0 00:05:27.447 EAL: Detected lcore 11 as core 13 on socket 0 00:05:27.447 EAL: Detected lcore 12 as core 0 on socket 1 00:05:27.447 EAL: Detected lcore 13 as core 1 on socket 1 00:05:27.447 EAL: Detected lcore 14 as core 2 on socket 1 00:05:27.447 EAL: Detected lcore 15 as core 3 on socket 1 00:05:27.447 EAL: Detected lcore 16 as core 4 on socket 1 00:05:27.447 EAL: Detected lcore 17 as core 5 on socket 1 00:05:27.447 EAL: Detected lcore 18 as core 8 on socket 1 00:05:27.447 EAL: Detected lcore 19 as core 9 on socket 1 00:05:27.447 EAL: Detected lcore 20 as core 10 on socket 1 00:05:27.447 EAL: Detected lcore 21 as core 11 on socket 1 00:05:27.447 EAL: Detected lcore 22 as core 12 on socket 1 00:05:27.447 EAL: Detected lcore 23 as core 13 on socket 1 00:05:27.447 EAL: Detected lcore 24 as core 0 on socket 0 00:05:27.447 EAL: Detected lcore 25 as core 1 on socket 0 00:05:27.447 EAL: Detected lcore 26 as core 2 on socket 0 00:05:27.447 EAL: Detected lcore 27 as core 3 on socket 0 00:05:27.447 EAL: Detected lcore 28 as core 4 on socket 0 00:05:27.447 EAL: Detected lcore 29 as core 5 on socket 0 00:05:27.448 EAL: Detected lcore 30 as core 8 on socket 0 00:05:27.448 EAL: Detected lcore 31 as core 9 on socket 0 00:05:27.448 EAL: Detected lcore 32 as core 10 on socket 0 00:05:27.448 EAL: Detected lcore 33 as core 11 on socket 0 00:05:27.448 EAL: Detected lcore 34 as core 12 on socket 0 00:05:27.448 EAL: Detected lcore 35 as core 13 on socket 0 00:05:27.448 EAL: Detected lcore 36 as core 0 on socket 1 00:05:27.448 EAL: Detected lcore 37 as core 1 on socket 1 00:05:27.448 EAL: Detected lcore 38 as core 2 on socket 1 00:05:27.448 EAL: Detected lcore 39 as core 3 on socket 1 00:05:27.448 EAL: Detected lcore 40 as core 4 on socket 1 00:05:27.448 EAL: Detected lcore 41 as core 5 on socket 1 00:05:27.448 EAL: Detected lcore 42 as core 8 on socket 1 00:05:27.448 EAL: Detected lcore 43 as core 9 on socket 1 00:05:27.448 EAL: Detected lcore 44 as core 10 on socket 1 00:05:27.448 EAL: Detected lcore 45 as core 11 on socket 1 00:05:27.448 EAL: Detected lcore 46 as core 12 on socket 1 00:05:27.448 EAL: Detected lcore 47 as core 13 on socket 1 00:05:27.448 EAL: Maximum logical cores by configuration: 128 00:05:27.448 EAL: Detected CPU lcores: 48 00:05:27.448 EAL: Detected NUMA nodes: 2 00:05:27.448 EAL: Checking presence of .so 'librte_eal.so.24.0' 00:05:27.448 EAL: Detected shared linkage of DPDK 00:05:27.448 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so.24.0 00:05:27.448 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so.24.0 00:05:27.448 EAL: Registered [vdev] bus. 00:05:27.448 EAL: bus.vdev log level changed from disabled to notice 00:05:27.448 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so.24.0 00:05:27.448 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so.24.0 00:05:27.448 EAL: pmd.net.i40e.init log level changed from disabled to notice 00:05:27.448 EAL: pmd.net.i40e.driver log level changed from disabled to notice 00:05:27.448 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_pci.so 00:05:27.448 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_bus_vdev.so 00:05:27.448 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_mempool_ring.so 00:05:27.448 EAL: open shared lib /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib/dpdk/pmds-24.0/librte_net_i40e.so 00:05:27.448 EAL: No shared files mode enabled, IPC will be disabled 00:05:27.448 EAL: No shared files mode enabled, IPC is disabled 00:05:27.448 EAL: Bus pci wants IOVA as 'DC' 00:05:27.448 EAL: Bus vdev wants IOVA as 'DC' 00:05:27.448 EAL: Buses did not request a specific IOVA mode. 00:05:27.448 EAL: IOMMU is available, selecting IOVA as VA mode. 00:05:27.448 EAL: Selected IOVA mode 'VA' 00:05:27.448 EAL: No free 2048 kB hugepages reported on node 1 00:05:27.448 EAL: Probing VFIO support... 00:05:27.448 EAL: IOMMU type 1 (Type 1) is supported 00:05:27.448 EAL: IOMMU type 7 (sPAPR) is not supported 00:05:27.448 EAL: IOMMU type 8 (No-IOMMU) is not supported 00:05:27.448 EAL: VFIO support initialized 00:05:27.448 EAL: Ask a virtual area of 0x2e000 bytes 00:05:27.448 EAL: Virtual area found at 0x200000000000 (size = 0x2e000) 00:05:27.448 EAL: Setting up physically contiguous memory... 00:05:27.448 EAL: Setting maximum number of open files to 524288 00:05:27.448 EAL: Detected memory type: socket_id:0 hugepage_sz:2097152 00:05:27.448 EAL: Detected memory type: socket_id:1 hugepage_sz:2097152 00:05:27.448 EAL: Creating 4 segment lists: n_segs:8192 socket_id:0 hugepage_sz:2097152 00:05:27.448 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.448 EAL: Virtual area found at 0x20000002e000 (size = 0x61000) 00:05:27.448 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.448 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.448 EAL: Virtual area found at 0x200000200000 (size = 0x400000000) 00:05:27.448 EAL: VA reserved for memseg list at 0x200000200000, size 400000000 00:05:27.448 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.448 EAL: Virtual area found at 0x200400200000 (size = 0x61000) 00:05:27.448 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.448 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.448 EAL: Virtual area found at 0x200400400000 (size = 0x400000000) 00:05:27.448 EAL: VA reserved for memseg list at 0x200400400000, size 400000000 00:05:27.448 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.448 EAL: Virtual area found at 0x200800400000 (size = 0x61000) 00:05:27.448 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.448 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.448 EAL: Virtual area found at 0x200800600000 (size = 0x400000000) 00:05:27.448 EAL: VA reserved for memseg list at 0x200800600000, size 400000000 00:05:27.448 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.448 EAL: Virtual area found at 0x200c00600000 (size = 0x61000) 00:05:27.448 EAL: Memseg list allocated at socket 0, page size 0x800kB 00:05:27.448 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.448 EAL: Virtual area found at 0x200c00800000 (size = 0x400000000) 00:05:27.448 EAL: VA reserved for memseg list at 0x200c00800000, size 400000000 00:05:27.448 EAL: Creating 4 segment lists: n_segs:8192 socket_id:1 hugepage_sz:2097152 00:05:27.448 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.448 EAL: Virtual area found at 0x201000800000 (size = 0x61000) 00:05:27.448 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.448 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.448 EAL: Virtual area found at 0x201000a00000 (size = 0x400000000) 00:05:27.448 EAL: VA reserved for memseg list at 0x201000a00000, size 400000000 00:05:27.448 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.448 EAL: Virtual area found at 0x201400a00000 (size = 0x61000) 00:05:27.448 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.448 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.449 EAL: Virtual area found at 0x201400c00000 (size = 0x400000000) 00:05:27.449 EAL: VA reserved for memseg list at 0x201400c00000, size 400000000 00:05:27.449 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.449 EAL: Virtual area found at 0x201800c00000 (size = 0x61000) 00:05:27.449 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.449 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.449 EAL: Virtual area found at 0x201800e00000 (size = 0x400000000) 00:05:27.449 EAL: VA reserved for memseg list at 0x201800e00000, size 400000000 00:05:27.449 EAL: Ask a virtual area of 0x61000 bytes 00:05:27.449 EAL: Virtual area found at 0x201c00e00000 (size = 0x61000) 00:05:27.449 EAL: Memseg list allocated at socket 1, page size 0x800kB 00:05:27.449 EAL: Ask a virtual area of 0x400000000 bytes 00:05:27.449 EAL: Virtual area found at 0x201c01000000 (size = 0x400000000) 00:05:27.449 EAL: VA reserved for memseg list at 0x201c01000000, size 400000000 00:05:27.449 EAL: Hugepages will be freed exactly as allocated. 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: TSC frequency is ~2700000 KHz 00:05:27.449 EAL: Main lcore 0 is ready (tid=7fdf4dc2fa00;cpuset=[0]) 00:05:27.449 EAL: Trying to obtain current memory policy. 00:05:27.449 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.449 EAL: Restoring previous memory policy: 0 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was expanded by 2MB 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: No PCI address specified using 'addr=' in: bus=pci 00:05:27.449 EAL: Mem event callback 'spdk:(nil)' registered 00:05:27.449 00:05:27.449 00:05:27.449 CUnit - A unit testing framework for C - Version 2.1-3 00:05:27.449 http://cunit.sourceforge.net/ 00:05:27.449 00:05:27.449 00:05:27.449 Suite: components_suite 00:05:27.449 Test: vtophys_malloc_test ...passed 00:05:27.449 Test: vtophys_spdk_malloc_test ...EAL: Trying to obtain current memory policy. 00:05:27.449 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.449 EAL: Restoring previous memory policy: 4 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was expanded by 4MB 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was shrunk by 4MB 00:05:27.449 EAL: Trying to obtain current memory policy. 00:05:27.449 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.449 EAL: Restoring previous memory policy: 4 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was expanded by 6MB 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was shrunk by 6MB 00:05:27.449 EAL: Trying to obtain current memory policy. 00:05:27.449 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.449 EAL: Restoring previous memory policy: 4 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was expanded by 10MB 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was shrunk by 10MB 00:05:27.449 EAL: Trying to obtain current memory policy. 00:05:27.449 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.449 EAL: Restoring previous memory policy: 4 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was expanded by 18MB 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was shrunk by 18MB 00:05:27.449 EAL: Trying to obtain current memory policy. 00:05:27.449 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.449 EAL: Restoring previous memory policy: 4 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was expanded by 34MB 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was shrunk by 34MB 00:05:27.449 EAL: Trying to obtain current memory policy. 00:05:27.449 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.449 EAL: Restoring previous memory policy: 4 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was expanded by 66MB 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was shrunk by 66MB 00:05:27.449 EAL: Trying to obtain current memory policy. 00:05:27.449 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.449 EAL: Restoring previous memory policy: 4 00:05:27.449 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.449 EAL: request: mp_malloc_sync 00:05:27.449 EAL: No shared files mode enabled, IPC is disabled 00:05:27.449 EAL: Heap on socket 0 was expanded by 130MB 00:05:27.450 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.708 EAL: request: mp_malloc_sync 00:05:27.708 EAL: No shared files mode enabled, IPC is disabled 00:05:27.708 EAL: Heap on socket 0 was shrunk by 130MB 00:05:27.708 EAL: Trying to obtain current memory policy. 00:05:27.708 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.708 EAL: Restoring previous memory policy: 4 00:05:27.708 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.708 EAL: request: mp_malloc_sync 00:05:27.708 EAL: No shared files mode enabled, IPC is disabled 00:05:27.708 EAL: Heap on socket 0 was expanded by 258MB 00:05:27.708 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.708 EAL: request: mp_malloc_sync 00:05:27.708 EAL: No shared files mode enabled, IPC is disabled 00:05:27.708 EAL: Heap on socket 0 was shrunk by 258MB 00:05:27.708 EAL: Trying to obtain current memory policy. 00:05:27.708 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:27.967 EAL: Restoring previous memory policy: 4 00:05:27.967 EAL: Calling mem event callback 'spdk:(nil)' 00:05:27.967 EAL: request: mp_malloc_sync 00:05:27.967 EAL: No shared files mode enabled, IPC is disabled 00:05:27.967 EAL: Heap on socket 0 was expanded by 514MB 00:05:27.967 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.225 EAL: request: mp_malloc_sync 00:05:28.225 EAL: No shared files mode enabled, IPC is disabled 00:05:28.225 EAL: Heap on socket 0 was shrunk by 514MB 00:05:28.225 EAL: Trying to obtain current memory policy. 00:05:28.225 EAL: Setting policy MPOL_PREFERRED for socket 0 00:05:28.484 EAL: Restoring previous memory policy: 4 00:05:28.484 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.484 EAL: request: mp_malloc_sync 00:05:28.484 EAL: No shared files mode enabled, IPC is disabled 00:05:28.484 EAL: Heap on socket 0 was expanded by 1026MB 00:05:28.484 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.743 EAL: request: mp_malloc_sync 00:05:28.743 EAL: No shared files mode enabled, IPC is disabled 00:05:28.743 EAL: Heap on socket 0 was shrunk by 1026MB 00:05:28.743 passed 00:05:28.743 00:05:28.743 Run Summary: Type Total Ran Passed Failed Inactive 00:05:28.743 suites 1 1 n/a 0 0 00:05:28.743 tests 2 2 2 0 0 00:05:28.743 asserts 497 497 497 0 n/a 00:05:28.743 00:05:28.743 Elapsed time = 1.357 seconds 00:05:28.743 EAL: Calling mem event callback 'spdk:(nil)' 00:05:28.743 EAL: request: mp_malloc_sync 00:05:28.743 EAL: No shared files mode enabled, IPC is disabled 00:05:28.743 EAL: Heap on socket 0 was shrunk by 2MB 00:05:28.743 EAL: No shared files mode enabled, IPC is disabled 00:05:28.743 EAL: No shared files mode enabled, IPC is disabled 00:05:28.743 EAL: No shared files mode enabled, IPC is disabled 00:05:28.743 00:05:28.743 real 0m1.475s 00:05:28.743 user 0m0.836s 00:05:28.743 sys 0m0.603s 00:05:28.743 04:07:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:28.743 04:07:19 -- common/autotest_common.sh@10 -- # set +x 00:05:28.743 ************************************ 00:05:28.743 END TEST env_vtophys 00:05:28.743 ************************************ 00:05:28.743 04:07:19 -- env/env.sh@12 -- # run_test env_pci /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:28.743 04:07:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:28.743 04:07:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:28.743 04:07:19 -- common/autotest_common.sh@10 -- # set +x 00:05:28.743 ************************************ 00:05:28.743 START TEST env_pci 00:05:28.743 ************************************ 00:05:28.743 04:07:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/pci/pci_ut 00:05:28.743 00:05:28.743 00:05:28.743 CUnit - A unit testing framework for C - Version 2.1-3 00:05:28.743 http://cunit.sourceforge.net/ 00:05:28.743 00:05:28.743 00:05:28.743 Suite: pci 00:05:28.743 Test: pci_hook ...[2024-11-30 04:07:19.367428] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk/pci.c:1040:spdk_pci_device_claim: *ERROR*: Cannot create lock on device /var/tmp/spdk_pci_lock_10000:00:01.0, probably process 2235560 has claimed it 00:05:29.002 EAL: Cannot find device (10000:00:01.0) 00:05:29.002 EAL: Failed to attach device on primary process 00:05:29.002 passed 00:05:29.002 00:05:29.002 Run Summary: Type Total Ran Passed Failed Inactive 00:05:29.002 suites 1 1 n/a 0 0 00:05:29.002 tests 1 1 1 0 0 00:05:29.002 asserts 25 25 25 0 n/a 00:05:29.002 00:05:29.002 Elapsed time = 0.022 seconds 00:05:29.002 00:05:29.002 real 0m0.034s 00:05:29.002 user 0m0.009s 00:05:29.002 sys 0m0.024s 00:05:29.002 04:07:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:29.002 04:07:19 -- common/autotest_common.sh@10 -- # set +x 00:05:29.002 ************************************ 00:05:29.002 END TEST env_pci 00:05:29.002 ************************************ 00:05:29.002 04:07:19 -- env/env.sh@14 -- # argv='-c 0x1 ' 00:05:29.002 04:07:19 -- env/env.sh@15 -- # uname 00:05:29.002 04:07:19 -- env/env.sh@15 -- # '[' Linux = Linux ']' 00:05:29.002 04:07:19 -- env/env.sh@22 -- # argv+=--base-virtaddr=0x200000000000 00:05:29.002 04:07:19 -- env/env.sh@24 -- # run_test env_dpdk_post_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:29.002 04:07:19 -- common/autotest_common.sh@1087 -- # '[' 5 -le 1 ']' 00:05:29.002 04:07:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:29.002 04:07:19 -- common/autotest_common.sh@10 -- # set +x 00:05:29.002 ************************************ 00:05:29.002 START TEST env_dpdk_post_init 00:05:29.002 ************************************ 00:05:29.002 04:07:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/env_dpdk_post_init/env_dpdk_post_init -c 0x1 --base-virtaddr=0x200000000000 00:05:29.002 EAL: Detected CPU lcores: 48 00:05:29.002 EAL: Detected NUMA nodes: 2 00:05:29.002 EAL: Detected shared linkage of DPDK 00:05:29.002 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:29.002 EAL: Selected IOVA mode 'VA' 00:05:29.002 EAL: No free 2048 kB hugepages reported on node 1 00:05:29.002 EAL: VFIO support initialized 00:05:29.002 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:29.002 EAL: Using IOMMU type 1 (Type 1) 00:05:29.002 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:00:04.0 (socket 0) 00:05:29.002 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:00:04.1 (socket 0) 00:05:29.002 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:00:04.2 (socket 0) 00:05:29.002 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:00:04.3 (socket 0) 00:05:29.002 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:00:04.4 (socket 0) 00:05:29.002 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:00:04.5 (socket 0) 00:05:29.002 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:00:04.6 (socket 0) 00:05:29.002 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:00:04.7 (socket 0) 00:05:29.002 EAL: Probe PCI driver: spdk_ioat (8086:0e20) device: 0000:80:04.0 (socket 1) 00:05:29.261 EAL: Probe PCI driver: spdk_ioat (8086:0e21) device: 0000:80:04.1 (socket 1) 00:05:29.261 EAL: Probe PCI driver: spdk_ioat (8086:0e22) device: 0000:80:04.2 (socket 1) 00:05:29.261 EAL: Probe PCI driver: spdk_ioat (8086:0e23) device: 0000:80:04.3 (socket 1) 00:05:29.261 EAL: Probe PCI driver: spdk_ioat (8086:0e24) device: 0000:80:04.4 (socket 1) 00:05:29.261 EAL: Probe PCI driver: spdk_ioat (8086:0e25) device: 0000:80:04.5 (socket 1) 00:05:29.261 EAL: Probe PCI driver: spdk_ioat (8086:0e26) device: 0000:80:04.6 (socket 1) 00:05:29.261 EAL: Probe PCI driver: spdk_ioat (8086:0e27) device: 0000:80:04.7 (socket 1) 00:05:29.826 EAL: Probe PCI driver: spdk_nvme (8086:0a54) device: 0000:88:00.0 (socket 1) 00:05:33.104 EAL: Releasing PCI mapped resource for 0000:88:00.0 00:05:33.104 EAL: Calling pci_unmap_resource for 0000:88:00.0 at 0x202001040000 00:05:33.362 Starting DPDK initialization... 00:05:33.362 Starting SPDK post initialization... 00:05:33.362 SPDK NVMe probe 00:05:33.362 Attaching to 0000:88:00.0 00:05:33.362 Attached to 0000:88:00.0 00:05:33.362 Cleaning up... 00:05:33.362 00:05:33.362 real 0m4.397s 00:05:33.362 user 0m3.294s 00:05:33.362 sys 0m0.161s 00:05:33.362 04:07:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.362 04:07:23 -- common/autotest_common.sh@10 -- # set +x 00:05:33.362 ************************************ 00:05:33.362 END TEST env_dpdk_post_init 00:05:33.362 ************************************ 00:05:33.362 04:07:23 -- env/env.sh@26 -- # uname 00:05:33.362 04:07:23 -- env/env.sh@26 -- # '[' Linux = Linux ']' 00:05:33.362 04:07:23 -- env/env.sh@29 -- # run_test env_mem_callbacks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:33.362 04:07:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.362 04:07:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.362 04:07:23 -- common/autotest_common.sh@10 -- # set +x 00:05:33.362 ************************************ 00:05:33.362 START TEST env_mem_callbacks 00:05:33.362 ************************************ 00:05:33.362 04:07:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/env/mem_callbacks/mem_callbacks 00:05:33.362 EAL: Detected CPU lcores: 48 00:05:33.362 EAL: Detected NUMA nodes: 2 00:05:33.362 EAL: Detected shared linkage of DPDK 00:05:33.362 EAL: Multi-process socket /var/run/dpdk/rte/mp_socket 00:05:33.362 EAL: Selected IOVA mode 'VA' 00:05:33.362 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.362 EAL: VFIO support initialized 00:05:33.362 TELEMETRY: No legacy callbacks, legacy socket not created 00:05:33.362 00:05:33.362 00:05:33.362 CUnit - A unit testing framework for C - Version 2.1-3 00:05:33.362 http://cunit.sourceforge.net/ 00:05:33.362 00:05:33.362 00:05:33.362 Suite: memory 00:05:33.362 Test: test ... 00:05:33.362 register 0x200000200000 2097152 00:05:33.362 malloc 3145728 00:05:33.362 register 0x200000400000 4194304 00:05:33.362 buf 0x200000500000 len 3145728 PASSED 00:05:33.362 malloc 64 00:05:33.362 buf 0x2000004fff40 len 64 PASSED 00:05:33.362 malloc 4194304 00:05:33.362 register 0x200000800000 6291456 00:05:33.362 buf 0x200000a00000 len 4194304 PASSED 00:05:33.362 free 0x200000500000 3145728 00:05:33.362 free 0x2000004fff40 64 00:05:33.362 unregister 0x200000400000 4194304 PASSED 00:05:33.362 free 0x200000a00000 4194304 00:05:33.362 unregister 0x200000800000 6291456 PASSED 00:05:33.362 malloc 8388608 00:05:33.362 register 0x200000400000 10485760 00:05:33.362 buf 0x200000600000 len 8388608 PASSED 00:05:33.362 free 0x200000600000 8388608 00:05:33.362 unregister 0x200000400000 10485760 PASSED 00:05:33.362 passed 00:05:33.362 00:05:33.362 Run Summary: Type Total Ran Passed Failed Inactive 00:05:33.362 suites 1 1 n/a 0 0 00:05:33.362 tests 1 1 1 0 0 00:05:33.362 asserts 15 15 15 0 n/a 00:05:33.362 00:05:33.362 Elapsed time = 0.005 seconds 00:05:33.362 00:05:33.362 real 0m0.049s 00:05:33.362 user 0m0.011s 00:05:33.362 sys 0m0.038s 00:05:33.362 04:07:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.362 04:07:23 -- common/autotest_common.sh@10 -- # set +x 00:05:33.362 ************************************ 00:05:33.362 END TEST env_mem_callbacks 00:05:33.362 ************************************ 00:05:33.362 00:05:33.362 real 0m6.373s 00:05:33.362 user 0m4.436s 00:05:33.362 sys 0m0.985s 00:05:33.362 04:07:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:33.362 04:07:23 -- common/autotest_common.sh@10 -- # set +x 00:05:33.362 ************************************ 00:05:33.362 END TEST env 00:05:33.362 ************************************ 00:05:33.363 04:07:23 -- spdk/autotest.sh@163 -- # run_test rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:33.363 04:07:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:33.363 04:07:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:33.363 04:07:23 -- common/autotest_common.sh@10 -- # set +x 00:05:33.363 ************************************ 00:05:33.363 START TEST rpc 00:05:33.363 ************************************ 00:05:33.363 04:07:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc/rpc.sh 00:05:33.363 * Looking for test storage... 00:05:33.363 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:33.363 04:07:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:33.363 04:07:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:33.363 04:07:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:33.621 04:07:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:33.621 04:07:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:33.621 04:07:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:33.621 04:07:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:33.621 04:07:24 -- scripts/common.sh@335 -- # IFS=.-: 00:05:33.621 04:07:24 -- scripts/common.sh@335 -- # read -ra ver1 00:05:33.621 04:07:24 -- scripts/common.sh@336 -- # IFS=.-: 00:05:33.621 04:07:24 -- scripts/common.sh@336 -- # read -ra ver2 00:05:33.621 04:07:24 -- scripts/common.sh@337 -- # local 'op=<' 00:05:33.621 04:07:24 -- scripts/common.sh@339 -- # ver1_l=2 00:05:33.621 04:07:24 -- scripts/common.sh@340 -- # ver2_l=1 00:05:33.621 04:07:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:33.621 04:07:24 -- scripts/common.sh@343 -- # case "$op" in 00:05:33.621 04:07:24 -- scripts/common.sh@344 -- # : 1 00:05:33.621 04:07:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:33.621 04:07:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:33.621 04:07:24 -- scripts/common.sh@364 -- # decimal 1 00:05:33.621 04:07:24 -- scripts/common.sh@352 -- # local d=1 00:05:33.621 04:07:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:33.621 04:07:24 -- scripts/common.sh@354 -- # echo 1 00:05:33.621 04:07:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:33.621 04:07:24 -- scripts/common.sh@365 -- # decimal 2 00:05:33.621 04:07:24 -- scripts/common.sh@352 -- # local d=2 00:05:33.621 04:07:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:33.621 04:07:24 -- scripts/common.sh@354 -- # echo 2 00:05:33.621 04:07:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:33.621 04:07:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:33.621 04:07:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:33.621 04:07:24 -- scripts/common.sh@367 -- # return 0 00:05:33.621 04:07:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:33.621 04:07:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:33.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.621 --rc genhtml_branch_coverage=1 00:05:33.621 --rc genhtml_function_coverage=1 00:05:33.621 --rc genhtml_legend=1 00:05:33.621 --rc geninfo_all_blocks=1 00:05:33.621 --rc geninfo_unexecuted_blocks=1 00:05:33.621 00:05:33.621 ' 00:05:33.621 04:07:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:33.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.621 --rc genhtml_branch_coverage=1 00:05:33.621 --rc genhtml_function_coverage=1 00:05:33.621 --rc genhtml_legend=1 00:05:33.621 --rc geninfo_all_blocks=1 00:05:33.621 --rc geninfo_unexecuted_blocks=1 00:05:33.621 00:05:33.621 ' 00:05:33.621 04:07:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:33.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.621 --rc genhtml_branch_coverage=1 00:05:33.621 --rc genhtml_function_coverage=1 00:05:33.621 --rc genhtml_legend=1 00:05:33.621 --rc geninfo_all_blocks=1 00:05:33.621 --rc geninfo_unexecuted_blocks=1 00:05:33.621 00:05:33.621 ' 00:05:33.621 04:07:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:33.621 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:33.621 --rc genhtml_branch_coverage=1 00:05:33.621 --rc genhtml_function_coverage=1 00:05:33.621 --rc genhtml_legend=1 00:05:33.621 --rc geninfo_all_blocks=1 00:05:33.621 --rc geninfo_unexecuted_blocks=1 00:05:33.621 00:05:33.621 ' 00:05:33.621 04:07:24 -- rpc/rpc.sh@65 -- # spdk_pid=2236234 00:05:33.621 04:07:24 -- rpc/rpc.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -e bdev 00:05:33.621 04:07:24 -- rpc/rpc.sh@66 -- # trap 'killprocess $spdk_pid; exit 1' SIGINT SIGTERM EXIT 00:05:33.621 04:07:24 -- rpc/rpc.sh@67 -- # waitforlisten 2236234 00:05:33.621 04:07:24 -- common/autotest_common.sh@829 -- # '[' -z 2236234 ']' 00:05:33.621 04:07:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:33.621 04:07:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:33.621 04:07:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:33.621 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:33.621 04:07:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:33.621 04:07:24 -- common/autotest_common.sh@10 -- # set +x 00:05:33.621 [2024-11-30 04:07:24.124385] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:33.621 [2024-11-30 04:07:24.124478] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2236234 ] 00:05:33.621 EAL: No free 2048 kB hugepages reported on node 1 00:05:33.621 [2024-11-30 04:07:24.183020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:33.879 [2024-11-30 04:07:24.270503] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:33.879 [2024-11-30 04:07:24.270673] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask bdev specified. 00:05:33.879 [2024-11-30 04:07:24.270694] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s spdk_tgt -p 2236234' to capture a snapshot of events at runtime. 00:05:33.879 [2024-11-30 04:07:24.270709] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/spdk_tgt_trace.pid2236234 for offline analysis/debug. 00:05:33.879 [2024-11-30 04:07:24.270741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:34.445 04:07:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:34.445 04:07:25 -- common/autotest_common.sh@862 -- # return 0 00:05:34.445 04:07:25 -- rpc/rpc.sh@69 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:34.445 04:07:25 -- rpc/rpc.sh@69 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc 00:05:34.445 04:07:25 -- rpc/rpc.sh@72 -- # rpc=rpc_cmd 00:05:34.445 04:07:25 -- rpc/rpc.sh@73 -- # run_test rpc_integrity rpc_integrity 00:05:34.445 04:07:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.445 04:07:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.445 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.709 ************************************ 00:05:34.709 START TEST rpc_integrity 00:05:34.709 ************************************ 00:05:34.710 04:07:25 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:34.710 04:07:25 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:34.710 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.710 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.710 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.710 04:07:25 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:34.710 04:07:25 -- rpc/rpc.sh@13 -- # jq length 00:05:34.710 04:07:25 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:34.710 04:07:25 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:34.710 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.710 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.710 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.710 04:07:25 -- rpc/rpc.sh@15 -- # malloc=Malloc0 00:05:34.710 04:07:25 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:34.710 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.710 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.710 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.710 04:07:25 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:34.710 { 00:05:34.710 "name": "Malloc0", 00:05:34.710 "aliases": [ 00:05:34.710 "74f505b8-b1bd-4191-af4b-ceeffb335c12" 00:05:34.710 ], 00:05:34.710 "product_name": "Malloc disk", 00:05:34.710 "block_size": 512, 00:05:34.710 "num_blocks": 16384, 00:05:34.710 "uuid": "74f505b8-b1bd-4191-af4b-ceeffb335c12", 00:05:34.710 "assigned_rate_limits": { 00:05:34.711 "rw_ios_per_sec": 0, 00:05:34.711 "rw_mbytes_per_sec": 0, 00:05:34.711 "r_mbytes_per_sec": 0, 00:05:34.711 "w_mbytes_per_sec": 0 00:05:34.711 }, 00:05:34.711 "claimed": false, 00:05:34.711 "zoned": false, 00:05:34.711 "supported_io_types": { 00:05:34.711 "read": true, 00:05:34.711 "write": true, 00:05:34.711 "unmap": true, 00:05:34.711 "write_zeroes": true, 00:05:34.711 "flush": true, 00:05:34.711 "reset": true, 00:05:34.711 "compare": false, 00:05:34.711 "compare_and_write": false, 00:05:34.711 "abort": true, 00:05:34.711 "nvme_admin": false, 00:05:34.711 "nvme_io": false 00:05:34.711 }, 00:05:34.711 "memory_domains": [ 00:05:34.711 { 00:05:34.711 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:34.711 "dma_device_type": 2 00:05:34.711 } 00:05:34.711 ], 00:05:34.711 "driver_specific": {} 00:05:34.711 } 00:05:34.711 ]' 00:05:34.711 04:07:25 -- rpc/rpc.sh@17 -- # jq length 00:05:34.711 04:07:25 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:34.711 04:07:25 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc0 -p Passthru0 00:05:34.711 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.711 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.711 [2024-11-30 04:07:25.189627] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc0 00:05:34.711 [2024-11-30 04:07:25.189677] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:34.711 [2024-11-30 04:07:25.189702] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x1f33bf0 00:05:34.711 [2024-11-30 04:07:25.189718] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:34.712 [2024-11-30 04:07:25.191222] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:34.712 [2024-11-30 04:07:25.191266] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:34.712 Passthru0 00:05:34.712 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.712 04:07:25 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:34.712 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.712 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.712 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.712 04:07:25 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:34.712 { 00:05:34.712 "name": "Malloc0", 00:05:34.712 "aliases": [ 00:05:34.712 "74f505b8-b1bd-4191-af4b-ceeffb335c12" 00:05:34.712 ], 00:05:34.712 "product_name": "Malloc disk", 00:05:34.712 "block_size": 512, 00:05:34.712 "num_blocks": 16384, 00:05:34.712 "uuid": "74f505b8-b1bd-4191-af4b-ceeffb335c12", 00:05:34.712 "assigned_rate_limits": { 00:05:34.712 "rw_ios_per_sec": 0, 00:05:34.712 "rw_mbytes_per_sec": 0, 00:05:34.712 "r_mbytes_per_sec": 0, 00:05:34.712 "w_mbytes_per_sec": 0 00:05:34.712 }, 00:05:34.712 "claimed": true, 00:05:34.712 "claim_type": "exclusive_write", 00:05:34.712 "zoned": false, 00:05:34.712 "supported_io_types": { 00:05:34.712 "read": true, 00:05:34.712 "write": true, 00:05:34.712 "unmap": true, 00:05:34.712 "write_zeroes": true, 00:05:34.712 "flush": true, 00:05:34.712 "reset": true, 00:05:34.712 "compare": false, 00:05:34.712 "compare_and_write": false, 00:05:34.712 "abort": true, 00:05:34.712 "nvme_admin": false, 00:05:34.712 "nvme_io": false 00:05:34.712 }, 00:05:34.712 "memory_domains": [ 00:05:34.712 { 00:05:34.712 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:34.712 "dma_device_type": 2 00:05:34.712 } 00:05:34.712 ], 00:05:34.712 "driver_specific": {} 00:05:34.712 }, 00:05:34.712 { 00:05:34.712 "name": "Passthru0", 00:05:34.712 "aliases": [ 00:05:34.712 "63cacceb-2b2f-5e07-95e8-024b222ffcf3" 00:05:34.712 ], 00:05:34.713 "product_name": "passthru", 00:05:34.713 "block_size": 512, 00:05:34.713 "num_blocks": 16384, 00:05:34.713 "uuid": "63cacceb-2b2f-5e07-95e8-024b222ffcf3", 00:05:34.713 "assigned_rate_limits": { 00:05:34.713 "rw_ios_per_sec": 0, 00:05:34.713 "rw_mbytes_per_sec": 0, 00:05:34.713 "r_mbytes_per_sec": 0, 00:05:34.713 "w_mbytes_per_sec": 0 00:05:34.713 }, 00:05:34.713 "claimed": false, 00:05:34.713 "zoned": false, 00:05:34.713 "supported_io_types": { 00:05:34.713 "read": true, 00:05:34.713 "write": true, 00:05:34.713 "unmap": true, 00:05:34.713 "write_zeroes": true, 00:05:34.713 "flush": true, 00:05:34.713 "reset": true, 00:05:34.713 "compare": false, 00:05:34.713 "compare_and_write": false, 00:05:34.713 "abort": true, 00:05:34.713 "nvme_admin": false, 00:05:34.713 "nvme_io": false 00:05:34.713 }, 00:05:34.713 "memory_domains": [ 00:05:34.713 { 00:05:34.713 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:34.713 "dma_device_type": 2 00:05:34.713 } 00:05:34.713 ], 00:05:34.713 "driver_specific": { 00:05:34.713 "passthru": { 00:05:34.713 "name": "Passthru0", 00:05:34.713 "base_bdev_name": "Malloc0" 00:05:34.713 } 00:05:34.713 } 00:05:34.713 } 00:05:34.713 ]' 00:05:34.713 04:07:25 -- rpc/rpc.sh@21 -- # jq length 00:05:34.713 04:07:25 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:34.713 04:07:25 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:34.713 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.713 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.713 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.714 04:07:25 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc0 00:05:34.714 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.714 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.714 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.714 04:07:25 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:34.714 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.714 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.714 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.714 04:07:25 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:34.714 04:07:25 -- rpc/rpc.sh@26 -- # jq length 00:05:34.714 04:07:25 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:34.714 00:05:34.714 real 0m0.228s 00:05:34.714 user 0m0.152s 00:05:34.714 sys 0m0.015s 00:05:34.714 04:07:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.714 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.714 ************************************ 00:05:34.714 END TEST rpc_integrity 00:05:34.714 ************************************ 00:05:34.714 04:07:25 -- rpc/rpc.sh@74 -- # run_test rpc_plugins rpc_plugins 00:05:34.714 04:07:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.714 04:07:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.714 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.714 ************************************ 00:05:34.714 START TEST rpc_plugins 00:05:34.714 ************************************ 00:05:34.714 04:07:25 -- common/autotest_common.sh@1114 -- # rpc_plugins 00:05:34.714 04:07:25 -- rpc/rpc.sh@30 -- # rpc_cmd --plugin rpc_plugin create_malloc 00:05:34.715 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.715 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.715 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.977 04:07:25 -- rpc/rpc.sh@30 -- # malloc=Malloc1 00:05:34.977 04:07:25 -- rpc/rpc.sh@31 -- # rpc_cmd bdev_get_bdevs 00:05:34.977 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.977 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.977 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.977 04:07:25 -- rpc/rpc.sh@31 -- # bdevs='[ 00:05:34.977 { 00:05:34.977 "name": "Malloc1", 00:05:34.977 "aliases": [ 00:05:34.977 "175d9c99-97b4-41a9-9df0-492fd3e4298d" 00:05:34.977 ], 00:05:34.977 "product_name": "Malloc disk", 00:05:34.977 "block_size": 4096, 00:05:34.977 "num_blocks": 256, 00:05:34.977 "uuid": "175d9c99-97b4-41a9-9df0-492fd3e4298d", 00:05:34.977 "assigned_rate_limits": { 00:05:34.977 "rw_ios_per_sec": 0, 00:05:34.977 "rw_mbytes_per_sec": 0, 00:05:34.977 "r_mbytes_per_sec": 0, 00:05:34.977 "w_mbytes_per_sec": 0 00:05:34.977 }, 00:05:34.977 "claimed": false, 00:05:34.977 "zoned": false, 00:05:34.977 "supported_io_types": { 00:05:34.977 "read": true, 00:05:34.977 "write": true, 00:05:34.977 "unmap": true, 00:05:34.977 "write_zeroes": true, 00:05:34.977 "flush": true, 00:05:34.977 "reset": true, 00:05:34.977 "compare": false, 00:05:34.977 "compare_and_write": false, 00:05:34.977 "abort": true, 00:05:34.977 "nvme_admin": false, 00:05:34.977 "nvme_io": false 00:05:34.977 }, 00:05:34.977 "memory_domains": [ 00:05:34.977 { 00:05:34.977 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:34.977 "dma_device_type": 2 00:05:34.977 } 00:05:34.977 ], 00:05:34.977 "driver_specific": {} 00:05:34.977 } 00:05:34.977 ]' 00:05:34.977 04:07:25 -- rpc/rpc.sh@32 -- # jq length 00:05:34.977 04:07:25 -- rpc/rpc.sh@32 -- # '[' 1 == 1 ']' 00:05:34.977 04:07:25 -- rpc/rpc.sh@34 -- # rpc_cmd --plugin rpc_plugin delete_malloc Malloc1 00:05:34.977 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.977 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.977 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.977 04:07:25 -- rpc/rpc.sh@35 -- # rpc_cmd bdev_get_bdevs 00:05:34.977 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.977 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.977 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.977 04:07:25 -- rpc/rpc.sh@35 -- # bdevs='[]' 00:05:34.977 04:07:25 -- rpc/rpc.sh@36 -- # jq length 00:05:34.978 04:07:25 -- rpc/rpc.sh@36 -- # '[' 0 == 0 ']' 00:05:34.978 00:05:34.978 real 0m0.111s 00:05:34.978 user 0m0.070s 00:05:34.978 sys 0m0.013s 00:05:34.978 04:07:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:34.978 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.978 ************************************ 00:05:34.978 END TEST rpc_plugins 00:05:34.978 ************************************ 00:05:34.978 04:07:25 -- rpc/rpc.sh@75 -- # run_test rpc_trace_cmd_test rpc_trace_cmd_test 00:05:34.978 04:07:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:34.978 04:07:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:34.978 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.978 ************************************ 00:05:34.978 START TEST rpc_trace_cmd_test 00:05:34.978 ************************************ 00:05:34.978 04:07:25 -- common/autotest_common.sh@1114 -- # rpc_trace_cmd_test 00:05:34.978 04:07:25 -- rpc/rpc.sh@40 -- # local info 00:05:34.978 04:07:25 -- rpc/rpc.sh@42 -- # rpc_cmd trace_get_info 00:05:34.978 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:34.978 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:34.978 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:34.978 04:07:25 -- rpc/rpc.sh@42 -- # info='{ 00:05:34.978 "tpoint_shm_path": "/dev/shm/spdk_tgt_trace.pid2236234", 00:05:34.978 "tpoint_group_mask": "0x8", 00:05:34.978 "iscsi_conn": { 00:05:34.978 "mask": "0x2", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "scsi": { 00:05:34.978 "mask": "0x4", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "bdev": { 00:05:34.978 "mask": "0x8", 00:05:34.978 "tpoint_mask": "0xffffffffffffffff" 00:05:34.978 }, 00:05:34.978 "nvmf_rdma": { 00:05:34.978 "mask": "0x10", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "nvmf_tcp": { 00:05:34.978 "mask": "0x20", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "ftl": { 00:05:34.978 "mask": "0x40", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "blobfs": { 00:05:34.978 "mask": "0x80", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "dsa": { 00:05:34.978 "mask": "0x200", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "thread": { 00:05:34.978 "mask": "0x400", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "nvme_pcie": { 00:05:34.978 "mask": "0x800", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "iaa": { 00:05:34.978 "mask": "0x1000", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "nvme_tcp": { 00:05:34.978 "mask": "0x2000", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 }, 00:05:34.978 "bdev_nvme": { 00:05:34.978 "mask": "0x4000", 00:05:34.978 "tpoint_mask": "0x0" 00:05:34.978 } 00:05:34.978 }' 00:05:34.978 04:07:25 -- rpc/rpc.sh@43 -- # jq length 00:05:34.978 04:07:25 -- rpc/rpc.sh@43 -- # '[' 15 -gt 2 ']' 00:05:34.978 04:07:25 -- rpc/rpc.sh@44 -- # jq 'has("tpoint_group_mask")' 00:05:34.978 04:07:25 -- rpc/rpc.sh@44 -- # '[' true = true ']' 00:05:34.978 04:07:25 -- rpc/rpc.sh@45 -- # jq 'has("tpoint_shm_path")' 00:05:34.978 04:07:25 -- rpc/rpc.sh@45 -- # '[' true = true ']' 00:05:34.978 04:07:25 -- rpc/rpc.sh@46 -- # jq 'has("bdev")' 00:05:35.236 04:07:25 -- rpc/rpc.sh@46 -- # '[' true = true ']' 00:05:35.236 04:07:25 -- rpc/rpc.sh@47 -- # jq -r .bdev.tpoint_mask 00:05:35.236 04:07:25 -- rpc/rpc.sh@47 -- # '[' 0xffffffffffffffff '!=' 0x0 ']' 00:05:35.236 00:05:35.236 real 0m0.193s 00:05:35.236 user 0m0.170s 00:05:35.236 sys 0m0.017s 00:05:35.236 04:07:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.236 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.236 ************************************ 00:05:35.236 END TEST rpc_trace_cmd_test 00:05:35.236 ************************************ 00:05:35.236 04:07:25 -- rpc/rpc.sh@76 -- # [[ 0 -eq 1 ]] 00:05:35.236 04:07:25 -- rpc/rpc.sh@80 -- # rpc=rpc_cmd 00:05:35.236 04:07:25 -- rpc/rpc.sh@81 -- # run_test rpc_daemon_integrity rpc_integrity 00:05:35.236 04:07:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:35.236 04:07:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:35.236 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.236 ************************************ 00:05:35.236 START TEST rpc_daemon_integrity 00:05:35.236 ************************************ 00:05:35.236 04:07:25 -- common/autotest_common.sh@1114 -- # rpc_integrity 00:05:35.236 04:07:25 -- rpc/rpc.sh@12 -- # rpc_cmd bdev_get_bdevs 00:05:35.236 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.236 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.236 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.236 04:07:25 -- rpc/rpc.sh@12 -- # bdevs='[]' 00:05:35.236 04:07:25 -- rpc/rpc.sh@13 -- # jq length 00:05:35.236 04:07:25 -- rpc/rpc.sh@13 -- # '[' 0 == 0 ']' 00:05:35.236 04:07:25 -- rpc/rpc.sh@15 -- # rpc_cmd bdev_malloc_create 8 512 00:05:35.236 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.236 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.236 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.236 04:07:25 -- rpc/rpc.sh@15 -- # malloc=Malloc2 00:05:35.236 04:07:25 -- rpc/rpc.sh@16 -- # rpc_cmd bdev_get_bdevs 00:05:35.236 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.236 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.236 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.236 04:07:25 -- rpc/rpc.sh@16 -- # bdevs='[ 00:05:35.236 { 00:05:35.237 "name": "Malloc2", 00:05:35.237 "aliases": [ 00:05:35.237 "52c308d2-de68-4891-a6b0-28720987e08b" 00:05:35.237 ], 00:05:35.237 "product_name": "Malloc disk", 00:05:35.237 "block_size": 512, 00:05:35.237 "num_blocks": 16384, 00:05:35.237 "uuid": "52c308d2-de68-4891-a6b0-28720987e08b", 00:05:35.237 "assigned_rate_limits": { 00:05:35.237 "rw_ios_per_sec": 0, 00:05:35.237 "rw_mbytes_per_sec": 0, 00:05:35.237 "r_mbytes_per_sec": 0, 00:05:35.237 "w_mbytes_per_sec": 0 00:05:35.237 }, 00:05:35.237 "claimed": false, 00:05:35.237 "zoned": false, 00:05:35.237 "supported_io_types": { 00:05:35.237 "read": true, 00:05:35.237 "write": true, 00:05:35.237 "unmap": true, 00:05:35.237 "write_zeroes": true, 00:05:35.237 "flush": true, 00:05:35.237 "reset": true, 00:05:35.237 "compare": false, 00:05:35.237 "compare_and_write": false, 00:05:35.237 "abort": true, 00:05:35.237 "nvme_admin": false, 00:05:35.237 "nvme_io": false 00:05:35.237 }, 00:05:35.237 "memory_domains": [ 00:05:35.237 { 00:05:35.237 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.237 "dma_device_type": 2 00:05:35.237 } 00:05:35.237 ], 00:05:35.237 "driver_specific": {} 00:05:35.237 } 00:05:35.237 ]' 00:05:35.237 04:07:25 -- rpc/rpc.sh@17 -- # jq length 00:05:35.237 04:07:25 -- rpc/rpc.sh@17 -- # '[' 1 == 1 ']' 00:05:35.237 04:07:25 -- rpc/rpc.sh@19 -- # rpc_cmd bdev_passthru_create -b Malloc2 -p Passthru0 00:05:35.237 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.237 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.237 [2024-11-30 04:07:25.795377] vbdev_passthru.c: 607:vbdev_passthru_register: *NOTICE*: Match on Malloc2 00:05:35.237 [2024-11-30 04:07:25.795424] vbdev_passthru.c: 636:vbdev_passthru_register: *NOTICE*: base bdev opened 00:05:35.237 [2024-11-30 04:07:25.795448] vbdev_passthru.c: 676:vbdev_passthru_register: *NOTICE*: io_device created at: 0x0x20d3940 00:05:35.237 [2024-11-30 04:07:25.795464] vbdev_passthru.c: 691:vbdev_passthru_register: *NOTICE*: bdev claimed 00:05:35.237 [2024-11-30 04:07:25.796797] vbdev_passthru.c: 704:vbdev_passthru_register: *NOTICE*: pt_bdev registered 00:05:35.237 [2024-11-30 04:07:25.796826] vbdev_passthru.c: 705:vbdev_passthru_register: *NOTICE*: created pt_bdev for: Passthru0 00:05:35.237 Passthru0 00:05:35.237 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.237 04:07:25 -- rpc/rpc.sh@20 -- # rpc_cmd bdev_get_bdevs 00:05:35.237 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.237 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.237 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.237 04:07:25 -- rpc/rpc.sh@20 -- # bdevs='[ 00:05:35.237 { 00:05:35.237 "name": "Malloc2", 00:05:35.237 "aliases": [ 00:05:35.237 "52c308d2-de68-4891-a6b0-28720987e08b" 00:05:35.237 ], 00:05:35.237 "product_name": "Malloc disk", 00:05:35.237 "block_size": 512, 00:05:35.237 "num_blocks": 16384, 00:05:35.237 "uuid": "52c308d2-de68-4891-a6b0-28720987e08b", 00:05:35.237 "assigned_rate_limits": { 00:05:35.237 "rw_ios_per_sec": 0, 00:05:35.237 "rw_mbytes_per_sec": 0, 00:05:35.237 "r_mbytes_per_sec": 0, 00:05:35.237 "w_mbytes_per_sec": 0 00:05:35.237 }, 00:05:35.237 "claimed": true, 00:05:35.237 "claim_type": "exclusive_write", 00:05:35.237 "zoned": false, 00:05:35.237 "supported_io_types": { 00:05:35.237 "read": true, 00:05:35.237 "write": true, 00:05:35.237 "unmap": true, 00:05:35.237 "write_zeroes": true, 00:05:35.237 "flush": true, 00:05:35.237 "reset": true, 00:05:35.237 "compare": false, 00:05:35.237 "compare_and_write": false, 00:05:35.237 "abort": true, 00:05:35.237 "nvme_admin": false, 00:05:35.237 "nvme_io": false 00:05:35.237 }, 00:05:35.237 "memory_domains": [ 00:05:35.237 { 00:05:35.237 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.237 "dma_device_type": 2 00:05:35.237 } 00:05:35.237 ], 00:05:35.237 "driver_specific": {} 00:05:35.237 }, 00:05:35.237 { 00:05:35.237 "name": "Passthru0", 00:05:35.237 "aliases": [ 00:05:35.237 "a9685ea5-581b-55b3-8e9f-f9edd154ba42" 00:05:35.237 ], 00:05:35.237 "product_name": "passthru", 00:05:35.237 "block_size": 512, 00:05:35.237 "num_blocks": 16384, 00:05:35.237 "uuid": "a9685ea5-581b-55b3-8e9f-f9edd154ba42", 00:05:35.237 "assigned_rate_limits": { 00:05:35.237 "rw_ios_per_sec": 0, 00:05:35.237 "rw_mbytes_per_sec": 0, 00:05:35.237 "r_mbytes_per_sec": 0, 00:05:35.237 "w_mbytes_per_sec": 0 00:05:35.237 }, 00:05:35.237 "claimed": false, 00:05:35.237 "zoned": false, 00:05:35.237 "supported_io_types": { 00:05:35.237 "read": true, 00:05:35.237 "write": true, 00:05:35.237 "unmap": true, 00:05:35.237 "write_zeroes": true, 00:05:35.237 "flush": true, 00:05:35.237 "reset": true, 00:05:35.237 "compare": false, 00:05:35.237 "compare_and_write": false, 00:05:35.237 "abort": true, 00:05:35.237 "nvme_admin": false, 00:05:35.237 "nvme_io": false 00:05:35.237 }, 00:05:35.237 "memory_domains": [ 00:05:35.237 { 00:05:35.237 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:05:35.237 "dma_device_type": 2 00:05:35.237 } 00:05:35.237 ], 00:05:35.237 "driver_specific": { 00:05:35.237 "passthru": { 00:05:35.237 "name": "Passthru0", 00:05:35.237 "base_bdev_name": "Malloc2" 00:05:35.237 } 00:05:35.237 } 00:05:35.237 } 00:05:35.237 ]' 00:05:35.237 04:07:25 -- rpc/rpc.sh@21 -- # jq length 00:05:35.237 04:07:25 -- rpc/rpc.sh@21 -- # '[' 2 == 2 ']' 00:05:35.237 04:07:25 -- rpc/rpc.sh@23 -- # rpc_cmd bdev_passthru_delete Passthru0 00:05:35.237 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.237 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.237 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.237 04:07:25 -- rpc/rpc.sh@24 -- # rpc_cmd bdev_malloc_delete Malloc2 00:05:35.237 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.237 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.497 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.497 04:07:25 -- rpc/rpc.sh@25 -- # rpc_cmd bdev_get_bdevs 00:05:35.497 04:07:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:35.497 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.497 04:07:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:35.497 04:07:25 -- rpc/rpc.sh@25 -- # bdevs='[]' 00:05:35.497 04:07:25 -- rpc/rpc.sh@26 -- # jq length 00:05:35.497 04:07:25 -- rpc/rpc.sh@26 -- # '[' 0 == 0 ']' 00:05:35.497 00:05:35.497 real 0m0.227s 00:05:35.497 user 0m0.154s 00:05:35.497 sys 0m0.018s 00:05:35.497 04:07:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.497 04:07:25 -- common/autotest_common.sh@10 -- # set +x 00:05:35.497 ************************************ 00:05:35.497 END TEST rpc_daemon_integrity 00:05:35.497 ************************************ 00:05:35.497 04:07:25 -- rpc/rpc.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:05:35.497 04:07:25 -- rpc/rpc.sh@84 -- # killprocess 2236234 00:05:35.497 04:07:25 -- common/autotest_common.sh@936 -- # '[' -z 2236234 ']' 00:05:35.497 04:07:25 -- common/autotest_common.sh@940 -- # kill -0 2236234 00:05:35.497 04:07:25 -- common/autotest_common.sh@941 -- # uname 00:05:35.497 04:07:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:35.497 04:07:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2236234 00:05:35.497 04:07:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:35.497 04:07:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:35.497 04:07:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2236234' 00:05:35.497 killing process with pid 2236234 00:05:35.497 04:07:25 -- common/autotest_common.sh@955 -- # kill 2236234 00:05:35.497 04:07:25 -- common/autotest_common.sh@960 -- # wait 2236234 00:05:35.755 00:05:35.755 real 0m2.452s 00:05:35.755 user 0m3.113s 00:05:35.755 sys 0m0.584s 00:05:35.755 04:07:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:35.755 04:07:26 -- common/autotest_common.sh@10 -- # set +x 00:05:35.755 ************************************ 00:05:35.755 END TEST rpc 00:05:35.755 ************************************ 00:05:36.013 04:07:26 -- spdk/autotest.sh@164 -- # run_test rpc_client /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:36.013 04:07:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.013 04:07:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.013 04:07:26 -- common/autotest_common.sh@10 -- # set +x 00:05:36.013 ************************************ 00:05:36.013 START TEST rpc_client 00:05:36.013 ************************************ 00:05:36.013 04:07:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client.sh 00:05:36.013 * Looking for test storage... 00:05:36.013 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client 00:05:36.013 04:07:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:36.013 04:07:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:36.013 04:07:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:36.013 04:07:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:36.013 04:07:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:36.013 04:07:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:36.013 04:07:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:36.013 04:07:26 -- scripts/common.sh@335 -- # IFS=.-: 00:05:36.013 04:07:26 -- scripts/common.sh@335 -- # read -ra ver1 00:05:36.013 04:07:26 -- scripts/common.sh@336 -- # IFS=.-: 00:05:36.013 04:07:26 -- scripts/common.sh@336 -- # read -ra ver2 00:05:36.013 04:07:26 -- scripts/common.sh@337 -- # local 'op=<' 00:05:36.013 04:07:26 -- scripts/common.sh@339 -- # ver1_l=2 00:05:36.013 04:07:26 -- scripts/common.sh@340 -- # ver2_l=1 00:05:36.013 04:07:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:36.013 04:07:26 -- scripts/common.sh@343 -- # case "$op" in 00:05:36.013 04:07:26 -- scripts/common.sh@344 -- # : 1 00:05:36.013 04:07:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:36.013 04:07:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:36.013 04:07:26 -- scripts/common.sh@364 -- # decimal 1 00:05:36.013 04:07:26 -- scripts/common.sh@352 -- # local d=1 00:05:36.013 04:07:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:36.013 04:07:26 -- scripts/common.sh@354 -- # echo 1 00:05:36.013 04:07:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:36.013 04:07:26 -- scripts/common.sh@365 -- # decimal 2 00:05:36.013 04:07:26 -- scripts/common.sh@352 -- # local d=2 00:05:36.013 04:07:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:36.013 04:07:26 -- scripts/common.sh@354 -- # echo 2 00:05:36.013 04:07:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:36.013 04:07:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:36.013 04:07:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:36.013 04:07:26 -- scripts/common.sh@367 -- # return 0 00:05:36.013 04:07:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:36.013 04:07:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:36.013 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.014 --rc genhtml_branch_coverage=1 00:05:36.014 --rc genhtml_function_coverage=1 00:05:36.014 --rc genhtml_legend=1 00:05:36.014 --rc geninfo_all_blocks=1 00:05:36.014 --rc geninfo_unexecuted_blocks=1 00:05:36.014 00:05:36.014 ' 00:05:36.014 04:07:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:36.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.014 --rc genhtml_branch_coverage=1 00:05:36.014 --rc genhtml_function_coverage=1 00:05:36.014 --rc genhtml_legend=1 00:05:36.014 --rc geninfo_all_blocks=1 00:05:36.014 --rc geninfo_unexecuted_blocks=1 00:05:36.014 00:05:36.014 ' 00:05:36.014 04:07:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:36.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.014 --rc genhtml_branch_coverage=1 00:05:36.014 --rc genhtml_function_coverage=1 00:05:36.014 --rc genhtml_legend=1 00:05:36.014 --rc geninfo_all_blocks=1 00:05:36.014 --rc geninfo_unexecuted_blocks=1 00:05:36.014 00:05:36.014 ' 00:05:36.014 04:07:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:36.014 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.014 --rc genhtml_branch_coverage=1 00:05:36.014 --rc genhtml_function_coverage=1 00:05:36.014 --rc genhtml_legend=1 00:05:36.014 --rc geninfo_all_blocks=1 00:05:36.014 --rc geninfo_unexecuted_blocks=1 00:05:36.014 00:05:36.014 ' 00:05:36.014 04:07:26 -- rpc_client/rpc_client.sh@10 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_client/rpc_client_test 00:05:36.014 OK 00:05:36.014 04:07:26 -- rpc_client/rpc_client.sh@12 -- # trap - SIGINT SIGTERM EXIT 00:05:36.014 00:05:36.014 real 0m0.152s 00:05:36.014 user 0m0.101s 00:05:36.014 sys 0m0.059s 00:05:36.014 04:07:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:36.014 04:07:26 -- common/autotest_common.sh@10 -- # set +x 00:05:36.014 ************************************ 00:05:36.014 END TEST rpc_client 00:05:36.014 ************************************ 00:05:36.014 04:07:26 -- spdk/autotest.sh@165 -- # run_test json_config /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:36.014 04:07:26 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:36.014 04:07:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:36.014 04:07:26 -- common/autotest_common.sh@10 -- # set +x 00:05:36.014 ************************************ 00:05:36.014 START TEST json_config 00:05:36.014 ************************************ 00:05:36.014 04:07:26 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config.sh 00:05:36.014 04:07:26 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:36.014 04:07:26 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:36.014 04:07:26 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:36.273 04:07:26 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:36.273 04:07:26 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:36.273 04:07:26 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:36.273 04:07:26 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:36.273 04:07:26 -- scripts/common.sh@335 -- # IFS=.-: 00:05:36.273 04:07:26 -- scripts/common.sh@335 -- # read -ra ver1 00:05:36.273 04:07:26 -- scripts/common.sh@336 -- # IFS=.-: 00:05:36.273 04:07:26 -- scripts/common.sh@336 -- # read -ra ver2 00:05:36.273 04:07:26 -- scripts/common.sh@337 -- # local 'op=<' 00:05:36.273 04:07:26 -- scripts/common.sh@339 -- # ver1_l=2 00:05:36.273 04:07:26 -- scripts/common.sh@340 -- # ver2_l=1 00:05:36.273 04:07:26 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:36.273 04:07:26 -- scripts/common.sh@343 -- # case "$op" in 00:05:36.273 04:07:26 -- scripts/common.sh@344 -- # : 1 00:05:36.273 04:07:26 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:36.273 04:07:26 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:36.273 04:07:26 -- scripts/common.sh@364 -- # decimal 1 00:05:36.273 04:07:26 -- scripts/common.sh@352 -- # local d=1 00:05:36.273 04:07:26 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:36.273 04:07:26 -- scripts/common.sh@354 -- # echo 1 00:05:36.273 04:07:26 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:36.273 04:07:26 -- scripts/common.sh@365 -- # decimal 2 00:05:36.273 04:07:26 -- scripts/common.sh@352 -- # local d=2 00:05:36.273 04:07:26 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:36.273 04:07:26 -- scripts/common.sh@354 -- # echo 2 00:05:36.273 04:07:26 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:36.273 04:07:26 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:36.273 04:07:26 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:36.273 04:07:26 -- scripts/common.sh@367 -- # return 0 00:05:36.273 04:07:26 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:36.273 04:07:26 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:36.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.273 --rc genhtml_branch_coverage=1 00:05:36.273 --rc genhtml_function_coverage=1 00:05:36.273 --rc genhtml_legend=1 00:05:36.273 --rc geninfo_all_blocks=1 00:05:36.273 --rc geninfo_unexecuted_blocks=1 00:05:36.273 00:05:36.273 ' 00:05:36.273 04:07:26 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:36.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.273 --rc genhtml_branch_coverage=1 00:05:36.273 --rc genhtml_function_coverage=1 00:05:36.273 --rc genhtml_legend=1 00:05:36.273 --rc geninfo_all_blocks=1 00:05:36.273 --rc geninfo_unexecuted_blocks=1 00:05:36.273 00:05:36.273 ' 00:05:36.273 04:07:26 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:36.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.273 --rc genhtml_branch_coverage=1 00:05:36.273 --rc genhtml_function_coverage=1 00:05:36.273 --rc genhtml_legend=1 00:05:36.273 --rc geninfo_all_blocks=1 00:05:36.273 --rc geninfo_unexecuted_blocks=1 00:05:36.273 00:05:36.273 ' 00:05:36.273 04:07:26 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:36.273 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:36.273 --rc genhtml_branch_coverage=1 00:05:36.273 --rc genhtml_function_coverage=1 00:05:36.273 --rc genhtml_legend=1 00:05:36.273 --rc geninfo_all_blocks=1 00:05:36.273 --rc geninfo_unexecuted_blocks=1 00:05:36.273 00:05:36.273 ' 00:05:36.273 04:07:26 -- json_config/json_config.sh@8 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:36.273 04:07:26 -- nvmf/common.sh@7 -- # uname -s 00:05:36.273 04:07:26 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:36.273 04:07:26 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:36.273 04:07:26 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:36.273 04:07:26 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:36.273 04:07:26 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:36.273 04:07:26 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:36.273 04:07:26 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:36.273 04:07:26 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:36.273 04:07:26 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:36.273 04:07:26 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:36.273 04:07:26 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:36.273 04:07:26 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:36.273 04:07:26 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:36.273 04:07:26 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:36.273 04:07:26 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:36.273 04:07:26 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:36.273 04:07:26 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:36.273 04:07:26 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:36.273 04:07:26 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:36.273 04:07:26 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.273 04:07:26 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.273 04:07:26 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.273 04:07:26 -- paths/export.sh@5 -- # export PATH 00:05:36.273 04:07:26 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:36.273 04:07:26 -- nvmf/common.sh@46 -- # : 0 00:05:36.273 04:07:26 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:36.273 04:07:26 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:36.273 04:07:26 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:36.274 04:07:26 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:36.274 04:07:26 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:36.274 04:07:26 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:36.274 04:07:26 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:36.274 04:07:26 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:36.274 04:07:26 -- json_config/json_config.sh@10 -- # [[ 0 -eq 1 ]] 00:05:36.274 04:07:26 -- json_config/json_config.sh@14 -- # [[ 0 -ne 1 ]] 00:05:36.274 04:07:26 -- json_config/json_config.sh@14 -- # [[ 0 -eq 1 ]] 00:05:36.274 04:07:26 -- json_config/json_config.sh@25 -- # (( SPDK_TEST_BLOCKDEV + SPDK_TEST_ISCSI + SPDK_TEST_NVMF + SPDK_TEST_VHOST + SPDK_TEST_VHOST_INIT + SPDK_TEST_RBD == 0 )) 00:05:36.274 04:07:26 -- json_config/json_config.sh@30 -- # app_pid=(['target']='' ['initiator']='') 00:05:36.274 04:07:26 -- json_config/json_config.sh@30 -- # declare -A app_pid 00:05:36.274 04:07:26 -- json_config/json_config.sh@31 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock' ['initiator']='/var/tmp/spdk_initiator.sock') 00:05:36.274 04:07:26 -- json_config/json_config.sh@31 -- # declare -A app_socket 00:05:36.274 04:07:26 -- json_config/json_config.sh@32 -- # app_params=(['target']='-m 0x1 -s 1024' ['initiator']='-m 0x2 -g -u -s 1024') 00:05:36.274 04:07:26 -- json_config/json_config.sh@32 -- # declare -A app_params 00:05:36.274 04:07:26 -- json_config/json_config.sh@33 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json' ['initiator']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json') 00:05:36.274 04:07:26 -- json_config/json_config.sh@33 -- # declare -A configs_path 00:05:36.274 04:07:26 -- json_config/json_config.sh@43 -- # last_event_id=0 00:05:36.274 04:07:26 -- json_config/json_config.sh@418 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:36.274 04:07:26 -- json_config/json_config.sh@419 -- # echo 'INFO: JSON configuration test init' 00:05:36.274 INFO: JSON configuration test init 00:05:36.274 04:07:26 -- json_config/json_config.sh@420 -- # json_config_test_init 00:05:36.274 04:07:26 -- json_config/json_config.sh@315 -- # timing_enter json_config_test_init 00:05:36.274 04:07:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:36.274 04:07:26 -- common/autotest_common.sh@10 -- # set +x 00:05:36.274 04:07:26 -- json_config/json_config.sh@316 -- # timing_enter json_config_setup_target 00:05:36.274 04:07:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:36.274 04:07:26 -- common/autotest_common.sh@10 -- # set +x 00:05:36.274 04:07:26 -- json_config/json_config.sh@318 -- # json_config_test_start_app target --wait-for-rpc 00:05:36.274 04:07:26 -- json_config/json_config.sh@98 -- # local app=target 00:05:36.274 04:07:26 -- json_config/json_config.sh@99 -- # shift 00:05:36.274 04:07:26 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:36.274 04:07:26 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:36.274 04:07:26 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:36.274 04:07:26 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:36.274 04:07:26 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:36.274 04:07:26 -- json_config/json_config.sh@111 -- # app_pid[$app]=2236729 00:05:36.274 04:07:26 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --wait-for-rpc 00:05:36.274 04:07:26 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:36.274 Waiting for target to run... 00:05:36.274 04:07:26 -- json_config/json_config.sh@114 -- # waitforlisten 2236729 /var/tmp/spdk_tgt.sock 00:05:36.274 04:07:26 -- common/autotest_common.sh@829 -- # '[' -z 2236729 ']' 00:05:36.274 04:07:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:36.274 04:07:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:36.274 04:07:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:36.274 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:36.274 04:07:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:36.274 04:07:26 -- common/autotest_common.sh@10 -- # set +x 00:05:36.274 [2024-11-30 04:07:26.773600] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:36.274 [2024-11-30 04:07:26.773682] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2236729 ] 00:05:36.274 EAL: No free 2048 kB hugepages reported on node 1 00:05:36.532 [2024-11-30 04:07:27.117892] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:36.791 [2024-11-30 04:07:27.179789] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:36.791 [2024-11-30 04:07:27.180003] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:37.357 04:07:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:37.357 04:07:27 -- common/autotest_common.sh@862 -- # return 0 00:05:37.357 04:07:27 -- json_config/json_config.sh@115 -- # echo '' 00:05:37.357 00:05:37.357 04:07:27 -- json_config/json_config.sh@322 -- # create_accel_config 00:05:37.357 04:07:27 -- json_config/json_config.sh@146 -- # timing_enter create_accel_config 00:05:37.357 04:07:27 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:37.357 04:07:27 -- common/autotest_common.sh@10 -- # set +x 00:05:37.357 04:07:27 -- json_config/json_config.sh@148 -- # [[ 0 -eq 1 ]] 00:05:37.357 04:07:27 -- json_config/json_config.sh@154 -- # timing_exit create_accel_config 00:05:37.357 04:07:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:37.357 04:07:27 -- common/autotest_common.sh@10 -- # set +x 00:05:37.357 04:07:27 -- json_config/json_config.sh@326 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh --json-with-subsystems 00:05:37.357 04:07:27 -- json_config/json_config.sh@327 -- # tgt_rpc load_config 00:05:37.357 04:07:27 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock load_config 00:05:40.640 04:07:30 -- json_config/json_config.sh@329 -- # tgt_check_notification_types 00:05:40.640 04:07:30 -- json_config/json_config.sh@46 -- # timing_enter tgt_check_notification_types 00:05:40.640 04:07:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:40.640 04:07:30 -- common/autotest_common.sh@10 -- # set +x 00:05:40.640 04:07:30 -- json_config/json_config.sh@48 -- # local ret=0 00:05:40.640 04:07:30 -- json_config/json_config.sh@49 -- # enabled_types=('bdev_register' 'bdev_unregister') 00:05:40.640 04:07:30 -- json_config/json_config.sh@49 -- # local enabled_types 00:05:40.640 04:07:30 -- json_config/json_config.sh@51 -- # tgt_rpc notify_get_types 00:05:40.640 04:07:30 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock notify_get_types 00:05:40.640 04:07:30 -- json_config/json_config.sh@51 -- # jq -r '.[]' 00:05:40.640 04:07:31 -- json_config/json_config.sh@51 -- # get_types=('bdev_register' 'bdev_unregister') 00:05:40.640 04:07:31 -- json_config/json_config.sh@51 -- # local get_types 00:05:40.640 04:07:31 -- json_config/json_config.sh@52 -- # [[ bdev_register bdev_unregister != \b\d\e\v\_\r\e\g\i\s\t\e\r\ \b\d\e\v\_\u\n\r\e\g\i\s\t\e\r ]] 00:05:40.640 04:07:31 -- json_config/json_config.sh@57 -- # timing_exit tgt_check_notification_types 00:05:40.640 04:07:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:40.640 04:07:31 -- common/autotest_common.sh@10 -- # set +x 00:05:40.640 04:07:31 -- json_config/json_config.sh@58 -- # return 0 00:05:40.640 04:07:31 -- json_config/json_config.sh@331 -- # [[ 0 -eq 1 ]] 00:05:40.640 04:07:31 -- json_config/json_config.sh@335 -- # [[ 0 -eq 1 ]] 00:05:40.640 04:07:31 -- json_config/json_config.sh@339 -- # [[ 0 -eq 1 ]] 00:05:40.640 04:07:31 -- json_config/json_config.sh@343 -- # [[ 1 -eq 1 ]] 00:05:40.640 04:07:31 -- json_config/json_config.sh@344 -- # create_nvmf_subsystem_config 00:05:40.640 04:07:31 -- json_config/json_config.sh@283 -- # timing_enter create_nvmf_subsystem_config 00:05:40.640 04:07:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:40.640 04:07:31 -- common/autotest_common.sh@10 -- # set +x 00:05:40.640 04:07:31 -- json_config/json_config.sh@285 -- # NVMF_FIRST_TARGET_IP=127.0.0.1 00:05:40.640 04:07:31 -- json_config/json_config.sh@286 -- # [[ tcp == \r\d\m\a ]] 00:05:40.640 04:07:31 -- json_config/json_config.sh@290 -- # [[ -z 127.0.0.1 ]] 00:05:40.640 04:07:31 -- json_config/json_config.sh@295 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:40.640 04:07:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocForNvmf0 00:05:40.898 MallocForNvmf0 00:05:40.898 04:07:31 -- json_config/json_config.sh@296 -- # tgt_rpc bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:40.898 04:07:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 4 1024 --name MallocForNvmf1 00:05:41.157 MallocForNvmf1 00:05:41.157 04:07:31 -- json_config/json_config.sh@298 -- # tgt_rpc nvmf_create_transport -t tcp -u 8192 -c 0 00:05:41.157 04:07:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_transport -t tcp -u 8192 -c 0 00:05:41.415 [2024-11-30 04:07:31.926566] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:41.415 04:07:31 -- json_config/json_config.sh@299 -- # tgt_rpc nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:41.415 04:07:31 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:05:41.673 04:07:32 -- json_config/json_config.sh@300 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:41.673 04:07:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf0 00:05:41.931 04:07:32 -- json_config/json_config.sh@301 -- # tgt_rpc nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:41.931 04:07:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 MallocForNvmf1 00:05:42.189 04:07:32 -- json_config/json_config.sh@302 -- # tgt_rpc nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:42.189 04:07:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 127.0.0.1 -s 4420 00:05:42.447 [2024-11-30 04:07:32.917911] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:42.448 04:07:32 -- json_config/json_config.sh@304 -- # timing_exit create_nvmf_subsystem_config 00:05:42.448 04:07:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:42.448 04:07:32 -- common/autotest_common.sh@10 -- # set +x 00:05:42.448 04:07:32 -- json_config/json_config.sh@346 -- # timing_exit json_config_setup_target 00:05:42.448 04:07:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:42.448 04:07:32 -- common/autotest_common.sh@10 -- # set +x 00:05:42.448 04:07:32 -- json_config/json_config.sh@348 -- # [[ 0 -eq 1 ]] 00:05:42.448 04:07:32 -- json_config/json_config.sh@353 -- # tgt_rpc bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:42.448 04:07:32 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_create 8 512 --name MallocBdevForConfigChangeCheck 00:05:42.706 MallocBdevForConfigChangeCheck 00:05:42.706 04:07:33 -- json_config/json_config.sh@355 -- # timing_exit json_config_test_init 00:05:42.706 04:07:33 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:42.706 04:07:33 -- common/autotest_common.sh@10 -- # set +x 00:05:42.706 04:07:33 -- json_config/json_config.sh@422 -- # tgt_rpc save_config 00:05:42.706 04:07:33 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:43.273 04:07:33 -- json_config/json_config.sh@424 -- # echo 'INFO: shutting down applications...' 00:05:43.273 INFO: shutting down applications... 00:05:43.273 04:07:33 -- json_config/json_config.sh@425 -- # [[ 0 -eq 1 ]] 00:05:43.273 04:07:33 -- json_config/json_config.sh@431 -- # json_config_clear target 00:05:43.273 04:07:33 -- json_config/json_config.sh@385 -- # [[ -n 22 ]] 00:05:43.273 04:07:33 -- json_config/json_config.sh@386 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py -s /var/tmp/spdk_tgt.sock clear_config 00:05:44.648 Calling clear_iscsi_subsystem 00:05:44.648 Calling clear_nvmf_subsystem 00:05:44.648 Calling clear_nbd_subsystem 00:05:44.648 Calling clear_ublk_subsystem 00:05:44.648 Calling clear_vhost_blk_subsystem 00:05:44.648 Calling clear_vhost_scsi_subsystem 00:05:44.648 Calling clear_scheduler_subsystem 00:05:44.648 Calling clear_bdev_subsystem 00:05:44.648 Calling clear_accel_subsystem 00:05:44.648 Calling clear_vmd_subsystem 00:05:44.648 Calling clear_sock_subsystem 00:05:44.648 Calling clear_iobuf_subsystem 00:05:44.648 04:07:35 -- json_config/json_config.sh@390 -- # local config_filter=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py 00:05:44.648 04:07:35 -- json_config/json_config.sh@396 -- # count=100 00:05:44.648 04:07:35 -- json_config/json_config.sh@397 -- # '[' 100 -gt 0 ']' 00:05:44.648 04:07:35 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:44.648 04:07:35 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method delete_global_parameters 00:05:44.648 04:07:35 -- json_config/json_config.sh@398 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method check_empty 00:05:45.215 04:07:35 -- json_config/json_config.sh@398 -- # break 00:05:45.215 04:07:35 -- json_config/json_config.sh@403 -- # '[' 100 -eq 0 ']' 00:05:45.215 04:07:35 -- json_config/json_config.sh@432 -- # json_config_test_shutdown_app target 00:05:45.215 04:07:35 -- json_config/json_config.sh@120 -- # local app=target 00:05:45.215 04:07:35 -- json_config/json_config.sh@123 -- # [[ -n 22 ]] 00:05:45.215 04:07:35 -- json_config/json_config.sh@124 -- # [[ -n 2236729 ]] 00:05:45.215 04:07:35 -- json_config/json_config.sh@127 -- # kill -SIGINT 2236729 00:05:45.215 04:07:35 -- json_config/json_config.sh@129 -- # (( i = 0 )) 00:05:45.215 04:07:35 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:45.215 04:07:35 -- json_config/json_config.sh@130 -- # kill -0 2236729 00:05:45.215 04:07:35 -- json_config/json_config.sh@134 -- # sleep 0.5 00:05:45.473 04:07:36 -- json_config/json_config.sh@129 -- # (( i++ )) 00:05:45.473 04:07:36 -- json_config/json_config.sh@129 -- # (( i < 30 )) 00:05:45.473 04:07:36 -- json_config/json_config.sh@130 -- # kill -0 2236729 00:05:45.473 04:07:36 -- json_config/json_config.sh@131 -- # app_pid[$app]= 00:05:45.473 04:07:36 -- json_config/json_config.sh@132 -- # break 00:05:45.473 04:07:36 -- json_config/json_config.sh@137 -- # [[ -n '' ]] 00:05:45.473 04:07:36 -- json_config/json_config.sh@142 -- # echo 'SPDK target shutdown done' 00:05:45.473 SPDK target shutdown done 00:05:45.473 04:07:36 -- json_config/json_config.sh@434 -- # echo 'INFO: relaunching applications...' 00:05:45.473 INFO: relaunching applications... 00:05:45.473 04:07:36 -- json_config/json_config.sh@435 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:45.473 04:07:36 -- json_config/json_config.sh@98 -- # local app=target 00:05:45.473 04:07:36 -- json_config/json_config.sh@99 -- # shift 00:05:45.473 04:07:36 -- json_config/json_config.sh@101 -- # [[ -n 22 ]] 00:05:45.473 04:07:36 -- json_config/json_config.sh@102 -- # [[ -z '' ]] 00:05:45.473 04:07:36 -- json_config/json_config.sh@104 -- # local app_extra_params= 00:05:45.731 04:07:36 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:45.731 04:07:36 -- json_config/json_config.sh@105 -- # [[ 0 -eq 1 ]] 00:05:45.731 04:07:36 -- json_config/json_config.sh@111 -- # app_pid[$app]=2238055 00:05:45.731 04:07:36 -- json_config/json_config.sh@113 -- # echo 'Waiting for target to run...' 00:05:45.731 Waiting for target to run... 00:05:45.731 04:07:36 -- json_config/json_config.sh@110 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:45.731 04:07:36 -- json_config/json_config.sh@114 -- # waitforlisten 2238055 /var/tmp/spdk_tgt.sock 00:05:45.731 04:07:36 -- common/autotest_common.sh@829 -- # '[' -z 2238055 ']' 00:05:45.731 04:07:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:45.731 04:07:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:45.731 04:07:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:45.731 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:45.731 04:07:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:45.731 04:07:36 -- common/autotest_common.sh@10 -- # set +x 00:05:45.731 [2024-11-30 04:07:36.155418] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:45.731 [2024-11-30 04:07:36.155506] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2238055 ] 00:05:45.731 EAL: No free 2048 kB hugepages reported on node 1 00:05:46.298 [2024-11-30 04:07:36.657565] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:46.298 [2024-11-30 04:07:36.737662] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:46.298 [2024-11-30 04:07:36.737866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:49.584 [2024-11-30 04:07:39.765663] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:05:49.584 [2024-11-30 04:07:39.798217] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4420 *** 00:05:49.584 04:07:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:49.584 04:07:40 -- common/autotest_common.sh@862 -- # return 0 00:05:49.584 04:07:40 -- json_config/json_config.sh@115 -- # echo '' 00:05:49.584 00:05:49.584 04:07:40 -- json_config/json_config.sh@436 -- # [[ 0 -eq 1 ]] 00:05:49.584 04:07:40 -- json_config/json_config.sh@440 -- # echo 'INFO: Checking if target configuration is the same...' 00:05:49.584 INFO: Checking if target configuration is the same... 00:05:49.584 04:07:40 -- json_config/json_config.sh@441 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:49.584 04:07:40 -- json_config/json_config.sh@441 -- # tgt_rpc save_config 00:05:49.584 04:07:40 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:49.584 + '[' 2 -ne 2 ']' 00:05:49.584 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:49.584 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:49.584 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:49.584 +++ basename /dev/fd/62 00:05:49.584 ++ mktemp /tmp/62.XXX 00:05:49.584 + tmp_file_1=/tmp/62.uGC 00:05:49.584 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:49.584 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:49.584 + tmp_file_2=/tmp/spdk_tgt_config.json.8GM 00:05:49.584 + ret=0 00:05:49.584 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:49.843 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.100 + diff -u /tmp/62.uGC /tmp/spdk_tgt_config.json.8GM 00:05:50.100 + echo 'INFO: JSON config files are the same' 00:05:50.100 INFO: JSON config files are the same 00:05:50.100 + rm /tmp/62.uGC /tmp/spdk_tgt_config.json.8GM 00:05:50.100 + exit 0 00:05:50.100 04:07:40 -- json_config/json_config.sh@442 -- # [[ 0 -eq 1 ]] 00:05:50.100 04:07:40 -- json_config/json_config.sh@447 -- # echo 'INFO: changing configuration and checking if this can be detected...' 00:05:50.100 INFO: changing configuration and checking if this can be detected... 00:05:50.100 04:07:40 -- json_config/json_config.sh@449 -- # tgt_rpc bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:50.100 04:07:40 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock bdev_malloc_delete MallocBdevForConfigChangeCheck 00:05:50.358 04:07:40 -- json_config/json_config.sh@450 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh /dev/fd/62 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.358 04:07:40 -- json_config/json_config.sh@450 -- # tgt_rpc save_config 00:05:50.358 04:07:40 -- json_config/json_config.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk_tgt.sock save_config 00:05:50.358 + '[' 2 -ne 2 ']' 00:05:50.358 +++ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_diff.sh 00:05:50.358 ++ readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/../.. 00:05:50.358 + rootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:05:50.358 +++ basename /dev/fd/62 00:05:50.358 ++ mktemp /tmp/62.XXX 00:05:50.358 + tmp_file_1=/tmp/62.Hwy 00:05:50.358 +++ basename /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:50.358 ++ mktemp /tmp/spdk_tgt_config.json.XXX 00:05:50.358 + tmp_file_2=/tmp/spdk_tgt_config.json.DB5 00:05:50.358 + ret=0 00:05:50.358 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.615 + /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/config_filter.py -method sort 00:05:50.615 + diff -u /tmp/62.Hwy /tmp/spdk_tgt_config.json.DB5 00:05:50.615 + ret=1 00:05:50.615 + echo '=== Start of file: /tmp/62.Hwy ===' 00:05:50.615 + cat /tmp/62.Hwy 00:05:50.616 + echo '=== End of file: /tmp/62.Hwy ===' 00:05:50.616 + echo '' 00:05:50.616 + echo '=== Start of file: /tmp/spdk_tgt_config.json.DB5 ===' 00:05:50.616 + cat /tmp/spdk_tgt_config.json.DB5 00:05:50.616 + echo '=== End of file: /tmp/spdk_tgt_config.json.DB5 ===' 00:05:50.616 + echo '' 00:05:50.616 + rm /tmp/62.Hwy /tmp/spdk_tgt_config.json.DB5 00:05:50.616 + exit 1 00:05:50.616 04:07:41 -- json_config/json_config.sh@454 -- # echo 'INFO: configuration change detected.' 00:05:50.616 INFO: configuration change detected. 00:05:50.616 04:07:41 -- json_config/json_config.sh@457 -- # json_config_test_fini 00:05:50.616 04:07:41 -- json_config/json_config.sh@359 -- # timing_enter json_config_test_fini 00:05:50.616 04:07:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:50.616 04:07:41 -- common/autotest_common.sh@10 -- # set +x 00:05:50.616 04:07:41 -- json_config/json_config.sh@360 -- # local ret=0 00:05:50.616 04:07:41 -- json_config/json_config.sh@362 -- # [[ -n '' ]] 00:05:50.616 04:07:41 -- json_config/json_config.sh@370 -- # [[ -n 2238055 ]] 00:05:50.616 04:07:41 -- json_config/json_config.sh@373 -- # cleanup_bdev_subsystem_config 00:05:50.616 04:07:41 -- json_config/json_config.sh@237 -- # timing_enter cleanup_bdev_subsystem_config 00:05:50.616 04:07:41 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:50.616 04:07:41 -- common/autotest_common.sh@10 -- # set +x 00:05:50.616 04:07:41 -- json_config/json_config.sh@239 -- # [[ 0 -eq 1 ]] 00:05:50.616 04:07:41 -- json_config/json_config.sh@246 -- # uname -s 00:05:50.616 04:07:41 -- json_config/json_config.sh@246 -- # [[ Linux = Linux ]] 00:05:50.616 04:07:41 -- json_config/json_config.sh@247 -- # rm -f /sample_aio 00:05:50.616 04:07:41 -- json_config/json_config.sh@250 -- # [[ 0 -eq 1 ]] 00:05:50.616 04:07:41 -- json_config/json_config.sh@254 -- # timing_exit cleanup_bdev_subsystem_config 00:05:50.616 04:07:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:50.616 04:07:41 -- common/autotest_common.sh@10 -- # set +x 00:05:50.616 04:07:41 -- json_config/json_config.sh@376 -- # killprocess 2238055 00:05:50.616 04:07:41 -- common/autotest_common.sh@936 -- # '[' -z 2238055 ']' 00:05:50.616 04:07:41 -- common/autotest_common.sh@940 -- # kill -0 2238055 00:05:50.616 04:07:41 -- common/autotest_common.sh@941 -- # uname 00:05:50.616 04:07:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:50.616 04:07:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2238055 00:05:50.874 04:07:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:50.874 04:07:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:50.874 04:07:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2238055' 00:05:50.874 killing process with pid 2238055 00:05:50.874 04:07:41 -- common/autotest_common.sh@955 -- # kill 2238055 00:05:50.874 04:07:41 -- common/autotest_common.sh@960 -- # wait 2238055 00:05:52.795 04:07:42 -- json_config/json_config.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_initiator_config.json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/spdk_tgt_config.json 00:05:52.795 04:07:42 -- json_config/json_config.sh@380 -- # timing_exit json_config_test_fini 00:05:52.795 04:07:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:52.795 04:07:42 -- common/autotest_common.sh@10 -- # set +x 00:05:52.795 04:07:42 -- json_config/json_config.sh@381 -- # return 0 00:05:52.795 04:07:42 -- json_config/json_config.sh@459 -- # echo 'INFO: Success' 00:05:52.795 INFO: Success 00:05:52.795 00:05:52.795 real 0m16.323s 00:05:52.795 user 0m18.799s 00:05:52.795 sys 0m2.094s 00:05:52.795 04:07:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:52.795 04:07:42 -- common/autotest_common.sh@10 -- # set +x 00:05:52.795 ************************************ 00:05:52.795 END TEST json_config 00:05:52.795 ************************************ 00:05:52.795 04:07:42 -- spdk/autotest.sh@166 -- # run_test json_config_extra_key /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:52.795 04:07:42 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:52.795 04:07:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:52.795 04:07:42 -- common/autotest_common.sh@10 -- # set +x 00:05:52.795 ************************************ 00:05:52.795 START TEST json_config_extra_key 00:05:52.795 ************************************ 00:05:52.795 04:07:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/json_config_extra_key.sh 00:05:52.795 04:07:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:52.795 04:07:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:52.795 04:07:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:52.795 04:07:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:52.795 04:07:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:52.795 04:07:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:52.795 04:07:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:52.795 04:07:43 -- scripts/common.sh@335 -- # IFS=.-: 00:05:52.795 04:07:43 -- scripts/common.sh@335 -- # read -ra ver1 00:05:52.795 04:07:43 -- scripts/common.sh@336 -- # IFS=.-: 00:05:52.795 04:07:43 -- scripts/common.sh@336 -- # read -ra ver2 00:05:52.795 04:07:43 -- scripts/common.sh@337 -- # local 'op=<' 00:05:52.795 04:07:43 -- scripts/common.sh@339 -- # ver1_l=2 00:05:52.795 04:07:43 -- scripts/common.sh@340 -- # ver2_l=1 00:05:52.795 04:07:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:52.795 04:07:43 -- scripts/common.sh@343 -- # case "$op" in 00:05:52.795 04:07:43 -- scripts/common.sh@344 -- # : 1 00:05:52.795 04:07:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:52.795 04:07:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:52.795 04:07:43 -- scripts/common.sh@364 -- # decimal 1 00:05:52.795 04:07:43 -- scripts/common.sh@352 -- # local d=1 00:05:52.795 04:07:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:52.795 04:07:43 -- scripts/common.sh@354 -- # echo 1 00:05:52.795 04:07:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:52.795 04:07:43 -- scripts/common.sh@365 -- # decimal 2 00:05:52.795 04:07:43 -- scripts/common.sh@352 -- # local d=2 00:05:52.795 04:07:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:52.795 04:07:43 -- scripts/common.sh@354 -- # echo 2 00:05:52.795 04:07:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:52.795 04:07:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:52.795 04:07:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:52.795 04:07:43 -- scripts/common.sh@367 -- # return 0 00:05:52.795 04:07:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:52.795 04:07:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:52.795 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.795 --rc genhtml_branch_coverage=1 00:05:52.795 --rc genhtml_function_coverage=1 00:05:52.795 --rc genhtml_legend=1 00:05:52.795 --rc geninfo_all_blocks=1 00:05:52.795 --rc geninfo_unexecuted_blocks=1 00:05:52.795 00:05:52.795 ' 00:05:52.795 04:07:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:52.795 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.795 --rc genhtml_branch_coverage=1 00:05:52.795 --rc genhtml_function_coverage=1 00:05:52.795 --rc genhtml_legend=1 00:05:52.795 --rc geninfo_all_blocks=1 00:05:52.795 --rc geninfo_unexecuted_blocks=1 00:05:52.795 00:05:52.795 ' 00:05:52.795 04:07:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:52.795 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.795 --rc genhtml_branch_coverage=1 00:05:52.795 --rc genhtml_function_coverage=1 00:05:52.795 --rc genhtml_legend=1 00:05:52.795 --rc geninfo_all_blocks=1 00:05:52.795 --rc geninfo_unexecuted_blocks=1 00:05:52.795 00:05:52.795 ' 00:05:52.795 04:07:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:52.795 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:52.795 --rc genhtml_branch_coverage=1 00:05:52.795 --rc genhtml_function_coverage=1 00:05:52.795 --rc genhtml_legend=1 00:05:52.795 --rc geninfo_all_blocks=1 00:05:52.795 --rc geninfo_unexecuted_blocks=1 00:05:52.795 00:05:52.795 ' 00:05:52.795 04:07:43 -- json_config/json_config_extra_key.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:05:52.795 04:07:43 -- nvmf/common.sh@7 -- # uname -s 00:05:52.795 04:07:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:05:52.795 04:07:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:05:52.795 04:07:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:05:52.795 04:07:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:05:52.795 04:07:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:05:52.795 04:07:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:05:52.795 04:07:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:05:52.795 04:07:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:05:52.796 04:07:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:05:52.796 04:07:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:05:52.796 04:07:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:05:52.796 04:07:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:05:52.796 04:07:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:05:52.796 04:07:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:05:52.796 04:07:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy-fallback 00:05:52.796 04:07:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:05:52.796 04:07:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:05:52.796 04:07:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:05:52.796 04:07:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:05:52.796 04:07:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:52.796 04:07:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:52.796 04:07:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:52.796 04:07:43 -- paths/export.sh@5 -- # export PATH 00:05:52.796 04:07:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:05:52.796 04:07:43 -- nvmf/common.sh@46 -- # : 0 00:05:52.796 04:07:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:05:52.796 04:07:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:05:52.796 04:07:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:05:52.796 04:07:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:05:52.796 04:07:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:05:52.796 04:07:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:05:52.796 04:07:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:05:52.796 04:07:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@16 -- # app_pid=(['target']='') 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@16 -- # declare -A app_pid 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@17 -- # app_socket=(['target']='/var/tmp/spdk_tgt.sock') 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@17 -- # declare -A app_socket 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@18 -- # app_params=(['target']='-m 0x1 -s 1024') 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@18 -- # declare -A app_params 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@19 -- # configs_path=(['target']='/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json') 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@19 -- # declare -A configs_path 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@74 -- # trap 'on_error_exit "${FUNCNAME}" "${LINENO}"' ERR 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@76 -- # echo 'INFO: launching applications...' 00:05:52.796 INFO: launching applications... 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@77 -- # json_config_test_start_app target --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@24 -- # local app=target 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@25 -- # shift 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@27 -- # [[ -n 22 ]] 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@28 -- # [[ -z '' ]] 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@31 -- # app_pid[$app]=2239027 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -s 1024 -r /var/tmp/spdk_tgt.sock --json /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/extra_key.json 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@33 -- # echo 'Waiting for target to run...' 00:05:52.796 Waiting for target to run... 00:05:52.796 04:07:43 -- json_config/json_config_extra_key.sh@34 -- # waitforlisten 2239027 /var/tmp/spdk_tgt.sock 00:05:52.796 04:07:43 -- common/autotest_common.sh@829 -- # '[' -z 2239027 ']' 00:05:52.796 04:07:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk_tgt.sock 00:05:52.796 04:07:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:52.796 04:07:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock...' 00:05:52.796 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk_tgt.sock... 00:05:52.796 04:07:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:52.796 04:07:43 -- common/autotest_common.sh@10 -- # set +x 00:05:52.796 [2024-11-30 04:07:43.121999] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:52.796 [2024-11-30 04:07:43.122100] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 -m 1024 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2239027 ] 00:05:52.796 EAL: No free 2048 kB hugepages reported on node 1 00:05:53.082 [2024-11-30 04:07:43.632302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:53.342 [2024-11-30 04:07:43.712610] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:53.342 [2024-11-30 04:07:43.712804] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:53.600 04:07:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:53.600 04:07:44 -- common/autotest_common.sh@862 -- # return 0 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@35 -- # echo '' 00:05:53.600 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@79 -- # echo 'INFO: shutting down applications...' 00:05:53.600 INFO: shutting down applications... 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@80 -- # json_config_test_shutdown_app target 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@40 -- # local app=target 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@43 -- # [[ -n 22 ]] 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@44 -- # [[ -n 2239027 ]] 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@47 -- # kill -SIGINT 2239027 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@49 -- # (( i = 0 )) 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2239027 00:05:53.600 04:07:44 -- json_config/json_config_extra_key.sh@54 -- # sleep 0.5 00:05:54.166 04:07:44 -- json_config/json_config_extra_key.sh@49 -- # (( i++ )) 00:05:54.166 04:07:44 -- json_config/json_config_extra_key.sh@49 -- # (( i < 30 )) 00:05:54.166 04:07:44 -- json_config/json_config_extra_key.sh@50 -- # kill -0 2239027 00:05:54.166 04:07:44 -- json_config/json_config_extra_key.sh@51 -- # app_pid[$app]= 00:05:54.166 04:07:44 -- json_config/json_config_extra_key.sh@52 -- # break 00:05:54.166 04:07:44 -- json_config/json_config_extra_key.sh@57 -- # [[ -n '' ]] 00:05:54.166 04:07:44 -- json_config/json_config_extra_key.sh@62 -- # echo 'SPDK target shutdown done' 00:05:54.166 SPDK target shutdown done 00:05:54.166 04:07:44 -- json_config/json_config_extra_key.sh@82 -- # echo Success 00:05:54.166 Success 00:05:54.166 00:05:54.166 real 0m1.659s 00:05:54.166 user 0m1.467s 00:05:54.166 sys 0m0.619s 00:05:54.166 04:07:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:54.166 04:07:44 -- common/autotest_common.sh@10 -- # set +x 00:05:54.166 ************************************ 00:05:54.166 END TEST json_config_extra_key 00:05:54.166 ************************************ 00:05:54.166 04:07:44 -- spdk/autotest.sh@167 -- # run_test alias_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:54.166 04:07:44 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:54.166 04:07:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:54.166 04:07:44 -- common/autotest_common.sh@10 -- # set +x 00:05:54.166 ************************************ 00:05:54.166 START TEST alias_rpc 00:05:54.166 ************************************ 00:05:54.166 04:07:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc/alias_rpc.sh 00:05:54.166 * Looking for test storage... 00:05:54.166 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/alias_rpc 00:05:54.166 04:07:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:54.166 04:07:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:54.166 04:07:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:54.166 04:07:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:54.166 04:07:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:54.166 04:07:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:54.166 04:07:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:54.166 04:07:44 -- scripts/common.sh@335 -- # IFS=.-: 00:05:54.166 04:07:44 -- scripts/common.sh@335 -- # read -ra ver1 00:05:54.166 04:07:44 -- scripts/common.sh@336 -- # IFS=.-: 00:05:54.166 04:07:44 -- scripts/common.sh@336 -- # read -ra ver2 00:05:54.166 04:07:44 -- scripts/common.sh@337 -- # local 'op=<' 00:05:54.166 04:07:44 -- scripts/common.sh@339 -- # ver1_l=2 00:05:54.166 04:07:44 -- scripts/common.sh@340 -- # ver2_l=1 00:05:54.166 04:07:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:54.166 04:07:44 -- scripts/common.sh@343 -- # case "$op" in 00:05:54.167 04:07:44 -- scripts/common.sh@344 -- # : 1 00:05:54.167 04:07:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:54.167 04:07:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:54.167 04:07:44 -- scripts/common.sh@364 -- # decimal 1 00:05:54.167 04:07:44 -- scripts/common.sh@352 -- # local d=1 00:05:54.167 04:07:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:54.167 04:07:44 -- scripts/common.sh@354 -- # echo 1 00:05:54.167 04:07:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:54.167 04:07:44 -- scripts/common.sh@365 -- # decimal 2 00:05:54.167 04:07:44 -- scripts/common.sh@352 -- # local d=2 00:05:54.167 04:07:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:54.167 04:07:44 -- scripts/common.sh@354 -- # echo 2 00:05:54.167 04:07:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:54.167 04:07:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:54.167 04:07:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:54.167 04:07:44 -- scripts/common.sh@367 -- # return 0 00:05:54.167 04:07:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:54.167 04:07:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:54.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.167 --rc genhtml_branch_coverage=1 00:05:54.167 --rc genhtml_function_coverage=1 00:05:54.167 --rc genhtml_legend=1 00:05:54.167 --rc geninfo_all_blocks=1 00:05:54.167 --rc geninfo_unexecuted_blocks=1 00:05:54.167 00:05:54.167 ' 00:05:54.167 04:07:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:54.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.167 --rc genhtml_branch_coverage=1 00:05:54.167 --rc genhtml_function_coverage=1 00:05:54.167 --rc genhtml_legend=1 00:05:54.167 --rc geninfo_all_blocks=1 00:05:54.167 --rc geninfo_unexecuted_blocks=1 00:05:54.167 00:05:54.167 ' 00:05:54.167 04:07:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:54.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.167 --rc genhtml_branch_coverage=1 00:05:54.167 --rc genhtml_function_coverage=1 00:05:54.167 --rc genhtml_legend=1 00:05:54.167 --rc geninfo_all_blocks=1 00:05:54.167 --rc geninfo_unexecuted_blocks=1 00:05:54.167 00:05:54.167 ' 00:05:54.167 04:07:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:54.167 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:54.167 --rc genhtml_branch_coverage=1 00:05:54.167 --rc genhtml_function_coverage=1 00:05:54.167 --rc genhtml_legend=1 00:05:54.167 --rc geninfo_all_blocks=1 00:05:54.167 --rc geninfo_unexecuted_blocks=1 00:05:54.167 00:05:54.167 ' 00:05:54.167 04:07:44 -- alias_rpc/alias_rpc.sh@10 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:05:54.167 04:07:44 -- alias_rpc/alias_rpc.sh@13 -- # spdk_tgt_pid=2239226 00:05:54.167 04:07:44 -- alias_rpc/alias_rpc.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:54.167 04:07:44 -- alias_rpc/alias_rpc.sh@14 -- # waitforlisten 2239226 00:05:54.167 04:07:44 -- common/autotest_common.sh@829 -- # '[' -z 2239226 ']' 00:05:54.167 04:07:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:54.167 04:07:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:54.167 04:07:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:54.167 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:54.167 04:07:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:54.167 04:07:44 -- common/autotest_common.sh@10 -- # set +x 00:05:54.426 [2024-11-30 04:07:44.810606] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:54.426 [2024-11-30 04:07:44.810706] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2239226 ] 00:05:54.426 EAL: No free 2048 kB hugepages reported on node 1 00:05:54.426 [2024-11-30 04:07:44.868208] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:54.426 [2024-11-30 04:07:44.954237] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:54.426 [2024-11-30 04:07:44.954441] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:55.367 04:07:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:55.367 04:07:45 -- common/autotest_common.sh@862 -- # return 0 00:05:55.367 04:07:45 -- alias_rpc/alias_rpc.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_config -i 00:05:55.625 04:07:46 -- alias_rpc/alias_rpc.sh@19 -- # killprocess 2239226 00:05:55.625 04:07:46 -- common/autotest_common.sh@936 -- # '[' -z 2239226 ']' 00:05:55.625 04:07:46 -- common/autotest_common.sh@940 -- # kill -0 2239226 00:05:55.625 04:07:46 -- common/autotest_common.sh@941 -- # uname 00:05:55.625 04:07:46 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:55.625 04:07:46 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2239226 00:05:55.625 04:07:46 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:55.625 04:07:46 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:55.625 04:07:46 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2239226' 00:05:55.625 killing process with pid 2239226 00:05:55.625 04:07:46 -- common/autotest_common.sh@955 -- # kill 2239226 00:05:55.625 04:07:46 -- common/autotest_common.sh@960 -- # wait 2239226 00:05:55.884 00:05:55.884 real 0m1.831s 00:05:55.884 user 0m2.125s 00:05:55.884 sys 0m0.443s 00:05:55.884 04:07:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:55.884 04:07:46 -- common/autotest_common.sh@10 -- # set +x 00:05:55.884 ************************************ 00:05:55.884 END TEST alias_rpc 00:05:55.884 ************************************ 00:05:55.884 04:07:46 -- spdk/autotest.sh@169 -- # [[ 0 -eq 0 ]] 00:05:55.884 04:07:46 -- spdk/autotest.sh@170 -- # run_test spdkcli_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:55.884 04:07:46 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:55.884 04:07:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:55.884 04:07:46 -- common/autotest_common.sh@10 -- # set +x 00:05:55.884 ************************************ 00:05:55.884 START TEST spdkcli_tcp 00:05:55.884 ************************************ 00:05:55.884 04:07:46 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/tcp.sh 00:05:56.144 * Looking for test storage... 00:05:56.144 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:05:56.144 04:07:46 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:56.144 04:07:46 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:56.144 04:07:46 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:56.144 04:07:46 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:56.144 04:07:46 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:56.144 04:07:46 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:56.144 04:07:46 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:56.144 04:07:46 -- scripts/common.sh@335 -- # IFS=.-: 00:05:56.144 04:07:46 -- scripts/common.sh@335 -- # read -ra ver1 00:05:56.144 04:07:46 -- scripts/common.sh@336 -- # IFS=.-: 00:05:56.144 04:07:46 -- scripts/common.sh@336 -- # read -ra ver2 00:05:56.144 04:07:46 -- scripts/common.sh@337 -- # local 'op=<' 00:05:56.144 04:07:46 -- scripts/common.sh@339 -- # ver1_l=2 00:05:56.144 04:07:46 -- scripts/common.sh@340 -- # ver2_l=1 00:05:56.144 04:07:46 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:56.144 04:07:46 -- scripts/common.sh@343 -- # case "$op" in 00:05:56.144 04:07:46 -- scripts/common.sh@344 -- # : 1 00:05:56.144 04:07:46 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:56.144 04:07:46 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:56.144 04:07:46 -- scripts/common.sh@364 -- # decimal 1 00:05:56.144 04:07:46 -- scripts/common.sh@352 -- # local d=1 00:05:56.144 04:07:46 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:56.144 04:07:46 -- scripts/common.sh@354 -- # echo 1 00:05:56.144 04:07:46 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:56.144 04:07:46 -- scripts/common.sh@365 -- # decimal 2 00:05:56.144 04:07:46 -- scripts/common.sh@352 -- # local d=2 00:05:56.144 04:07:46 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:56.144 04:07:46 -- scripts/common.sh@354 -- # echo 2 00:05:56.144 04:07:46 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:56.144 04:07:46 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:56.144 04:07:46 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:56.144 04:07:46 -- scripts/common.sh@367 -- # return 0 00:05:56.144 04:07:46 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:56.144 04:07:46 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:56.144 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.144 --rc genhtml_branch_coverage=1 00:05:56.144 --rc genhtml_function_coverage=1 00:05:56.144 --rc genhtml_legend=1 00:05:56.144 --rc geninfo_all_blocks=1 00:05:56.144 --rc geninfo_unexecuted_blocks=1 00:05:56.144 00:05:56.144 ' 00:05:56.144 04:07:46 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:56.144 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.144 --rc genhtml_branch_coverage=1 00:05:56.144 --rc genhtml_function_coverage=1 00:05:56.144 --rc genhtml_legend=1 00:05:56.144 --rc geninfo_all_blocks=1 00:05:56.144 --rc geninfo_unexecuted_blocks=1 00:05:56.144 00:05:56.144 ' 00:05:56.144 04:07:46 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:56.144 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.144 --rc genhtml_branch_coverage=1 00:05:56.144 --rc genhtml_function_coverage=1 00:05:56.144 --rc genhtml_legend=1 00:05:56.144 --rc geninfo_all_blocks=1 00:05:56.144 --rc geninfo_unexecuted_blocks=1 00:05:56.144 00:05:56.144 ' 00:05:56.144 04:07:46 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:56.144 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:56.144 --rc genhtml_branch_coverage=1 00:05:56.144 --rc genhtml_function_coverage=1 00:05:56.144 --rc genhtml_legend=1 00:05:56.144 --rc geninfo_all_blocks=1 00:05:56.144 --rc geninfo_unexecuted_blocks=1 00:05:56.144 00:05:56.144 ' 00:05:56.144 04:07:46 -- spdkcli/tcp.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:05:56.144 04:07:46 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:05:56.144 04:07:46 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:05:56.144 04:07:46 -- spdkcli/tcp.sh@18 -- # IP_ADDRESS=127.0.0.1 00:05:56.144 04:07:46 -- spdkcli/tcp.sh@19 -- # PORT=9998 00:05:56.144 04:07:46 -- spdkcli/tcp.sh@21 -- # trap 'err_cleanup; exit 1' SIGINT SIGTERM EXIT 00:05:56.144 04:07:46 -- spdkcli/tcp.sh@23 -- # timing_enter run_spdk_tgt_tcp 00:05:56.144 04:07:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:05:56.144 04:07:46 -- common/autotest_common.sh@10 -- # set +x 00:05:56.144 04:07:46 -- spdkcli/tcp.sh@25 -- # spdk_tgt_pid=2239559 00:05:56.144 04:07:46 -- spdkcli/tcp.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x3 -p 0 00:05:56.144 04:07:46 -- spdkcli/tcp.sh@27 -- # waitforlisten 2239559 00:05:56.144 04:07:46 -- common/autotest_common.sh@829 -- # '[' -z 2239559 ']' 00:05:56.144 04:07:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:56.144 04:07:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:56.144 04:07:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:56.144 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:56.144 04:07:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:56.144 04:07:46 -- common/autotest_common.sh@10 -- # set +x 00:05:56.144 [2024-11-30 04:07:46.665654] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:56.144 [2024-11-30 04:07:46.665740] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2239559 ] 00:05:56.144 EAL: No free 2048 kB hugepages reported on node 1 00:05:56.144 [2024-11-30 04:07:46.723340] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:05:56.404 [2024-11-30 04:07:46.810420] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:56.404 [2024-11-30 04:07:46.810646] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:56.404 [2024-11-30 04:07:46.810651] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:57.339 04:07:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:57.339 04:07:47 -- common/autotest_common.sh@862 -- # return 0 00:05:57.339 04:07:47 -- spdkcli/tcp.sh@31 -- # socat_pid=2239700 00:05:57.339 04:07:47 -- spdkcli/tcp.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -r 100 -t 2 -s 127.0.0.1 -p 9998 rpc_get_methods 00:05:57.339 04:07:47 -- spdkcli/tcp.sh@30 -- # socat TCP-LISTEN:9998 UNIX-CONNECT:/var/tmp/spdk.sock 00:05:57.339 [ 00:05:57.339 "bdev_malloc_delete", 00:05:57.339 "bdev_malloc_create", 00:05:57.339 "bdev_null_resize", 00:05:57.339 "bdev_null_delete", 00:05:57.339 "bdev_null_create", 00:05:57.339 "bdev_nvme_cuse_unregister", 00:05:57.339 "bdev_nvme_cuse_register", 00:05:57.339 "bdev_opal_new_user", 00:05:57.339 "bdev_opal_set_lock_state", 00:05:57.339 "bdev_opal_delete", 00:05:57.339 "bdev_opal_get_info", 00:05:57.339 "bdev_opal_create", 00:05:57.339 "bdev_nvme_opal_revert", 00:05:57.339 "bdev_nvme_opal_init", 00:05:57.339 "bdev_nvme_send_cmd", 00:05:57.339 "bdev_nvme_get_path_iostat", 00:05:57.339 "bdev_nvme_get_mdns_discovery_info", 00:05:57.339 "bdev_nvme_stop_mdns_discovery", 00:05:57.339 "bdev_nvme_start_mdns_discovery", 00:05:57.339 "bdev_nvme_set_multipath_policy", 00:05:57.339 "bdev_nvme_set_preferred_path", 00:05:57.339 "bdev_nvme_get_io_paths", 00:05:57.339 "bdev_nvme_remove_error_injection", 00:05:57.339 "bdev_nvme_add_error_injection", 00:05:57.339 "bdev_nvme_get_discovery_info", 00:05:57.339 "bdev_nvme_stop_discovery", 00:05:57.339 "bdev_nvme_start_discovery", 00:05:57.339 "bdev_nvme_get_controller_health_info", 00:05:57.339 "bdev_nvme_disable_controller", 00:05:57.339 "bdev_nvme_enable_controller", 00:05:57.339 "bdev_nvme_reset_controller", 00:05:57.339 "bdev_nvme_get_transport_statistics", 00:05:57.339 "bdev_nvme_apply_firmware", 00:05:57.339 "bdev_nvme_detach_controller", 00:05:57.339 "bdev_nvme_get_controllers", 00:05:57.340 "bdev_nvme_attach_controller", 00:05:57.340 "bdev_nvme_set_hotplug", 00:05:57.340 "bdev_nvme_set_options", 00:05:57.340 "bdev_passthru_delete", 00:05:57.340 "bdev_passthru_create", 00:05:57.340 "bdev_lvol_grow_lvstore", 00:05:57.340 "bdev_lvol_get_lvols", 00:05:57.340 "bdev_lvol_get_lvstores", 00:05:57.340 "bdev_lvol_delete", 00:05:57.340 "bdev_lvol_set_read_only", 00:05:57.340 "bdev_lvol_resize", 00:05:57.340 "bdev_lvol_decouple_parent", 00:05:57.340 "bdev_lvol_inflate", 00:05:57.340 "bdev_lvol_rename", 00:05:57.340 "bdev_lvol_clone_bdev", 00:05:57.340 "bdev_lvol_clone", 00:05:57.340 "bdev_lvol_snapshot", 00:05:57.340 "bdev_lvol_create", 00:05:57.340 "bdev_lvol_delete_lvstore", 00:05:57.340 "bdev_lvol_rename_lvstore", 00:05:57.340 "bdev_lvol_create_lvstore", 00:05:57.340 "bdev_raid_set_options", 00:05:57.340 "bdev_raid_remove_base_bdev", 00:05:57.340 "bdev_raid_add_base_bdev", 00:05:57.340 "bdev_raid_delete", 00:05:57.340 "bdev_raid_create", 00:05:57.340 "bdev_raid_get_bdevs", 00:05:57.340 "bdev_error_inject_error", 00:05:57.340 "bdev_error_delete", 00:05:57.340 "bdev_error_create", 00:05:57.340 "bdev_split_delete", 00:05:57.340 "bdev_split_create", 00:05:57.340 "bdev_delay_delete", 00:05:57.340 "bdev_delay_create", 00:05:57.340 "bdev_delay_update_latency", 00:05:57.340 "bdev_zone_block_delete", 00:05:57.340 "bdev_zone_block_create", 00:05:57.340 "blobfs_create", 00:05:57.340 "blobfs_detect", 00:05:57.340 "blobfs_set_cache_size", 00:05:57.340 "bdev_aio_delete", 00:05:57.340 "bdev_aio_rescan", 00:05:57.340 "bdev_aio_create", 00:05:57.340 "bdev_ftl_set_property", 00:05:57.340 "bdev_ftl_get_properties", 00:05:57.340 "bdev_ftl_get_stats", 00:05:57.340 "bdev_ftl_unmap", 00:05:57.340 "bdev_ftl_unload", 00:05:57.340 "bdev_ftl_delete", 00:05:57.340 "bdev_ftl_load", 00:05:57.340 "bdev_ftl_create", 00:05:57.340 "bdev_virtio_attach_controller", 00:05:57.340 "bdev_virtio_scsi_get_devices", 00:05:57.340 "bdev_virtio_detach_controller", 00:05:57.340 "bdev_virtio_blk_set_hotplug", 00:05:57.340 "bdev_iscsi_delete", 00:05:57.340 "bdev_iscsi_create", 00:05:57.340 "bdev_iscsi_set_options", 00:05:57.340 "accel_error_inject_error", 00:05:57.340 "ioat_scan_accel_module", 00:05:57.340 "dsa_scan_accel_module", 00:05:57.340 "iaa_scan_accel_module", 00:05:57.340 "vfu_virtio_create_scsi_endpoint", 00:05:57.340 "vfu_virtio_scsi_remove_target", 00:05:57.340 "vfu_virtio_scsi_add_target", 00:05:57.340 "vfu_virtio_create_blk_endpoint", 00:05:57.340 "vfu_virtio_delete_endpoint", 00:05:57.340 "iscsi_set_options", 00:05:57.340 "iscsi_get_auth_groups", 00:05:57.340 "iscsi_auth_group_remove_secret", 00:05:57.340 "iscsi_auth_group_add_secret", 00:05:57.340 "iscsi_delete_auth_group", 00:05:57.340 "iscsi_create_auth_group", 00:05:57.340 "iscsi_set_discovery_auth", 00:05:57.340 "iscsi_get_options", 00:05:57.340 "iscsi_target_node_request_logout", 00:05:57.340 "iscsi_target_node_set_redirect", 00:05:57.340 "iscsi_target_node_set_auth", 00:05:57.340 "iscsi_target_node_add_lun", 00:05:57.340 "iscsi_get_connections", 00:05:57.340 "iscsi_portal_group_set_auth", 00:05:57.340 "iscsi_start_portal_group", 00:05:57.340 "iscsi_delete_portal_group", 00:05:57.340 "iscsi_create_portal_group", 00:05:57.340 "iscsi_get_portal_groups", 00:05:57.340 "iscsi_delete_target_node", 00:05:57.340 "iscsi_target_node_remove_pg_ig_maps", 00:05:57.340 "iscsi_target_node_add_pg_ig_maps", 00:05:57.340 "iscsi_create_target_node", 00:05:57.340 "iscsi_get_target_nodes", 00:05:57.340 "iscsi_delete_initiator_group", 00:05:57.340 "iscsi_initiator_group_remove_initiators", 00:05:57.340 "iscsi_initiator_group_add_initiators", 00:05:57.340 "iscsi_create_initiator_group", 00:05:57.340 "iscsi_get_initiator_groups", 00:05:57.340 "nvmf_set_crdt", 00:05:57.340 "nvmf_set_config", 00:05:57.340 "nvmf_set_max_subsystems", 00:05:57.340 "nvmf_subsystem_get_listeners", 00:05:57.340 "nvmf_subsystem_get_qpairs", 00:05:57.340 "nvmf_subsystem_get_controllers", 00:05:57.340 "nvmf_get_stats", 00:05:57.340 "nvmf_get_transports", 00:05:57.340 "nvmf_create_transport", 00:05:57.340 "nvmf_get_targets", 00:05:57.340 "nvmf_delete_target", 00:05:57.340 "nvmf_create_target", 00:05:57.340 "nvmf_subsystem_allow_any_host", 00:05:57.340 "nvmf_subsystem_remove_host", 00:05:57.340 "nvmf_subsystem_add_host", 00:05:57.340 "nvmf_subsystem_remove_ns", 00:05:57.340 "nvmf_subsystem_add_ns", 00:05:57.340 "nvmf_subsystem_listener_set_ana_state", 00:05:57.340 "nvmf_discovery_get_referrals", 00:05:57.340 "nvmf_discovery_remove_referral", 00:05:57.340 "nvmf_discovery_add_referral", 00:05:57.340 "nvmf_subsystem_remove_listener", 00:05:57.340 "nvmf_subsystem_add_listener", 00:05:57.340 "nvmf_delete_subsystem", 00:05:57.340 "nvmf_create_subsystem", 00:05:57.340 "nvmf_get_subsystems", 00:05:57.340 "env_dpdk_get_mem_stats", 00:05:57.340 "nbd_get_disks", 00:05:57.340 "nbd_stop_disk", 00:05:57.340 "nbd_start_disk", 00:05:57.340 "ublk_recover_disk", 00:05:57.340 "ublk_get_disks", 00:05:57.340 "ublk_stop_disk", 00:05:57.340 "ublk_start_disk", 00:05:57.340 "ublk_destroy_target", 00:05:57.340 "ublk_create_target", 00:05:57.340 "virtio_blk_create_transport", 00:05:57.340 "virtio_blk_get_transports", 00:05:57.340 "vhost_controller_set_coalescing", 00:05:57.340 "vhost_get_controllers", 00:05:57.340 "vhost_delete_controller", 00:05:57.340 "vhost_create_blk_controller", 00:05:57.340 "vhost_scsi_controller_remove_target", 00:05:57.340 "vhost_scsi_controller_add_target", 00:05:57.340 "vhost_start_scsi_controller", 00:05:57.340 "vhost_create_scsi_controller", 00:05:57.340 "thread_set_cpumask", 00:05:57.340 "framework_get_scheduler", 00:05:57.340 "framework_set_scheduler", 00:05:57.340 "framework_get_reactors", 00:05:57.340 "thread_get_io_channels", 00:05:57.340 "thread_get_pollers", 00:05:57.340 "thread_get_stats", 00:05:57.340 "framework_monitor_context_switch", 00:05:57.340 "spdk_kill_instance", 00:05:57.340 "log_enable_timestamps", 00:05:57.340 "log_get_flags", 00:05:57.340 "log_clear_flag", 00:05:57.340 "log_set_flag", 00:05:57.340 "log_get_level", 00:05:57.340 "log_set_level", 00:05:57.340 "log_get_print_level", 00:05:57.340 "log_set_print_level", 00:05:57.340 "framework_enable_cpumask_locks", 00:05:57.340 "framework_disable_cpumask_locks", 00:05:57.340 "framework_wait_init", 00:05:57.340 "framework_start_init", 00:05:57.340 "scsi_get_devices", 00:05:57.340 "bdev_get_histogram", 00:05:57.340 "bdev_enable_histogram", 00:05:57.340 "bdev_set_qos_limit", 00:05:57.340 "bdev_set_qd_sampling_period", 00:05:57.340 "bdev_get_bdevs", 00:05:57.340 "bdev_reset_iostat", 00:05:57.340 "bdev_get_iostat", 00:05:57.340 "bdev_examine", 00:05:57.341 "bdev_wait_for_examine", 00:05:57.341 "bdev_set_options", 00:05:57.341 "notify_get_notifications", 00:05:57.341 "notify_get_types", 00:05:57.341 "accel_get_stats", 00:05:57.341 "accel_set_options", 00:05:57.341 "accel_set_driver", 00:05:57.341 "accel_crypto_key_destroy", 00:05:57.341 "accel_crypto_keys_get", 00:05:57.341 "accel_crypto_key_create", 00:05:57.341 "accel_assign_opc", 00:05:57.341 "accel_get_module_info", 00:05:57.341 "accel_get_opc_assignments", 00:05:57.341 "vmd_rescan", 00:05:57.341 "vmd_remove_device", 00:05:57.341 "vmd_enable", 00:05:57.341 "sock_set_default_impl", 00:05:57.341 "sock_impl_set_options", 00:05:57.341 "sock_impl_get_options", 00:05:57.341 "iobuf_get_stats", 00:05:57.341 "iobuf_set_options", 00:05:57.341 "framework_get_pci_devices", 00:05:57.341 "framework_get_config", 00:05:57.341 "framework_get_subsystems", 00:05:57.341 "vfu_tgt_set_base_path", 00:05:57.341 "trace_get_info", 00:05:57.341 "trace_get_tpoint_group_mask", 00:05:57.341 "trace_disable_tpoint_group", 00:05:57.341 "trace_enable_tpoint_group", 00:05:57.341 "trace_clear_tpoint_mask", 00:05:57.341 "trace_set_tpoint_mask", 00:05:57.341 "spdk_get_version", 00:05:57.341 "rpc_get_methods" 00:05:57.341 ] 00:05:57.341 04:07:47 -- spdkcli/tcp.sh@35 -- # timing_exit run_spdk_tgt_tcp 00:05:57.341 04:07:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:05:57.341 04:07:47 -- common/autotest_common.sh@10 -- # set +x 00:05:57.341 04:07:47 -- spdkcli/tcp.sh@37 -- # trap - SIGINT SIGTERM EXIT 00:05:57.341 04:07:47 -- spdkcli/tcp.sh@38 -- # killprocess 2239559 00:05:57.341 04:07:47 -- common/autotest_common.sh@936 -- # '[' -z 2239559 ']' 00:05:57.341 04:07:47 -- common/autotest_common.sh@940 -- # kill -0 2239559 00:05:57.341 04:07:47 -- common/autotest_common.sh@941 -- # uname 00:05:57.341 04:07:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:57.341 04:07:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2239559 00:05:57.341 04:07:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:57.341 04:07:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:57.341 04:07:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2239559' 00:05:57.341 killing process with pid 2239559 00:05:57.341 04:07:47 -- common/autotest_common.sh@955 -- # kill 2239559 00:05:57.341 04:07:47 -- common/autotest_common.sh@960 -- # wait 2239559 00:05:57.908 00:05:57.908 real 0m1.876s 00:05:57.908 user 0m3.600s 00:05:57.908 sys 0m0.523s 00:05:57.908 04:07:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:57.908 04:07:48 -- common/autotest_common.sh@10 -- # set +x 00:05:57.908 ************************************ 00:05:57.908 END TEST spdkcli_tcp 00:05:57.908 ************************************ 00:05:57.908 04:07:48 -- spdk/autotest.sh@173 -- # run_test dpdk_mem_utility /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:57.908 04:07:48 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:57.908 04:07:48 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:57.908 04:07:48 -- common/autotest_common.sh@10 -- # set +x 00:05:57.908 ************************************ 00:05:57.908 START TEST dpdk_mem_utility 00:05:57.908 ************************************ 00:05:57.908 04:07:48 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility/test_dpdk_mem_info.sh 00:05:57.908 * Looking for test storage... 00:05:57.908 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/dpdk_memory_utility 00:05:57.908 04:07:48 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:57.908 04:07:48 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:57.908 04:07:48 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:57.908 04:07:48 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:57.908 04:07:48 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:57.908 04:07:48 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:57.908 04:07:48 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:57.908 04:07:48 -- scripts/common.sh@335 -- # IFS=.-: 00:05:57.908 04:07:48 -- scripts/common.sh@335 -- # read -ra ver1 00:05:57.908 04:07:48 -- scripts/common.sh@336 -- # IFS=.-: 00:05:57.908 04:07:48 -- scripts/common.sh@336 -- # read -ra ver2 00:05:57.908 04:07:48 -- scripts/common.sh@337 -- # local 'op=<' 00:05:57.908 04:07:48 -- scripts/common.sh@339 -- # ver1_l=2 00:05:57.908 04:07:48 -- scripts/common.sh@340 -- # ver2_l=1 00:05:57.908 04:07:48 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:57.908 04:07:48 -- scripts/common.sh@343 -- # case "$op" in 00:05:57.908 04:07:48 -- scripts/common.sh@344 -- # : 1 00:05:57.908 04:07:48 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:57.908 04:07:48 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:57.908 04:07:48 -- scripts/common.sh@364 -- # decimal 1 00:05:57.908 04:07:48 -- scripts/common.sh@352 -- # local d=1 00:05:57.908 04:07:48 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:57.908 04:07:48 -- scripts/common.sh@354 -- # echo 1 00:05:57.908 04:07:48 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:57.908 04:07:48 -- scripts/common.sh@365 -- # decimal 2 00:05:57.908 04:07:48 -- scripts/common.sh@352 -- # local d=2 00:05:57.908 04:07:48 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:57.908 04:07:48 -- scripts/common.sh@354 -- # echo 2 00:05:57.908 04:07:48 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:57.908 04:07:48 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:57.908 04:07:48 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:57.908 04:07:48 -- scripts/common.sh@367 -- # return 0 00:05:57.908 04:07:48 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:57.908 04:07:48 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:57.908 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.908 --rc genhtml_branch_coverage=1 00:05:57.908 --rc genhtml_function_coverage=1 00:05:57.908 --rc genhtml_legend=1 00:05:57.908 --rc geninfo_all_blocks=1 00:05:57.908 --rc geninfo_unexecuted_blocks=1 00:05:57.908 00:05:57.909 ' 00:05:57.909 04:07:48 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:57.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.909 --rc genhtml_branch_coverage=1 00:05:57.909 --rc genhtml_function_coverage=1 00:05:57.909 --rc genhtml_legend=1 00:05:57.909 --rc geninfo_all_blocks=1 00:05:57.909 --rc geninfo_unexecuted_blocks=1 00:05:57.909 00:05:57.909 ' 00:05:57.909 04:07:48 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:57.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.909 --rc genhtml_branch_coverage=1 00:05:57.909 --rc genhtml_function_coverage=1 00:05:57.909 --rc genhtml_legend=1 00:05:57.909 --rc geninfo_all_blocks=1 00:05:57.909 --rc geninfo_unexecuted_blocks=1 00:05:57.909 00:05:57.909 ' 00:05:57.909 04:07:48 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:57.909 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:57.909 --rc genhtml_branch_coverage=1 00:05:57.909 --rc genhtml_function_coverage=1 00:05:57.909 --rc genhtml_legend=1 00:05:57.909 --rc geninfo_all_blocks=1 00:05:57.909 --rc geninfo_unexecuted_blocks=1 00:05:57.909 00:05:57.909 ' 00:05:57.909 04:07:48 -- dpdk_memory_utility/test_dpdk_mem_info.sh@10 -- # MEM_SCRIPT=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:57.909 04:07:48 -- dpdk_memory_utility/test_dpdk_mem_info.sh@13 -- # spdkpid=2239901 00:05:57.909 04:07:48 -- dpdk_memory_utility/test_dpdk_mem_info.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt 00:05:57.909 04:07:48 -- dpdk_memory_utility/test_dpdk_mem_info.sh@15 -- # waitforlisten 2239901 00:05:57.909 04:07:48 -- common/autotest_common.sh@829 -- # '[' -z 2239901 ']' 00:05:57.909 04:07:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:05:57.909 04:07:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:05:57.909 04:07:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:05:57.909 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:05:57.909 04:07:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:05:57.909 04:07:48 -- common/autotest_common.sh@10 -- # set +x 00:05:58.168 [2024-11-30 04:07:48.561365] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:58.168 [2024-11-30 04:07:48.561459] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2239901 ] 00:05:58.168 EAL: No free 2048 kB hugepages reported on node 1 00:05:58.168 [2024-11-30 04:07:48.620351] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:05:58.168 [2024-11-30 04:07:48.705539] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:05:58.168 [2024-11-30 04:07:48.705729] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:05:59.104 04:07:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:05:59.104 04:07:49 -- common/autotest_common.sh@862 -- # return 0 00:05:59.104 04:07:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@17 -- # trap 'killprocess $spdkpid' SIGINT SIGTERM EXIT 00:05:59.104 04:07:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@19 -- # rpc_cmd env_dpdk_get_mem_stats 00:05:59.104 04:07:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:05:59.104 04:07:49 -- common/autotest_common.sh@10 -- # set +x 00:05:59.104 { 00:05:59.104 "filename": "/tmp/spdk_mem_dump.txt" 00:05:59.104 } 00:05:59.104 04:07:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:05:59.104 04:07:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py 00:05:59.104 DPDK memory size 814.000000 MiB in 1 heap(s) 00:05:59.104 1 heaps totaling size 814.000000 MiB 00:05:59.104 size: 814.000000 MiB heap id: 0 00:05:59.104 end heaps---------- 00:05:59.104 8 mempools totaling size 598.116089 MiB 00:05:59.104 size: 212.674988 MiB name: PDU_immediate_data_Pool 00:05:59.104 size: 158.602051 MiB name: PDU_data_out_Pool 00:05:59.104 size: 84.521057 MiB name: bdev_io_2239901 00:05:59.104 size: 51.011292 MiB name: evtpool_2239901 00:05:59.104 size: 50.003479 MiB name: msgpool_2239901 00:05:59.104 size: 21.763794 MiB name: PDU_Pool 00:05:59.104 size: 19.513306 MiB name: SCSI_TASK_Pool 00:05:59.104 size: 0.026123 MiB name: Session_Pool 00:05:59.104 end mempools------- 00:05:59.104 6 memzones totaling size 4.142822 MiB 00:05:59.104 size: 1.000366 MiB name: RG_ring_0_2239901 00:05:59.104 size: 1.000366 MiB name: RG_ring_1_2239901 00:05:59.104 size: 1.000366 MiB name: RG_ring_4_2239901 00:05:59.104 size: 1.000366 MiB name: RG_ring_5_2239901 00:05:59.104 size: 0.125366 MiB name: RG_ring_2_2239901 00:05:59.104 size: 0.015991 MiB name: RG_ring_3_2239901 00:05:59.104 end memzones------- 00:05:59.104 04:07:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/dpdk_mem_info.py -m 0 00:05:59.104 heap id: 0 total size: 814.000000 MiB number of busy elements: 41 number of free elements: 15 00:05:59.104 list of free elements. size: 12.519348 MiB 00:05:59.104 element at address: 0x200000400000 with size: 1.999512 MiB 00:05:59.104 element at address: 0x200018e00000 with size: 0.999878 MiB 00:05:59.104 element at address: 0x200019000000 with size: 0.999878 MiB 00:05:59.104 element at address: 0x200003e00000 with size: 0.996277 MiB 00:05:59.104 element at address: 0x200031c00000 with size: 0.994446 MiB 00:05:59.104 element at address: 0x200013800000 with size: 0.978699 MiB 00:05:59.104 element at address: 0x200007000000 with size: 0.959839 MiB 00:05:59.104 element at address: 0x200019200000 with size: 0.936584 MiB 00:05:59.104 element at address: 0x200000200000 with size: 0.841614 MiB 00:05:59.104 element at address: 0x20001aa00000 with size: 0.582886 MiB 00:05:59.105 element at address: 0x20000b200000 with size: 0.490723 MiB 00:05:59.105 element at address: 0x200000800000 with size: 0.487793 MiB 00:05:59.105 element at address: 0x200019400000 with size: 0.485657 MiB 00:05:59.105 element at address: 0x200027e00000 with size: 0.410034 MiB 00:05:59.105 element at address: 0x200003a00000 with size: 0.355530 MiB 00:05:59.105 list of standard malloc elements. size: 199.218079 MiB 00:05:59.105 element at address: 0x20000b3fff80 with size: 132.000122 MiB 00:05:59.105 element at address: 0x2000071fff80 with size: 64.000122 MiB 00:05:59.105 element at address: 0x200018efff80 with size: 1.000122 MiB 00:05:59.105 element at address: 0x2000190fff80 with size: 1.000122 MiB 00:05:59.105 element at address: 0x2000192fff80 with size: 1.000122 MiB 00:05:59.105 element at address: 0x2000003d9f00 with size: 0.140747 MiB 00:05:59.105 element at address: 0x2000192eff00 with size: 0.062622 MiB 00:05:59.105 element at address: 0x2000003fdf80 with size: 0.007935 MiB 00:05:59.105 element at address: 0x2000192efdc0 with size: 0.000305 MiB 00:05:59.105 element at address: 0x2000002d7740 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000002d7800 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000002d78c0 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000002d7ac0 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000002d7b80 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000002d7c40 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000003d9e40 with size: 0.000183 MiB 00:05:59.105 element at address: 0x20000087ce00 with size: 0.000183 MiB 00:05:59.105 element at address: 0x20000087cec0 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000008fd180 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200003a5b040 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200003adb300 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200003adb500 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200003adf7c0 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200003affa80 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200003affb40 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200003eff0c0 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000070fdd80 with size: 0.000183 MiB 00:05:59.105 element at address: 0x20000b27da00 with size: 0.000183 MiB 00:05:59.105 element at address: 0x20000b27dac0 with size: 0.000183 MiB 00:05:59.105 element at address: 0x20000b2fdd80 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000138fa8c0 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000192efc40 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000192efd00 with size: 0.000183 MiB 00:05:59.105 element at address: 0x2000194bc740 with size: 0.000183 MiB 00:05:59.105 element at address: 0x20001aa95380 with size: 0.000183 MiB 00:05:59.105 element at address: 0x20001aa95440 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200027e68f80 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200027e69040 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200027e6fc40 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200027e6fe40 with size: 0.000183 MiB 00:05:59.105 element at address: 0x200027e6ff00 with size: 0.000183 MiB 00:05:59.105 list of memzone associated elements. size: 602.262573 MiB 00:05:59.105 element at address: 0x20001aa95500 with size: 211.416748 MiB 00:05:59.105 associated memzone info: size: 211.416626 MiB name: MP_PDU_immediate_data_Pool_0 00:05:59.105 element at address: 0x200027e6ffc0 with size: 157.562561 MiB 00:05:59.105 associated memzone info: size: 157.562439 MiB name: MP_PDU_data_out_Pool_0 00:05:59.105 element at address: 0x2000139fab80 with size: 84.020630 MiB 00:05:59.105 associated memzone info: size: 84.020508 MiB name: MP_bdev_io_2239901_0 00:05:59.105 element at address: 0x2000009ff380 with size: 48.003052 MiB 00:05:59.105 associated memzone info: size: 48.002930 MiB name: MP_evtpool_2239901_0 00:05:59.105 element at address: 0x200003fff380 with size: 48.003052 MiB 00:05:59.105 associated memzone info: size: 48.002930 MiB name: MP_msgpool_2239901_0 00:05:59.105 element at address: 0x2000195be940 with size: 20.255554 MiB 00:05:59.105 associated memzone info: size: 20.255432 MiB name: MP_PDU_Pool_0 00:05:59.105 element at address: 0x200031dfeb40 with size: 18.005066 MiB 00:05:59.105 associated memzone info: size: 18.004944 MiB name: MP_SCSI_TASK_Pool_0 00:05:59.105 element at address: 0x2000005ffe00 with size: 2.000488 MiB 00:05:59.105 associated memzone info: size: 2.000366 MiB name: RG_MP_evtpool_2239901 00:05:59.105 element at address: 0x200003bffe00 with size: 2.000488 MiB 00:05:59.105 associated memzone info: size: 2.000366 MiB name: RG_MP_msgpool_2239901 00:05:59.105 element at address: 0x2000002d7d00 with size: 1.008118 MiB 00:05:59.105 associated memzone info: size: 1.007996 MiB name: MP_evtpool_2239901 00:05:59.105 element at address: 0x20000b2fde40 with size: 1.008118 MiB 00:05:59.105 associated memzone info: size: 1.007996 MiB name: MP_PDU_Pool 00:05:59.105 element at address: 0x2000194bc800 with size: 1.008118 MiB 00:05:59.105 associated memzone info: size: 1.007996 MiB name: MP_PDU_immediate_data_Pool 00:05:59.105 element at address: 0x2000070fde40 with size: 1.008118 MiB 00:05:59.105 associated memzone info: size: 1.007996 MiB name: MP_PDU_data_out_Pool 00:05:59.105 element at address: 0x2000008fd240 with size: 1.008118 MiB 00:05:59.105 associated memzone info: size: 1.007996 MiB name: MP_SCSI_TASK_Pool 00:05:59.105 element at address: 0x200003eff180 with size: 1.000488 MiB 00:05:59.105 associated memzone info: size: 1.000366 MiB name: RG_ring_0_2239901 00:05:59.105 element at address: 0x200003affc00 with size: 1.000488 MiB 00:05:59.105 associated memzone info: size: 1.000366 MiB name: RG_ring_1_2239901 00:05:59.105 element at address: 0x2000138fa980 with size: 1.000488 MiB 00:05:59.105 associated memzone info: size: 1.000366 MiB name: RG_ring_4_2239901 00:05:59.105 element at address: 0x200031cfe940 with size: 1.000488 MiB 00:05:59.105 associated memzone info: size: 1.000366 MiB name: RG_ring_5_2239901 00:05:59.105 element at address: 0x200003a5b100 with size: 0.500488 MiB 00:05:59.105 associated memzone info: size: 0.500366 MiB name: RG_MP_bdev_io_2239901 00:05:59.105 element at address: 0x20000b27db80 with size: 0.500488 MiB 00:05:59.105 associated memzone info: size: 0.500366 MiB name: RG_MP_PDU_Pool 00:05:59.105 element at address: 0x20000087cf80 with size: 0.500488 MiB 00:05:59.105 associated memzone info: size: 0.500366 MiB name: RG_MP_SCSI_TASK_Pool 00:05:59.105 element at address: 0x20001947c540 with size: 0.250488 MiB 00:05:59.105 associated memzone info: size: 0.250366 MiB name: RG_MP_PDU_immediate_data_Pool 00:05:59.105 element at address: 0x200003adf880 with size: 0.125488 MiB 00:05:59.105 associated memzone info: size: 0.125366 MiB name: RG_ring_2_2239901 00:05:59.105 element at address: 0x2000070f5b80 with size: 0.031738 MiB 00:05:59.105 associated memzone info: size: 0.031616 MiB name: RG_MP_PDU_data_out_Pool 00:05:59.105 element at address: 0x200027e69100 with size: 0.023743 MiB 00:05:59.105 associated memzone info: size: 0.023621 MiB name: MP_Session_Pool_0 00:05:59.105 element at address: 0x200003adb5c0 with size: 0.016113 MiB 00:05:59.105 associated memzone info: size: 0.015991 MiB name: RG_ring_3_2239901 00:05:59.105 element at address: 0x200027e6f240 with size: 0.002441 MiB 00:05:59.105 associated memzone info: size: 0.002319 MiB name: RG_MP_Session_Pool 00:05:59.105 element at address: 0x2000002d7980 with size: 0.000305 MiB 00:05:59.105 associated memzone info: size: 0.000183 MiB name: MP_msgpool_2239901 00:05:59.105 element at address: 0x200003adb3c0 with size: 0.000305 MiB 00:05:59.105 associated memzone info: size: 0.000183 MiB name: MP_bdev_io_2239901 00:05:59.105 element at address: 0x200027e6fd00 with size: 0.000305 MiB 00:05:59.105 associated memzone info: size: 0.000183 MiB name: MP_Session_Pool 00:05:59.105 04:07:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@25 -- # trap - SIGINT SIGTERM EXIT 00:05:59.105 04:07:49 -- dpdk_memory_utility/test_dpdk_mem_info.sh@26 -- # killprocess 2239901 00:05:59.105 04:07:49 -- common/autotest_common.sh@936 -- # '[' -z 2239901 ']' 00:05:59.105 04:07:49 -- common/autotest_common.sh@940 -- # kill -0 2239901 00:05:59.105 04:07:49 -- common/autotest_common.sh@941 -- # uname 00:05:59.105 04:07:49 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:05:59.105 04:07:49 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2239901 00:05:59.105 04:07:49 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:05:59.105 04:07:49 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:05:59.105 04:07:49 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2239901' 00:05:59.105 killing process with pid 2239901 00:05:59.105 04:07:49 -- common/autotest_common.sh@955 -- # kill 2239901 00:05:59.105 04:07:49 -- common/autotest_common.sh@960 -- # wait 2239901 00:05:59.672 00:05:59.672 real 0m1.718s 00:05:59.672 user 0m1.880s 00:05:59.672 sys 0m0.478s 00:05:59.672 04:07:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:05:59.672 04:07:50 -- common/autotest_common.sh@10 -- # set +x 00:05:59.672 ************************************ 00:05:59.672 END TEST dpdk_mem_utility 00:05:59.672 ************************************ 00:05:59.672 04:07:50 -- spdk/autotest.sh@174 -- # run_test event /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:59.672 04:07:50 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:05:59.672 04:07:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.672 04:07:50 -- common/autotest_common.sh@10 -- # set +x 00:05:59.672 ************************************ 00:05:59.672 START TEST event 00:05:59.672 ************************************ 00:05:59.672 04:07:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event.sh 00:05:59.672 * Looking for test storage... 00:05:59.672 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:05:59.672 04:07:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:05:59.672 04:07:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:05:59.672 04:07:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:05:59.672 04:07:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:05:59.672 04:07:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:05:59.672 04:07:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:05:59.672 04:07:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:05:59.672 04:07:50 -- scripts/common.sh@335 -- # IFS=.-: 00:05:59.672 04:07:50 -- scripts/common.sh@335 -- # read -ra ver1 00:05:59.672 04:07:50 -- scripts/common.sh@336 -- # IFS=.-: 00:05:59.672 04:07:50 -- scripts/common.sh@336 -- # read -ra ver2 00:05:59.672 04:07:50 -- scripts/common.sh@337 -- # local 'op=<' 00:05:59.672 04:07:50 -- scripts/common.sh@339 -- # ver1_l=2 00:05:59.672 04:07:50 -- scripts/common.sh@340 -- # ver2_l=1 00:05:59.672 04:07:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:05:59.672 04:07:50 -- scripts/common.sh@343 -- # case "$op" in 00:05:59.672 04:07:50 -- scripts/common.sh@344 -- # : 1 00:05:59.672 04:07:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:05:59.672 04:07:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:05:59.672 04:07:50 -- scripts/common.sh@364 -- # decimal 1 00:05:59.672 04:07:50 -- scripts/common.sh@352 -- # local d=1 00:05:59.672 04:07:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:05:59.672 04:07:50 -- scripts/common.sh@354 -- # echo 1 00:05:59.672 04:07:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:05:59.672 04:07:50 -- scripts/common.sh@365 -- # decimal 2 00:05:59.672 04:07:50 -- scripts/common.sh@352 -- # local d=2 00:05:59.672 04:07:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:05:59.672 04:07:50 -- scripts/common.sh@354 -- # echo 2 00:05:59.672 04:07:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:05:59.672 04:07:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:05:59.672 04:07:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:05:59.672 04:07:50 -- scripts/common.sh@367 -- # return 0 00:05:59.672 04:07:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:05:59.672 04:07:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:05:59.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.672 --rc genhtml_branch_coverage=1 00:05:59.672 --rc genhtml_function_coverage=1 00:05:59.672 --rc genhtml_legend=1 00:05:59.672 --rc geninfo_all_blocks=1 00:05:59.672 --rc geninfo_unexecuted_blocks=1 00:05:59.672 00:05:59.672 ' 00:05:59.672 04:07:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:05:59.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.672 --rc genhtml_branch_coverage=1 00:05:59.672 --rc genhtml_function_coverage=1 00:05:59.672 --rc genhtml_legend=1 00:05:59.672 --rc geninfo_all_blocks=1 00:05:59.672 --rc geninfo_unexecuted_blocks=1 00:05:59.672 00:05:59.672 ' 00:05:59.672 04:07:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:05:59.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.672 --rc genhtml_branch_coverage=1 00:05:59.672 --rc genhtml_function_coverage=1 00:05:59.672 --rc genhtml_legend=1 00:05:59.672 --rc geninfo_all_blocks=1 00:05:59.672 --rc geninfo_unexecuted_blocks=1 00:05:59.672 00:05:59.672 ' 00:05:59.672 04:07:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:05:59.672 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:05:59.672 --rc genhtml_branch_coverage=1 00:05:59.672 --rc genhtml_function_coverage=1 00:05:59.672 --rc genhtml_legend=1 00:05:59.672 --rc geninfo_all_blocks=1 00:05:59.672 --rc geninfo_unexecuted_blocks=1 00:05:59.673 00:05:59.673 ' 00:05:59.673 04:07:50 -- event/event.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/nbd_common.sh 00:05:59.673 04:07:50 -- bdev/nbd_common.sh@6 -- # set -e 00:05:59.673 04:07:50 -- event/event.sh@45 -- # run_test event_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:59.673 04:07:50 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:05:59.673 04:07:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:05:59.673 04:07:50 -- common/autotest_common.sh@10 -- # set +x 00:05:59.673 ************************************ 00:05:59.673 START TEST event_perf 00:05:59.673 ************************************ 00:05:59.673 04:07:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/event_perf/event_perf -m 0xF -t 1 00:05:59.673 Running I/O for 1 seconds...[2024-11-30 04:07:50.280869] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:05:59.673 [2024-11-30 04:07:50.280969] [ DPDK EAL parameters: event_perf --no-shconf -c 0xF --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2240124 ] 00:05:59.930 EAL: No free 2048 kB hugepages reported on node 1 00:05:59.930 [2024-11-30 04:07:50.344162] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:05:59.930 [2024-11-30 04:07:50.438751] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:05:59.930 [2024-11-30 04:07:50.438773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:05:59.930 [2024-11-30 04:07:50.438794] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:05:59.930 [2024-11-30 04:07:50.438796] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:01.305 Running I/O for 1 seconds... 00:06:01.305 lcore 0: 226527 00:06:01.305 lcore 1: 226528 00:06:01.305 lcore 2: 226527 00:06:01.305 lcore 3: 226526 00:06:01.305 done. 00:06:01.305 00:06:01.305 real 0m1.258s 00:06:01.305 user 0m4.161s 00:06:01.305 sys 0m0.091s 00:06:01.305 04:07:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:01.305 04:07:51 -- common/autotest_common.sh@10 -- # set +x 00:06:01.305 ************************************ 00:06:01.305 END TEST event_perf 00:06:01.305 ************************************ 00:06:01.305 04:07:51 -- event/event.sh@46 -- # run_test event_reactor /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:01.305 04:07:51 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:01.305 04:07:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:01.305 04:07:51 -- common/autotest_common.sh@10 -- # set +x 00:06:01.305 ************************************ 00:06:01.305 START TEST event_reactor 00:06:01.305 ************************************ 00:06:01.305 04:07:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor/reactor -t 1 00:06:01.305 [2024-11-30 04:07:51.568449] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:01.305 [2024-11-30 04:07:51.568535] [ DPDK EAL parameters: reactor --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2240283 ] 00:06:01.305 EAL: No free 2048 kB hugepages reported on node 1 00:06:01.305 [2024-11-30 04:07:51.632153] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:01.305 [2024-11-30 04:07:51.719473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:02.241 test_start 00:06:02.241 oneshot 00:06:02.241 tick 100 00:06:02.241 tick 100 00:06:02.241 tick 250 00:06:02.241 tick 100 00:06:02.241 tick 100 00:06:02.241 tick 100 00:06:02.241 tick 250 00:06:02.241 tick 500 00:06:02.241 tick 100 00:06:02.241 tick 100 00:06:02.241 tick 250 00:06:02.241 tick 100 00:06:02.241 tick 100 00:06:02.241 test_end 00:06:02.241 00:06:02.241 real 0m1.249s 00:06:02.241 user 0m1.162s 00:06:02.241 sys 0m0.081s 00:06:02.241 04:07:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:02.241 04:07:52 -- common/autotest_common.sh@10 -- # set +x 00:06:02.241 ************************************ 00:06:02.241 END TEST event_reactor 00:06:02.241 ************************************ 00:06:02.241 04:07:52 -- event/event.sh@47 -- # run_test event_reactor_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:02.241 04:07:52 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:06:02.241 04:07:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:02.241 04:07:52 -- common/autotest_common.sh@10 -- # set +x 00:06:02.241 ************************************ 00:06:02.241 START TEST event_reactor_perf 00:06:02.241 ************************************ 00:06:02.241 04:07:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/reactor_perf/reactor_perf -t 1 00:06:02.241 [2024-11-30 04:07:52.846573] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:02.241 [2024-11-30 04:07:52.846658] [ DPDK EAL parameters: reactor_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2240437 ] 00:06:02.526 EAL: No free 2048 kB hugepages reported on node 1 00:06:02.526 [2024-11-30 04:07:52.910735] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:02.526 [2024-11-30 04:07:53.000768] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.460 test_start 00:06:03.460 test_end 00:06:03.460 Performance: 351397 events per second 00:06:03.460 00:06:03.460 real 0m1.247s 00:06:03.460 user 0m1.153s 00:06:03.460 sys 0m0.088s 00:06:03.460 04:07:54 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:03.460 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:03.460 ************************************ 00:06:03.460 END TEST event_reactor_perf 00:06:03.460 ************************************ 00:06:03.718 04:07:54 -- event/event.sh@49 -- # uname -s 00:06:03.719 04:07:54 -- event/event.sh@49 -- # '[' Linux = Linux ']' 00:06:03.719 04:07:54 -- event/event.sh@50 -- # run_test event_scheduler /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:03.719 04:07:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:03.719 04:07:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:03.719 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:03.719 ************************************ 00:06:03.719 START TEST event_scheduler 00:06:03.719 ************************************ 00:06:03.719 04:07:54 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler.sh 00:06:03.719 * Looking for test storage... 00:06:03.719 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler 00:06:03.719 04:07:54 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:03.719 04:07:54 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:03.719 04:07:54 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:03.719 04:07:54 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:03.719 04:07:54 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:03.719 04:07:54 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:03.719 04:07:54 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:03.719 04:07:54 -- scripts/common.sh@335 -- # IFS=.-: 00:06:03.719 04:07:54 -- scripts/common.sh@335 -- # read -ra ver1 00:06:03.719 04:07:54 -- scripts/common.sh@336 -- # IFS=.-: 00:06:03.719 04:07:54 -- scripts/common.sh@336 -- # read -ra ver2 00:06:03.719 04:07:54 -- scripts/common.sh@337 -- # local 'op=<' 00:06:03.719 04:07:54 -- scripts/common.sh@339 -- # ver1_l=2 00:06:03.719 04:07:54 -- scripts/common.sh@340 -- # ver2_l=1 00:06:03.719 04:07:54 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:03.719 04:07:54 -- scripts/common.sh@343 -- # case "$op" in 00:06:03.719 04:07:54 -- scripts/common.sh@344 -- # : 1 00:06:03.719 04:07:54 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:03.719 04:07:54 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:03.719 04:07:54 -- scripts/common.sh@364 -- # decimal 1 00:06:03.719 04:07:54 -- scripts/common.sh@352 -- # local d=1 00:06:03.719 04:07:54 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:03.719 04:07:54 -- scripts/common.sh@354 -- # echo 1 00:06:03.719 04:07:54 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:03.719 04:07:54 -- scripts/common.sh@365 -- # decimal 2 00:06:03.719 04:07:54 -- scripts/common.sh@352 -- # local d=2 00:06:03.719 04:07:54 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:03.719 04:07:54 -- scripts/common.sh@354 -- # echo 2 00:06:03.719 04:07:54 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:03.719 04:07:54 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:03.719 04:07:54 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:03.719 04:07:54 -- scripts/common.sh@367 -- # return 0 00:06:03.719 04:07:54 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:03.719 04:07:54 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:03.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.719 --rc genhtml_branch_coverage=1 00:06:03.719 --rc genhtml_function_coverage=1 00:06:03.719 --rc genhtml_legend=1 00:06:03.719 --rc geninfo_all_blocks=1 00:06:03.719 --rc geninfo_unexecuted_blocks=1 00:06:03.719 00:06:03.719 ' 00:06:03.719 04:07:54 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:03.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.719 --rc genhtml_branch_coverage=1 00:06:03.719 --rc genhtml_function_coverage=1 00:06:03.719 --rc genhtml_legend=1 00:06:03.719 --rc geninfo_all_blocks=1 00:06:03.719 --rc geninfo_unexecuted_blocks=1 00:06:03.719 00:06:03.719 ' 00:06:03.719 04:07:54 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:03.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.719 --rc genhtml_branch_coverage=1 00:06:03.719 --rc genhtml_function_coverage=1 00:06:03.719 --rc genhtml_legend=1 00:06:03.719 --rc geninfo_all_blocks=1 00:06:03.719 --rc geninfo_unexecuted_blocks=1 00:06:03.719 00:06:03.719 ' 00:06:03.719 04:07:54 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:03.719 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:03.719 --rc genhtml_branch_coverage=1 00:06:03.719 --rc genhtml_function_coverage=1 00:06:03.719 --rc genhtml_legend=1 00:06:03.719 --rc geninfo_all_blocks=1 00:06:03.719 --rc geninfo_unexecuted_blocks=1 00:06:03.719 00:06:03.719 ' 00:06:03.719 04:07:54 -- scheduler/scheduler.sh@29 -- # rpc=rpc_cmd 00:06:03.719 04:07:54 -- scheduler/scheduler.sh@35 -- # scheduler_pid=2240756 00:06:03.719 04:07:54 -- scheduler/scheduler.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/scheduler/scheduler -m 0xF -p 0x2 --wait-for-rpc -f 00:06:03.719 04:07:54 -- scheduler/scheduler.sh@36 -- # trap 'killprocess $scheduler_pid; exit 1' SIGINT SIGTERM EXIT 00:06:03.719 04:07:54 -- scheduler/scheduler.sh@37 -- # waitforlisten 2240756 00:06:03.719 04:07:54 -- common/autotest_common.sh@829 -- # '[' -z 2240756 ']' 00:06:03.719 04:07:54 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:03.719 04:07:54 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:03.719 04:07:54 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:03.719 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:03.719 04:07:54 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:03.719 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:03.719 [2024-11-30 04:07:54.283150] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:03.719 [2024-11-30 04:07:54.283242] [ DPDK EAL parameters: scheduler --no-shconf -c 0xF --main-lcore=2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2240756 ] 00:06:03.719 EAL: No free 2048 kB hugepages reported on node 1 00:06:03.719 [2024-11-30 04:07:54.343881] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:06:03.978 [2024-11-30 04:07:54.429866] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:03.978 [2024-11-30 04:07:54.429932] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:03.978 [2024-11-30 04:07:54.430061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:03.978 [2024-11-30 04:07:54.430066] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:03.978 04:07:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:03.978 04:07:54 -- common/autotest_common.sh@862 -- # return 0 00:06:03.978 04:07:54 -- scheduler/scheduler.sh@39 -- # rpc_cmd framework_set_scheduler dynamic 00:06:03.978 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:03.978 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:03.978 POWER: Env isn't set yet! 00:06:03.978 POWER: Attempting to initialise ACPI cpufreq power management... 00:06:03.978 POWER: failed to open /sys/devices/system/cpu/cpu%u/cpufreq/scaling_available_frequencies 00:06:03.978 POWER: Cannot get available frequencies of lcore 0 00:06:03.978 POWER: Attempting to initialise PSTAT power management... 00:06:03.978 POWER: Power management governor of lcore 0 has been set to 'performance' successfully 00:06:03.978 POWER: Initialized successfully for lcore 0 power management 00:06:03.978 POWER: Power management governor of lcore 1 has been set to 'performance' successfully 00:06:03.978 POWER: Initialized successfully for lcore 1 power management 00:06:03.978 POWER: Power management governor of lcore 2 has been set to 'performance' successfully 00:06:03.978 POWER: Initialized successfully for lcore 2 power management 00:06:03.978 POWER: Power management governor of lcore 3 has been set to 'performance' successfully 00:06:03.978 POWER: Initialized successfully for lcore 3 power management 00:06:03.978 [2024-11-30 04:07:54.533145] scheduler_dynamic.c: 387:set_opts: *NOTICE*: Setting scheduler load limit to 20 00:06:03.978 [2024-11-30 04:07:54.533162] scheduler_dynamic.c: 389:set_opts: *NOTICE*: Setting scheduler core limit to 80 00:06:03.978 [2024-11-30 04:07:54.533173] scheduler_dynamic.c: 391:set_opts: *NOTICE*: Setting scheduler core busy to 95 00:06:03.978 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:03.978 04:07:54 -- scheduler/scheduler.sh@40 -- # rpc_cmd framework_start_init 00:06:03.978 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:03.978 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.236 [2024-11-30 04:07:54.634745] scheduler.c: 382:test_start: *NOTICE*: Scheduler test application started. 00:06:04.236 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.236 04:07:54 -- scheduler/scheduler.sh@43 -- # run_test scheduler_create_thread scheduler_create_thread 00:06:04.236 04:07:54 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:04.236 04:07:54 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:04.236 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.236 ************************************ 00:06:04.236 START TEST scheduler_create_thread 00:06:04.236 ************************************ 00:06:04.236 04:07:54 -- common/autotest_common.sh@1114 -- # scheduler_create_thread 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@12 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x1 -a 100 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 2 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@13 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x2 -a 100 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 3 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@14 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x4 -a 100 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 4 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@15 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n active_pinned -m 0x8 -a 100 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 5 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@16 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x1 -a 0 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 6 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@17 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x2 -a 0 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 7 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@18 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x4 -a 0 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 8 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@19 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n idle_pinned -m 0x8 -a 0 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 9 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@21 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n one_third_active -a 30 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 10 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@22 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n half_active -a 0 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@22 -- # thread_id=11 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@23 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_set_active 11 50 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:04.237 04:07:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:04.237 04:07:54 -- scheduler/scheduler.sh@25 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_create -n deleted -a 100 00:06:04.237 04:07:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:04.237 04:07:54 -- common/autotest_common.sh@10 -- # set +x 00:06:05.170 04:07:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:05.170 04:07:55 -- scheduler/scheduler.sh@25 -- # thread_id=12 00:06:05.170 04:07:55 -- scheduler/scheduler.sh@26 -- # rpc_cmd --plugin scheduler_plugin scheduler_thread_delete 12 00:06:05.170 04:07:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:05.170 04:07:55 -- common/autotest_common.sh@10 -- # set +x 00:06:06.542 04:07:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:06.542 00:06:06.542 real 0m2.138s 00:06:06.542 user 0m0.014s 00:06:06.542 sys 0m0.000s 00:06:06.542 04:07:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:06.542 04:07:56 -- common/autotest_common.sh@10 -- # set +x 00:06:06.542 ************************************ 00:06:06.542 END TEST scheduler_create_thread 00:06:06.542 ************************************ 00:06:06.542 04:07:56 -- scheduler/scheduler.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:06:06.542 04:07:56 -- scheduler/scheduler.sh@46 -- # killprocess 2240756 00:06:06.542 04:07:56 -- common/autotest_common.sh@936 -- # '[' -z 2240756 ']' 00:06:06.542 04:07:56 -- common/autotest_common.sh@940 -- # kill -0 2240756 00:06:06.542 04:07:56 -- common/autotest_common.sh@941 -- # uname 00:06:06.542 04:07:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:06.542 04:07:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2240756 00:06:06.542 04:07:56 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:06.542 04:07:56 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:06.542 04:07:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2240756' 00:06:06.542 killing process with pid 2240756 00:06:06.542 04:07:56 -- common/autotest_common.sh@955 -- # kill 2240756 00:06:06.542 04:07:56 -- common/autotest_common.sh@960 -- # wait 2240756 00:06:06.800 [2024-11-30 04:07:57.259796] scheduler.c: 360:test_shutdown: *NOTICE*: Scheduler test application stopped. 00:06:06.800 POWER: Power management governor of lcore 0 has been set to 'userspace' successfully 00:06:06.800 POWER: Power management of lcore 0 has exited from 'performance' mode and been set back to the original 00:06:06.800 POWER: Power management governor of lcore 1 has been set to 'schedutil' successfully 00:06:06.800 POWER: Power management of lcore 1 has exited from 'performance' mode and been set back to the original 00:06:06.800 POWER: Power management governor of lcore 2 has been set to 'schedutil' successfully 00:06:06.800 POWER: Power management of lcore 2 has exited from 'performance' mode and been set back to the original 00:06:06.800 POWER: Power management governor of lcore 3 has been set to 'schedutil' successfully 00:06:06.800 POWER: Power management of lcore 3 has exited from 'performance' mode and been set back to the original 00:06:07.058 00:06:07.058 real 0m3.371s 00:06:07.058 user 0m4.787s 00:06:07.058 sys 0m0.328s 00:06:07.058 04:07:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:07.058 04:07:57 -- common/autotest_common.sh@10 -- # set +x 00:06:07.059 ************************************ 00:06:07.059 END TEST event_scheduler 00:06:07.059 ************************************ 00:06:07.059 04:07:57 -- event/event.sh@51 -- # modprobe -n nbd 00:06:07.059 04:07:57 -- event/event.sh@52 -- # run_test app_repeat app_repeat_test 00:06:07.059 04:07:57 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:07.059 04:07:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:07.059 04:07:57 -- common/autotest_common.sh@10 -- # set +x 00:06:07.059 ************************************ 00:06:07.059 START TEST app_repeat 00:06:07.059 ************************************ 00:06:07.059 04:07:57 -- common/autotest_common.sh@1114 -- # app_repeat_test 00:06:07.059 04:07:57 -- event/event.sh@12 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:07.059 04:07:57 -- event/event.sh@13 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:07.059 04:07:57 -- event/event.sh@13 -- # local nbd_list 00:06:07.059 04:07:57 -- event/event.sh@14 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:07.059 04:07:57 -- event/event.sh@14 -- # local bdev_list 00:06:07.059 04:07:57 -- event/event.sh@15 -- # local repeat_times=4 00:06:07.059 04:07:57 -- event/event.sh@17 -- # modprobe nbd 00:06:07.059 04:07:57 -- event/event.sh@19 -- # repeat_pid=2241213 00:06:07.059 04:07:57 -- event/event.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/app_repeat/app_repeat -r /var/tmp/spdk-nbd.sock -m 0x3 -t 4 00:06:07.059 04:07:57 -- event/event.sh@20 -- # trap 'killprocess $repeat_pid; exit 1' SIGINT SIGTERM EXIT 00:06:07.059 04:07:57 -- event/event.sh@21 -- # echo 'Process app_repeat pid: 2241213' 00:06:07.059 Process app_repeat pid: 2241213 00:06:07.059 04:07:57 -- event/event.sh@23 -- # for i in {0..2} 00:06:07.059 04:07:57 -- event/event.sh@24 -- # echo 'spdk_app_start Round 0' 00:06:07.059 spdk_app_start Round 0 00:06:07.059 04:07:57 -- event/event.sh@25 -- # waitforlisten 2241213 /var/tmp/spdk-nbd.sock 00:06:07.059 04:07:57 -- common/autotest_common.sh@829 -- # '[' -z 2241213 ']' 00:06:07.059 04:07:57 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:07.059 04:07:57 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:07.059 04:07:57 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:07.059 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:07.059 04:07:57 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:07.059 04:07:57 -- common/autotest_common.sh@10 -- # set +x 00:06:07.059 [2024-11-30 04:07:57.534293] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:07.059 [2024-11-30 04:07:57.534372] [ DPDK EAL parameters: app_repeat --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2241213 ] 00:06:07.059 EAL: No free 2048 kB hugepages reported on node 1 00:06:07.059 [2024-11-30 04:07:57.597059] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:07.059 [2024-11-30 04:07:57.685104] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:07.059 [2024-11-30 04:07:57.685109] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:07.993 04:07:58 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:07.993 04:07:58 -- common/autotest_common.sh@862 -- # return 0 00:06:07.993 04:07:58 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:08.252 Malloc0 00:06:08.252 04:07:58 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:08.510 Malloc1 00:06:08.510 04:07:59 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@12 -- # local i 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.510 04:07:59 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:08.768 /dev/nbd0 00:06:08.768 04:07:59 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:08.768 04:07:59 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:08.768 04:07:59 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:08.768 04:07:59 -- common/autotest_common.sh@867 -- # local i 00:06:08.768 04:07:59 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:08.768 04:07:59 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:08.768 04:07:59 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:08.768 04:07:59 -- common/autotest_common.sh@871 -- # break 00:06:08.768 04:07:59 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:08.768 04:07:59 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:08.768 04:07:59 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:08.768 1+0 records in 00:06:08.768 1+0 records out 00:06:08.768 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000230799 s, 17.7 MB/s 00:06:08.768 04:07:59 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.768 04:07:59 -- common/autotest_common.sh@884 -- # size=4096 00:06:08.768 04:07:59 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:08.768 04:07:59 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:08.768 04:07:59 -- common/autotest_common.sh@887 -- # return 0 00:06:08.768 04:07:59 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:08.768 04:07:59 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:08.768 04:07:59 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:09.026 /dev/nbd1 00:06:09.026 04:07:59 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:09.026 04:07:59 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:09.026 04:07:59 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:09.026 04:07:59 -- common/autotest_common.sh@867 -- # local i 00:06:09.026 04:07:59 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:09.026 04:07:59 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:09.026 04:07:59 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:09.026 04:07:59 -- common/autotest_common.sh@871 -- # break 00:06:09.026 04:07:59 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:09.026 04:07:59 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:09.026 04:07:59 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:09.026 1+0 records in 00:06:09.026 1+0 records out 00:06:09.026 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000195864 s, 20.9 MB/s 00:06:09.026 04:07:59 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.026 04:07:59 -- common/autotest_common.sh@884 -- # size=4096 00:06:09.026 04:07:59 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:09.026 04:07:59 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:09.026 04:07:59 -- common/autotest_common.sh@887 -- # return 0 00:06:09.026 04:07:59 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:09.026 04:07:59 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:09.026 04:07:59 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:09.026 04:07:59 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.026 04:07:59 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:09.284 04:07:59 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:09.284 { 00:06:09.284 "nbd_device": "/dev/nbd0", 00:06:09.284 "bdev_name": "Malloc0" 00:06:09.284 }, 00:06:09.284 { 00:06:09.284 "nbd_device": "/dev/nbd1", 00:06:09.284 "bdev_name": "Malloc1" 00:06:09.284 } 00:06:09.284 ]' 00:06:09.284 04:07:59 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:09.284 { 00:06:09.284 "nbd_device": "/dev/nbd0", 00:06:09.284 "bdev_name": "Malloc0" 00:06:09.284 }, 00:06:09.284 { 00:06:09.284 "nbd_device": "/dev/nbd1", 00:06:09.284 "bdev_name": "Malloc1" 00:06:09.284 } 00:06:09.284 ]' 00:06:09.284 04:07:59 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:09.542 /dev/nbd1' 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:09.542 /dev/nbd1' 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@65 -- # count=2 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@95 -- # count=2 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:09.542 256+0 records in 00:06:09.542 256+0 records out 00:06:09.542 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0048847 s, 215 MB/s 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:09.542 256+0 records in 00:06:09.542 256+0 records out 00:06:09.542 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0226485 s, 46.3 MB/s 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:09.542 256+0 records in 00:06:09.542 256+0 records out 00:06:09.542 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0245827 s, 42.7 MB/s 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@51 -- # local i 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:09.542 04:07:59 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:09.801 04:08:00 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:09.801 04:08:00 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:09.801 04:08:00 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:09.801 04:08:00 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:09.801 04:08:00 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:09.801 04:08:00 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:09.801 04:08:00 -- bdev/nbd_common.sh@41 -- # break 00:06:09.801 04:08:00 -- bdev/nbd_common.sh@45 -- # return 0 00:06:09.801 04:08:00 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:09.801 04:08:00 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@41 -- # break 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@45 -- # return 0 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:10.058 04:08:00 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@65 -- # true 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@65 -- # count=0 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@104 -- # count=0 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:10.317 04:08:00 -- bdev/nbd_common.sh@109 -- # return 0 00:06:10.317 04:08:00 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:10.574 04:08:01 -- event/event.sh@35 -- # sleep 3 00:06:10.831 [2024-11-30 04:08:01.361477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:10.831 [2024-11-30 04:08:01.448791] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:10.831 [2024-11-30 04:08:01.448792] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:11.089 [2024-11-30 04:08:01.510172] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:11.089 [2024-11-30 04:08:01.510264] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:13.616 04:08:04 -- event/event.sh@23 -- # for i in {0..2} 00:06:13.616 04:08:04 -- event/event.sh@24 -- # echo 'spdk_app_start Round 1' 00:06:13.616 spdk_app_start Round 1 00:06:13.616 04:08:04 -- event/event.sh@25 -- # waitforlisten 2241213 /var/tmp/spdk-nbd.sock 00:06:13.616 04:08:04 -- common/autotest_common.sh@829 -- # '[' -z 2241213 ']' 00:06:13.616 04:08:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:13.616 04:08:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:13.616 04:08:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:13.616 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:13.616 04:08:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:13.616 04:08:04 -- common/autotest_common.sh@10 -- # set +x 00:06:13.874 04:08:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:13.874 04:08:04 -- common/autotest_common.sh@862 -- # return 0 00:06:13.874 04:08:04 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:14.132 Malloc0 00:06:14.132 04:08:04 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:14.388 Malloc1 00:06:14.388 04:08:04 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:14.388 04:08:04 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@12 -- # local i 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.389 04:08:04 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:14.646 /dev/nbd0 00:06:14.646 04:08:05 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:14.646 04:08:05 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:14.646 04:08:05 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:14.646 04:08:05 -- common/autotest_common.sh@867 -- # local i 00:06:14.646 04:08:05 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:14.646 04:08:05 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:14.646 04:08:05 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:14.646 04:08:05 -- common/autotest_common.sh@871 -- # break 00:06:14.646 04:08:05 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:14.646 04:08:05 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:14.646 04:08:05 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:14.646 1+0 records in 00:06:14.646 1+0 records out 00:06:14.646 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000192084 s, 21.3 MB/s 00:06:14.646 04:08:05 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.646 04:08:05 -- common/autotest_common.sh@884 -- # size=4096 00:06:14.646 04:08:05 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.646 04:08:05 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:14.646 04:08:05 -- common/autotest_common.sh@887 -- # return 0 00:06:14.646 04:08:05 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:14.646 04:08:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.646 04:08:05 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:14.905 /dev/nbd1 00:06:14.905 04:08:05 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:14.905 04:08:05 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:14.905 04:08:05 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:14.905 04:08:05 -- common/autotest_common.sh@867 -- # local i 00:06:14.905 04:08:05 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:14.905 04:08:05 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:14.905 04:08:05 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:14.905 04:08:05 -- common/autotest_common.sh@871 -- # break 00:06:14.905 04:08:05 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:14.905 04:08:05 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:14.905 04:08:05 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:14.906 1+0 records in 00:06:14.906 1+0 records out 00:06:14.906 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000196105 s, 20.9 MB/s 00:06:14.906 04:08:05 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.906 04:08:05 -- common/autotest_common.sh@884 -- # size=4096 00:06:14.906 04:08:05 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:14.906 04:08:05 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:14.906 04:08:05 -- common/autotest_common.sh@887 -- # return 0 00:06:14.906 04:08:05 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:14.906 04:08:05 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:14.906 04:08:05 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:14.906 04:08:05 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:14.906 04:08:05 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:15.164 { 00:06:15.164 "nbd_device": "/dev/nbd0", 00:06:15.164 "bdev_name": "Malloc0" 00:06:15.164 }, 00:06:15.164 { 00:06:15.164 "nbd_device": "/dev/nbd1", 00:06:15.164 "bdev_name": "Malloc1" 00:06:15.164 } 00:06:15.164 ]' 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:15.164 { 00:06:15.164 "nbd_device": "/dev/nbd0", 00:06:15.164 "bdev_name": "Malloc0" 00:06:15.164 }, 00:06:15.164 { 00:06:15.164 "nbd_device": "/dev/nbd1", 00:06:15.164 "bdev_name": "Malloc1" 00:06:15.164 } 00:06:15.164 ]' 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:15.164 /dev/nbd1' 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:15.164 /dev/nbd1' 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@65 -- # count=2 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@95 -- # count=2 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:15.164 04:08:05 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:15.422 256+0 records in 00:06:15.422 256+0 records out 00:06:15.422 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00489844 s, 214 MB/s 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:15.422 256+0 records in 00:06:15.422 256+0 records out 00:06:15.422 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0225155 s, 46.6 MB/s 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:15.422 256+0 records in 00:06:15.422 256+0 records out 00:06:15.422 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0213928 s, 49.0 MB/s 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@51 -- # local i 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.422 04:08:05 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:15.702 04:08:06 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:15.702 04:08:06 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:15.702 04:08:06 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:15.702 04:08:06 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.702 04:08:06 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.702 04:08:06 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:15.702 04:08:06 -- bdev/nbd_common.sh@41 -- # break 00:06:15.702 04:08:06 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.702 04:08:06 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:15.702 04:08:06 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@41 -- # break 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@45 -- # return 0 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:15.960 04:08:06 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:16.217 04:08:06 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:16.217 04:08:06 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:16.217 04:08:06 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:16.217 04:08:06 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:16.217 04:08:06 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:16.218 04:08:06 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:16.218 04:08:06 -- bdev/nbd_common.sh@65 -- # true 00:06:16.218 04:08:06 -- bdev/nbd_common.sh@65 -- # count=0 00:06:16.218 04:08:06 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:16.218 04:08:06 -- bdev/nbd_common.sh@104 -- # count=0 00:06:16.218 04:08:06 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:16.218 04:08:06 -- bdev/nbd_common.sh@109 -- # return 0 00:06:16.218 04:08:06 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:16.475 04:08:06 -- event/event.sh@35 -- # sleep 3 00:06:16.733 [2024-11-30 04:08:07.205534] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:16.733 [2024-11-30 04:08:07.292619] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:16.733 [2024-11-30 04:08:07.292622] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:16.733 [2024-11-30 04:08:07.353942] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:16.733 [2024-11-30 04:08:07.354041] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:20.010 04:08:09 -- event/event.sh@23 -- # for i in {0..2} 00:06:20.010 04:08:09 -- event/event.sh@24 -- # echo 'spdk_app_start Round 2' 00:06:20.010 spdk_app_start Round 2 00:06:20.010 04:08:09 -- event/event.sh@25 -- # waitforlisten 2241213 /var/tmp/spdk-nbd.sock 00:06:20.010 04:08:09 -- common/autotest_common.sh@829 -- # '[' -z 2241213 ']' 00:06:20.010 04:08:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:20.010 04:08:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:20.010 04:08:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:20.010 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:20.010 04:08:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:20.010 04:08:09 -- common/autotest_common.sh@10 -- # set +x 00:06:20.010 04:08:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:20.010 04:08:10 -- common/autotest_common.sh@862 -- # return 0 00:06:20.010 04:08:10 -- event/event.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.010 Malloc0 00:06:20.010 04:08:10 -- event/event.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock bdev_malloc_create 64 4096 00:06:20.268 Malloc1 00:06:20.268 04:08:10 -- event/event.sh@30 -- # nbd_rpc_data_verify /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@90 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@91 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@91 -- # local bdev_list 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@92 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@92 -- # local nbd_list 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@94 -- # nbd_start_disks /var/tmp/spdk-nbd.sock 'Malloc0 Malloc1' '/dev/nbd0 /dev/nbd1' 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@9 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@10 -- # bdev_list=('Malloc0' 'Malloc1') 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@10 -- # local bdev_list 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@11 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@11 -- # local nbd_list 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@12 -- # local i 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@14 -- # (( i = 0 )) 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.268 04:08:10 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc0 /dev/nbd0 00:06:20.526 /dev/nbd0 00:06:20.526 04:08:11 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd0 00:06:20.526 04:08:11 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd0 00:06:20.526 04:08:11 -- common/autotest_common.sh@866 -- # local nbd_name=nbd0 00:06:20.526 04:08:11 -- common/autotest_common.sh@867 -- # local i 00:06:20.526 04:08:11 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:20.526 04:08:11 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:20.526 04:08:11 -- common/autotest_common.sh@870 -- # grep -q -w nbd0 /proc/partitions 00:06:20.526 04:08:11 -- common/autotest_common.sh@871 -- # break 00:06:20.526 04:08:11 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:20.526 04:08:11 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:20.526 04:08:11 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd0 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.526 1+0 records in 00:06:20.526 1+0 records out 00:06:20.526 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000165643 s, 24.7 MB/s 00:06:20.526 04:08:11 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.526 04:08:11 -- common/autotest_common.sh@884 -- # size=4096 00:06:20.526 04:08:11 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.526 04:08:11 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:20.526 04:08:11 -- common/autotest_common.sh@887 -- # return 0 00:06:20.526 04:08:11 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.526 04:08:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.526 04:08:11 -- bdev/nbd_common.sh@15 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_start_disk Malloc1 /dev/nbd1 00:06:20.808 /dev/nbd1 00:06:20.808 04:08:11 -- bdev/nbd_common.sh@17 -- # basename /dev/nbd1 00:06:20.808 04:08:11 -- bdev/nbd_common.sh@17 -- # waitfornbd nbd1 00:06:20.808 04:08:11 -- common/autotest_common.sh@866 -- # local nbd_name=nbd1 00:06:20.808 04:08:11 -- common/autotest_common.sh@867 -- # local i 00:06:20.808 04:08:11 -- common/autotest_common.sh@869 -- # (( i = 1 )) 00:06:20.808 04:08:11 -- common/autotest_common.sh@869 -- # (( i <= 20 )) 00:06:20.808 04:08:11 -- common/autotest_common.sh@870 -- # grep -q -w nbd1 /proc/partitions 00:06:20.808 04:08:11 -- common/autotest_common.sh@871 -- # break 00:06:20.808 04:08:11 -- common/autotest_common.sh@882 -- # (( i = 1 )) 00:06:20.808 04:08:11 -- common/autotest_common.sh@882 -- # (( i <= 20 )) 00:06:20.808 04:08:11 -- common/autotest_common.sh@883 -- # dd if=/dev/nbd1 of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest bs=4096 count=1 iflag=direct 00:06:20.808 1+0 records in 00:06:20.808 1+0 records out 00:06:20.808 4096 bytes (4.1 kB, 4.0 KiB) copied, 0.000198284 s, 20.7 MB/s 00:06:20.808 04:08:11 -- common/autotest_common.sh@884 -- # stat -c %s /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.808 04:08:11 -- common/autotest_common.sh@884 -- # size=4096 00:06:20.808 04:08:11 -- common/autotest_common.sh@885 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdtest 00:06:20.808 04:08:11 -- common/autotest_common.sh@886 -- # '[' 4096 '!=' 0 ']' 00:06:20.808 04:08:11 -- common/autotest_common.sh@887 -- # return 0 00:06:20.808 04:08:11 -- bdev/nbd_common.sh@14 -- # (( i++ )) 00:06:20.808 04:08:11 -- bdev/nbd_common.sh@14 -- # (( i < 2 )) 00:06:20.808 04:08:11 -- bdev/nbd_common.sh@95 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:20.808 04:08:11 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:20.808 04:08:11 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[ 00:06:21.067 { 00:06:21.067 "nbd_device": "/dev/nbd0", 00:06:21.067 "bdev_name": "Malloc0" 00:06:21.067 }, 00:06:21.067 { 00:06:21.067 "nbd_device": "/dev/nbd1", 00:06:21.067 "bdev_name": "Malloc1" 00:06:21.067 } 00:06:21.067 ]' 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@64 -- # echo '[ 00:06:21.067 { 00:06:21.067 "nbd_device": "/dev/nbd0", 00:06:21.067 "bdev_name": "Malloc0" 00:06:21.067 }, 00:06:21.067 { 00:06:21.067 "nbd_device": "/dev/nbd1", 00:06:21.067 "bdev_name": "Malloc1" 00:06:21.067 } 00:06:21.067 ]' 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@64 -- # nbd_disks_name='/dev/nbd0 00:06:21.067 /dev/nbd1' 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@65 -- # echo '/dev/nbd0 00:06:21.067 /dev/nbd1' 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@65 -- # count=2 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@66 -- # echo 2 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@95 -- # count=2 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@96 -- # '[' 2 -ne 2 ']' 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@100 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' write 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@71 -- # local operation=write 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@74 -- # '[' write = write ']' 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@76 -- # dd if=/dev/urandom of=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest bs=4096 count=256 00:06:21.067 256+0 records in 00:06:21.067 256+0 records out 00:06:21.067 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.00511181 s, 205 MB/s 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd0 bs=4096 count=256 oflag=direct 00:06:21.067 256+0 records in 00:06:21.067 256+0 records out 00:06:21.067 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0190082 s, 55.2 MB/s 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@77 -- # for i in "${nbd_list[@]}" 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@78 -- # dd if=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest of=/dev/nbd1 bs=4096 count=256 oflag=direct 00:06:21.067 256+0 records in 00:06:21.067 256+0 records out 00:06:21.067 1048576 bytes (1.0 MB, 1.0 MiB) copied, 0.0231418 s, 45.3 MB/s 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@101 -- # nbd_dd_data_verify '/dev/nbd0 /dev/nbd1' verify 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@70 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@70 -- # local nbd_list 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@71 -- # local operation=verify 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@72 -- # local tmp_file=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@74 -- # '[' verify = write ']' 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@80 -- # '[' verify = verify ']' 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd0 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@82 -- # for i in "${nbd_list[@]}" 00:06:21.067 04:08:11 -- bdev/nbd_common.sh@83 -- # cmp -b -n 1M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest /dev/nbd1 00:06:21.326 04:08:11 -- bdev/nbd_common.sh@85 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/nbdrandtest 00:06:21.326 04:08:11 -- bdev/nbd_common.sh@103 -- # nbd_stop_disks /var/tmp/spdk-nbd.sock '/dev/nbd0 /dev/nbd1' 00:06:21.326 04:08:11 -- bdev/nbd_common.sh@49 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.326 04:08:11 -- bdev/nbd_common.sh@50 -- # nbd_list=('/dev/nbd0' '/dev/nbd1') 00:06:21.326 04:08:11 -- bdev/nbd_common.sh@50 -- # local nbd_list 00:06:21.326 04:08:11 -- bdev/nbd_common.sh@51 -- # local i 00:06:21.326 04:08:11 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.326 04:08:11 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd0 00:06:21.586 04:08:11 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd0 00:06:21.586 04:08:11 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd0 00:06:21.586 04:08:11 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd0 00:06:21.586 04:08:11 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.586 04:08:11 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.586 04:08:11 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd0 /proc/partitions 00:06:21.586 04:08:11 -- bdev/nbd_common.sh@41 -- # break 00:06:21.586 04:08:11 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.586 04:08:11 -- bdev/nbd_common.sh@53 -- # for i in "${nbd_list[@]}" 00:06:21.586 04:08:11 -- bdev/nbd_common.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_stop_disk /dev/nbd1 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@55 -- # basename /dev/nbd1 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@55 -- # waitfornbd_exit nbd1 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@35 -- # local nbd_name=nbd1 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@37 -- # (( i = 1 )) 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@37 -- # (( i <= 20 )) 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@38 -- # grep -q -w nbd1 /proc/partitions 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@41 -- # break 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@45 -- # return 0 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@104 -- # nbd_get_count /var/tmp/spdk-nbd.sock 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@61 -- # local rpc_server=/var/tmp/spdk-nbd.sock 00:06:21.844 04:08:12 -- bdev/nbd_common.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock nbd_get_disks 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@63 -- # nbd_disks_json='[]' 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@64 -- # echo '[]' 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@64 -- # jq -r '.[] | .nbd_device' 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@64 -- # nbd_disks_name= 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@65 -- # echo '' 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@65 -- # grep -c /dev/nbd 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@65 -- # true 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@65 -- # count=0 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@66 -- # echo 0 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@104 -- # count=0 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@105 -- # '[' 0 -ne 0 ']' 00:06:22.102 04:08:12 -- bdev/nbd_common.sh@109 -- # return 0 00:06:22.102 04:08:12 -- event/event.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/spdk-nbd.sock spdk_kill_instance SIGTERM 00:06:22.360 04:08:12 -- event/event.sh@35 -- # sleep 3 00:06:22.618 [2024-11-30 04:08:13.066741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:06:22.618 [2024-11-30 04:08:13.157863] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:22.618 [2024-11-30 04:08:13.157867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:22.618 [2024-11-30 04:08:13.211727] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_register' already registered. 00:06:22.618 [2024-11-30 04:08:13.211785] notify.c: 45:spdk_notify_type_register: *NOTICE*: Notification type 'bdev_unregister' already registered. 00:06:25.898 04:08:15 -- event/event.sh@38 -- # waitforlisten 2241213 /var/tmp/spdk-nbd.sock 00:06:25.898 04:08:15 -- common/autotest_common.sh@829 -- # '[' -z 2241213 ']' 00:06:25.898 04:08:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk-nbd.sock 00:06:25.898 04:08:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:25.898 04:08:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock...' 00:06:25.898 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk-nbd.sock... 00:06:25.898 04:08:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:25.899 04:08:15 -- common/autotest_common.sh@10 -- # set +x 00:06:25.899 04:08:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:25.899 04:08:16 -- common/autotest_common.sh@862 -- # return 0 00:06:25.899 04:08:16 -- event/event.sh@39 -- # killprocess 2241213 00:06:25.899 04:08:16 -- common/autotest_common.sh@936 -- # '[' -z 2241213 ']' 00:06:25.899 04:08:16 -- common/autotest_common.sh@940 -- # kill -0 2241213 00:06:25.899 04:08:16 -- common/autotest_common.sh@941 -- # uname 00:06:25.899 04:08:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:25.899 04:08:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2241213 00:06:25.899 04:08:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:25.899 04:08:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:25.899 04:08:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2241213' 00:06:25.899 killing process with pid 2241213 00:06:25.899 04:08:16 -- common/autotest_common.sh@955 -- # kill 2241213 00:06:25.899 04:08:16 -- common/autotest_common.sh@960 -- # wait 2241213 00:06:25.899 spdk_app_start is called in Round 0. 00:06:25.899 Shutdown signal received, stop current app iteration 00:06:25.899 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:25.899 spdk_app_start is called in Round 1. 00:06:25.899 Shutdown signal received, stop current app iteration 00:06:25.899 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:25.899 spdk_app_start is called in Round 2. 00:06:25.899 Shutdown signal received, stop current app iteration 00:06:25.899 Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 reinitialization... 00:06:25.899 spdk_app_start is called in Round 3. 00:06:25.899 Shutdown signal received, stop current app iteration 00:06:25.899 04:08:16 -- event/event.sh@40 -- # trap - SIGINT SIGTERM EXIT 00:06:25.899 04:08:16 -- event/event.sh@42 -- # return 0 00:06:25.899 00:06:25.899 real 0m18.837s 00:06:25.899 user 0m41.411s 00:06:25.899 sys 0m3.117s 00:06:25.899 04:08:16 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:25.899 04:08:16 -- common/autotest_common.sh@10 -- # set +x 00:06:25.899 ************************************ 00:06:25.899 END TEST app_repeat 00:06:25.899 ************************************ 00:06:25.899 04:08:16 -- event/event.sh@54 -- # (( SPDK_TEST_CRYPTO == 0 )) 00:06:25.899 04:08:16 -- event/event.sh@55 -- # run_test cpu_locks /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:25.899 04:08:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.899 04:08:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.899 04:08:16 -- common/autotest_common.sh@10 -- # set +x 00:06:25.899 ************************************ 00:06:25.899 START TEST cpu_locks 00:06:25.899 ************************************ 00:06:25.899 04:08:16 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event/cpu_locks.sh 00:06:25.899 * Looking for test storage... 00:06:25.899 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/event 00:06:25.899 04:08:16 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:25.899 04:08:16 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:25.899 04:08:16 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:25.899 04:08:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:25.899 04:08:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:25.899 04:08:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:25.899 04:08:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:25.899 04:08:16 -- scripts/common.sh@335 -- # IFS=.-: 00:06:25.899 04:08:16 -- scripts/common.sh@335 -- # read -ra ver1 00:06:25.899 04:08:16 -- scripts/common.sh@336 -- # IFS=.-: 00:06:25.899 04:08:16 -- scripts/common.sh@336 -- # read -ra ver2 00:06:25.899 04:08:16 -- scripts/common.sh@337 -- # local 'op=<' 00:06:25.899 04:08:16 -- scripts/common.sh@339 -- # ver1_l=2 00:06:25.899 04:08:16 -- scripts/common.sh@340 -- # ver2_l=1 00:06:25.899 04:08:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:25.899 04:08:16 -- scripts/common.sh@343 -- # case "$op" in 00:06:25.899 04:08:16 -- scripts/common.sh@344 -- # : 1 00:06:25.899 04:08:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:25.899 04:08:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:25.899 04:08:16 -- scripts/common.sh@364 -- # decimal 1 00:06:25.899 04:08:16 -- scripts/common.sh@352 -- # local d=1 00:06:25.899 04:08:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:25.899 04:08:16 -- scripts/common.sh@354 -- # echo 1 00:06:25.899 04:08:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:25.899 04:08:16 -- scripts/common.sh@365 -- # decimal 2 00:06:25.899 04:08:16 -- scripts/common.sh@352 -- # local d=2 00:06:25.899 04:08:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:25.899 04:08:16 -- scripts/common.sh@354 -- # echo 2 00:06:25.899 04:08:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:25.899 04:08:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:25.899 04:08:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:25.899 04:08:16 -- scripts/common.sh@367 -- # return 0 00:06:25.899 04:08:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:25.899 04:08:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:25.899 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.899 --rc genhtml_branch_coverage=1 00:06:25.899 --rc genhtml_function_coverage=1 00:06:25.899 --rc genhtml_legend=1 00:06:25.899 --rc geninfo_all_blocks=1 00:06:25.899 --rc geninfo_unexecuted_blocks=1 00:06:25.899 00:06:25.899 ' 00:06:25.899 04:08:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:25.899 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.899 --rc genhtml_branch_coverage=1 00:06:25.899 --rc genhtml_function_coverage=1 00:06:25.899 --rc genhtml_legend=1 00:06:25.899 --rc geninfo_all_blocks=1 00:06:25.899 --rc geninfo_unexecuted_blocks=1 00:06:25.899 00:06:25.899 ' 00:06:25.899 04:08:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:25.899 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.899 --rc genhtml_branch_coverage=1 00:06:25.899 --rc genhtml_function_coverage=1 00:06:25.899 --rc genhtml_legend=1 00:06:25.899 --rc geninfo_all_blocks=1 00:06:25.899 --rc geninfo_unexecuted_blocks=1 00:06:25.899 00:06:25.899 ' 00:06:25.899 04:08:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:25.899 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:25.899 --rc genhtml_branch_coverage=1 00:06:25.899 --rc genhtml_function_coverage=1 00:06:25.899 --rc genhtml_legend=1 00:06:25.899 --rc geninfo_all_blocks=1 00:06:25.899 --rc geninfo_unexecuted_blocks=1 00:06:25.899 00:06:25.899 ' 00:06:25.899 04:08:16 -- event/cpu_locks.sh@11 -- # rpc_sock1=/var/tmp/spdk.sock 00:06:25.899 04:08:16 -- event/cpu_locks.sh@12 -- # rpc_sock2=/var/tmp/spdk2.sock 00:06:25.899 04:08:16 -- event/cpu_locks.sh@164 -- # trap cleanup EXIT SIGTERM SIGINT 00:06:25.899 04:08:16 -- event/cpu_locks.sh@166 -- # run_test default_locks default_locks 00:06:25.899 04:08:16 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:25.899 04:08:16 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:25.899 04:08:16 -- common/autotest_common.sh@10 -- # set +x 00:06:26.157 ************************************ 00:06:26.157 START TEST default_locks 00:06:26.157 ************************************ 00:06:26.157 04:08:16 -- common/autotest_common.sh@1114 -- # default_locks 00:06:26.157 04:08:16 -- event/cpu_locks.sh@46 -- # spdk_tgt_pid=2243723 00:06:26.157 04:08:16 -- event/cpu_locks.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:26.157 04:08:16 -- event/cpu_locks.sh@47 -- # waitforlisten 2243723 00:06:26.157 04:08:16 -- common/autotest_common.sh@829 -- # '[' -z 2243723 ']' 00:06:26.157 04:08:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:26.157 04:08:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:26.157 04:08:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:26.157 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:26.157 04:08:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:26.158 04:08:16 -- common/autotest_common.sh@10 -- # set +x 00:06:26.158 [2024-11-30 04:08:16.583935] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:26.158 [2024-11-30 04:08:16.584058] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2243723 ] 00:06:26.158 EAL: No free 2048 kB hugepages reported on node 1 00:06:26.158 [2024-11-30 04:08:16.651005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:26.158 [2024-11-30 04:08:16.738720] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:26.158 [2024-11-30 04:08:16.738909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:27.092 04:08:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:27.092 04:08:17 -- common/autotest_common.sh@862 -- # return 0 00:06:27.092 04:08:17 -- event/cpu_locks.sh@49 -- # locks_exist 2243723 00:06:27.092 04:08:17 -- event/cpu_locks.sh@22 -- # lslocks -p 2243723 00:06:27.092 04:08:17 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:27.092 lslocks: write error 00:06:27.092 04:08:17 -- event/cpu_locks.sh@50 -- # killprocess 2243723 00:06:27.092 04:08:17 -- common/autotest_common.sh@936 -- # '[' -z 2243723 ']' 00:06:27.092 04:08:17 -- common/autotest_common.sh@940 -- # kill -0 2243723 00:06:27.092 04:08:17 -- common/autotest_common.sh@941 -- # uname 00:06:27.092 04:08:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:27.092 04:08:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2243723 00:06:27.349 04:08:17 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:27.349 04:08:17 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:27.349 04:08:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2243723' 00:06:27.349 killing process with pid 2243723 00:06:27.349 04:08:17 -- common/autotest_common.sh@955 -- # kill 2243723 00:06:27.349 04:08:17 -- common/autotest_common.sh@960 -- # wait 2243723 00:06:27.609 04:08:18 -- event/cpu_locks.sh@52 -- # NOT waitforlisten 2243723 00:06:27.609 04:08:18 -- common/autotest_common.sh@650 -- # local es=0 00:06:27.609 04:08:18 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2243723 00:06:27.609 04:08:18 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:27.609 04:08:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.609 04:08:18 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:27.609 04:08:18 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:27.609 04:08:18 -- common/autotest_common.sh@653 -- # waitforlisten 2243723 00:06:27.609 04:08:18 -- common/autotest_common.sh@829 -- # '[' -z 2243723 ']' 00:06:27.609 04:08:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.609 04:08:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.609 04:08:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.609 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.609 04:08:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.609 04:08:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.609 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2243723) - No such process 00:06:27.609 ERROR: process (pid: 2243723) is no longer running 00:06:27.609 04:08:18 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:27.609 04:08:18 -- common/autotest_common.sh@862 -- # return 1 00:06:27.609 04:08:18 -- common/autotest_common.sh@653 -- # es=1 00:06:27.609 04:08:18 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:27.609 04:08:18 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:27.609 04:08:18 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:27.609 04:08:18 -- event/cpu_locks.sh@54 -- # no_locks 00:06:27.609 04:08:18 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:27.609 04:08:18 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:27.609 04:08:18 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:27.609 00:06:27.609 real 0m1.650s 00:06:27.609 user 0m1.781s 00:06:27.609 sys 0m0.554s 00:06:27.609 04:08:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:27.609 04:08:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.609 ************************************ 00:06:27.609 END TEST default_locks 00:06:27.609 ************************************ 00:06:27.609 04:08:18 -- event/cpu_locks.sh@167 -- # run_test default_locks_via_rpc default_locks_via_rpc 00:06:27.609 04:08:18 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:27.609 04:08:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:27.609 04:08:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.609 ************************************ 00:06:27.609 START TEST default_locks_via_rpc 00:06:27.609 ************************************ 00:06:27.609 04:08:18 -- common/autotest_common.sh@1114 -- # default_locks_via_rpc 00:06:27.609 04:08:18 -- event/cpu_locks.sh@62 -- # spdk_tgt_pid=2243941 00:06:27.609 04:08:18 -- event/cpu_locks.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:27.609 04:08:18 -- event/cpu_locks.sh@63 -- # waitforlisten 2243941 00:06:27.609 04:08:18 -- common/autotest_common.sh@829 -- # '[' -z 2243941 ']' 00:06:27.609 04:08:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:27.609 04:08:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:27.609 04:08:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:27.609 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:27.609 04:08:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:27.609 04:08:18 -- common/autotest_common.sh@10 -- # set +x 00:06:27.868 [2024-11-30 04:08:18.258199] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:27.868 [2024-11-30 04:08:18.258295] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2243941 ] 00:06:27.868 EAL: No free 2048 kB hugepages reported on node 1 00:06:27.868 [2024-11-30 04:08:18.318683] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:27.868 [2024-11-30 04:08:18.407453] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:27.868 [2024-11-30 04:08:18.407673] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:28.802 04:08:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:28.802 04:08:19 -- common/autotest_common.sh@862 -- # return 0 00:06:28.802 04:08:19 -- event/cpu_locks.sh@65 -- # rpc_cmd framework_disable_cpumask_locks 00:06:28.802 04:08:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.802 04:08:19 -- common/autotest_common.sh@10 -- # set +x 00:06:28.802 04:08:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.802 04:08:19 -- event/cpu_locks.sh@67 -- # no_locks 00:06:28.802 04:08:19 -- event/cpu_locks.sh@26 -- # lock_files=() 00:06:28.802 04:08:19 -- event/cpu_locks.sh@26 -- # local lock_files 00:06:28.802 04:08:19 -- event/cpu_locks.sh@27 -- # (( 0 != 0 )) 00:06:28.802 04:08:19 -- event/cpu_locks.sh@69 -- # rpc_cmd framework_enable_cpumask_locks 00:06:28.802 04:08:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:28.802 04:08:19 -- common/autotest_common.sh@10 -- # set +x 00:06:28.802 04:08:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:28.802 04:08:19 -- event/cpu_locks.sh@71 -- # locks_exist 2243941 00:06:28.802 04:08:19 -- event/cpu_locks.sh@22 -- # lslocks -p 2243941 00:06:28.802 04:08:19 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:29.061 04:08:19 -- event/cpu_locks.sh@73 -- # killprocess 2243941 00:06:29.061 04:08:19 -- common/autotest_common.sh@936 -- # '[' -z 2243941 ']' 00:06:29.061 04:08:19 -- common/autotest_common.sh@940 -- # kill -0 2243941 00:06:29.061 04:08:19 -- common/autotest_common.sh@941 -- # uname 00:06:29.061 04:08:19 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:29.061 04:08:19 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2243941 00:06:29.061 04:08:19 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:29.061 04:08:19 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:29.061 04:08:19 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2243941' 00:06:29.061 killing process with pid 2243941 00:06:29.061 04:08:19 -- common/autotest_common.sh@955 -- # kill 2243941 00:06:29.061 04:08:19 -- common/autotest_common.sh@960 -- # wait 2243941 00:06:29.319 00:06:29.319 real 0m1.708s 00:06:29.319 user 0m1.843s 00:06:29.319 sys 0m0.538s 00:06:29.319 04:08:19 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:29.319 04:08:19 -- common/autotest_common.sh@10 -- # set +x 00:06:29.319 ************************************ 00:06:29.319 END TEST default_locks_via_rpc 00:06:29.319 ************************************ 00:06:29.319 04:08:19 -- event/cpu_locks.sh@168 -- # run_test non_locking_app_on_locked_coremask non_locking_app_on_locked_coremask 00:06:29.319 04:08:19 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:29.319 04:08:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:29.319 04:08:19 -- common/autotest_common.sh@10 -- # set +x 00:06:29.319 ************************************ 00:06:29.319 START TEST non_locking_app_on_locked_coremask 00:06:29.319 ************************************ 00:06:29.319 04:08:19 -- common/autotest_common.sh@1114 -- # non_locking_app_on_locked_coremask 00:06:29.319 04:08:19 -- event/cpu_locks.sh@80 -- # spdk_tgt_pid=2244238 00:06:29.319 04:08:19 -- event/cpu_locks.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:29.319 04:08:19 -- event/cpu_locks.sh@81 -- # waitforlisten 2244238 /var/tmp/spdk.sock 00:06:29.319 04:08:19 -- common/autotest_common.sh@829 -- # '[' -z 2244238 ']' 00:06:29.319 04:08:19 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:29.319 04:08:19 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:29.319 04:08:19 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:29.319 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:29.319 04:08:19 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:29.319 04:08:19 -- common/autotest_common.sh@10 -- # set +x 00:06:29.576 [2024-11-30 04:08:19.990678] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:29.576 [2024-11-30 04:08:19.990769] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2244238 ] 00:06:29.576 EAL: No free 2048 kB hugepages reported on node 1 00:06:29.576 [2024-11-30 04:08:20.053695] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:29.576 [2024-11-30 04:08:20.143499] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:29.576 [2024-11-30 04:08:20.143667] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:30.510 04:08:20 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:30.510 04:08:20 -- common/autotest_common.sh@862 -- # return 0 00:06:30.510 04:08:20 -- event/cpu_locks.sh@84 -- # spdk_tgt_pid2=2244268 00:06:30.510 04:08:20 -- event/cpu_locks.sh@85 -- # waitforlisten 2244268 /var/tmp/spdk2.sock 00:06:30.510 04:08:20 -- event/cpu_locks.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks -r /var/tmp/spdk2.sock 00:06:30.510 04:08:20 -- common/autotest_common.sh@829 -- # '[' -z 2244268 ']' 00:06:30.510 04:08:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:30.510 04:08:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:30.510 04:08:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:30.510 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:30.510 04:08:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:30.510 04:08:20 -- common/autotest_common.sh@10 -- # set +x 00:06:30.510 [2024-11-30 04:08:21.014883] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:30.510 [2024-11-30 04:08:21.015018] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2244268 ] 00:06:30.510 EAL: No free 2048 kB hugepages reported on node 1 00:06:30.510 [2024-11-30 04:08:21.113475] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:30.510 [2024-11-30 04:08:21.113510] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:30.770 [2024-11-30 04:08:21.290567] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:30.770 [2024-11-30 04:08:21.290779] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:31.336 04:08:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:31.336 04:08:21 -- common/autotest_common.sh@862 -- # return 0 00:06:31.336 04:08:21 -- event/cpu_locks.sh@87 -- # locks_exist 2244238 00:06:31.336 04:08:21 -- event/cpu_locks.sh@22 -- # lslocks -p 2244238 00:06:31.336 04:08:21 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:31.902 lslocks: write error 00:06:31.902 04:08:22 -- event/cpu_locks.sh@89 -- # killprocess 2244238 00:06:31.902 04:08:22 -- common/autotest_common.sh@936 -- # '[' -z 2244238 ']' 00:06:31.902 04:08:22 -- common/autotest_common.sh@940 -- # kill -0 2244238 00:06:31.902 04:08:22 -- common/autotest_common.sh@941 -- # uname 00:06:31.902 04:08:22 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:31.902 04:08:22 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2244238 00:06:31.902 04:08:22 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:31.902 04:08:22 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:31.902 04:08:22 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2244238' 00:06:31.902 killing process with pid 2244238 00:06:31.902 04:08:22 -- common/autotest_common.sh@955 -- # kill 2244238 00:06:31.902 04:08:22 -- common/autotest_common.sh@960 -- # wait 2244238 00:06:32.836 04:08:23 -- event/cpu_locks.sh@90 -- # killprocess 2244268 00:06:32.836 04:08:23 -- common/autotest_common.sh@936 -- # '[' -z 2244268 ']' 00:06:32.836 04:08:23 -- common/autotest_common.sh@940 -- # kill -0 2244268 00:06:32.836 04:08:23 -- common/autotest_common.sh@941 -- # uname 00:06:32.836 04:08:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:32.836 04:08:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2244268 00:06:32.836 04:08:23 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:32.836 04:08:23 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:32.836 04:08:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2244268' 00:06:32.836 killing process with pid 2244268 00:06:32.836 04:08:23 -- common/autotest_common.sh@955 -- # kill 2244268 00:06:32.836 04:08:23 -- common/autotest_common.sh@960 -- # wait 2244268 00:06:33.095 00:06:33.095 real 0m3.768s 00:06:33.095 user 0m4.130s 00:06:33.095 sys 0m1.109s 00:06:33.095 04:08:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:33.095 04:08:23 -- common/autotest_common.sh@10 -- # set +x 00:06:33.095 ************************************ 00:06:33.095 END TEST non_locking_app_on_locked_coremask 00:06:33.095 ************************************ 00:06:33.353 04:08:23 -- event/cpu_locks.sh@169 -- # run_test locking_app_on_unlocked_coremask locking_app_on_unlocked_coremask 00:06:33.353 04:08:23 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:33.353 04:08:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:33.354 04:08:23 -- common/autotest_common.sh@10 -- # set +x 00:06:33.354 ************************************ 00:06:33.354 START TEST locking_app_on_unlocked_coremask 00:06:33.354 ************************************ 00:06:33.354 04:08:23 -- common/autotest_common.sh@1114 -- # locking_app_on_unlocked_coremask 00:06:33.354 04:08:23 -- event/cpu_locks.sh@98 -- # spdk_tgt_pid=2244692 00:06:33.354 04:08:23 -- event/cpu_locks.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 --disable-cpumask-locks 00:06:33.354 04:08:23 -- event/cpu_locks.sh@99 -- # waitforlisten 2244692 /var/tmp/spdk.sock 00:06:33.354 04:08:23 -- common/autotest_common.sh@829 -- # '[' -z 2244692 ']' 00:06:33.354 04:08:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:33.354 04:08:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:33.354 04:08:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:33.354 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:33.354 04:08:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:33.354 04:08:23 -- common/autotest_common.sh@10 -- # set +x 00:06:33.354 [2024-11-30 04:08:23.787993] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:33.354 [2024-11-30 04:08:23.788103] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2244692 ] 00:06:33.354 EAL: No free 2048 kB hugepages reported on node 1 00:06:33.354 [2024-11-30 04:08:23.850094] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:33.354 [2024-11-30 04:08:23.850144] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:33.354 [2024-11-30 04:08:23.935048] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:33.354 [2024-11-30 04:08:23.935240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:34.289 04:08:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:34.289 04:08:24 -- common/autotest_common.sh@862 -- # return 0 00:06:34.289 04:08:24 -- event/cpu_locks.sh@102 -- # spdk_tgt_pid2=2244834 00:06:34.289 04:08:24 -- event/cpu_locks.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:34.289 04:08:24 -- event/cpu_locks.sh@103 -- # waitforlisten 2244834 /var/tmp/spdk2.sock 00:06:34.289 04:08:24 -- common/autotest_common.sh@829 -- # '[' -z 2244834 ']' 00:06:34.289 04:08:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:34.289 04:08:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:34.289 04:08:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:34.289 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:34.289 04:08:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:34.289 04:08:24 -- common/autotest_common.sh@10 -- # set +x 00:06:34.289 [2024-11-30 04:08:24.775899] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:34.289 [2024-11-30 04:08:24.776001] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2244834 ] 00:06:34.289 EAL: No free 2048 kB hugepages reported on node 1 00:06:34.289 [2024-11-30 04:08:24.869484] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:34.558 [2024-11-30 04:08:25.047478] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:34.558 [2024-11-30 04:08:25.047682] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:35.125 04:08:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:35.125 04:08:25 -- common/autotest_common.sh@862 -- # return 0 00:06:35.125 04:08:25 -- event/cpu_locks.sh@105 -- # locks_exist 2244834 00:06:35.125 04:08:25 -- event/cpu_locks.sh@22 -- # lslocks -p 2244834 00:06:35.125 04:08:25 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:35.690 lslocks: write error 00:06:35.690 04:08:26 -- event/cpu_locks.sh@107 -- # killprocess 2244692 00:06:35.690 04:08:26 -- common/autotest_common.sh@936 -- # '[' -z 2244692 ']' 00:06:35.690 04:08:26 -- common/autotest_common.sh@940 -- # kill -0 2244692 00:06:35.690 04:08:26 -- common/autotest_common.sh@941 -- # uname 00:06:35.690 04:08:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:35.690 04:08:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2244692 00:06:35.690 04:08:26 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:35.690 04:08:26 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:35.690 04:08:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2244692' 00:06:35.690 killing process with pid 2244692 00:06:35.690 04:08:26 -- common/autotest_common.sh@955 -- # kill 2244692 00:06:35.690 04:08:26 -- common/autotest_common.sh@960 -- # wait 2244692 00:06:36.624 04:08:26 -- event/cpu_locks.sh@108 -- # killprocess 2244834 00:06:36.624 04:08:26 -- common/autotest_common.sh@936 -- # '[' -z 2244834 ']' 00:06:36.624 04:08:26 -- common/autotest_common.sh@940 -- # kill -0 2244834 00:06:36.624 04:08:26 -- common/autotest_common.sh@941 -- # uname 00:06:36.624 04:08:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:36.624 04:08:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2244834 00:06:36.624 04:08:27 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:36.624 04:08:27 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:36.624 04:08:27 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2244834' 00:06:36.624 killing process with pid 2244834 00:06:36.624 04:08:27 -- common/autotest_common.sh@955 -- # kill 2244834 00:06:36.624 04:08:27 -- common/autotest_common.sh@960 -- # wait 2244834 00:06:36.882 00:06:36.882 real 0m3.702s 00:06:36.882 user 0m4.104s 00:06:36.882 sys 0m1.037s 00:06:36.882 04:08:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:36.882 04:08:27 -- common/autotest_common.sh@10 -- # set +x 00:06:36.882 ************************************ 00:06:36.882 END TEST locking_app_on_unlocked_coremask 00:06:36.882 ************************************ 00:06:36.882 04:08:27 -- event/cpu_locks.sh@170 -- # run_test locking_app_on_locked_coremask locking_app_on_locked_coremask 00:06:36.882 04:08:27 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:36.882 04:08:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:36.882 04:08:27 -- common/autotest_common.sh@10 -- # set +x 00:06:36.882 ************************************ 00:06:36.882 START TEST locking_app_on_locked_coremask 00:06:36.882 ************************************ 00:06:36.882 04:08:27 -- common/autotest_common.sh@1114 -- # locking_app_on_locked_coremask 00:06:36.882 04:08:27 -- event/cpu_locks.sh@115 -- # spdk_tgt_pid=2245142 00:06:36.882 04:08:27 -- event/cpu_locks.sh@114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 00:06:36.882 04:08:27 -- event/cpu_locks.sh@116 -- # waitforlisten 2245142 /var/tmp/spdk.sock 00:06:36.882 04:08:27 -- common/autotest_common.sh@829 -- # '[' -z 2245142 ']' 00:06:36.882 04:08:27 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:36.882 04:08:27 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:36.882 04:08:27 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:36.882 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:36.882 04:08:27 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:36.882 04:08:27 -- common/autotest_common.sh@10 -- # set +x 00:06:37.141 [2024-11-30 04:08:27.518084] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:37.141 [2024-11-30 04:08:27.518165] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2245142 ] 00:06:37.141 EAL: No free 2048 kB hugepages reported on node 1 00:06:37.141 [2024-11-30 04:08:27.577392] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:37.141 [2024-11-30 04:08:27.664131] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:37.141 [2024-11-30 04:08:27.664300] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:38.075 04:08:28 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.075 04:08:28 -- common/autotest_common.sh@862 -- # return 0 00:06:38.075 04:08:28 -- event/cpu_locks.sh@119 -- # spdk_tgt_pid2=2245280 00:06:38.075 04:08:28 -- event/cpu_locks.sh@120 -- # NOT waitforlisten 2245280 /var/tmp/spdk2.sock 00:06:38.075 04:08:28 -- event/cpu_locks.sh@118 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1 -r /var/tmp/spdk2.sock 00:06:38.075 04:08:28 -- common/autotest_common.sh@650 -- # local es=0 00:06:38.075 04:08:28 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2245280 /var/tmp/spdk2.sock 00:06:38.075 04:08:28 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:38.075 04:08:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.075 04:08:28 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:38.075 04:08:28 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:38.075 04:08:28 -- common/autotest_common.sh@653 -- # waitforlisten 2245280 /var/tmp/spdk2.sock 00:06:38.075 04:08:28 -- common/autotest_common.sh@829 -- # '[' -z 2245280 ']' 00:06:38.075 04:08:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:38.075 04:08:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:38.075 04:08:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:38.075 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:38.075 04:08:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:38.075 04:08:28 -- common/autotest_common.sh@10 -- # set +x 00:06:38.075 [2024-11-30 04:08:28.518638] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:38.075 [2024-11-30 04:08:28.518721] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2245280 ] 00:06:38.075 EAL: No free 2048 kB hugepages reported on node 1 00:06:38.075 [2024-11-30 04:08:28.613611] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 0, probably process 2245142 has claimed it. 00:06:38.075 [2024-11-30 04:08:28.613668] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:38.641 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2245280) - No such process 00:06:38.641 ERROR: process (pid: 2245280) is no longer running 00:06:38.641 04:08:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:38.641 04:08:29 -- common/autotest_common.sh@862 -- # return 1 00:06:38.641 04:08:29 -- common/autotest_common.sh@653 -- # es=1 00:06:38.641 04:08:29 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:38.641 04:08:29 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:38.641 04:08:29 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:38.641 04:08:29 -- event/cpu_locks.sh@122 -- # locks_exist 2245142 00:06:38.641 04:08:29 -- event/cpu_locks.sh@22 -- # lslocks -p 2245142 00:06:38.641 04:08:29 -- event/cpu_locks.sh@22 -- # grep -q spdk_cpu_lock 00:06:39.207 lslocks: write error 00:06:39.207 04:08:29 -- event/cpu_locks.sh@124 -- # killprocess 2245142 00:06:39.207 04:08:29 -- common/autotest_common.sh@936 -- # '[' -z 2245142 ']' 00:06:39.207 04:08:29 -- common/autotest_common.sh@940 -- # kill -0 2245142 00:06:39.207 04:08:29 -- common/autotest_common.sh@941 -- # uname 00:06:39.207 04:08:29 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:39.207 04:08:29 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2245142 00:06:39.207 04:08:29 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:39.207 04:08:29 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:39.207 04:08:29 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2245142' 00:06:39.207 killing process with pid 2245142 00:06:39.207 04:08:29 -- common/autotest_common.sh@955 -- # kill 2245142 00:06:39.207 04:08:29 -- common/autotest_common.sh@960 -- # wait 2245142 00:06:39.464 00:06:39.464 real 0m2.599s 00:06:39.464 user 0m2.999s 00:06:39.464 sys 0m0.671s 00:06:39.464 04:08:30 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:39.464 04:08:30 -- common/autotest_common.sh@10 -- # set +x 00:06:39.464 ************************************ 00:06:39.464 END TEST locking_app_on_locked_coremask 00:06:39.464 ************************************ 00:06:39.464 04:08:30 -- event/cpu_locks.sh@171 -- # run_test locking_overlapped_coremask locking_overlapped_coremask 00:06:39.464 04:08:30 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:39.464 04:08:30 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:39.464 04:08:30 -- common/autotest_common.sh@10 -- # set +x 00:06:39.464 ************************************ 00:06:39.464 START TEST locking_overlapped_coremask 00:06:39.464 ************************************ 00:06:39.464 04:08:30 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask 00:06:39.464 04:08:30 -- event/cpu_locks.sh@132 -- # spdk_tgt_pid=2245580 00:06:39.464 04:08:30 -- event/cpu_locks.sh@131 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 00:06:39.464 04:08:30 -- event/cpu_locks.sh@133 -- # waitforlisten 2245580 /var/tmp/spdk.sock 00:06:39.464 04:08:30 -- common/autotest_common.sh@829 -- # '[' -z 2245580 ']' 00:06:39.464 04:08:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:39.464 04:08:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:39.464 04:08:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:39.464 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:39.464 04:08:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:39.464 04:08:30 -- common/autotest_common.sh@10 -- # set +x 00:06:39.722 [2024-11-30 04:08:30.140505] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:39.722 [2024-11-30 04:08:30.140604] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2245580 ] 00:06:39.722 EAL: No free 2048 kB hugepages reported on node 1 00:06:39.722 [2024-11-30 04:08:30.205395] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:39.722 [2024-11-30 04:08:30.295917] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:39.722 [2024-11-30 04:08:30.296154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:39.722 [2024-11-30 04:08:30.296225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:39.722 [2024-11-30 04:08:30.296228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:40.655 04:08:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:40.655 04:08:31 -- common/autotest_common.sh@862 -- # return 0 00:06:40.655 04:08:31 -- event/cpu_locks.sh@136 -- # spdk_tgt_pid2=2245603 00:06:40.655 04:08:31 -- event/cpu_locks.sh@135 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock 00:06:40.655 04:08:31 -- event/cpu_locks.sh@137 -- # NOT waitforlisten 2245603 /var/tmp/spdk2.sock 00:06:40.655 04:08:31 -- common/autotest_common.sh@650 -- # local es=0 00:06:40.655 04:08:31 -- common/autotest_common.sh@652 -- # valid_exec_arg waitforlisten 2245603 /var/tmp/spdk2.sock 00:06:40.655 04:08:31 -- common/autotest_common.sh@638 -- # local arg=waitforlisten 00:06:40.655 04:08:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:40.655 04:08:31 -- common/autotest_common.sh@642 -- # type -t waitforlisten 00:06:40.655 04:08:31 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:40.655 04:08:31 -- common/autotest_common.sh@653 -- # waitforlisten 2245603 /var/tmp/spdk2.sock 00:06:40.655 04:08:31 -- common/autotest_common.sh@829 -- # '[' -z 2245603 ']' 00:06:40.655 04:08:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:40.655 04:08:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:40.655 04:08:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:40.655 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:40.655 04:08:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:40.655 04:08:31 -- common/autotest_common.sh@10 -- # set +x 00:06:40.655 [2024-11-30 04:08:31.142165] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:40.655 [2024-11-30 04:08:31.142277] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2245603 ] 00:06:40.655 EAL: No free 2048 kB hugepages reported on node 1 00:06:40.655 [2024-11-30 04:08:31.238924] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2245580 has claimed it. 00:06:40.655 [2024-11-30 04:08:31.239021] app.c: 791:spdk_app_start: *ERROR*: Unable to acquire lock on assigned core mask - exiting. 00:06:41.218 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 844: kill: (2245603) - No such process 00:06:41.218 ERROR: process (pid: 2245603) is no longer running 00:06:41.218 04:08:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:41.218 04:08:31 -- common/autotest_common.sh@862 -- # return 1 00:06:41.218 04:08:31 -- common/autotest_common.sh@653 -- # es=1 00:06:41.218 04:08:31 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:41.218 04:08:31 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:41.218 04:08:31 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:41.218 04:08:31 -- event/cpu_locks.sh@139 -- # check_remaining_locks 00:06:41.218 04:08:31 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:41.218 04:08:31 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:41.218 04:08:31 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:41.218 04:08:31 -- event/cpu_locks.sh@141 -- # killprocess 2245580 00:06:41.218 04:08:31 -- common/autotest_common.sh@936 -- # '[' -z 2245580 ']' 00:06:41.218 04:08:31 -- common/autotest_common.sh@940 -- # kill -0 2245580 00:06:41.218 04:08:31 -- common/autotest_common.sh@941 -- # uname 00:06:41.476 04:08:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:41.476 04:08:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2245580 00:06:41.476 04:08:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:41.476 04:08:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:41.476 04:08:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2245580' 00:06:41.476 killing process with pid 2245580 00:06:41.476 04:08:31 -- common/autotest_common.sh@955 -- # kill 2245580 00:06:41.476 04:08:31 -- common/autotest_common.sh@960 -- # wait 2245580 00:06:41.734 00:06:41.734 real 0m2.195s 00:06:41.734 user 0m6.339s 00:06:41.734 sys 0m0.477s 00:06:41.734 04:08:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:41.734 04:08:32 -- common/autotest_common.sh@10 -- # set +x 00:06:41.734 ************************************ 00:06:41.734 END TEST locking_overlapped_coremask 00:06:41.734 ************************************ 00:06:41.734 04:08:32 -- event/cpu_locks.sh@172 -- # run_test locking_overlapped_coremask_via_rpc locking_overlapped_coremask_via_rpc 00:06:41.734 04:08:32 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:41.734 04:08:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:41.734 04:08:32 -- common/autotest_common.sh@10 -- # set +x 00:06:41.734 ************************************ 00:06:41.734 START TEST locking_overlapped_coremask_via_rpc 00:06:41.734 ************************************ 00:06:41.734 04:08:32 -- common/autotest_common.sh@1114 -- # locking_overlapped_coremask_via_rpc 00:06:41.734 04:08:32 -- event/cpu_locks.sh@148 -- # spdk_tgt_pid=2245878 00:06:41.734 04:08:32 -- event/cpu_locks.sh@147 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x7 --disable-cpumask-locks 00:06:41.734 04:08:32 -- event/cpu_locks.sh@149 -- # waitforlisten 2245878 /var/tmp/spdk.sock 00:06:41.734 04:08:32 -- common/autotest_common.sh@829 -- # '[' -z 2245878 ']' 00:06:41.734 04:08:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:41.734 04:08:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:41.734 04:08:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:41.734 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:41.734 04:08:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:41.734 04:08:32 -- common/autotest_common.sh@10 -- # set +x 00:06:41.734 [2024-11-30 04:08:32.364986] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:41.734 [2024-11-30 04:08:32.365086] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2245878 ] 00:06:41.992 EAL: No free 2048 kB hugepages reported on node 1 00:06:41.992 [2024-11-30 04:08:32.427143] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:41.992 [2024-11-30 04:08:32.427210] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:41.992 [2024-11-30 04:08:32.516797] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:41.992 [2024-11-30 04:08:32.517015] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:06:41.992 [2024-11-30 04:08:32.517081] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:41.992 [2024-11-30 04:08:32.517084] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:42.926 04:08:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:42.926 04:08:33 -- common/autotest_common.sh@862 -- # return 0 00:06:42.926 04:08:33 -- event/cpu_locks.sh@152 -- # spdk_tgt_pid2=2245916 00:06:42.926 04:08:33 -- event/cpu_locks.sh@151 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -m 0x1c -r /var/tmp/spdk2.sock --disable-cpumask-locks 00:06:42.926 04:08:33 -- event/cpu_locks.sh@153 -- # waitforlisten 2245916 /var/tmp/spdk2.sock 00:06:42.926 04:08:33 -- common/autotest_common.sh@829 -- # '[' -z 2245916 ']' 00:06:42.926 04:08:33 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:42.926 04:08:33 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:42.926 04:08:33 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:42.926 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:42.926 04:08:33 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:42.926 04:08:33 -- common/autotest_common.sh@10 -- # set +x 00:06:42.926 [2024-11-30 04:08:33.391067] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:42.926 [2024-11-30 04:08:33.391153] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1c --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2245916 ] 00:06:42.926 EAL: No free 2048 kB hugepages reported on node 1 00:06:42.926 [2024-11-30 04:08:33.485465] app.c: 795:spdk_app_start: *NOTICE*: CPU core locks deactivated. 00:06:42.926 [2024-11-30 04:08:33.485503] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:06:43.184 [2024-11-30 04:08:33.655056] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:43.184 [2024-11-30 04:08:33.655264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:06:43.184 [2024-11-30 04:08:33.659016] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:06:43.184 [2024-11-30 04:08:33.659019] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:06:43.750 04:08:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:43.750 04:08:34 -- common/autotest_common.sh@862 -- # return 0 00:06:43.750 04:08:34 -- event/cpu_locks.sh@155 -- # rpc_cmd framework_enable_cpumask_locks 00:06:43.750 04:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.750 04:08:34 -- common/autotest_common.sh@10 -- # set +x 00:06:43.750 04:08:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:43.750 04:08:34 -- event/cpu_locks.sh@156 -- # NOT rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:43.750 04:08:34 -- common/autotest_common.sh@650 -- # local es=0 00:06:43.750 04:08:34 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:43.750 04:08:34 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:06:43.750 04:08:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:43.750 04:08:34 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:06:43.750 04:08:34 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:43.750 04:08:34 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/spdk2.sock framework_enable_cpumask_locks 00:06:43.750 04:08:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:43.750 04:08:34 -- common/autotest_common.sh@10 -- # set +x 00:06:43.750 [2024-11-30 04:08:34.368052] app.c: 665:claim_cpu_cores: *ERROR*: Cannot create lock on core 2, probably process 2245878 has claimed it. 00:06:43.750 request: 00:06:43.750 { 00:06:43.750 "method": "framework_enable_cpumask_locks", 00:06:43.750 "req_id": 1 00:06:43.750 } 00:06:43.750 Got JSON-RPC error response 00:06:43.750 response: 00:06:43.750 { 00:06:43.750 "code": -32603, 00:06:43.750 "message": "Failed to claim CPU core: 2" 00:06:43.750 } 00:06:43.750 04:08:34 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:06:43.750 04:08:34 -- common/autotest_common.sh@653 -- # es=1 00:06:43.750 04:08:34 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:43.750 04:08:34 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:43.750 04:08:34 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:43.750 04:08:34 -- event/cpu_locks.sh@158 -- # waitforlisten 2245878 /var/tmp/spdk.sock 00:06:43.750 04:08:34 -- common/autotest_common.sh@829 -- # '[' -z 2245878 ']' 00:06:43.750 04:08:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:43.750 04:08:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:43.750 04:08:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:43.750 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:43.750 04:08:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:43.750 04:08:34 -- common/autotest_common.sh@10 -- # set +x 00:06:44.315 04:08:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:44.315 04:08:34 -- common/autotest_common.sh@862 -- # return 0 00:06:44.315 04:08:34 -- event/cpu_locks.sh@159 -- # waitforlisten 2245916 /var/tmp/spdk2.sock 00:06:44.315 04:08:34 -- common/autotest_common.sh@829 -- # '[' -z 2245916 ']' 00:06:44.315 04:08:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk2.sock 00:06:44.315 04:08:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:44.315 04:08:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock...' 00:06:44.315 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk2.sock... 00:06:44.315 04:08:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:44.315 04:08:34 -- common/autotest_common.sh@10 -- # set +x 00:06:44.315 04:08:34 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:44.315 04:08:34 -- common/autotest_common.sh@862 -- # return 0 00:06:44.315 04:08:34 -- event/cpu_locks.sh@161 -- # check_remaining_locks 00:06:44.315 04:08:34 -- event/cpu_locks.sh@36 -- # locks=(/var/tmp/spdk_cpu_lock_*) 00:06:44.315 04:08:34 -- event/cpu_locks.sh@37 -- # locks_expected=(/var/tmp/spdk_cpu_lock_{000..002}) 00:06:44.316 04:08:34 -- event/cpu_locks.sh@38 -- # [[ /var/tmp/spdk_cpu_lock_000 /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 == \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\0\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\1\ \/\v\a\r\/\t\m\p\/\s\p\d\k\_\c\p\u\_\l\o\c\k\_\0\0\2 ]] 00:06:44.316 00:06:44.316 real 0m2.585s 00:06:44.316 user 0m1.300s 00:06:44.316 sys 0m0.206s 00:06:44.316 04:08:34 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:44.316 04:08:34 -- common/autotest_common.sh@10 -- # set +x 00:06:44.316 ************************************ 00:06:44.316 END TEST locking_overlapped_coremask_via_rpc 00:06:44.316 ************************************ 00:06:44.316 04:08:34 -- event/cpu_locks.sh@174 -- # cleanup 00:06:44.316 04:08:34 -- event/cpu_locks.sh@15 -- # [[ -z 2245878 ]] 00:06:44.316 04:08:34 -- event/cpu_locks.sh@15 -- # killprocess 2245878 00:06:44.316 04:08:34 -- common/autotest_common.sh@936 -- # '[' -z 2245878 ']' 00:06:44.316 04:08:34 -- common/autotest_common.sh@940 -- # kill -0 2245878 00:06:44.316 04:08:34 -- common/autotest_common.sh@941 -- # uname 00:06:44.316 04:08:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.316 04:08:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2245878 00:06:44.573 04:08:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:44.573 04:08:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:44.573 04:08:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2245878' 00:06:44.573 killing process with pid 2245878 00:06:44.573 04:08:34 -- common/autotest_common.sh@955 -- # kill 2245878 00:06:44.573 04:08:34 -- common/autotest_common.sh@960 -- # wait 2245878 00:06:44.830 04:08:35 -- event/cpu_locks.sh@16 -- # [[ -z 2245916 ]] 00:06:44.830 04:08:35 -- event/cpu_locks.sh@16 -- # killprocess 2245916 00:06:44.830 04:08:35 -- common/autotest_common.sh@936 -- # '[' -z 2245916 ']' 00:06:44.830 04:08:35 -- common/autotest_common.sh@940 -- # kill -0 2245916 00:06:44.830 04:08:35 -- common/autotest_common.sh@941 -- # uname 00:06:44.830 04:08:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:44.830 04:08:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2245916 00:06:44.830 04:08:35 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:06:44.830 04:08:35 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:06:44.830 04:08:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2245916' 00:06:44.830 killing process with pid 2245916 00:06:44.830 04:08:35 -- common/autotest_common.sh@955 -- # kill 2245916 00:06:44.830 04:08:35 -- common/autotest_common.sh@960 -- # wait 2245916 00:06:45.397 04:08:35 -- event/cpu_locks.sh@18 -- # rm -f 00:06:45.397 04:08:35 -- event/cpu_locks.sh@1 -- # cleanup 00:06:45.397 04:08:35 -- event/cpu_locks.sh@15 -- # [[ -z 2245878 ]] 00:06:45.397 04:08:35 -- event/cpu_locks.sh@15 -- # killprocess 2245878 00:06:45.397 04:08:35 -- common/autotest_common.sh@936 -- # '[' -z 2245878 ']' 00:06:45.397 04:08:35 -- common/autotest_common.sh@940 -- # kill -0 2245878 00:06:45.397 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2245878) - No such process 00:06:45.397 04:08:35 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2245878 is not found' 00:06:45.397 Process with pid 2245878 is not found 00:06:45.397 04:08:35 -- event/cpu_locks.sh@16 -- # [[ -z 2245916 ]] 00:06:45.397 04:08:35 -- event/cpu_locks.sh@16 -- # killprocess 2245916 00:06:45.397 04:08:35 -- common/autotest_common.sh@936 -- # '[' -z 2245916 ']' 00:06:45.397 04:08:35 -- common/autotest_common.sh@940 -- # kill -0 2245916 00:06:45.397 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2245916) - No such process 00:06:45.397 04:08:35 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2245916 is not found' 00:06:45.397 Process with pid 2245916 is not found 00:06:45.397 04:08:35 -- event/cpu_locks.sh@18 -- # rm -f 00:06:45.397 00:06:45.397 real 0m19.426s 00:06:45.397 user 0m35.270s 00:06:45.397 sys 0m5.472s 00:06:45.397 04:08:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.397 04:08:35 -- common/autotest_common.sh@10 -- # set +x 00:06:45.397 ************************************ 00:06:45.397 END TEST cpu_locks 00:06:45.397 ************************************ 00:06:45.397 00:06:45.397 real 0m45.703s 00:06:45.397 user 1m28.106s 00:06:45.397 sys 0m9.368s 00:06:45.397 04:08:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:45.397 04:08:35 -- common/autotest_common.sh@10 -- # set +x 00:06:45.397 ************************************ 00:06:45.397 END TEST event 00:06:45.397 ************************************ 00:06:45.397 04:08:35 -- spdk/autotest.sh@175 -- # run_test thread /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:45.397 04:08:35 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:45.397 04:08:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.397 04:08:35 -- common/autotest_common.sh@10 -- # set +x 00:06:45.397 ************************************ 00:06:45.397 START TEST thread 00:06:45.397 ************************************ 00:06:45.397 04:08:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/thread.sh 00:06:45.397 * Looking for test storage... 00:06:45.397 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread 00:06:45.397 04:08:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:45.397 04:08:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:45.397 04:08:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:45.397 04:08:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:45.397 04:08:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:45.397 04:08:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:45.397 04:08:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:45.397 04:08:35 -- scripts/common.sh@335 -- # IFS=.-: 00:06:45.397 04:08:35 -- scripts/common.sh@335 -- # read -ra ver1 00:06:45.397 04:08:35 -- scripts/common.sh@336 -- # IFS=.-: 00:06:45.397 04:08:35 -- scripts/common.sh@336 -- # read -ra ver2 00:06:45.397 04:08:35 -- scripts/common.sh@337 -- # local 'op=<' 00:06:45.397 04:08:35 -- scripts/common.sh@339 -- # ver1_l=2 00:06:45.397 04:08:35 -- scripts/common.sh@340 -- # ver2_l=1 00:06:45.397 04:08:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:45.397 04:08:35 -- scripts/common.sh@343 -- # case "$op" in 00:06:45.397 04:08:35 -- scripts/common.sh@344 -- # : 1 00:06:45.397 04:08:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:45.397 04:08:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:45.397 04:08:35 -- scripts/common.sh@364 -- # decimal 1 00:06:45.397 04:08:35 -- scripts/common.sh@352 -- # local d=1 00:06:45.397 04:08:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:45.397 04:08:35 -- scripts/common.sh@354 -- # echo 1 00:06:45.397 04:08:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:45.397 04:08:35 -- scripts/common.sh@365 -- # decimal 2 00:06:45.397 04:08:35 -- scripts/common.sh@352 -- # local d=2 00:06:45.397 04:08:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:45.397 04:08:35 -- scripts/common.sh@354 -- # echo 2 00:06:45.397 04:08:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:45.397 04:08:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:45.397 04:08:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:45.397 04:08:35 -- scripts/common.sh@367 -- # return 0 00:06:45.397 04:08:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:45.397 04:08:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:45.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.397 --rc genhtml_branch_coverage=1 00:06:45.397 --rc genhtml_function_coverage=1 00:06:45.397 --rc genhtml_legend=1 00:06:45.397 --rc geninfo_all_blocks=1 00:06:45.397 --rc geninfo_unexecuted_blocks=1 00:06:45.397 00:06:45.397 ' 00:06:45.397 04:08:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:45.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.397 --rc genhtml_branch_coverage=1 00:06:45.397 --rc genhtml_function_coverage=1 00:06:45.397 --rc genhtml_legend=1 00:06:45.397 --rc geninfo_all_blocks=1 00:06:45.397 --rc geninfo_unexecuted_blocks=1 00:06:45.397 00:06:45.397 ' 00:06:45.397 04:08:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:45.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.397 --rc genhtml_branch_coverage=1 00:06:45.397 --rc genhtml_function_coverage=1 00:06:45.397 --rc genhtml_legend=1 00:06:45.397 --rc geninfo_all_blocks=1 00:06:45.397 --rc geninfo_unexecuted_blocks=1 00:06:45.397 00:06:45.397 ' 00:06:45.397 04:08:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:45.397 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:45.397 --rc genhtml_branch_coverage=1 00:06:45.397 --rc genhtml_function_coverage=1 00:06:45.397 --rc genhtml_legend=1 00:06:45.397 --rc geninfo_all_blocks=1 00:06:45.397 --rc geninfo_unexecuted_blocks=1 00:06:45.397 00:06:45.397 ' 00:06:45.397 04:08:35 -- thread/thread.sh@11 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:45.397 04:08:35 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:45.397 04:08:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:45.397 04:08:35 -- common/autotest_common.sh@10 -- # set +x 00:06:45.397 ************************************ 00:06:45.397 START TEST thread_poller_perf 00:06:45.397 ************************************ 00:06:45.397 04:08:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 1 -t 1 00:06:45.397 [2024-11-30 04:08:36.005333] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:45.397 [2024-11-30 04:08:36.005434] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2246409 ] 00:06:45.656 EAL: No free 2048 kB hugepages reported on node 1 00:06:45.656 [2024-11-30 04:08:36.067566] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:45.656 [2024-11-30 04:08:36.156320] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:45.656 Running 1000 pollers for 1 seconds with 1 microseconds period. 00:06:47.076 [2024-11-30T03:08:37.707Z] ====================================== 00:06:47.076 [2024-11-30T03:08:37.707Z] busy:2713948717 (cyc) 00:06:47.076 [2024-11-30T03:08:37.707Z] total_run_count: 279000 00:06:47.076 [2024-11-30T03:08:37.707Z] tsc_hz: 2700000000 (cyc) 00:06:47.076 [2024-11-30T03:08:37.707Z] ====================================== 00:06:47.076 [2024-11-30T03:08:37.707Z] poller_cost: 9727 (cyc), 3602 (nsec) 00:06:47.076 00:06:47.076 real 0m1.255s 00:06:47.076 user 0m1.162s 00:06:47.076 sys 0m0.087s 00:06:47.076 04:08:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:47.076 04:08:37 -- common/autotest_common.sh@10 -- # set +x 00:06:47.076 ************************************ 00:06:47.076 END TEST thread_poller_perf 00:06:47.076 ************************************ 00:06:47.076 04:08:37 -- thread/thread.sh@12 -- # run_test thread_poller_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:47.076 04:08:37 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:06:47.076 04:08:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:47.076 04:08:37 -- common/autotest_common.sh@10 -- # set +x 00:06:47.076 ************************************ 00:06:47.076 START TEST thread_poller_perf 00:06:47.076 ************************************ 00:06:47.076 04:08:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/thread/poller_perf/poller_perf -b 1000 -l 0 -t 1 00:06:47.076 [2024-11-30 04:08:37.284861] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:47.076 [2024-11-30 04:08:37.284950] [ DPDK EAL parameters: poller_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2246565 ] 00:06:47.076 EAL: No free 2048 kB hugepages reported on node 1 00:06:47.076 [2024-11-30 04:08:37.346448] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:47.076 [2024-11-30 04:08:37.436897] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:47.076 Running 1000 pollers for 1 seconds with 0 microseconds period. 00:06:48.030 [2024-11-30T03:08:38.661Z] ====================================== 00:06:48.030 [2024-11-30T03:08:38.661Z] busy:2703550323 (cyc) 00:06:48.030 [2024-11-30T03:08:38.661Z] total_run_count: 3827000 00:06:48.030 [2024-11-30T03:08:38.661Z] tsc_hz: 2700000000 (cyc) 00:06:48.030 [2024-11-30T03:08:38.661Z] ====================================== 00:06:48.030 [2024-11-30T03:08:38.661Z] poller_cost: 706 (cyc), 261 (nsec) 00:06:48.030 00:06:48.030 real 0m1.248s 00:06:48.030 user 0m1.152s 00:06:48.030 sys 0m0.089s 00:06:48.030 04:08:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.030 04:08:38 -- common/autotest_common.sh@10 -- # set +x 00:06:48.030 ************************************ 00:06:48.030 END TEST thread_poller_perf 00:06:48.030 ************************************ 00:06:48.030 04:08:38 -- thread/thread.sh@17 -- # [[ y != \y ]] 00:06:48.030 00:06:48.030 real 0m2.691s 00:06:48.030 user 0m2.431s 00:06:48.030 sys 0m0.264s 00:06:48.030 04:08:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:48.030 04:08:38 -- common/autotest_common.sh@10 -- # set +x 00:06:48.030 ************************************ 00:06:48.030 END TEST thread 00:06:48.030 ************************************ 00:06:48.030 04:08:38 -- spdk/autotest.sh@176 -- # run_test accel /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:48.030 04:08:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:06:48.030 04:08:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:48.030 04:08:38 -- common/autotest_common.sh@10 -- # set +x 00:06:48.030 ************************************ 00:06:48.030 START TEST accel 00:06:48.030 ************************************ 00:06:48.030 04:08:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel.sh 00:06:48.030 * Looking for test storage... 00:06:48.030 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:06:48.030 04:08:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:06:48.030 04:08:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:06:48.030 04:08:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:06:48.289 04:08:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:06:48.289 04:08:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:06:48.289 04:08:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:06:48.289 04:08:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:06:48.289 04:08:38 -- scripts/common.sh@335 -- # IFS=.-: 00:06:48.289 04:08:38 -- scripts/common.sh@335 -- # read -ra ver1 00:06:48.289 04:08:38 -- scripts/common.sh@336 -- # IFS=.-: 00:06:48.289 04:08:38 -- scripts/common.sh@336 -- # read -ra ver2 00:06:48.289 04:08:38 -- scripts/common.sh@337 -- # local 'op=<' 00:06:48.289 04:08:38 -- scripts/common.sh@339 -- # ver1_l=2 00:06:48.289 04:08:38 -- scripts/common.sh@340 -- # ver2_l=1 00:06:48.289 04:08:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:06:48.289 04:08:38 -- scripts/common.sh@343 -- # case "$op" in 00:06:48.289 04:08:38 -- scripts/common.sh@344 -- # : 1 00:06:48.289 04:08:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:06:48.289 04:08:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:06:48.289 04:08:38 -- scripts/common.sh@364 -- # decimal 1 00:06:48.289 04:08:38 -- scripts/common.sh@352 -- # local d=1 00:06:48.289 04:08:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:06:48.289 04:08:38 -- scripts/common.sh@354 -- # echo 1 00:06:48.289 04:08:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:06:48.289 04:08:38 -- scripts/common.sh@365 -- # decimal 2 00:06:48.289 04:08:38 -- scripts/common.sh@352 -- # local d=2 00:06:48.289 04:08:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:06:48.289 04:08:38 -- scripts/common.sh@354 -- # echo 2 00:06:48.289 04:08:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:06:48.289 04:08:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:06:48.289 04:08:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:06:48.289 04:08:38 -- scripts/common.sh@367 -- # return 0 00:06:48.289 04:08:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:06:48.289 04:08:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:06:48.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.289 --rc genhtml_branch_coverage=1 00:06:48.289 --rc genhtml_function_coverage=1 00:06:48.289 --rc genhtml_legend=1 00:06:48.289 --rc geninfo_all_blocks=1 00:06:48.289 --rc geninfo_unexecuted_blocks=1 00:06:48.289 00:06:48.289 ' 00:06:48.289 04:08:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:06:48.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.289 --rc genhtml_branch_coverage=1 00:06:48.289 --rc genhtml_function_coverage=1 00:06:48.289 --rc genhtml_legend=1 00:06:48.289 --rc geninfo_all_blocks=1 00:06:48.289 --rc geninfo_unexecuted_blocks=1 00:06:48.289 00:06:48.289 ' 00:06:48.289 04:08:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:06:48.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.289 --rc genhtml_branch_coverage=1 00:06:48.289 --rc genhtml_function_coverage=1 00:06:48.289 --rc genhtml_legend=1 00:06:48.289 --rc geninfo_all_blocks=1 00:06:48.289 --rc geninfo_unexecuted_blocks=1 00:06:48.289 00:06:48.289 ' 00:06:48.289 04:08:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:06:48.289 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:06:48.289 --rc genhtml_branch_coverage=1 00:06:48.289 --rc genhtml_function_coverage=1 00:06:48.289 --rc genhtml_legend=1 00:06:48.289 --rc geninfo_all_blocks=1 00:06:48.289 --rc geninfo_unexecuted_blocks=1 00:06:48.289 00:06:48.289 ' 00:06:48.289 04:08:38 -- accel/accel.sh@73 -- # declare -A expected_opcs 00:06:48.289 04:08:38 -- accel/accel.sh@74 -- # get_expected_opcs 00:06:48.289 04:08:38 -- accel/accel.sh@57 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:06:48.289 04:08:38 -- accel/accel.sh@59 -- # spdk_tgt_pid=2246768 00:06:48.289 04:08:38 -- accel/accel.sh@60 -- # waitforlisten 2246768 00:06:48.289 04:08:38 -- common/autotest_common.sh@829 -- # '[' -z 2246768 ']' 00:06:48.289 04:08:38 -- accel/accel.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt -c /dev/fd/63 00:06:48.289 04:08:38 -- accel/accel.sh@58 -- # build_accel_config 00:06:48.289 04:08:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:06:48.289 04:08:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:06:48.289 04:08:38 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:48.289 04:08:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:06:48.289 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:06:48.289 04:08:38 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:48.289 04:08:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:06:48.289 04:08:38 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:48.289 04:08:38 -- common/autotest_common.sh@10 -- # set +x 00:06:48.289 04:08:38 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:48.289 04:08:38 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:48.289 04:08:38 -- accel/accel.sh@41 -- # local IFS=, 00:06:48.289 04:08:38 -- accel/accel.sh@42 -- # jq -r . 00:06:48.289 [2024-11-30 04:08:38.756508] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:48.289 [2024-11-30 04:08:38.756600] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2246768 ] 00:06:48.289 EAL: No free 2048 kB hugepages reported on node 1 00:06:48.289 [2024-11-30 04:08:38.814703] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:48.289 [2024-11-30 04:08:38.905102] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:06:48.289 [2024-11-30 04:08:38.905275] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:49.224 04:08:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:06:49.224 04:08:39 -- common/autotest_common.sh@862 -- # return 0 00:06:49.224 04:08:39 -- accel/accel.sh@62 -- # exp_opcs=($($rpc_py accel_get_opc_assignments | jq -r ". | to_entries | map(\"\(.key)=\(.value)\") | .[]")) 00:06:49.224 04:08:39 -- accel/accel.sh@62 -- # rpc_cmd accel_get_opc_assignments 00:06:49.224 04:08:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:06:49.224 04:08:39 -- accel/accel.sh@62 -- # jq -r '. | to_entries | map("\(.key)=\(.value)") | .[]' 00:06:49.224 04:08:39 -- common/autotest_common.sh@10 -- # set +x 00:06:49.224 04:08:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@63 -- # for opc_opt in "${exp_opcs[@]}" 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # IFS== 00:06:49.224 04:08:39 -- accel/accel.sh@64 -- # read -r opc module 00:06:49.224 04:08:39 -- accel/accel.sh@65 -- # expected_opcs["$opc"]=software 00:06:49.224 04:08:39 -- accel/accel.sh@67 -- # killprocess 2246768 00:06:49.224 04:08:39 -- common/autotest_common.sh@936 -- # '[' -z 2246768 ']' 00:06:49.224 04:08:39 -- common/autotest_common.sh@940 -- # kill -0 2246768 00:06:49.224 04:08:39 -- common/autotest_common.sh@941 -- # uname 00:06:49.224 04:08:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:06:49.224 04:08:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2246768 00:06:49.224 04:08:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:06:49.224 04:08:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:06:49.224 04:08:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2246768' 00:06:49.224 killing process with pid 2246768 00:06:49.224 04:08:39 -- common/autotest_common.sh@955 -- # kill 2246768 00:06:49.224 04:08:39 -- common/autotest_common.sh@960 -- # wait 2246768 00:06:49.792 04:08:40 -- accel/accel.sh@68 -- # trap - ERR 00:06:49.792 04:08:40 -- accel/accel.sh@81 -- # run_test accel_help accel_perf -h 00:06:49.792 04:08:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:06:49.792 04:08:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.792 04:08:40 -- common/autotest_common.sh@10 -- # set +x 00:06:49.792 04:08:40 -- common/autotest_common.sh@1114 -- # accel_perf -h 00:06:49.792 04:08:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -h 00:06:49.792 04:08:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.792 04:08:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.792 04:08:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.792 04:08:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.792 04:08:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.792 04:08:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.792 04:08:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.792 04:08:40 -- accel/accel.sh@42 -- # jq -r . 00:06:49.792 04:08:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:49.792 04:08:40 -- common/autotest_common.sh@10 -- # set +x 00:06:49.792 04:08:40 -- accel/accel.sh@83 -- # run_test accel_missing_filename NOT accel_perf -t 1 -w compress 00:06:49.792 04:08:40 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:49.792 04:08:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:49.792 04:08:40 -- common/autotest_common.sh@10 -- # set +x 00:06:49.792 ************************************ 00:06:49.792 START TEST accel_missing_filename 00:06:49.792 ************************************ 00:06:49.792 04:08:40 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress 00:06:49.792 04:08:40 -- common/autotest_common.sh@650 -- # local es=0 00:06:49.792 04:08:40 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress 00:06:49.792 04:08:40 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:49.792 04:08:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.792 04:08:40 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:49.792 04:08:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:49.792 04:08:40 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress 00:06:49.792 04:08:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress 00:06:49.792 04:08:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:49.792 04:08:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:49.792 04:08:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:49.792 04:08:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:49.792 04:08:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:49.792 04:08:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:49.792 04:08:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:49.792 04:08:40 -- accel/accel.sh@42 -- # jq -r . 00:06:49.792 [2024-11-30 04:08:40.280148] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:49.792 [2024-11-30 04:08:40.280230] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2247074 ] 00:06:49.792 EAL: No free 2048 kB hugepages reported on node 1 00:06:49.792 [2024-11-30 04:08:40.346267] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.052 [2024-11-30 04:08:40.437767] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.052 [2024-11-30 04:08:40.500672] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:50.052 [2024-11-30 04:08:40.584954] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:50.052 A filename is required. 00:06:50.052 04:08:40 -- common/autotest_common.sh@653 -- # es=234 00:06:50.052 04:08:40 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.052 04:08:40 -- common/autotest_common.sh@662 -- # es=106 00:06:50.052 04:08:40 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:50.052 04:08:40 -- common/autotest_common.sh@670 -- # es=1 00:06:50.052 04:08:40 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.052 00:06:50.052 real 0m0.405s 00:06:50.052 user 0m0.286s 00:06:50.052 sys 0m0.148s 00:06:50.052 04:08:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.052 04:08:40 -- common/autotest_common.sh@10 -- # set +x 00:06:50.052 ************************************ 00:06:50.052 END TEST accel_missing_filename 00:06:50.052 ************************************ 00:06:50.310 04:08:40 -- accel/accel.sh@85 -- # run_test accel_compress_verify NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.310 04:08:40 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:50.310 04:08:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.310 04:08:40 -- common/autotest_common.sh@10 -- # set +x 00:06:50.310 ************************************ 00:06:50.310 START TEST accel_compress_verify 00:06:50.310 ************************************ 00:06:50.310 04:08:40 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.310 04:08:40 -- common/autotest_common.sh@650 -- # local es=0 00:06:50.310 04:08:40 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.310 04:08:40 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:50.310 04:08:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.310 04:08:40 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:50.310 04:08:40 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.311 04:08:40 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.311 04:08:40 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:06:50.311 04:08:40 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.311 04:08:40 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.311 04:08:40 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.311 04:08:40 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.311 04:08:40 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.311 04:08:40 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.311 04:08:40 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.311 04:08:40 -- accel/accel.sh@42 -- # jq -r . 00:06:50.311 [2024-11-30 04:08:40.713406] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.311 [2024-11-30 04:08:40.713493] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2247094 ] 00:06:50.311 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.311 [2024-11-30 04:08:40.778406] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.311 [2024-11-30 04:08:40.868164] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:50.311 [2024-11-30 04:08:40.929910] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:06:50.569 [2024-11-30 04:08:41.015186] accel_perf.c:1385:main: *ERROR*: ERROR starting application 00:06:50.569 00:06:50.569 Compression does not support the verify option, aborting. 00:06:50.569 04:08:41 -- common/autotest_common.sh@653 -- # es=161 00:06:50.569 04:08:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.569 04:08:41 -- common/autotest_common.sh@662 -- # es=33 00:06:50.569 04:08:41 -- common/autotest_common.sh@663 -- # case "$es" in 00:06:50.569 04:08:41 -- common/autotest_common.sh@670 -- # es=1 00:06:50.569 04:08:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.569 00:06:50.569 real 0m0.404s 00:06:50.569 user 0m0.296s 00:06:50.569 sys 0m0.142s 00:06:50.569 04:08:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.569 04:08:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.569 ************************************ 00:06:50.569 END TEST accel_compress_verify 00:06:50.569 ************************************ 00:06:50.569 04:08:41 -- accel/accel.sh@87 -- # run_test accel_wrong_workload NOT accel_perf -t 1 -w foobar 00:06:50.569 04:08:41 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:50.569 04:08:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.569 04:08:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.569 ************************************ 00:06:50.569 START TEST accel_wrong_workload 00:06:50.569 ************************************ 00:06:50.569 04:08:41 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w foobar 00:06:50.569 04:08:41 -- common/autotest_common.sh@650 -- # local es=0 00:06:50.569 04:08:41 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w foobar 00:06:50.569 04:08:41 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:50.569 04:08:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.569 04:08:41 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:50.569 04:08:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.569 04:08:41 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w foobar 00:06:50.569 04:08:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w foobar 00:06:50.569 04:08:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.569 04:08:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.569 04:08:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.569 04:08:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.569 04:08:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.569 04:08:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.569 04:08:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.569 04:08:41 -- accel/accel.sh@42 -- # jq -r . 00:06:50.569 Unsupported workload type: foobar 00:06:50.569 [2024-11-30 04:08:41.144490] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'w' failed: 1 00:06:50.569 accel_perf options: 00:06:50.569 [-h help message] 00:06:50.569 [-q queue depth per core] 00:06:50.569 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:50.569 [-T number of threads per core 00:06:50.569 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:50.569 [-t time in seconds] 00:06:50.569 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:50.569 [ dif_verify, , dif_generate, dif_generate_copy 00:06:50.569 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:50.569 [-l for compress/decompress workloads, name of uncompressed input file 00:06:50.569 [-S for crc32c workload, use this seed value (default 0) 00:06:50.569 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:50.569 [-f for fill workload, use this BYTE value (default 255) 00:06:50.569 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:50.569 [-y verify result if this switch is on] 00:06:50.569 [-a tasks to allocate per core (default: same value as -q)] 00:06:50.569 Can be used to spread operations across a wider range of memory. 00:06:50.569 04:08:41 -- common/autotest_common.sh@653 -- # es=1 00:06:50.569 04:08:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.569 04:08:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:50.569 04:08:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.569 00:06:50.569 real 0m0.024s 00:06:50.569 user 0m0.015s 00:06:50.569 sys 0m0.009s 00:06:50.569 04:08:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.569 04:08:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.569 ************************************ 00:06:50.569 END TEST accel_wrong_workload 00:06:50.569 ************************************ 00:06:50.569 Error: writing output failed: Broken pipe 00:06:50.569 04:08:41 -- accel/accel.sh@89 -- # run_test accel_negative_buffers NOT accel_perf -t 1 -w xor -y -x -1 00:06:50.569 04:08:41 -- common/autotest_common.sh@1087 -- # '[' 10 -le 1 ']' 00:06:50.569 04:08:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.569 04:08:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.569 ************************************ 00:06:50.569 START TEST accel_negative_buffers 00:06:50.569 ************************************ 00:06:50.569 04:08:41 -- common/autotest_common.sh@1114 -- # NOT accel_perf -t 1 -w xor -y -x -1 00:06:50.569 04:08:41 -- common/autotest_common.sh@650 -- # local es=0 00:06:50.569 04:08:41 -- common/autotest_common.sh@652 -- # valid_exec_arg accel_perf -t 1 -w xor -y -x -1 00:06:50.569 04:08:41 -- common/autotest_common.sh@638 -- # local arg=accel_perf 00:06:50.569 04:08:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.569 04:08:41 -- common/autotest_common.sh@642 -- # type -t accel_perf 00:06:50.569 04:08:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:06:50.569 04:08:41 -- common/autotest_common.sh@653 -- # accel_perf -t 1 -w xor -y -x -1 00:06:50.569 04:08:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x -1 00:06:50.569 04:08:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.569 04:08:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.569 04:08:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.569 04:08:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.569 04:08:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.569 04:08:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.569 04:08:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.570 04:08:41 -- accel/accel.sh@42 -- # jq -r . 00:06:50.570 -x option must be non-negative. 00:06:50.570 [2024-11-30 04:08:41.193651] app.c:1292:spdk_app_parse_args: *ERROR*: Parsing app-specific command line parameter 'x' failed: 1 00:06:50.570 accel_perf options: 00:06:50.570 [-h help message] 00:06:50.570 [-q queue depth per core] 00:06:50.570 [-C for supported workloads, use this value to configure the io vector size to test (default 1) 00:06:50.570 [-T number of threads per core 00:06:50.570 [-o transfer size in bytes (default: 4KiB. For compress/decompress, 0 means the input file size)] 00:06:50.570 [-t time in seconds] 00:06:50.570 [-w workload type must be one of these: copy, fill, crc32c, copy_crc32c, compare, compress, decompress, dualcast, xor, 00:06:50.570 [ dif_verify, , dif_generate, dif_generate_copy 00:06:50.570 [-M assign module to the operation, not compatible with accel_assign_opc RPC 00:06:50.570 [-l for compress/decompress workloads, name of uncompressed input file 00:06:50.570 [-S for crc32c workload, use this seed value (default 0) 00:06:50.570 [-P for compare workload, percentage of operations that should miscompare (percent, default 0) 00:06:50.570 [-f for fill workload, use this BYTE value (default 255) 00:06:50.570 [-x for xor workload, use this number of source buffers (default, minimum: 2)] 00:06:50.570 [-y verify result if this switch is on] 00:06:50.570 [-a tasks to allocate per core (default: same value as -q)] 00:06:50.570 Can be used to spread operations across a wider range of memory. 00:06:50.570 04:08:41 -- common/autotest_common.sh@653 -- # es=1 00:06:50.570 04:08:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:06:50.570 04:08:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:06:50.570 04:08:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:06:50.570 00:06:50.570 real 0m0.023s 00:06:50.570 user 0m0.012s 00:06:50.570 sys 0m0.011s 00:06:50.570 04:08:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:50.570 04:08:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.570 ************************************ 00:06:50.570 END TEST accel_negative_buffers 00:06:50.570 ************************************ 00:06:50.828 Error: writing output failed: Broken pipe 00:06:50.828 04:08:41 -- accel/accel.sh@93 -- # run_test accel_crc32c accel_test -t 1 -w crc32c -S 32 -y 00:06:50.828 04:08:41 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:50.828 04:08:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:50.828 04:08:41 -- common/autotest_common.sh@10 -- # set +x 00:06:50.828 ************************************ 00:06:50.828 START TEST accel_crc32c 00:06:50.828 ************************************ 00:06:50.828 04:08:41 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -S 32 -y 00:06:50.828 04:08:41 -- accel/accel.sh@16 -- # local accel_opc 00:06:50.828 04:08:41 -- accel/accel.sh@17 -- # local accel_module 00:06:50.828 04:08:41 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:50.828 04:08:41 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:50.828 04:08:41 -- accel/accel.sh@12 -- # build_accel_config 00:06:50.828 04:08:41 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:50.828 04:08:41 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:50.828 04:08:41 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:50.828 04:08:41 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:50.828 04:08:41 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:50.828 04:08:41 -- accel/accel.sh@41 -- # local IFS=, 00:06:50.828 04:08:41 -- accel/accel.sh@42 -- # jq -r . 00:06:50.828 [2024-11-30 04:08:41.240827] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:50.828 [2024-11-30 04:08:41.240900] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2247185 ] 00:06:50.828 EAL: No free 2048 kB hugepages reported on node 1 00:06:50.828 [2024-11-30 04:08:41.305484] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:50.828 [2024-11-30 04:08:41.396548] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.201 04:08:42 -- accel/accel.sh@18 -- # out=' 00:06:52.201 SPDK Configuration: 00:06:52.201 Core mask: 0x1 00:06:52.201 00:06:52.201 Accel Perf Configuration: 00:06:52.201 Workload Type: crc32c 00:06:52.201 CRC-32C seed: 32 00:06:52.201 Transfer size: 4096 bytes 00:06:52.201 Vector count 1 00:06:52.201 Module: software 00:06:52.201 Queue depth: 32 00:06:52.201 Allocate depth: 32 00:06:52.201 # threads/core: 1 00:06:52.201 Run time: 1 seconds 00:06:52.201 Verify: Yes 00:06:52.201 00:06:52.201 Running for 1 seconds... 00:06:52.201 00:06:52.201 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:52.201 ------------------------------------------------------------------------------------ 00:06:52.201 0,0 404320/s 1579 MiB/s 0 0 00:06:52.201 ==================================================================================== 00:06:52.201 Total 404320/s 1579 MiB/s 0 0' 00:06:52.201 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.201 04:08:42 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -S 32 -y 00:06:52.201 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.201 04:08:42 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -S 32 -y 00:06:52.201 04:08:42 -- accel/accel.sh@12 -- # build_accel_config 00:06:52.201 04:08:42 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:52.202 04:08:42 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:52.202 04:08:42 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:52.202 04:08:42 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:52.202 04:08:42 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:52.202 04:08:42 -- accel/accel.sh@41 -- # local IFS=, 00:06:52.202 04:08:42 -- accel/accel.sh@42 -- # jq -r . 00:06:52.202 [2024-11-30 04:08:42.642361] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:52.202 [2024-11-30 04:08:42.642440] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2247421 ] 00:06:52.202 EAL: No free 2048 kB hugepages reported on node 1 00:06:52.202 [2024-11-30 04:08:42.702677] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:52.202 [2024-11-30 04:08:42.792905] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val= 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val= 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val=0x1 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val= 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val= 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val=crc32c 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val=32 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val= 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val=software 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@23 -- # accel_module=software 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val=32 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val=32 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val=1 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val=Yes 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val= 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:52.460 04:08:42 -- accel/accel.sh@21 -- # val= 00:06:52.460 04:08:42 -- accel/accel.sh@22 -- # case "$var" in 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # IFS=: 00:06:52.460 04:08:42 -- accel/accel.sh@20 -- # read -r var val 00:06:53.396 04:08:44 -- accel/accel.sh@21 -- # val= 00:06:53.396 04:08:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # IFS=: 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # read -r var val 00:06:53.396 04:08:44 -- accel/accel.sh@21 -- # val= 00:06:53.396 04:08:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # IFS=: 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # read -r var val 00:06:53.396 04:08:44 -- accel/accel.sh@21 -- # val= 00:06:53.396 04:08:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # IFS=: 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # read -r var val 00:06:53.396 04:08:44 -- accel/accel.sh@21 -- # val= 00:06:53.396 04:08:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # IFS=: 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # read -r var val 00:06:53.396 04:08:44 -- accel/accel.sh@21 -- # val= 00:06:53.396 04:08:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # IFS=: 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # read -r var val 00:06:53.396 04:08:44 -- accel/accel.sh@21 -- # val= 00:06:53.396 04:08:44 -- accel/accel.sh@22 -- # case "$var" in 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # IFS=: 00:06:53.396 04:08:44 -- accel/accel.sh@20 -- # read -r var val 00:06:53.396 04:08:44 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:53.396 04:08:44 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:53.396 04:08:44 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:53.396 00:06:53.396 real 0m2.802s 00:06:53.396 user 0m2.499s 00:06:53.396 sys 0m0.297s 00:06:53.396 04:08:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:53.396 04:08:44 -- common/autotest_common.sh@10 -- # set +x 00:06:53.396 ************************************ 00:06:53.396 END TEST accel_crc32c 00:06:53.396 ************************************ 00:06:53.654 04:08:44 -- accel/accel.sh@94 -- # run_test accel_crc32c_C2 accel_test -t 1 -w crc32c -y -C 2 00:06:53.654 04:08:44 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:06:53.654 04:08:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:53.654 04:08:44 -- common/autotest_common.sh@10 -- # set +x 00:06:53.654 ************************************ 00:06:53.654 START TEST accel_crc32c_C2 00:06:53.654 ************************************ 00:06:53.654 04:08:44 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w crc32c -y -C 2 00:06:53.654 04:08:44 -- accel/accel.sh@16 -- # local accel_opc 00:06:53.654 04:08:44 -- accel/accel.sh@17 -- # local accel_module 00:06:53.654 04:08:44 -- accel/accel.sh@18 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:53.654 04:08:44 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:53.654 04:08:44 -- accel/accel.sh@12 -- # build_accel_config 00:06:53.654 04:08:44 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:53.654 04:08:44 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:53.654 04:08:44 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:53.654 04:08:44 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:53.654 04:08:44 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:53.654 04:08:44 -- accel/accel.sh@41 -- # local IFS=, 00:06:53.654 04:08:44 -- accel/accel.sh@42 -- # jq -r . 00:06:53.654 [2024-11-30 04:08:44.066360] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:53.654 [2024-11-30 04:08:44.066430] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2247581 ] 00:06:53.654 EAL: No free 2048 kB hugepages reported on node 1 00:06:53.655 [2024-11-30 04:08:44.126942] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:53.655 [2024-11-30 04:08:44.217406] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.027 04:08:45 -- accel/accel.sh@18 -- # out=' 00:06:55.027 SPDK Configuration: 00:06:55.027 Core mask: 0x1 00:06:55.027 00:06:55.027 Accel Perf Configuration: 00:06:55.027 Workload Type: crc32c 00:06:55.027 CRC-32C seed: 0 00:06:55.027 Transfer size: 4096 bytes 00:06:55.027 Vector count 2 00:06:55.027 Module: software 00:06:55.027 Queue depth: 32 00:06:55.027 Allocate depth: 32 00:06:55.027 # threads/core: 1 00:06:55.027 Run time: 1 seconds 00:06:55.027 Verify: Yes 00:06:55.027 00:06:55.027 Running for 1 seconds... 00:06:55.027 00:06:55.027 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:55.028 ------------------------------------------------------------------------------------ 00:06:55.028 0,0 316544/s 2473 MiB/s 0 0 00:06:55.028 ==================================================================================== 00:06:55.028 Total 316544/s 1236 MiB/s 0 0' 00:06:55.028 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.028 04:08:45 -- accel/accel.sh@15 -- # accel_perf -t 1 -w crc32c -y -C 2 00:06:55.028 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.028 04:08:45 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w crc32c -y -C 2 00:06:55.028 04:08:45 -- accel/accel.sh@12 -- # build_accel_config 00:06:55.028 04:08:45 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:55.028 04:08:45 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:55.028 04:08:45 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:55.028 04:08:45 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:55.028 04:08:45 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:55.028 04:08:45 -- accel/accel.sh@41 -- # local IFS=, 00:06:55.028 04:08:45 -- accel/accel.sh@42 -- # jq -r . 00:06:55.028 [2024-11-30 04:08:45.467031] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:55.028 [2024-11-30 04:08:45.467118] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2247721 ] 00:06:55.028 EAL: No free 2048 kB hugepages reported on node 1 00:06:55.028 [2024-11-30 04:08:45.528393] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:55.028 [2024-11-30 04:08:45.618695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:55.285 04:08:45 -- accel/accel.sh@21 -- # val= 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val= 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val=0x1 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val= 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val= 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val=crc32c 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@24 -- # accel_opc=crc32c 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val=0 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val= 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val=software 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@23 -- # accel_module=software 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val=32 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val=32 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val=1 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val=Yes 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val= 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:55.286 04:08:45 -- accel/accel.sh@21 -- # val= 00:06:55.286 04:08:45 -- accel/accel.sh@22 -- # case "$var" in 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # IFS=: 00:06:55.286 04:08:45 -- accel/accel.sh@20 -- # read -r var val 00:06:56.219 04:08:46 -- accel/accel.sh@21 -- # val= 00:06:56.219 04:08:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.219 04:08:46 -- accel/accel.sh@20 -- # IFS=: 00:06:56.219 04:08:46 -- accel/accel.sh@20 -- # read -r var val 00:06:56.219 04:08:46 -- accel/accel.sh@21 -- # val= 00:06:56.219 04:08:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.219 04:08:46 -- accel/accel.sh@20 -- # IFS=: 00:06:56.219 04:08:46 -- accel/accel.sh@20 -- # read -r var val 00:06:56.478 04:08:46 -- accel/accel.sh@21 -- # val= 00:06:56.478 04:08:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.478 04:08:46 -- accel/accel.sh@20 -- # IFS=: 00:06:56.478 04:08:46 -- accel/accel.sh@20 -- # read -r var val 00:06:56.478 04:08:46 -- accel/accel.sh@21 -- # val= 00:06:56.478 04:08:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.478 04:08:46 -- accel/accel.sh@20 -- # IFS=: 00:06:56.478 04:08:46 -- accel/accel.sh@20 -- # read -r var val 00:06:56.478 04:08:46 -- accel/accel.sh@21 -- # val= 00:06:56.478 04:08:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.478 04:08:46 -- accel/accel.sh@20 -- # IFS=: 00:06:56.478 04:08:46 -- accel/accel.sh@20 -- # read -r var val 00:06:56.478 04:08:46 -- accel/accel.sh@21 -- # val= 00:06:56.478 04:08:46 -- accel/accel.sh@22 -- # case "$var" in 00:06:56.478 04:08:46 -- accel/accel.sh@20 -- # IFS=: 00:06:56.478 04:08:46 -- accel/accel.sh@20 -- # read -r var val 00:06:56.478 04:08:46 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:56.478 04:08:46 -- accel/accel.sh@28 -- # [[ -n crc32c ]] 00:06:56.478 04:08:46 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:56.478 00:06:56.478 real 0m2.802s 00:06:56.478 user 0m2.506s 00:06:56.478 sys 0m0.290s 00:06:56.478 04:08:46 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:56.478 04:08:46 -- common/autotest_common.sh@10 -- # set +x 00:06:56.478 ************************************ 00:06:56.478 END TEST accel_crc32c_C2 00:06:56.478 ************************************ 00:06:56.478 04:08:46 -- accel/accel.sh@95 -- # run_test accel_copy accel_test -t 1 -w copy -y 00:06:56.478 04:08:46 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:06:56.478 04:08:46 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:56.478 04:08:46 -- common/autotest_common.sh@10 -- # set +x 00:06:56.478 ************************************ 00:06:56.478 START TEST accel_copy 00:06:56.478 ************************************ 00:06:56.478 04:08:46 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy -y 00:06:56.478 04:08:46 -- accel/accel.sh@16 -- # local accel_opc 00:06:56.478 04:08:46 -- accel/accel.sh@17 -- # local accel_module 00:06:56.478 04:08:46 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy -y 00:06:56.478 04:08:46 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:56.478 04:08:46 -- accel/accel.sh@12 -- # build_accel_config 00:06:56.478 04:08:46 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:56.478 04:08:46 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:56.478 04:08:46 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:56.478 04:08:46 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:56.478 04:08:46 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:56.478 04:08:46 -- accel/accel.sh@41 -- # local IFS=, 00:06:56.478 04:08:46 -- accel/accel.sh@42 -- # jq -r . 00:06:56.478 [2024-11-30 04:08:46.895207] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:56.478 [2024-11-30 04:08:46.895298] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2247900 ] 00:06:56.478 EAL: No free 2048 kB hugepages reported on node 1 00:06:56.478 [2024-11-30 04:08:46.958651] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:56.478 [2024-11-30 04:08:47.049694] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:57.852 04:08:48 -- accel/accel.sh@18 -- # out=' 00:06:57.852 SPDK Configuration: 00:06:57.852 Core mask: 0x1 00:06:57.852 00:06:57.852 Accel Perf Configuration: 00:06:57.852 Workload Type: copy 00:06:57.852 Transfer size: 4096 bytes 00:06:57.852 Vector count 1 00:06:57.852 Module: software 00:06:57.852 Queue depth: 32 00:06:57.852 Allocate depth: 32 00:06:57.853 # threads/core: 1 00:06:57.853 Run time: 1 seconds 00:06:57.853 Verify: Yes 00:06:57.853 00:06:57.853 Running for 1 seconds... 00:06:57.853 00:06:57.853 Core,Thread Transfers Bandwidth Failed Miscompares 00:06:57.853 ------------------------------------------------------------------------------------ 00:06:57.853 0,0 280096/s 1094 MiB/s 0 0 00:06:57.853 ==================================================================================== 00:06:57.853 Total 280096/s 1094 MiB/s 0 0' 00:06:57.853 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:57.853 04:08:48 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy -y 00:06:57.853 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:57.853 04:08:48 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy -y 00:06:57.853 04:08:48 -- accel/accel.sh@12 -- # build_accel_config 00:06:57.853 04:08:48 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:57.853 04:08:48 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:57.853 04:08:48 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:57.853 04:08:48 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:57.853 04:08:48 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:57.853 04:08:48 -- accel/accel.sh@41 -- # local IFS=, 00:06:57.853 04:08:48 -- accel/accel.sh@42 -- # jq -r . 00:06:57.853 [2024-11-30 04:08:48.291417] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:57.853 [2024-11-30 04:08:48.291498] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2248148 ] 00:06:57.853 EAL: No free 2048 kB hugepages reported on node 1 00:06:57.853 [2024-11-30 04:08:48.352784] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:57.853 [2024-11-30 04:08:48.442879] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val= 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val= 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val=0x1 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val= 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val= 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val=copy 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@24 -- # accel_opc=copy 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val='4096 bytes' 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val= 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val=software 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@23 -- # accel_module=software 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val=32 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val=32 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val=1 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.111 04:08:48 -- accel/accel.sh@21 -- # val='1 seconds' 00:06:58.111 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.111 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.112 04:08:48 -- accel/accel.sh@21 -- # val=Yes 00:06:58.112 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.112 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.112 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.112 04:08:48 -- accel/accel.sh@21 -- # val= 00:06:58.112 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.112 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.112 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:58.112 04:08:48 -- accel/accel.sh@21 -- # val= 00:06:58.112 04:08:48 -- accel/accel.sh@22 -- # case "$var" in 00:06:58.112 04:08:48 -- accel/accel.sh@20 -- # IFS=: 00:06:58.112 04:08:48 -- accel/accel.sh@20 -- # read -r var val 00:06:59.045 04:08:49 -- accel/accel.sh@21 -- # val= 00:06:59.045 04:08:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # IFS=: 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # read -r var val 00:06:59.045 04:08:49 -- accel/accel.sh@21 -- # val= 00:06:59.045 04:08:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # IFS=: 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # read -r var val 00:06:59.045 04:08:49 -- accel/accel.sh@21 -- # val= 00:06:59.045 04:08:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # IFS=: 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # read -r var val 00:06:59.045 04:08:49 -- accel/accel.sh@21 -- # val= 00:06:59.045 04:08:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # IFS=: 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # read -r var val 00:06:59.045 04:08:49 -- accel/accel.sh@21 -- # val= 00:06:59.045 04:08:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # IFS=: 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # read -r var val 00:06:59.045 04:08:49 -- accel/accel.sh@21 -- # val= 00:06:59.045 04:08:49 -- accel/accel.sh@22 -- # case "$var" in 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # IFS=: 00:06:59.045 04:08:49 -- accel/accel.sh@20 -- # read -r var val 00:06:59.045 04:08:49 -- accel/accel.sh@28 -- # [[ -n software ]] 00:06:59.045 04:08:49 -- accel/accel.sh@28 -- # [[ -n copy ]] 00:06:59.045 04:08:49 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:06:59.045 00:06:59.045 real 0m2.798s 00:06:59.045 user 0m2.486s 00:06:59.045 sys 0m0.303s 00:06:59.045 04:08:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:06:59.302 04:08:49 -- common/autotest_common.sh@10 -- # set +x 00:06:59.302 ************************************ 00:06:59.302 END TEST accel_copy 00:06:59.302 ************************************ 00:06:59.303 04:08:49 -- accel/accel.sh@96 -- # run_test accel_fill accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.303 04:08:49 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:06:59.303 04:08:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:06:59.303 04:08:49 -- common/autotest_common.sh@10 -- # set +x 00:06:59.303 ************************************ 00:06:59.303 START TEST accel_fill 00:06:59.303 ************************************ 00:06:59.303 04:08:49 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.303 04:08:49 -- accel/accel.sh@16 -- # local accel_opc 00:06:59.303 04:08:49 -- accel/accel.sh@17 -- # local accel_module 00:06:59.303 04:08:49 -- accel/accel.sh@18 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.303 04:08:49 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:06:59.303 04:08:49 -- accel/accel.sh@12 -- # build_accel_config 00:06:59.303 04:08:49 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:06:59.303 04:08:49 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:06:59.303 04:08:49 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:06:59.303 04:08:49 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:06:59.303 04:08:49 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:06:59.303 04:08:49 -- accel/accel.sh@41 -- # local IFS=, 00:06:59.303 04:08:49 -- accel/accel.sh@42 -- # jq -r . 00:06:59.303 [2024-11-30 04:08:49.715378] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:06:59.303 [2024-11-30 04:08:49.715455] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2248302 ] 00:06:59.303 EAL: No free 2048 kB hugepages reported on node 1 00:06:59.303 [2024-11-30 04:08:49.778216] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:06:59.303 [2024-11-30 04:08:49.868693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.673 04:08:51 -- accel/accel.sh@18 -- # out=' 00:07:00.673 SPDK Configuration: 00:07:00.673 Core mask: 0x1 00:07:00.673 00:07:00.673 Accel Perf Configuration: 00:07:00.673 Workload Type: fill 00:07:00.673 Fill pattern: 0x80 00:07:00.673 Transfer size: 4096 bytes 00:07:00.673 Vector count 1 00:07:00.673 Module: software 00:07:00.673 Queue depth: 64 00:07:00.673 Allocate depth: 64 00:07:00.673 # threads/core: 1 00:07:00.674 Run time: 1 seconds 00:07:00.674 Verify: Yes 00:07:00.674 00:07:00.674 Running for 1 seconds... 00:07:00.674 00:07:00.674 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:00.674 ------------------------------------------------------------------------------------ 00:07:00.674 0,0 404800/s 1581 MiB/s 0 0 00:07:00.674 ==================================================================================== 00:07:00.674 Total 404800/s 1581 MiB/s 0 0' 00:07:00.674 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.674 04:08:51 -- accel/accel.sh@15 -- # accel_perf -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:00.674 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.674 04:08:51 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w fill -f 128 -q 64 -a 64 -y 00:07:00.674 04:08:51 -- accel/accel.sh@12 -- # build_accel_config 00:07:00.674 04:08:51 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:00.674 04:08:51 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:00.674 04:08:51 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:00.674 04:08:51 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:00.674 04:08:51 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:00.674 04:08:51 -- accel/accel.sh@41 -- # local IFS=, 00:07:00.674 04:08:51 -- accel/accel.sh@42 -- # jq -r . 00:07:00.674 [2024-11-30 04:08:51.117771] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:00.674 [2024-11-30 04:08:51.117860] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2248446 ] 00:07:00.674 EAL: No free 2048 kB hugepages reported on node 1 00:07:00.674 [2024-11-30 04:08:51.179552] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:00.674 [2024-11-30 04:08:51.269684] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val= 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val= 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val=0x1 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val= 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val= 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val=fill 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@24 -- # accel_opc=fill 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val=0x80 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val= 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val=software 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@23 -- # accel_module=software 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val=64 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val=64 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val=1 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val=Yes 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val= 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:00.933 04:08:51 -- accel/accel.sh@21 -- # val= 00:07:00.933 04:08:51 -- accel/accel.sh@22 -- # case "$var" in 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # IFS=: 00:07:00.933 04:08:51 -- accel/accel.sh@20 -- # read -r var val 00:07:02.306 04:08:52 -- accel/accel.sh@21 -- # val= 00:07:02.306 04:08:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # IFS=: 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # read -r var val 00:07:02.306 04:08:52 -- accel/accel.sh@21 -- # val= 00:07:02.306 04:08:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # IFS=: 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # read -r var val 00:07:02.306 04:08:52 -- accel/accel.sh@21 -- # val= 00:07:02.306 04:08:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # IFS=: 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # read -r var val 00:07:02.306 04:08:52 -- accel/accel.sh@21 -- # val= 00:07:02.306 04:08:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # IFS=: 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # read -r var val 00:07:02.306 04:08:52 -- accel/accel.sh@21 -- # val= 00:07:02.306 04:08:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # IFS=: 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # read -r var val 00:07:02.306 04:08:52 -- accel/accel.sh@21 -- # val= 00:07:02.306 04:08:52 -- accel/accel.sh@22 -- # case "$var" in 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # IFS=: 00:07:02.306 04:08:52 -- accel/accel.sh@20 -- # read -r var val 00:07:02.306 04:08:52 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:02.306 04:08:52 -- accel/accel.sh@28 -- # [[ -n fill ]] 00:07:02.306 04:08:52 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:02.306 00:07:02.306 real 0m2.805s 00:07:02.306 user 0m2.504s 00:07:02.306 sys 0m0.294s 00:07:02.306 04:08:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:02.306 04:08:52 -- common/autotest_common.sh@10 -- # set +x 00:07:02.306 ************************************ 00:07:02.306 END TEST accel_fill 00:07:02.306 ************************************ 00:07:02.306 04:08:52 -- accel/accel.sh@97 -- # run_test accel_copy_crc32c accel_test -t 1 -w copy_crc32c -y 00:07:02.306 04:08:52 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:02.306 04:08:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:02.306 04:08:52 -- common/autotest_common.sh@10 -- # set +x 00:07:02.306 ************************************ 00:07:02.306 START TEST accel_copy_crc32c 00:07:02.306 ************************************ 00:07:02.306 04:08:52 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y 00:07:02.306 04:08:52 -- accel/accel.sh@16 -- # local accel_opc 00:07:02.306 04:08:52 -- accel/accel.sh@17 -- # local accel_module 00:07:02.306 04:08:52 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:02.306 04:08:52 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:02.306 04:08:52 -- accel/accel.sh@12 -- # build_accel_config 00:07:02.306 04:08:52 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:02.306 04:08:52 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:02.306 04:08:52 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:02.306 04:08:52 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:02.306 04:08:52 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:02.306 04:08:52 -- accel/accel.sh@41 -- # local IFS=, 00:07:02.306 04:08:52 -- accel/accel.sh@42 -- # jq -r . 00:07:02.306 [2024-11-30 04:08:52.548308] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:02.306 [2024-11-30 04:08:52.548378] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2248617 ] 00:07:02.306 EAL: No free 2048 kB hugepages reported on node 1 00:07:02.306 [2024-11-30 04:08:52.610716] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:02.306 [2024-11-30 04:08:52.701605] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.681 04:08:53 -- accel/accel.sh@18 -- # out=' 00:07:03.681 SPDK Configuration: 00:07:03.681 Core mask: 0x1 00:07:03.681 00:07:03.681 Accel Perf Configuration: 00:07:03.681 Workload Type: copy_crc32c 00:07:03.681 CRC-32C seed: 0 00:07:03.681 Vector size: 4096 bytes 00:07:03.681 Transfer size: 4096 bytes 00:07:03.681 Vector count 1 00:07:03.681 Module: software 00:07:03.681 Queue depth: 32 00:07:03.681 Allocate depth: 32 00:07:03.681 # threads/core: 1 00:07:03.681 Run time: 1 seconds 00:07:03.681 Verify: Yes 00:07:03.681 00:07:03.681 Running for 1 seconds... 00:07:03.681 00:07:03.681 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:03.681 ------------------------------------------------------------------------------------ 00:07:03.681 0,0 218624/s 854 MiB/s 0 0 00:07:03.681 ==================================================================================== 00:07:03.681 Total 218624/s 854 MiB/s 0 0' 00:07:03.681 04:08:53 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:53 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y 00:07:03.681 04:08:53 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:53 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y 00:07:03.681 04:08:53 -- accel/accel.sh@12 -- # build_accel_config 00:07:03.681 04:08:53 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:03.681 04:08:53 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:03.681 04:08:53 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:03.681 04:08:53 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:03.681 04:08:53 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:03.681 04:08:53 -- accel/accel.sh@41 -- # local IFS=, 00:07:03.681 04:08:53 -- accel/accel.sh@42 -- # jq -r . 00:07:03.681 [2024-11-30 04:08:53.940482] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:03.681 [2024-11-30 04:08:53.940565] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2248867 ] 00:07:03.681 EAL: No free 2048 kB hugepages reported on node 1 00:07:03.681 [2024-11-30 04:08:54.002049] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:03.681 [2024-11-30 04:08:54.092450] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val= 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val= 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val=0x1 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val= 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val= 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val=0 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val= 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val=software 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@23 -- # accel_module=software 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val=32 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val=32 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val=1 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val=Yes 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val= 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:03.681 04:08:54 -- accel/accel.sh@21 -- # val= 00:07:03.681 04:08:54 -- accel/accel.sh@22 -- # case "$var" in 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # IFS=: 00:07:03.681 04:08:54 -- accel/accel.sh@20 -- # read -r var val 00:07:05.055 04:08:55 -- accel/accel.sh@21 -- # val= 00:07:05.055 04:08:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # IFS=: 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # read -r var val 00:07:05.055 04:08:55 -- accel/accel.sh@21 -- # val= 00:07:05.055 04:08:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # IFS=: 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # read -r var val 00:07:05.055 04:08:55 -- accel/accel.sh@21 -- # val= 00:07:05.055 04:08:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # IFS=: 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # read -r var val 00:07:05.055 04:08:55 -- accel/accel.sh@21 -- # val= 00:07:05.055 04:08:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # IFS=: 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # read -r var val 00:07:05.055 04:08:55 -- accel/accel.sh@21 -- # val= 00:07:05.055 04:08:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # IFS=: 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # read -r var val 00:07:05.055 04:08:55 -- accel/accel.sh@21 -- # val= 00:07:05.055 04:08:55 -- accel/accel.sh@22 -- # case "$var" in 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # IFS=: 00:07:05.055 04:08:55 -- accel/accel.sh@20 -- # read -r var val 00:07:05.055 04:08:55 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:05.055 04:08:55 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:05.055 04:08:55 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:05.055 00:07:05.055 real 0m2.794s 00:07:05.055 user 0m2.497s 00:07:05.055 sys 0m0.289s 00:07:05.055 04:08:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:05.055 04:08:55 -- common/autotest_common.sh@10 -- # set +x 00:07:05.055 ************************************ 00:07:05.055 END TEST accel_copy_crc32c 00:07:05.055 ************************************ 00:07:05.055 04:08:55 -- accel/accel.sh@98 -- # run_test accel_copy_crc32c_C2 accel_test -t 1 -w copy_crc32c -y -C 2 00:07:05.055 04:08:55 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:05.055 04:08:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:05.055 04:08:55 -- common/autotest_common.sh@10 -- # set +x 00:07:05.055 ************************************ 00:07:05.055 START TEST accel_copy_crc32c_C2 00:07:05.055 ************************************ 00:07:05.055 04:08:55 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w copy_crc32c -y -C 2 00:07:05.055 04:08:55 -- accel/accel.sh@16 -- # local accel_opc 00:07:05.055 04:08:55 -- accel/accel.sh@17 -- # local accel_module 00:07:05.055 04:08:55 -- accel/accel.sh@18 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:05.055 04:08:55 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:05.055 04:08:55 -- accel/accel.sh@12 -- # build_accel_config 00:07:05.055 04:08:55 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:05.055 04:08:55 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:05.055 04:08:55 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:05.055 04:08:55 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:05.055 04:08:55 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:05.055 04:08:55 -- accel/accel.sh@41 -- # local IFS=, 00:07:05.055 04:08:55 -- accel/accel.sh@42 -- # jq -r . 00:07:05.055 [2024-11-30 04:08:55.371322] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:05.055 [2024-11-30 04:08:55.371408] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2249029 ] 00:07:05.055 EAL: No free 2048 kB hugepages reported on node 1 00:07:05.055 [2024-11-30 04:08:55.433201] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:05.055 [2024-11-30 04:08:55.523470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.430 04:08:56 -- accel/accel.sh@18 -- # out=' 00:07:06.430 SPDK Configuration: 00:07:06.430 Core mask: 0x1 00:07:06.430 00:07:06.430 Accel Perf Configuration: 00:07:06.430 Workload Type: copy_crc32c 00:07:06.430 CRC-32C seed: 0 00:07:06.430 Vector size: 4096 bytes 00:07:06.430 Transfer size: 8192 bytes 00:07:06.430 Vector count 2 00:07:06.430 Module: software 00:07:06.430 Queue depth: 32 00:07:06.430 Allocate depth: 32 00:07:06.430 # threads/core: 1 00:07:06.430 Run time: 1 seconds 00:07:06.430 Verify: Yes 00:07:06.430 00:07:06.430 Running for 1 seconds... 00:07:06.430 00:07:06.430 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:06.430 ------------------------------------------------------------------------------------ 00:07:06.430 0,0 155360/s 1213 MiB/s 0 0 00:07:06.430 ==================================================================================== 00:07:06.430 Total 155360/s 606 MiB/s 0 0' 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.430 04:08:56 -- accel/accel.sh@15 -- # accel_perf -t 1 -w copy_crc32c -y -C 2 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.430 04:08:56 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w copy_crc32c -y -C 2 00:07:06.430 04:08:56 -- accel/accel.sh@12 -- # build_accel_config 00:07:06.430 04:08:56 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:06.430 04:08:56 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:06.430 04:08:56 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:06.430 04:08:56 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:06.430 04:08:56 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:06.430 04:08:56 -- accel/accel.sh@41 -- # local IFS=, 00:07:06.430 04:08:56 -- accel/accel.sh@42 -- # jq -r . 00:07:06.430 [2024-11-30 04:08:56.775285] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:06.430 [2024-11-30 04:08:56.775373] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2249167 ] 00:07:06.430 EAL: No free 2048 kB hugepages reported on node 1 00:07:06.430 [2024-11-30 04:08:56.837190] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:06.430 [2024-11-30 04:08:56.927043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:06.430 04:08:56 -- accel/accel.sh@21 -- # val= 00:07:06.430 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.430 04:08:56 -- accel/accel.sh@21 -- # val= 00:07:06.430 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.430 04:08:56 -- accel/accel.sh@21 -- # val=0x1 00:07:06.430 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.430 04:08:56 -- accel/accel.sh@21 -- # val= 00:07:06.430 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.430 04:08:56 -- accel/accel.sh@21 -- # val= 00:07:06.430 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.430 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.430 04:08:56 -- accel/accel.sh@21 -- # val=copy_crc32c 00:07:06.430 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@24 -- # accel_opc=copy_crc32c 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val=0 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val='8192 bytes' 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val= 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val=software 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@23 -- # accel_module=software 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val=32 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val=32 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val=1 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val=Yes 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val= 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:06.431 04:08:56 -- accel/accel.sh@21 -- # val= 00:07:06.431 04:08:56 -- accel/accel.sh@22 -- # case "$var" in 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # IFS=: 00:07:06.431 04:08:56 -- accel/accel.sh@20 -- # read -r var val 00:07:07.804 04:08:58 -- accel/accel.sh@21 -- # val= 00:07:07.804 04:08:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.804 04:08:58 -- accel/accel.sh@20 -- # IFS=: 00:07:07.804 04:08:58 -- accel/accel.sh@20 -- # read -r var val 00:07:07.804 04:08:58 -- accel/accel.sh@21 -- # val= 00:07:07.804 04:08:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.804 04:08:58 -- accel/accel.sh@20 -- # IFS=: 00:07:07.804 04:08:58 -- accel/accel.sh@20 -- # read -r var val 00:07:07.804 04:08:58 -- accel/accel.sh@21 -- # val= 00:07:07.804 04:08:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.804 04:08:58 -- accel/accel.sh@20 -- # IFS=: 00:07:07.804 04:08:58 -- accel/accel.sh@20 -- # read -r var val 00:07:07.804 04:08:58 -- accel/accel.sh@21 -- # val= 00:07:07.805 04:08:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.805 04:08:58 -- accel/accel.sh@20 -- # IFS=: 00:07:07.805 04:08:58 -- accel/accel.sh@20 -- # read -r var val 00:07:07.805 04:08:58 -- accel/accel.sh@21 -- # val= 00:07:07.805 04:08:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.805 04:08:58 -- accel/accel.sh@20 -- # IFS=: 00:07:07.805 04:08:58 -- accel/accel.sh@20 -- # read -r var val 00:07:07.805 04:08:58 -- accel/accel.sh@21 -- # val= 00:07:07.805 04:08:58 -- accel/accel.sh@22 -- # case "$var" in 00:07:07.805 04:08:58 -- accel/accel.sh@20 -- # IFS=: 00:07:07.805 04:08:58 -- accel/accel.sh@20 -- # read -r var val 00:07:07.805 04:08:58 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:07.805 04:08:58 -- accel/accel.sh@28 -- # [[ -n copy_crc32c ]] 00:07:07.805 04:08:58 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:07.805 00:07:07.805 real 0m2.806s 00:07:07.805 user 0m2.507s 00:07:07.805 sys 0m0.292s 00:07:07.805 04:08:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:07.805 04:08:58 -- common/autotest_common.sh@10 -- # set +x 00:07:07.805 ************************************ 00:07:07.805 END TEST accel_copy_crc32c_C2 00:07:07.805 ************************************ 00:07:07.805 04:08:58 -- accel/accel.sh@99 -- # run_test accel_dualcast accel_test -t 1 -w dualcast -y 00:07:07.805 04:08:58 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:07.805 04:08:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:07.805 04:08:58 -- common/autotest_common.sh@10 -- # set +x 00:07:07.805 ************************************ 00:07:07.805 START TEST accel_dualcast 00:07:07.805 ************************************ 00:07:07.805 04:08:58 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dualcast -y 00:07:07.805 04:08:58 -- accel/accel.sh@16 -- # local accel_opc 00:07:07.805 04:08:58 -- accel/accel.sh@17 -- # local accel_module 00:07:07.805 04:08:58 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dualcast -y 00:07:07.805 04:08:58 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:07.805 04:08:58 -- accel/accel.sh@12 -- # build_accel_config 00:07:07.805 04:08:58 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:07.805 04:08:58 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:07.805 04:08:58 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:07.805 04:08:58 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:07.805 04:08:58 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:07.805 04:08:58 -- accel/accel.sh@41 -- # local IFS=, 00:07:07.805 04:08:58 -- accel/accel.sh@42 -- # jq -r . 00:07:07.805 [2024-11-30 04:08:58.204945] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:07.805 [2024-11-30 04:08:58.205039] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2249334 ] 00:07:07.805 EAL: No free 2048 kB hugepages reported on node 1 00:07:07.805 [2024-11-30 04:08:58.266261] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:07.805 [2024-11-30 04:08:58.356594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.178 04:08:59 -- accel/accel.sh@18 -- # out=' 00:07:09.178 SPDK Configuration: 00:07:09.178 Core mask: 0x1 00:07:09.178 00:07:09.178 Accel Perf Configuration: 00:07:09.178 Workload Type: dualcast 00:07:09.178 Transfer size: 4096 bytes 00:07:09.178 Vector count 1 00:07:09.178 Module: software 00:07:09.178 Queue depth: 32 00:07:09.178 Allocate depth: 32 00:07:09.178 # threads/core: 1 00:07:09.178 Run time: 1 seconds 00:07:09.178 Verify: Yes 00:07:09.178 00:07:09.178 Running for 1 seconds... 00:07:09.178 00:07:09.178 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:09.178 ------------------------------------------------------------------------------------ 00:07:09.178 0,0 299520/s 1170 MiB/s 0 0 00:07:09.178 ==================================================================================== 00:07:09.178 Total 299520/s 1170 MiB/s 0 0' 00:07:09.178 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.178 04:08:59 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dualcast -y 00:07:09.178 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.178 04:08:59 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dualcast -y 00:07:09.178 04:08:59 -- accel/accel.sh@12 -- # build_accel_config 00:07:09.178 04:08:59 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:09.178 04:08:59 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:09.178 04:08:59 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:09.178 04:08:59 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:09.178 04:08:59 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:09.178 04:08:59 -- accel/accel.sh@41 -- # local IFS=, 00:07:09.178 04:08:59 -- accel/accel.sh@42 -- # jq -r . 00:07:09.178 [2024-11-30 04:08:59.599283] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:09.178 [2024-11-30 04:08:59.599364] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2249588 ] 00:07:09.178 EAL: No free 2048 kB hugepages reported on node 1 00:07:09.178 [2024-11-30 04:08:59.661256] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:09.178 [2024-11-30 04:08:59.748888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val= 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val= 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val=0x1 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val= 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val= 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val=dualcast 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@24 -- # accel_opc=dualcast 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val= 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val=software 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@23 -- # accel_module=software 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val=32 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val=32 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val=1 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val=Yes 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val= 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:09.437 04:08:59 -- accel/accel.sh@21 -- # val= 00:07:09.437 04:08:59 -- accel/accel.sh@22 -- # case "$var" in 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # IFS=: 00:07:09.437 04:08:59 -- accel/accel.sh@20 -- # read -r var val 00:07:10.372 04:09:00 -- accel/accel.sh@21 -- # val= 00:07:10.372 04:09:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # IFS=: 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # read -r var val 00:07:10.372 04:09:00 -- accel/accel.sh@21 -- # val= 00:07:10.372 04:09:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # IFS=: 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # read -r var val 00:07:10.372 04:09:00 -- accel/accel.sh@21 -- # val= 00:07:10.372 04:09:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # IFS=: 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # read -r var val 00:07:10.372 04:09:00 -- accel/accel.sh@21 -- # val= 00:07:10.372 04:09:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # IFS=: 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # read -r var val 00:07:10.372 04:09:00 -- accel/accel.sh@21 -- # val= 00:07:10.372 04:09:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # IFS=: 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # read -r var val 00:07:10.372 04:09:00 -- accel/accel.sh@21 -- # val= 00:07:10.372 04:09:00 -- accel/accel.sh@22 -- # case "$var" in 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # IFS=: 00:07:10.372 04:09:00 -- accel/accel.sh@20 -- # read -r var val 00:07:10.372 04:09:00 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:10.372 04:09:00 -- accel/accel.sh@28 -- # [[ -n dualcast ]] 00:07:10.372 04:09:00 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:10.372 00:07:10.372 real 0m2.789s 00:07:10.372 user 0m2.498s 00:07:10.372 sys 0m0.283s 00:07:10.372 04:09:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:10.372 04:09:00 -- common/autotest_common.sh@10 -- # set +x 00:07:10.372 ************************************ 00:07:10.372 END TEST accel_dualcast 00:07:10.372 ************************************ 00:07:10.372 04:09:00 -- accel/accel.sh@100 -- # run_test accel_compare accel_test -t 1 -w compare -y 00:07:10.372 04:09:00 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:10.372 04:09:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:10.372 04:09:00 -- common/autotest_common.sh@10 -- # set +x 00:07:10.372 ************************************ 00:07:10.372 START TEST accel_compare 00:07:10.372 ************************************ 00:07:10.372 04:09:00 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compare -y 00:07:10.372 04:09:00 -- accel/accel.sh@16 -- # local accel_opc 00:07:10.372 04:09:00 -- accel/accel.sh@17 -- # local accel_module 00:07:10.372 04:09:00 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compare -y 00:07:10.372 04:09:00 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:10.372 04:09:00 -- accel/accel.sh@12 -- # build_accel_config 00:07:10.372 04:09:01 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:10.372 04:09:01 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:10.372 04:09:01 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:10.372 04:09:01 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:10.372 04:09:01 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:10.372 04:09:01 -- accel/accel.sh@41 -- # local IFS=, 00:07:10.372 04:09:01 -- accel/accel.sh@42 -- # jq -r . 00:07:10.631 [2024-11-30 04:09:01.017494] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:10.631 [2024-11-30 04:09:01.017578] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2249815 ] 00:07:10.631 EAL: No free 2048 kB hugepages reported on node 1 00:07:10.631 [2024-11-30 04:09:01.079413] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:10.631 [2024-11-30 04:09:01.175671] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.005 04:09:02 -- accel/accel.sh@18 -- # out=' 00:07:12.005 SPDK Configuration: 00:07:12.005 Core mask: 0x1 00:07:12.005 00:07:12.005 Accel Perf Configuration: 00:07:12.005 Workload Type: compare 00:07:12.005 Transfer size: 4096 bytes 00:07:12.005 Vector count 1 00:07:12.005 Module: software 00:07:12.005 Queue depth: 32 00:07:12.005 Allocate depth: 32 00:07:12.005 # threads/core: 1 00:07:12.005 Run time: 1 seconds 00:07:12.005 Verify: Yes 00:07:12.005 00:07:12.005 Running for 1 seconds... 00:07:12.005 00:07:12.005 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:12.005 ------------------------------------------------------------------------------------ 00:07:12.005 0,0 396448/s 1548 MiB/s 0 0 00:07:12.005 ==================================================================================== 00:07:12.005 Total 396448/s 1548 MiB/s 0 0' 00:07:12.005 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.005 04:09:02 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compare -y 00:07:12.005 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.005 04:09:02 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compare -y 00:07:12.005 04:09:02 -- accel/accel.sh@12 -- # build_accel_config 00:07:12.005 04:09:02 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:12.005 04:09:02 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:12.005 04:09:02 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:12.005 04:09:02 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:12.005 04:09:02 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:12.005 04:09:02 -- accel/accel.sh@41 -- # local IFS=, 00:07:12.005 04:09:02 -- accel/accel.sh@42 -- # jq -r . 00:07:12.005 [2024-11-30 04:09:02.431988] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:12.005 [2024-11-30 04:09:02.432082] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2250007 ] 00:07:12.005 EAL: No free 2048 kB hugepages reported on node 1 00:07:12.005 [2024-11-30 04:09:02.494707] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:12.005 [2024-11-30 04:09:02.585505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val= 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val= 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val=0x1 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val= 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val= 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val=compare 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@24 -- # accel_opc=compare 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val= 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val=software 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@23 -- # accel_module=software 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val=32 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val=32 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val=1 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val=Yes 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val= 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:12.264 04:09:02 -- accel/accel.sh@21 -- # val= 00:07:12.264 04:09:02 -- accel/accel.sh@22 -- # case "$var" in 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # IFS=: 00:07:12.264 04:09:02 -- accel/accel.sh@20 -- # read -r var val 00:07:13.196 04:09:03 -- accel/accel.sh@21 -- # val= 00:07:13.196 04:09:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # IFS=: 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # read -r var val 00:07:13.196 04:09:03 -- accel/accel.sh@21 -- # val= 00:07:13.196 04:09:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # IFS=: 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # read -r var val 00:07:13.196 04:09:03 -- accel/accel.sh@21 -- # val= 00:07:13.196 04:09:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # IFS=: 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # read -r var val 00:07:13.196 04:09:03 -- accel/accel.sh@21 -- # val= 00:07:13.196 04:09:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # IFS=: 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # read -r var val 00:07:13.196 04:09:03 -- accel/accel.sh@21 -- # val= 00:07:13.196 04:09:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # IFS=: 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # read -r var val 00:07:13.196 04:09:03 -- accel/accel.sh@21 -- # val= 00:07:13.196 04:09:03 -- accel/accel.sh@22 -- # case "$var" in 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # IFS=: 00:07:13.196 04:09:03 -- accel/accel.sh@20 -- # read -r var val 00:07:13.196 04:09:03 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:13.196 04:09:03 -- accel/accel.sh@28 -- # [[ -n compare ]] 00:07:13.196 04:09:03 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:13.196 00:07:13.196 real 0m2.821s 00:07:13.196 user 0m2.521s 00:07:13.196 sys 0m0.292s 00:07:13.197 04:09:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:13.197 04:09:03 -- common/autotest_common.sh@10 -- # set +x 00:07:13.197 ************************************ 00:07:13.197 END TEST accel_compare 00:07:13.197 ************************************ 00:07:13.454 04:09:03 -- accel/accel.sh@101 -- # run_test accel_xor accel_test -t 1 -w xor -y 00:07:13.454 04:09:03 -- common/autotest_common.sh@1087 -- # '[' 7 -le 1 ']' 00:07:13.454 04:09:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:13.454 04:09:03 -- common/autotest_common.sh@10 -- # set +x 00:07:13.454 ************************************ 00:07:13.454 START TEST accel_xor 00:07:13.454 ************************************ 00:07:13.454 04:09:03 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y 00:07:13.454 04:09:03 -- accel/accel.sh@16 -- # local accel_opc 00:07:13.454 04:09:03 -- accel/accel.sh@17 -- # local accel_module 00:07:13.454 04:09:03 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y 00:07:13.454 04:09:03 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:13.454 04:09:03 -- accel/accel.sh@12 -- # build_accel_config 00:07:13.454 04:09:03 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:13.454 04:09:03 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:13.454 04:09:03 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:13.454 04:09:03 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:13.454 04:09:03 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:13.454 04:09:03 -- accel/accel.sh@41 -- # local IFS=, 00:07:13.454 04:09:03 -- accel/accel.sh@42 -- # jq -r . 00:07:13.454 [2024-11-30 04:09:03.865338] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:13.454 [2024-11-30 04:09:03.865410] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2250172 ] 00:07:13.454 EAL: No free 2048 kB hugepages reported on node 1 00:07:13.454 [2024-11-30 04:09:03.927828] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:13.454 [2024-11-30 04:09:04.018069] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:14.825 04:09:05 -- accel/accel.sh@18 -- # out=' 00:07:14.825 SPDK Configuration: 00:07:14.825 Core mask: 0x1 00:07:14.825 00:07:14.825 Accel Perf Configuration: 00:07:14.825 Workload Type: xor 00:07:14.825 Source buffers: 2 00:07:14.825 Transfer size: 4096 bytes 00:07:14.825 Vector count 1 00:07:14.825 Module: software 00:07:14.825 Queue depth: 32 00:07:14.825 Allocate depth: 32 00:07:14.825 # threads/core: 1 00:07:14.825 Run time: 1 seconds 00:07:14.825 Verify: Yes 00:07:14.825 00:07:14.825 Running for 1 seconds... 00:07:14.825 00:07:14.825 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:14.825 ------------------------------------------------------------------------------------ 00:07:14.825 0,0 192480/s 751 MiB/s 0 0 00:07:14.825 ==================================================================================== 00:07:14.825 Total 192480/s 751 MiB/s 0 0' 00:07:14.825 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:14.825 04:09:05 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y 00:07:14.825 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:14.825 04:09:05 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y 00:07:14.825 04:09:05 -- accel/accel.sh@12 -- # build_accel_config 00:07:14.825 04:09:05 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:14.825 04:09:05 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:14.825 04:09:05 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:14.825 04:09:05 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:14.825 04:09:05 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:14.825 04:09:05 -- accel/accel.sh@41 -- # local IFS=, 00:07:14.825 04:09:05 -- accel/accel.sh@42 -- # jq -r . 00:07:14.825 [2024-11-30 04:09:05.274640] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:14.825 [2024-11-30 04:09:05.274727] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2250425 ] 00:07:14.825 EAL: No free 2048 kB hugepages reported on node 1 00:07:14.825 [2024-11-30 04:09:05.336422] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:14.825 [2024-11-30 04:09:05.424744] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val= 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val= 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val=0x1 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val= 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val= 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val=xor 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val=2 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val= 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val=software 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@23 -- # accel_module=software 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val=32 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val=32 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val=1 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val=Yes 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val= 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:15.110 04:09:05 -- accel/accel.sh@21 -- # val= 00:07:15.110 04:09:05 -- accel/accel.sh@22 -- # case "$var" in 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # IFS=: 00:07:15.110 04:09:05 -- accel/accel.sh@20 -- # read -r var val 00:07:16.045 04:09:06 -- accel/accel.sh@21 -- # val= 00:07:16.045 04:09:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # IFS=: 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # read -r var val 00:07:16.045 04:09:06 -- accel/accel.sh@21 -- # val= 00:07:16.045 04:09:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # IFS=: 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # read -r var val 00:07:16.045 04:09:06 -- accel/accel.sh@21 -- # val= 00:07:16.045 04:09:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # IFS=: 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # read -r var val 00:07:16.045 04:09:06 -- accel/accel.sh@21 -- # val= 00:07:16.045 04:09:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # IFS=: 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # read -r var val 00:07:16.045 04:09:06 -- accel/accel.sh@21 -- # val= 00:07:16.045 04:09:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # IFS=: 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # read -r var val 00:07:16.045 04:09:06 -- accel/accel.sh@21 -- # val= 00:07:16.045 04:09:06 -- accel/accel.sh@22 -- # case "$var" in 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # IFS=: 00:07:16.045 04:09:06 -- accel/accel.sh@20 -- # read -r var val 00:07:16.045 04:09:06 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:16.045 04:09:06 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:16.045 04:09:06 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:16.045 00:07:16.045 real 0m2.795s 00:07:16.045 user 0m2.495s 00:07:16.045 sys 0m0.294s 00:07:16.045 04:09:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:16.045 04:09:06 -- common/autotest_common.sh@10 -- # set +x 00:07:16.045 ************************************ 00:07:16.045 END TEST accel_xor 00:07:16.045 ************************************ 00:07:16.045 04:09:06 -- accel/accel.sh@102 -- # run_test accel_xor accel_test -t 1 -w xor -y -x 3 00:07:16.045 04:09:06 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:16.045 04:09:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:16.045 04:09:06 -- common/autotest_common.sh@10 -- # set +x 00:07:16.045 ************************************ 00:07:16.045 START TEST accel_xor 00:07:16.045 ************************************ 00:07:16.045 04:09:06 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w xor -y -x 3 00:07:16.045 04:09:06 -- accel/accel.sh@16 -- # local accel_opc 00:07:16.045 04:09:06 -- accel/accel.sh@17 -- # local accel_module 00:07:16.045 04:09:06 -- accel/accel.sh@18 -- # accel_perf -t 1 -w xor -y -x 3 00:07:16.045 04:09:06 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:16.045 04:09:06 -- accel/accel.sh@12 -- # build_accel_config 00:07:16.045 04:09:06 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:16.045 04:09:06 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:16.045 04:09:06 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:16.045 04:09:06 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:16.045 04:09:06 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:16.045 04:09:06 -- accel/accel.sh@41 -- # local IFS=, 00:07:16.045 04:09:06 -- accel/accel.sh@42 -- # jq -r . 00:07:16.304 [2024-11-30 04:09:06.686594] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:16.304 [2024-11-30 04:09:06.686672] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2250592 ] 00:07:16.304 EAL: No free 2048 kB hugepages reported on node 1 00:07:16.304 [2024-11-30 04:09:06.750510] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:16.304 [2024-11-30 04:09:06.841560] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.679 04:09:08 -- accel/accel.sh@18 -- # out=' 00:07:17.679 SPDK Configuration: 00:07:17.679 Core mask: 0x1 00:07:17.679 00:07:17.679 Accel Perf Configuration: 00:07:17.679 Workload Type: xor 00:07:17.679 Source buffers: 3 00:07:17.679 Transfer size: 4096 bytes 00:07:17.679 Vector count 1 00:07:17.679 Module: software 00:07:17.679 Queue depth: 32 00:07:17.679 Allocate depth: 32 00:07:17.679 # threads/core: 1 00:07:17.679 Run time: 1 seconds 00:07:17.679 Verify: Yes 00:07:17.679 00:07:17.679 Running for 1 seconds... 00:07:17.679 00:07:17.679 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:17.679 ------------------------------------------------------------------------------------ 00:07:17.679 0,0 185312/s 723 MiB/s 0 0 00:07:17.679 ==================================================================================== 00:07:17.679 Total 185312/s 723 MiB/s 0 0' 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.679 04:09:08 -- accel/accel.sh@15 -- # accel_perf -t 1 -w xor -y -x 3 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.679 04:09:08 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w xor -y -x 3 00:07:17.679 04:09:08 -- accel/accel.sh@12 -- # build_accel_config 00:07:17.679 04:09:08 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:17.679 04:09:08 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:17.679 04:09:08 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:17.679 04:09:08 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:17.679 04:09:08 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:17.679 04:09:08 -- accel/accel.sh@41 -- # local IFS=, 00:07:17.679 04:09:08 -- accel/accel.sh@42 -- # jq -r . 00:07:17.679 [2024-11-30 04:09:08.083764] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:17.679 [2024-11-30 04:09:08.083864] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2251061 ] 00:07:17.679 EAL: No free 2048 kB hugepages reported on node 1 00:07:17.679 [2024-11-30 04:09:08.145857] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:17.679 [2024-11-30 04:09:08.236083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:17.679 04:09:08 -- accel/accel.sh@21 -- # val= 00:07:17.679 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.679 04:09:08 -- accel/accel.sh@21 -- # val= 00:07:17.679 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.679 04:09:08 -- accel/accel.sh@21 -- # val=0x1 00:07:17.679 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.679 04:09:08 -- accel/accel.sh@21 -- # val= 00:07:17.679 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.679 04:09:08 -- accel/accel.sh@21 -- # val= 00:07:17.679 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.679 04:09:08 -- accel/accel.sh@21 -- # val=xor 00:07:17.679 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.679 04:09:08 -- accel/accel.sh@24 -- # accel_opc=xor 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.679 04:09:08 -- accel/accel.sh@21 -- # val=3 00:07:17.679 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.679 04:09:08 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:17.679 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.679 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.679 04:09:08 -- accel/accel.sh@21 -- # val= 00:07:17.680 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.680 04:09:08 -- accel/accel.sh@21 -- # val=software 00:07:17.680 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.680 04:09:08 -- accel/accel.sh@23 -- # accel_module=software 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.680 04:09:08 -- accel/accel.sh@21 -- # val=32 00:07:17.680 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.680 04:09:08 -- accel/accel.sh@21 -- # val=32 00:07:17.680 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.680 04:09:08 -- accel/accel.sh@21 -- # val=1 00:07:17.680 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.680 04:09:08 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:17.680 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.680 04:09:08 -- accel/accel.sh@21 -- # val=Yes 00:07:17.680 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.680 04:09:08 -- accel/accel.sh@21 -- # val= 00:07:17.680 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:17.680 04:09:08 -- accel/accel.sh@21 -- # val= 00:07:17.680 04:09:08 -- accel/accel.sh@22 -- # case "$var" in 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # IFS=: 00:07:17.680 04:09:08 -- accel/accel.sh@20 -- # read -r var val 00:07:19.053 04:09:09 -- accel/accel.sh@21 -- # val= 00:07:19.053 04:09:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # IFS=: 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # read -r var val 00:07:19.053 04:09:09 -- accel/accel.sh@21 -- # val= 00:07:19.053 04:09:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # IFS=: 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # read -r var val 00:07:19.053 04:09:09 -- accel/accel.sh@21 -- # val= 00:07:19.053 04:09:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # IFS=: 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # read -r var val 00:07:19.053 04:09:09 -- accel/accel.sh@21 -- # val= 00:07:19.053 04:09:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # IFS=: 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # read -r var val 00:07:19.053 04:09:09 -- accel/accel.sh@21 -- # val= 00:07:19.053 04:09:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # IFS=: 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # read -r var val 00:07:19.053 04:09:09 -- accel/accel.sh@21 -- # val= 00:07:19.053 04:09:09 -- accel/accel.sh@22 -- # case "$var" in 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # IFS=: 00:07:19.053 04:09:09 -- accel/accel.sh@20 -- # read -r var val 00:07:19.053 04:09:09 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:19.053 04:09:09 -- accel/accel.sh@28 -- # [[ -n xor ]] 00:07:19.053 04:09:09 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:19.053 00:07:19.053 real 0m2.793s 00:07:19.053 user 0m2.493s 00:07:19.053 sys 0m0.291s 00:07:19.053 04:09:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:19.053 04:09:09 -- common/autotest_common.sh@10 -- # set +x 00:07:19.053 ************************************ 00:07:19.053 END TEST accel_xor 00:07:19.053 ************************************ 00:07:19.053 04:09:09 -- accel/accel.sh@103 -- # run_test accel_dif_verify accel_test -t 1 -w dif_verify 00:07:19.053 04:09:09 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:19.053 04:09:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:19.053 04:09:09 -- common/autotest_common.sh@10 -- # set +x 00:07:19.053 ************************************ 00:07:19.053 START TEST accel_dif_verify 00:07:19.053 ************************************ 00:07:19.053 04:09:09 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_verify 00:07:19.053 04:09:09 -- accel/accel.sh@16 -- # local accel_opc 00:07:19.053 04:09:09 -- accel/accel.sh@17 -- # local accel_module 00:07:19.053 04:09:09 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_verify 00:07:19.053 04:09:09 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:19.053 04:09:09 -- accel/accel.sh@12 -- # build_accel_config 00:07:19.053 04:09:09 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:19.053 04:09:09 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:19.053 04:09:09 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:19.053 04:09:09 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:19.053 04:09:09 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:19.053 04:09:09 -- accel/accel.sh@41 -- # local IFS=, 00:07:19.053 04:09:09 -- accel/accel.sh@42 -- # jq -r . 00:07:19.053 [2024-11-30 04:09:09.502167] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:19.053 [2024-11-30 04:09:09.502262] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2251398 ] 00:07:19.053 EAL: No free 2048 kB hugepages reported on node 1 00:07:19.053 [2024-11-30 04:09:09.564477] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:19.053 [2024-11-30 04:09:09.659607] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.427 04:09:10 -- accel/accel.sh@18 -- # out=' 00:07:20.427 SPDK Configuration: 00:07:20.427 Core mask: 0x1 00:07:20.427 00:07:20.427 Accel Perf Configuration: 00:07:20.427 Workload Type: dif_verify 00:07:20.427 Vector size: 4096 bytes 00:07:20.427 Transfer size: 4096 bytes 00:07:20.427 Block size: 512 bytes 00:07:20.427 Metadata size: 8 bytes 00:07:20.427 Vector count 1 00:07:20.427 Module: software 00:07:20.427 Queue depth: 32 00:07:20.427 Allocate depth: 32 00:07:20.427 # threads/core: 1 00:07:20.427 Run time: 1 seconds 00:07:20.427 Verify: No 00:07:20.427 00:07:20.427 Running for 1 seconds... 00:07:20.427 00:07:20.427 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:20.427 ------------------------------------------------------------------------------------ 00:07:20.427 0,0 82912/s 328 MiB/s 0 0 00:07:20.427 ==================================================================================== 00:07:20.427 Total 82912/s 323 MiB/s 0 0' 00:07:20.427 04:09:10 -- accel/accel.sh@20 -- # IFS=: 00:07:20.427 04:09:10 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_verify 00:07:20.427 04:09:10 -- accel/accel.sh@20 -- # read -r var val 00:07:20.427 04:09:10 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_verify 00:07:20.427 04:09:10 -- accel/accel.sh@12 -- # build_accel_config 00:07:20.427 04:09:10 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:20.427 04:09:10 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:20.427 04:09:10 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:20.427 04:09:10 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:20.427 04:09:10 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:20.427 04:09:10 -- accel/accel.sh@41 -- # local IFS=, 00:07:20.427 04:09:10 -- accel/accel.sh@42 -- # jq -r . 00:07:20.427 [2024-11-30 04:09:10.905206] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:20.427 [2024-11-30 04:09:10.905298] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2251655 ] 00:07:20.427 EAL: No free 2048 kB hugepages reported on node 1 00:07:20.427 [2024-11-30 04:09:10.965834] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:20.427 [2024-11-30 04:09:11.057112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val= 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val= 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val=0x1 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val= 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val= 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val=dif_verify 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@24 -- # accel_opc=dif_verify 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val= 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val=software 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@23 -- # accel_module=software 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val=32 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val=32 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val=1 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val=No 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val= 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:20.686 04:09:11 -- accel/accel.sh@21 -- # val= 00:07:20.686 04:09:11 -- accel/accel.sh@22 -- # case "$var" in 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # IFS=: 00:07:20.686 04:09:11 -- accel/accel.sh@20 -- # read -r var val 00:07:22.059 04:09:12 -- accel/accel.sh@21 -- # val= 00:07:22.059 04:09:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # IFS=: 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # read -r var val 00:07:22.059 04:09:12 -- accel/accel.sh@21 -- # val= 00:07:22.059 04:09:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # IFS=: 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # read -r var val 00:07:22.059 04:09:12 -- accel/accel.sh@21 -- # val= 00:07:22.059 04:09:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # IFS=: 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # read -r var val 00:07:22.059 04:09:12 -- accel/accel.sh@21 -- # val= 00:07:22.059 04:09:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # IFS=: 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # read -r var val 00:07:22.059 04:09:12 -- accel/accel.sh@21 -- # val= 00:07:22.059 04:09:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # IFS=: 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # read -r var val 00:07:22.059 04:09:12 -- accel/accel.sh@21 -- # val= 00:07:22.059 04:09:12 -- accel/accel.sh@22 -- # case "$var" in 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # IFS=: 00:07:22.059 04:09:12 -- accel/accel.sh@20 -- # read -r var val 00:07:22.059 04:09:12 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:22.059 04:09:12 -- accel/accel.sh@28 -- # [[ -n dif_verify ]] 00:07:22.059 04:09:12 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:22.059 00:07:22.059 real 0m2.797s 00:07:22.059 user 0m2.499s 00:07:22.059 sys 0m0.293s 00:07:22.059 04:09:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:22.059 04:09:12 -- common/autotest_common.sh@10 -- # set +x 00:07:22.059 ************************************ 00:07:22.059 END TEST accel_dif_verify 00:07:22.059 ************************************ 00:07:22.059 04:09:12 -- accel/accel.sh@104 -- # run_test accel_dif_generate accel_test -t 1 -w dif_generate 00:07:22.059 04:09:12 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:22.059 04:09:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:22.059 04:09:12 -- common/autotest_common.sh@10 -- # set +x 00:07:22.059 ************************************ 00:07:22.059 START TEST accel_dif_generate 00:07:22.059 ************************************ 00:07:22.059 04:09:12 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate 00:07:22.059 04:09:12 -- accel/accel.sh@16 -- # local accel_opc 00:07:22.059 04:09:12 -- accel/accel.sh@17 -- # local accel_module 00:07:22.059 04:09:12 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate 00:07:22.059 04:09:12 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:22.059 04:09:12 -- accel/accel.sh@12 -- # build_accel_config 00:07:22.059 04:09:12 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:22.059 04:09:12 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:22.059 04:09:12 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:22.059 04:09:12 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:22.059 04:09:12 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:22.059 04:09:12 -- accel/accel.sh@41 -- # local IFS=, 00:07:22.059 04:09:12 -- accel/accel.sh@42 -- # jq -r . 00:07:22.059 [2024-11-30 04:09:12.323806] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:22.059 [2024-11-30 04:09:12.323886] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2251820 ] 00:07:22.059 EAL: No free 2048 kB hugepages reported on node 1 00:07:22.059 [2024-11-30 04:09:12.384811] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:22.059 [2024-11-30 04:09:12.473894] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.433 04:09:13 -- accel/accel.sh@18 -- # out=' 00:07:23.433 SPDK Configuration: 00:07:23.433 Core mask: 0x1 00:07:23.433 00:07:23.433 Accel Perf Configuration: 00:07:23.433 Workload Type: dif_generate 00:07:23.433 Vector size: 4096 bytes 00:07:23.433 Transfer size: 4096 bytes 00:07:23.433 Block size: 512 bytes 00:07:23.433 Metadata size: 8 bytes 00:07:23.433 Vector count 1 00:07:23.433 Module: software 00:07:23.433 Queue depth: 32 00:07:23.433 Allocate depth: 32 00:07:23.433 # threads/core: 1 00:07:23.433 Run time: 1 seconds 00:07:23.433 Verify: No 00:07:23.433 00:07:23.433 Running for 1 seconds... 00:07:23.433 00:07:23.433 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:23.433 ------------------------------------------------------------------------------------ 00:07:23.433 0,0 96384/s 382 MiB/s 0 0 00:07:23.433 ==================================================================================== 00:07:23.433 Total 96384/s 376 MiB/s 0 0' 00:07:23.433 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.433 04:09:13 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate 00:07:23.433 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.433 04:09:13 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate 00:07:23.433 04:09:13 -- accel/accel.sh@12 -- # build_accel_config 00:07:23.433 04:09:13 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:23.433 04:09:13 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:23.433 04:09:13 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:23.433 04:09:13 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:23.433 04:09:13 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:23.433 04:09:13 -- accel/accel.sh@41 -- # local IFS=, 00:07:23.433 04:09:13 -- accel/accel.sh@42 -- # jq -r . 00:07:23.433 [2024-11-30 04:09:13.710451] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:23.433 [2024-11-30 04:09:13.710530] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2251963 ] 00:07:23.433 EAL: No free 2048 kB hugepages reported on node 1 00:07:23.433 [2024-11-30 04:09:13.771261] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:23.433 [2024-11-30 04:09:13.861075] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:23.433 04:09:13 -- accel/accel.sh@21 -- # val= 00:07:23.433 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.433 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.433 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.433 04:09:13 -- accel/accel.sh@21 -- # val= 00:07:23.433 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.433 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.433 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.433 04:09:13 -- accel/accel.sh@21 -- # val=0x1 00:07:23.433 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.433 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.433 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.433 04:09:13 -- accel/accel.sh@21 -- # val= 00:07:23.433 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.433 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.433 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.433 04:09:13 -- accel/accel.sh@21 -- # val= 00:07:23.433 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val=dif_generate 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@24 -- # accel_opc=dif_generate 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val='512 bytes' 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val='8 bytes' 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val= 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val=software 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@23 -- # accel_module=software 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val=32 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val=32 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val=1 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val=No 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val= 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:23.434 04:09:13 -- accel/accel.sh@21 -- # val= 00:07:23.434 04:09:13 -- accel/accel.sh@22 -- # case "$var" in 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # IFS=: 00:07:23.434 04:09:13 -- accel/accel.sh@20 -- # read -r var val 00:07:24.805 04:09:15 -- accel/accel.sh@21 -- # val= 00:07:24.805 04:09:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # IFS=: 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # read -r var val 00:07:24.805 04:09:15 -- accel/accel.sh@21 -- # val= 00:07:24.805 04:09:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # IFS=: 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # read -r var val 00:07:24.805 04:09:15 -- accel/accel.sh@21 -- # val= 00:07:24.805 04:09:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # IFS=: 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # read -r var val 00:07:24.805 04:09:15 -- accel/accel.sh@21 -- # val= 00:07:24.805 04:09:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # IFS=: 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # read -r var val 00:07:24.805 04:09:15 -- accel/accel.sh@21 -- # val= 00:07:24.805 04:09:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # IFS=: 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # read -r var val 00:07:24.805 04:09:15 -- accel/accel.sh@21 -- # val= 00:07:24.805 04:09:15 -- accel/accel.sh@22 -- # case "$var" in 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # IFS=: 00:07:24.805 04:09:15 -- accel/accel.sh@20 -- # read -r var val 00:07:24.805 04:09:15 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:24.805 04:09:15 -- accel/accel.sh@28 -- # [[ -n dif_generate ]] 00:07:24.805 04:09:15 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:24.805 00:07:24.805 real 0m2.791s 00:07:24.805 user 0m2.497s 00:07:24.805 sys 0m0.289s 00:07:24.805 04:09:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:24.805 04:09:15 -- common/autotest_common.sh@10 -- # set +x 00:07:24.805 ************************************ 00:07:24.805 END TEST accel_dif_generate 00:07:24.805 ************************************ 00:07:24.805 04:09:15 -- accel/accel.sh@105 -- # run_test accel_dif_generate_copy accel_test -t 1 -w dif_generate_copy 00:07:24.805 04:09:15 -- common/autotest_common.sh@1087 -- # '[' 6 -le 1 ']' 00:07:24.805 04:09:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:24.805 04:09:15 -- common/autotest_common.sh@10 -- # set +x 00:07:24.805 ************************************ 00:07:24.805 START TEST accel_dif_generate_copy 00:07:24.805 ************************************ 00:07:24.805 04:09:15 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w dif_generate_copy 00:07:24.805 04:09:15 -- accel/accel.sh@16 -- # local accel_opc 00:07:24.805 04:09:15 -- accel/accel.sh@17 -- # local accel_module 00:07:24.805 04:09:15 -- accel/accel.sh@18 -- # accel_perf -t 1 -w dif_generate_copy 00:07:24.805 04:09:15 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:24.805 04:09:15 -- accel/accel.sh@12 -- # build_accel_config 00:07:24.805 04:09:15 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:24.805 04:09:15 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:24.805 04:09:15 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:24.805 04:09:15 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:24.805 04:09:15 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:24.805 04:09:15 -- accel/accel.sh@41 -- # local IFS=, 00:07:24.805 04:09:15 -- accel/accel.sh@42 -- # jq -r . 00:07:24.805 [2024-11-30 04:09:15.138413] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:24.805 [2024-11-30 04:09:15.138499] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2252117 ] 00:07:24.805 EAL: No free 2048 kB hugepages reported on node 1 00:07:24.805 [2024-11-30 04:09:15.199995] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:24.805 [2024-11-30 04:09:15.289642] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.177 04:09:16 -- accel/accel.sh@18 -- # out=' 00:07:26.177 SPDK Configuration: 00:07:26.177 Core mask: 0x1 00:07:26.177 00:07:26.177 Accel Perf Configuration: 00:07:26.177 Workload Type: dif_generate_copy 00:07:26.177 Vector size: 4096 bytes 00:07:26.177 Transfer size: 4096 bytes 00:07:26.177 Vector count 1 00:07:26.177 Module: software 00:07:26.177 Queue depth: 32 00:07:26.177 Allocate depth: 32 00:07:26.177 # threads/core: 1 00:07:26.177 Run time: 1 seconds 00:07:26.177 Verify: No 00:07:26.177 00:07:26.177 Running for 1 seconds... 00:07:26.177 00:07:26.177 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:26.177 ------------------------------------------------------------------------------------ 00:07:26.177 0,0 76288/s 302 MiB/s 0 0 00:07:26.177 ==================================================================================== 00:07:26.177 Total 76288/s 298 MiB/s 0 0' 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@15 -- # accel_perf -t 1 -w dif_generate_copy 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w dif_generate_copy 00:07:26.177 04:09:16 -- accel/accel.sh@12 -- # build_accel_config 00:07:26.177 04:09:16 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:26.177 04:09:16 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:26.177 04:09:16 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:26.177 04:09:16 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:26.177 04:09:16 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:26.177 04:09:16 -- accel/accel.sh@41 -- # local IFS=, 00:07:26.177 04:09:16 -- accel/accel.sh@42 -- # jq -r . 00:07:26.177 [2024-11-30 04:09:16.528273] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:26.177 [2024-11-30 04:09:16.528366] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2252382 ] 00:07:26.177 EAL: No free 2048 kB hugepages reported on node 1 00:07:26.177 [2024-11-30 04:09:16.588788] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:26.177 [2024-11-30 04:09:16.678576] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val= 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val= 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val=0x1 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val= 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val= 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val=dif_generate_copy 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@24 -- # accel_opc=dif_generate_copy 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val= 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val=software 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@23 -- # accel_module=software 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val=32 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val=32 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val=1 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val=No 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val= 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:26.177 04:09:16 -- accel/accel.sh@21 -- # val= 00:07:26.177 04:09:16 -- accel/accel.sh@22 -- # case "$var" in 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # IFS=: 00:07:26.177 04:09:16 -- accel/accel.sh@20 -- # read -r var val 00:07:27.551 04:09:17 -- accel/accel.sh@21 -- # val= 00:07:27.551 04:09:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # IFS=: 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # read -r var val 00:07:27.551 04:09:17 -- accel/accel.sh@21 -- # val= 00:07:27.551 04:09:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # IFS=: 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # read -r var val 00:07:27.551 04:09:17 -- accel/accel.sh@21 -- # val= 00:07:27.551 04:09:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # IFS=: 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # read -r var val 00:07:27.551 04:09:17 -- accel/accel.sh@21 -- # val= 00:07:27.551 04:09:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # IFS=: 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # read -r var val 00:07:27.551 04:09:17 -- accel/accel.sh@21 -- # val= 00:07:27.551 04:09:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # IFS=: 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # read -r var val 00:07:27.551 04:09:17 -- accel/accel.sh@21 -- # val= 00:07:27.551 04:09:17 -- accel/accel.sh@22 -- # case "$var" in 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # IFS=: 00:07:27.551 04:09:17 -- accel/accel.sh@20 -- # read -r var val 00:07:27.551 04:09:17 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:27.551 04:09:17 -- accel/accel.sh@28 -- # [[ -n dif_generate_copy ]] 00:07:27.551 04:09:17 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:27.551 00:07:27.551 real 0m2.794s 00:07:27.551 user 0m2.499s 00:07:27.551 sys 0m0.286s 00:07:27.551 04:09:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:27.551 04:09:17 -- common/autotest_common.sh@10 -- # set +x 00:07:27.551 ************************************ 00:07:27.551 END TEST accel_dif_generate_copy 00:07:27.551 ************************************ 00:07:27.551 04:09:17 -- accel/accel.sh@107 -- # [[ y == y ]] 00:07:27.551 04:09:17 -- accel/accel.sh@108 -- # run_test accel_comp accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.551 04:09:17 -- common/autotest_common.sh@1087 -- # '[' 8 -le 1 ']' 00:07:27.551 04:09:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:27.551 04:09:17 -- common/autotest_common.sh@10 -- # set +x 00:07:27.551 ************************************ 00:07:27.551 START TEST accel_comp 00:07:27.551 ************************************ 00:07:27.551 04:09:17 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.551 04:09:17 -- accel/accel.sh@16 -- # local accel_opc 00:07:27.551 04:09:17 -- accel/accel.sh@17 -- # local accel_module 00:07:27.551 04:09:17 -- accel/accel.sh@18 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.551 04:09:17 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:27.551 04:09:17 -- accel/accel.sh@12 -- # build_accel_config 00:07:27.551 04:09:17 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:27.551 04:09:17 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:27.551 04:09:17 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:27.551 04:09:17 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:27.551 04:09:17 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:27.551 04:09:17 -- accel/accel.sh@41 -- # local IFS=, 00:07:27.551 04:09:17 -- accel/accel.sh@42 -- # jq -r . 00:07:27.551 [2024-11-30 04:09:17.953778] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:27.551 [2024-11-30 04:09:17.953862] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2252539 ] 00:07:27.551 EAL: No free 2048 kB hugepages reported on node 1 00:07:27.551 [2024-11-30 04:09:18.016057] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:27.551 [2024-11-30 04:09:18.105203] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:28.924 04:09:19 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:28.924 00:07:28.925 SPDK Configuration: 00:07:28.925 Core mask: 0x1 00:07:28.925 00:07:28.925 Accel Perf Configuration: 00:07:28.925 Workload Type: compress 00:07:28.925 Transfer size: 4096 bytes 00:07:28.925 Vector count 1 00:07:28.925 Module: software 00:07:28.925 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.925 Queue depth: 32 00:07:28.925 Allocate depth: 32 00:07:28.925 # threads/core: 1 00:07:28.925 Run time: 1 seconds 00:07:28.925 Verify: No 00:07:28.925 00:07:28.925 Running for 1 seconds... 00:07:28.925 00:07:28.925 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:28.925 ------------------------------------------------------------------------------------ 00:07:28.925 0,0 31584/s 131 MiB/s 0 0 00:07:28.925 ==================================================================================== 00:07:28.925 Total 31584/s 123 MiB/s 0 0' 00:07:28.925 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:28.925 04:09:19 -- accel/accel.sh@15 -- # accel_perf -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.925 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:28.925 04:09:19 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w compress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:28.925 04:09:19 -- accel/accel.sh@12 -- # build_accel_config 00:07:28.925 04:09:19 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:28.925 04:09:19 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:28.925 04:09:19 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:28.925 04:09:19 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:28.925 04:09:19 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:28.925 04:09:19 -- accel/accel.sh@41 -- # local IFS=, 00:07:28.925 04:09:19 -- accel/accel.sh@42 -- # jq -r . 00:07:28.925 [2024-11-30 04:09:19.356190] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:28.925 [2024-11-30 04:09:19.356285] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2252682 ] 00:07:28.925 EAL: No free 2048 kB hugepages reported on node 1 00:07:28.925 [2024-11-30 04:09:19.417203] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:28.925 [2024-11-30 04:09:19.506179] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val= 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val= 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val= 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val=0x1 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val= 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val= 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val=compress 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@24 -- # accel_opc=compress 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val= 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val=software 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@23 -- # accel_module=software 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val=32 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val=32 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val=1 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val=No 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val= 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:29.183 04:09:19 -- accel/accel.sh@21 -- # val= 00:07:29.183 04:09:19 -- accel/accel.sh@22 -- # case "$var" in 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # IFS=: 00:07:29.183 04:09:19 -- accel/accel.sh@20 -- # read -r var val 00:07:30.118 04:09:20 -- accel/accel.sh@21 -- # val= 00:07:30.118 04:09:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # IFS=: 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # read -r var val 00:07:30.118 04:09:20 -- accel/accel.sh@21 -- # val= 00:07:30.118 04:09:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # IFS=: 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # read -r var val 00:07:30.118 04:09:20 -- accel/accel.sh@21 -- # val= 00:07:30.118 04:09:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # IFS=: 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # read -r var val 00:07:30.118 04:09:20 -- accel/accel.sh@21 -- # val= 00:07:30.118 04:09:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # IFS=: 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # read -r var val 00:07:30.118 04:09:20 -- accel/accel.sh@21 -- # val= 00:07:30.118 04:09:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # IFS=: 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # read -r var val 00:07:30.118 04:09:20 -- accel/accel.sh@21 -- # val= 00:07:30.118 04:09:20 -- accel/accel.sh@22 -- # case "$var" in 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # IFS=: 00:07:30.118 04:09:20 -- accel/accel.sh@20 -- # read -r var val 00:07:30.118 04:09:20 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:30.118 04:09:20 -- accel/accel.sh@28 -- # [[ -n compress ]] 00:07:30.118 04:09:20 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:30.118 00:07:30.118 real 0m2.811s 00:07:30.118 user 0m2.513s 00:07:30.118 sys 0m0.292s 00:07:30.118 04:09:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:30.118 04:09:20 -- common/autotest_common.sh@10 -- # set +x 00:07:30.118 ************************************ 00:07:30.118 END TEST accel_comp 00:07:30.118 ************************************ 00:07:30.376 04:09:20 -- accel/accel.sh@109 -- # run_test accel_decomp accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.376 04:09:20 -- common/autotest_common.sh@1087 -- # '[' 9 -le 1 ']' 00:07:30.376 04:09:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:30.376 04:09:20 -- common/autotest_common.sh@10 -- # set +x 00:07:30.376 ************************************ 00:07:30.376 START TEST accel_decomp 00:07:30.376 ************************************ 00:07:30.376 04:09:20 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.376 04:09:20 -- accel/accel.sh@16 -- # local accel_opc 00:07:30.376 04:09:20 -- accel/accel.sh@17 -- # local accel_module 00:07:30.376 04:09:20 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.376 04:09:20 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:30.376 04:09:20 -- accel/accel.sh@12 -- # build_accel_config 00:07:30.376 04:09:20 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:30.376 04:09:20 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:30.376 04:09:20 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:30.376 04:09:20 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:30.376 04:09:20 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:30.376 04:09:20 -- accel/accel.sh@41 -- # local IFS=, 00:07:30.377 04:09:20 -- accel/accel.sh@42 -- # jq -r . 00:07:30.377 [2024-11-30 04:09:20.785293] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:30.377 [2024-11-30 04:09:20.785364] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2252844 ] 00:07:30.377 EAL: No free 2048 kB hugepages reported on node 1 00:07:30.377 [2024-11-30 04:09:20.847071] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:30.377 [2024-11-30 04:09:20.937095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:31.749 04:09:22 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:31.749 00:07:31.749 SPDK Configuration: 00:07:31.749 Core mask: 0x1 00:07:31.749 00:07:31.749 Accel Perf Configuration: 00:07:31.749 Workload Type: decompress 00:07:31.749 Transfer size: 4096 bytes 00:07:31.749 Vector count 1 00:07:31.749 Module: software 00:07:31.749 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:31.749 Queue depth: 32 00:07:31.749 Allocate depth: 32 00:07:31.749 # threads/core: 1 00:07:31.749 Run time: 1 seconds 00:07:31.749 Verify: Yes 00:07:31.749 00:07:31.749 Running for 1 seconds... 00:07:31.749 00:07:31.749 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:31.749 ------------------------------------------------------------------------------------ 00:07:31.749 0,0 55488/s 102 MiB/s 0 0 00:07:31.749 ==================================================================================== 00:07:31.749 Total 55488/s 216 MiB/s 0 0' 00:07:31.749 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:31.749 04:09:22 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:31.749 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:31.749 04:09:22 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y 00:07:31.749 04:09:22 -- accel/accel.sh@12 -- # build_accel_config 00:07:31.749 04:09:22 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:31.749 04:09:22 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:31.749 04:09:22 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:31.749 04:09:22 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:31.749 04:09:22 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:31.749 04:09:22 -- accel/accel.sh@41 -- # local IFS=, 00:07:31.750 04:09:22 -- accel/accel.sh@42 -- # jq -r . 00:07:31.750 [2024-11-30 04:09:22.178480] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:31.750 [2024-11-30 04:09:22.178563] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2253090 ] 00:07:31.750 EAL: No free 2048 kB hugepages reported on node 1 00:07:31.750 [2024-11-30 04:09:22.240213] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:31.750 [2024-11-30 04:09:22.330240] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val= 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val= 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val= 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val=0x1 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val= 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val= 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val=decompress 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val= 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val=software 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@23 -- # accel_module=software 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val=32 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val=32 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val=1 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val=Yes 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val= 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.007 04:09:22 -- accel/accel.sh@21 -- # val= 00:07:32.007 04:09:22 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # IFS=: 00:07:32.007 04:09:22 -- accel/accel.sh@20 -- # read -r var val 00:07:32.941 04:09:23 -- accel/accel.sh@21 -- # val= 00:07:32.941 04:09:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # IFS=: 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # read -r var val 00:07:32.941 04:09:23 -- accel/accel.sh@21 -- # val= 00:07:32.941 04:09:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # IFS=: 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # read -r var val 00:07:32.941 04:09:23 -- accel/accel.sh@21 -- # val= 00:07:32.941 04:09:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # IFS=: 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # read -r var val 00:07:32.941 04:09:23 -- accel/accel.sh@21 -- # val= 00:07:32.941 04:09:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # IFS=: 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # read -r var val 00:07:32.941 04:09:23 -- accel/accel.sh@21 -- # val= 00:07:32.941 04:09:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # IFS=: 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # read -r var val 00:07:32.941 04:09:23 -- accel/accel.sh@21 -- # val= 00:07:32.941 04:09:23 -- accel/accel.sh@22 -- # case "$var" in 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # IFS=: 00:07:32.941 04:09:23 -- accel/accel.sh@20 -- # read -r var val 00:07:32.941 04:09:23 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:32.941 04:09:23 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:32.941 04:09:23 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:32.941 00:07:32.941 real 0m2.801s 00:07:32.941 user 0m2.512s 00:07:32.941 sys 0m0.282s 00:07:32.941 04:09:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:32.941 04:09:23 -- common/autotest_common.sh@10 -- # set +x 00:07:32.941 ************************************ 00:07:32.941 END TEST accel_decomp 00:07:32.941 ************************************ 00:07:33.199 04:09:23 -- accel/accel.sh@110 -- # run_test accel_decmop_full accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.199 04:09:23 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:33.199 04:09:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:33.199 04:09:23 -- common/autotest_common.sh@10 -- # set +x 00:07:33.199 ************************************ 00:07:33.199 START TEST accel_decmop_full 00:07:33.199 ************************************ 00:07:33.199 04:09:23 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.199 04:09:23 -- accel/accel.sh@16 -- # local accel_opc 00:07:33.199 04:09:23 -- accel/accel.sh@17 -- # local accel_module 00:07:33.199 04:09:23 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.199 04:09:23 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:33.199 04:09:23 -- accel/accel.sh@12 -- # build_accel_config 00:07:33.199 04:09:23 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:33.199 04:09:23 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:33.199 04:09:23 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:33.199 04:09:23 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:33.199 04:09:23 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:33.199 04:09:23 -- accel/accel.sh@41 -- # local IFS=, 00:07:33.199 04:09:23 -- accel/accel.sh@42 -- # jq -r . 00:07:33.199 [2024-11-30 04:09:23.613536] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:33.199 [2024-11-30 04:09:23.613621] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2253262 ] 00:07:33.199 EAL: No free 2048 kB hugepages reported on node 1 00:07:33.199 [2024-11-30 04:09:23.675391] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:33.199 [2024-11-30 04:09:23.766212] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.576 04:09:25 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:34.576 00:07:34.576 SPDK Configuration: 00:07:34.576 Core mask: 0x1 00:07:34.576 00:07:34.576 Accel Perf Configuration: 00:07:34.576 Workload Type: decompress 00:07:34.576 Transfer size: 111250 bytes 00:07:34.576 Vector count 1 00:07:34.576 Module: software 00:07:34.576 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.576 Queue depth: 32 00:07:34.576 Allocate depth: 32 00:07:34.576 # threads/core: 1 00:07:34.576 Run time: 1 seconds 00:07:34.576 Verify: Yes 00:07:34.576 00:07:34.576 Running for 1 seconds... 00:07:34.576 00:07:34.576 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:34.576 ------------------------------------------------------------------------------------ 00:07:34.576 0,0 3808/s 157 MiB/s 0 0 00:07:34.576 ==================================================================================== 00:07:34.576 Total 3808/s 404 MiB/s 0 0' 00:07:34.576 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.576 04:09:25 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:34.576 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.577 04:09:25 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 00:07:34.577 04:09:25 -- accel/accel.sh@12 -- # build_accel_config 00:07:34.577 04:09:25 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:34.577 04:09:25 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:34.577 04:09:25 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:34.577 04:09:25 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:34.577 04:09:25 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:34.577 04:09:25 -- accel/accel.sh@41 -- # local IFS=, 00:07:34.577 04:09:25 -- accel/accel.sh@42 -- # jq -r . 00:07:34.577 [2024-11-30 04:09:25.031947] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:34.577 [2024-11-30 04:09:25.032049] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2253407 ] 00:07:34.577 EAL: No free 2048 kB hugepages reported on node 1 00:07:34.577 [2024-11-30 04:09:25.094947] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:34.577 [2024-11-30 04:09:25.187112] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val= 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val= 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val= 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val=0x1 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val= 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val= 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val=decompress 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val= 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val=software 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@23 -- # accel_module=software 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val=32 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val=32 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val=1 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val=Yes 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val= 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:34.836 04:09:25 -- accel/accel.sh@21 -- # val= 00:07:34.836 04:09:25 -- accel/accel.sh@22 -- # case "$var" in 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # IFS=: 00:07:34.836 04:09:25 -- accel/accel.sh@20 -- # read -r var val 00:07:36.209 04:09:26 -- accel/accel.sh@21 -- # val= 00:07:36.209 04:09:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.209 04:09:26 -- accel/accel.sh@20 -- # IFS=: 00:07:36.209 04:09:26 -- accel/accel.sh@20 -- # read -r var val 00:07:36.209 04:09:26 -- accel/accel.sh@21 -- # val= 00:07:36.209 04:09:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.209 04:09:26 -- accel/accel.sh@20 -- # IFS=: 00:07:36.209 04:09:26 -- accel/accel.sh@20 -- # read -r var val 00:07:36.209 04:09:26 -- accel/accel.sh@21 -- # val= 00:07:36.210 04:09:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.210 04:09:26 -- accel/accel.sh@20 -- # IFS=: 00:07:36.210 04:09:26 -- accel/accel.sh@20 -- # read -r var val 00:07:36.210 04:09:26 -- accel/accel.sh@21 -- # val= 00:07:36.210 04:09:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.210 04:09:26 -- accel/accel.sh@20 -- # IFS=: 00:07:36.210 04:09:26 -- accel/accel.sh@20 -- # read -r var val 00:07:36.210 04:09:26 -- accel/accel.sh@21 -- # val= 00:07:36.210 04:09:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.210 04:09:26 -- accel/accel.sh@20 -- # IFS=: 00:07:36.210 04:09:26 -- accel/accel.sh@20 -- # read -r var val 00:07:36.210 04:09:26 -- accel/accel.sh@21 -- # val= 00:07:36.210 04:09:26 -- accel/accel.sh@22 -- # case "$var" in 00:07:36.210 04:09:26 -- accel/accel.sh@20 -- # IFS=: 00:07:36.210 04:09:26 -- accel/accel.sh@20 -- # read -r var val 00:07:36.210 04:09:26 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:36.210 04:09:26 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:36.210 04:09:26 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:36.210 00:07:36.210 real 0m2.841s 00:07:36.210 user 0m2.555s 00:07:36.210 sys 0m0.280s 00:07:36.210 04:09:26 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:36.210 04:09:26 -- common/autotest_common.sh@10 -- # set +x 00:07:36.210 ************************************ 00:07:36.210 END TEST accel_decmop_full 00:07:36.210 ************************************ 00:07:36.210 04:09:26 -- accel/accel.sh@111 -- # run_test accel_decomp_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.210 04:09:26 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:36.210 04:09:26 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:36.210 04:09:26 -- common/autotest_common.sh@10 -- # set +x 00:07:36.210 ************************************ 00:07:36.210 START TEST accel_decomp_mcore 00:07:36.210 ************************************ 00:07:36.210 04:09:26 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.210 04:09:26 -- accel/accel.sh@16 -- # local accel_opc 00:07:36.210 04:09:26 -- accel/accel.sh@17 -- # local accel_module 00:07:36.210 04:09:26 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.210 04:09:26 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:36.210 04:09:26 -- accel/accel.sh@12 -- # build_accel_config 00:07:36.210 04:09:26 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:36.210 04:09:26 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:36.210 04:09:26 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:36.210 04:09:26 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:36.210 04:09:26 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:36.210 04:09:26 -- accel/accel.sh@41 -- # local IFS=, 00:07:36.210 04:09:26 -- accel/accel.sh@42 -- # jq -r . 00:07:36.210 [2024-11-30 04:09:26.476867] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:36.210 [2024-11-30 04:09:26.477051] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2253566 ] 00:07:36.210 EAL: No free 2048 kB hugepages reported on node 1 00:07:36.210 [2024-11-30 04:09:26.541741] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:36.210 [2024-11-30 04:09:26.641726] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:36.210 [2024-11-30 04:09:26.641798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:36.210 [2024-11-30 04:09:26.641852] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:36.210 [2024-11-30 04:09:26.641855] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.584 04:09:27 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:37.584 00:07:37.584 SPDK Configuration: 00:07:37.584 Core mask: 0xf 00:07:37.584 00:07:37.584 Accel Perf Configuration: 00:07:37.584 Workload Type: decompress 00:07:37.584 Transfer size: 4096 bytes 00:07:37.584 Vector count 1 00:07:37.584 Module: software 00:07:37.584 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.584 Queue depth: 32 00:07:37.584 Allocate depth: 32 00:07:37.584 # threads/core: 1 00:07:37.584 Run time: 1 seconds 00:07:37.584 Verify: Yes 00:07:37.584 00:07:37.584 Running for 1 seconds... 00:07:37.584 00:07:37.584 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:37.584 ------------------------------------------------------------------------------------ 00:07:37.584 0,0 50016/s 92 MiB/s 0 0 00:07:37.584 3,0 50528/s 93 MiB/s 0 0 00:07:37.584 2,0 50528/s 93 MiB/s 0 0 00:07:37.584 1,0 50304/s 92 MiB/s 0 0 00:07:37.584 ==================================================================================== 00:07:37.584 Total 201376/s 786 MiB/s 0 0' 00:07:37.584 04:09:27 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:27 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:37.584 04:09:27 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:27 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -m 0xf 00:07:37.584 04:09:27 -- accel/accel.sh@12 -- # build_accel_config 00:07:37.584 04:09:27 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:37.584 04:09:27 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:37.584 04:09:27 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:37.584 04:09:27 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:37.584 04:09:27 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:37.584 04:09:27 -- accel/accel.sh@41 -- # local IFS=, 00:07:37.584 04:09:27 -- accel/accel.sh@42 -- # jq -r . 00:07:37.584 [2024-11-30 04:09:27.896460] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:37.584 [2024-11-30 04:09:27.896554] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2253833 ] 00:07:37.584 EAL: No free 2048 kB hugepages reported on node 1 00:07:37.584 [2024-11-30 04:09:27.959825] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:37.584 [2024-11-30 04:09:28.056909] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:37.584 [2024-11-30 04:09:28.056984] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:37.584 [2024-11-30 04:09:28.057022] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:37.584 [2024-11-30 04:09:28.057026] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val= 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val= 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val= 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val=0xf 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val= 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val= 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val=decompress 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val= 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val=software 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@23 -- # accel_module=software 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val=32 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val=32 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val=1 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val=Yes 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val= 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:37.584 04:09:28 -- accel/accel.sh@21 -- # val= 00:07:37.584 04:09:28 -- accel/accel.sh@22 -- # case "$var" in 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # IFS=: 00:07:37.584 04:09:28 -- accel/accel.sh@20 -- # read -r var val 00:07:38.957 04:09:29 -- accel/accel.sh@21 -- # val= 00:07:38.957 04:09:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # IFS=: 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # read -r var val 00:07:38.957 04:09:29 -- accel/accel.sh@21 -- # val= 00:07:38.957 04:09:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # IFS=: 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # read -r var val 00:07:38.957 04:09:29 -- accel/accel.sh@21 -- # val= 00:07:38.957 04:09:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # IFS=: 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # read -r var val 00:07:38.957 04:09:29 -- accel/accel.sh@21 -- # val= 00:07:38.957 04:09:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # IFS=: 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # read -r var val 00:07:38.957 04:09:29 -- accel/accel.sh@21 -- # val= 00:07:38.957 04:09:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # IFS=: 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # read -r var val 00:07:38.957 04:09:29 -- accel/accel.sh@21 -- # val= 00:07:38.957 04:09:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # IFS=: 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # read -r var val 00:07:38.957 04:09:29 -- accel/accel.sh@21 -- # val= 00:07:38.957 04:09:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # IFS=: 00:07:38.957 04:09:29 -- accel/accel.sh@20 -- # read -r var val 00:07:38.958 04:09:29 -- accel/accel.sh@21 -- # val= 00:07:38.958 04:09:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.958 04:09:29 -- accel/accel.sh@20 -- # IFS=: 00:07:38.958 04:09:29 -- accel/accel.sh@20 -- # read -r var val 00:07:38.958 04:09:29 -- accel/accel.sh@21 -- # val= 00:07:38.958 04:09:29 -- accel/accel.sh@22 -- # case "$var" in 00:07:38.958 04:09:29 -- accel/accel.sh@20 -- # IFS=: 00:07:38.958 04:09:29 -- accel/accel.sh@20 -- # read -r var val 00:07:38.958 04:09:29 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:38.958 04:09:29 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:38.958 04:09:29 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:38.958 00:07:38.958 real 0m2.848s 00:07:38.958 user 0m9.448s 00:07:38.958 sys 0m0.319s 00:07:38.958 04:09:29 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:38.958 04:09:29 -- common/autotest_common.sh@10 -- # set +x 00:07:38.958 ************************************ 00:07:38.958 END TEST accel_decomp_mcore 00:07:38.958 ************************************ 00:07:38.958 04:09:29 -- accel/accel.sh@112 -- # run_test accel_decomp_full_mcore accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.958 04:09:29 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:38.958 04:09:29 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:38.958 04:09:29 -- common/autotest_common.sh@10 -- # set +x 00:07:38.958 ************************************ 00:07:38.958 START TEST accel_decomp_full_mcore 00:07:38.958 ************************************ 00:07:38.958 04:09:29 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.958 04:09:29 -- accel/accel.sh@16 -- # local accel_opc 00:07:38.958 04:09:29 -- accel/accel.sh@17 -- # local accel_module 00:07:38.958 04:09:29 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.958 04:09:29 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:38.958 04:09:29 -- accel/accel.sh@12 -- # build_accel_config 00:07:38.958 04:09:29 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:38.958 04:09:29 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:38.958 04:09:29 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:38.958 04:09:29 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:38.958 04:09:29 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:38.958 04:09:29 -- accel/accel.sh@41 -- # local IFS=, 00:07:38.958 04:09:29 -- accel/accel.sh@42 -- # jq -r . 00:07:38.958 [2024-11-30 04:09:29.356411] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:38.958 [2024-11-30 04:09:29.356496] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2253989 ] 00:07:38.958 EAL: No free 2048 kB hugepages reported on node 1 00:07:38.958 [2024-11-30 04:09:29.419975] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:38.958 [2024-11-30 04:09:29.524092] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:38.958 [2024-11-30 04:09:29.524137] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:38.958 [2024-11-30 04:09:29.524191] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:38.958 [2024-11-30 04:09:29.524194] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.330 04:09:30 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:40.330 00:07:40.330 SPDK Configuration: 00:07:40.330 Core mask: 0xf 00:07:40.330 00:07:40.330 Accel Perf Configuration: 00:07:40.330 Workload Type: decompress 00:07:40.330 Transfer size: 111250 bytes 00:07:40.330 Vector count 1 00:07:40.330 Module: software 00:07:40.330 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.330 Queue depth: 32 00:07:40.330 Allocate depth: 32 00:07:40.330 # threads/core: 1 00:07:40.330 Run time: 1 seconds 00:07:40.330 Verify: Yes 00:07:40.330 00:07:40.330 Running for 1 seconds... 00:07:40.330 00:07:40.330 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:40.330 ------------------------------------------------------------------------------------ 00:07:40.330 0,0 4224/s 174 MiB/s 0 0 00:07:40.330 3,0 4224/s 174 MiB/s 0 0 00:07:40.330 2,0 4224/s 174 MiB/s 0 0 00:07:40.330 1,0 4224/s 174 MiB/s 0 0 00:07:40.330 ==================================================================================== 00:07:40.330 Total 16896/s 1792 MiB/s 0 0' 00:07:40.330 04:09:30 -- accel/accel.sh@20 -- # IFS=: 00:07:40.330 04:09:30 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:40.330 04:09:30 -- accel/accel.sh@20 -- # read -r var val 00:07:40.330 04:09:30 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -m 0xf 00:07:40.330 04:09:30 -- accel/accel.sh@12 -- # build_accel_config 00:07:40.330 04:09:30 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:40.330 04:09:30 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:40.330 04:09:30 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:40.330 04:09:30 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:40.330 04:09:30 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:40.330 04:09:30 -- accel/accel.sh@41 -- # local IFS=, 00:07:40.330 04:09:30 -- accel/accel.sh@42 -- # jq -r . 00:07:40.330 [2024-11-30 04:09:30.782108] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:40.330 [2024-11-30 04:09:30.782194] [ DPDK EAL parameters: accel_perf --no-shconf -c 0xf --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2254143 ] 00:07:40.330 EAL: No free 2048 kB hugepages reported on node 1 00:07:40.330 [2024-11-30 04:09:30.845113] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:07:40.330 [2024-11-30 04:09:30.940362] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:40.330 [2024-11-30 04:09:30.940419] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:40.330 [2024-11-30 04:09:30.940471] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:07:40.330 [2024-11-30 04:09:30.940474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val= 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val= 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val= 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val=0xf 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val= 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val= 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val=decompress 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val= 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val=software 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@23 -- # accel_module=software 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val=32 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val=32 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val=1 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val=Yes 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val= 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:40.589 04:09:31 -- accel/accel.sh@21 -- # val= 00:07:40.589 04:09:31 -- accel/accel.sh@22 -- # case "$var" in 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # IFS=: 00:07:40.589 04:09:31 -- accel/accel.sh@20 -- # read -r var val 00:07:41.961 04:09:32 -- accel/accel.sh@21 -- # val= 00:07:41.961 04:09:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.961 04:09:32 -- accel/accel.sh@20 -- # IFS=: 00:07:41.961 04:09:32 -- accel/accel.sh@20 -- # read -r var val 00:07:41.961 04:09:32 -- accel/accel.sh@21 -- # val= 00:07:41.961 04:09:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.961 04:09:32 -- accel/accel.sh@20 -- # IFS=: 00:07:41.961 04:09:32 -- accel/accel.sh@20 -- # read -r var val 00:07:41.961 04:09:32 -- accel/accel.sh@21 -- # val= 00:07:41.961 04:09:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.961 04:09:32 -- accel/accel.sh@20 -- # IFS=: 00:07:41.961 04:09:32 -- accel/accel.sh@20 -- # read -r var val 00:07:41.961 04:09:32 -- accel/accel.sh@21 -- # val= 00:07:41.961 04:09:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.961 04:09:32 -- accel/accel.sh@20 -- # IFS=: 00:07:41.961 04:09:32 -- accel/accel.sh@20 -- # read -r var val 00:07:41.961 04:09:32 -- accel/accel.sh@21 -- # val= 00:07:41.961 04:09:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.961 04:09:32 -- accel/accel.sh@20 -- # IFS=: 00:07:41.961 04:09:32 -- accel/accel.sh@20 -- # read -r var val 00:07:41.961 04:09:32 -- accel/accel.sh@21 -- # val= 00:07:41.962 04:09:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.962 04:09:32 -- accel/accel.sh@20 -- # IFS=: 00:07:41.962 04:09:32 -- accel/accel.sh@20 -- # read -r var val 00:07:41.962 04:09:32 -- accel/accel.sh@21 -- # val= 00:07:41.962 04:09:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.962 04:09:32 -- accel/accel.sh@20 -- # IFS=: 00:07:41.962 04:09:32 -- accel/accel.sh@20 -- # read -r var val 00:07:41.962 04:09:32 -- accel/accel.sh@21 -- # val= 00:07:41.962 04:09:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.962 04:09:32 -- accel/accel.sh@20 -- # IFS=: 00:07:41.962 04:09:32 -- accel/accel.sh@20 -- # read -r var val 00:07:41.962 04:09:32 -- accel/accel.sh@21 -- # val= 00:07:41.962 04:09:32 -- accel/accel.sh@22 -- # case "$var" in 00:07:41.962 04:09:32 -- accel/accel.sh@20 -- # IFS=: 00:07:41.962 04:09:32 -- accel/accel.sh@20 -- # read -r var val 00:07:41.962 04:09:32 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:41.962 04:09:32 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:41.962 04:09:32 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:41.962 00:07:41.962 real 0m2.858s 00:07:41.962 user 0m9.466s 00:07:41.962 sys 0m0.316s 00:07:41.962 04:09:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:41.962 04:09:32 -- common/autotest_common.sh@10 -- # set +x 00:07:41.962 ************************************ 00:07:41.962 END TEST accel_decomp_full_mcore 00:07:41.962 ************************************ 00:07:41.962 04:09:32 -- accel/accel.sh@113 -- # run_test accel_decomp_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.962 04:09:32 -- common/autotest_common.sh@1087 -- # '[' 11 -le 1 ']' 00:07:41.962 04:09:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:41.962 04:09:32 -- common/autotest_common.sh@10 -- # set +x 00:07:41.962 ************************************ 00:07:41.962 START TEST accel_decomp_mthread 00:07:41.962 ************************************ 00:07:41.962 04:09:32 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.962 04:09:32 -- accel/accel.sh@16 -- # local accel_opc 00:07:41.962 04:09:32 -- accel/accel.sh@17 -- # local accel_module 00:07:41.962 04:09:32 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.962 04:09:32 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:41.962 04:09:32 -- accel/accel.sh@12 -- # build_accel_config 00:07:41.962 04:09:32 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:41.962 04:09:32 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:41.962 04:09:32 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:41.962 04:09:32 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:41.962 04:09:32 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:41.962 04:09:32 -- accel/accel.sh@41 -- # local IFS=, 00:07:41.962 04:09:32 -- accel/accel.sh@42 -- # jq -r . 00:07:41.962 [2024-11-30 04:09:32.243889] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:41.962 [2024-11-30 04:09:32.243981] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2254304 ] 00:07:41.962 EAL: No free 2048 kB hugepages reported on node 1 00:07:41.962 [2024-11-30 04:09:32.306374] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:41.962 [2024-11-30 04:09:32.397264] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.336 04:09:33 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:43.336 00:07:43.336 SPDK Configuration: 00:07:43.336 Core mask: 0x1 00:07:43.336 00:07:43.336 Accel Perf Configuration: 00:07:43.336 Workload Type: decompress 00:07:43.336 Transfer size: 4096 bytes 00:07:43.336 Vector count 1 00:07:43.336 Module: software 00:07:43.336 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.336 Queue depth: 32 00:07:43.336 Allocate depth: 32 00:07:43.336 # threads/core: 2 00:07:43.336 Run time: 1 seconds 00:07:43.336 Verify: Yes 00:07:43.336 00:07:43.336 Running for 1 seconds... 00:07:43.336 00:07:43.336 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:43.336 ------------------------------------------------------------------------------------ 00:07:43.336 0,1 28064/s 51 MiB/s 0 0 00:07:43.336 0,0 27936/s 51 MiB/s 0 0 00:07:43.336 ==================================================================================== 00:07:43.336 Total 56000/s 218 MiB/s 0 0' 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -T 2 00:07:43.336 04:09:33 -- accel/accel.sh@12 -- # build_accel_config 00:07:43.336 04:09:33 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:43.336 04:09:33 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:43.336 04:09:33 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:43.336 04:09:33 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:43.336 04:09:33 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:43.336 04:09:33 -- accel/accel.sh@41 -- # local IFS=, 00:07:43.336 04:09:33 -- accel/accel.sh@42 -- # jq -r . 00:07:43.336 [2024-11-30 04:09:33.651782] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:43.336 [2024-11-30 04:09:33.651874] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2254569 ] 00:07:43.336 EAL: No free 2048 kB hugepages reported on node 1 00:07:43.336 [2024-11-30 04:09:33.717178] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:43.336 [2024-11-30 04:09:33.810595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val= 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val= 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val= 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val=0x1 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val= 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val= 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val=decompress 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val='4096 bytes' 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val= 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val=software 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@23 -- # accel_module=software 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val=32 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val=32 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val=2 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val=Yes 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val= 00:07:43.336 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.336 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:43.336 04:09:33 -- accel/accel.sh@21 -- # val= 00:07:43.337 04:09:33 -- accel/accel.sh@22 -- # case "$var" in 00:07:43.337 04:09:33 -- accel/accel.sh@20 -- # IFS=: 00:07:43.337 04:09:33 -- accel/accel.sh@20 -- # read -r var val 00:07:44.764 04:09:35 -- accel/accel.sh@21 -- # val= 00:07:44.764 04:09:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # IFS=: 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # read -r var val 00:07:44.764 04:09:35 -- accel/accel.sh@21 -- # val= 00:07:44.764 04:09:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # IFS=: 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # read -r var val 00:07:44.764 04:09:35 -- accel/accel.sh@21 -- # val= 00:07:44.764 04:09:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # IFS=: 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # read -r var val 00:07:44.764 04:09:35 -- accel/accel.sh@21 -- # val= 00:07:44.764 04:09:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # IFS=: 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # read -r var val 00:07:44.764 04:09:35 -- accel/accel.sh@21 -- # val= 00:07:44.764 04:09:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # IFS=: 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # read -r var val 00:07:44.764 04:09:35 -- accel/accel.sh@21 -- # val= 00:07:44.764 04:09:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # IFS=: 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # read -r var val 00:07:44.764 04:09:35 -- accel/accel.sh@21 -- # val= 00:07:44.764 04:09:35 -- accel/accel.sh@22 -- # case "$var" in 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # IFS=: 00:07:44.764 04:09:35 -- accel/accel.sh@20 -- # read -r var val 00:07:44.764 04:09:35 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:44.764 04:09:35 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:44.764 04:09:35 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:44.764 00:07:44.764 real 0m2.836s 00:07:44.764 user 0m2.531s 00:07:44.764 sys 0m0.295s 00:07:44.764 04:09:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:44.764 04:09:35 -- common/autotest_common.sh@10 -- # set +x 00:07:44.764 ************************************ 00:07:44.764 END TEST accel_decomp_mthread 00:07:44.765 ************************************ 00:07:44.765 04:09:35 -- accel/accel.sh@114 -- # run_test accel_deomp_full_mthread accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.765 04:09:35 -- common/autotest_common.sh@1087 -- # '[' 13 -le 1 ']' 00:07:44.765 04:09:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:44.765 04:09:35 -- common/autotest_common.sh@10 -- # set +x 00:07:44.765 ************************************ 00:07:44.765 START TEST accel_deomp_full_mthread 00:07:44.765 ************************************ 00:07:44.765 04:09:35 -- common/autotest_common.sh@1114 -- # accel_test -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.765 04:09:35 -- accel/accel.sh@16 -- # local accel_opc 00:07:44.765 04:09:35 -- accel/accel.sh@17 -- # local accel_module 00:07:44.765 04:09:35 -- accel/accel.sh@18 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.765 04:09:35 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:44.765 04:09:35 -- accel/accel.sh@12 -- # build_accel_config 00:07:44.765 04:09:35 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:44.765 04:09:35 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:44.765 04:09:35 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:44.765 04:09:35 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:44.765 04:09:35 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:44.765 04:09:35 -- accel/accel.sh@41 -- # local IFS=, 00:07:44.765 04:09:35 -- accel/accel.sh@42 -- # jq -r . 00:07:44.765 [2024-11-30 04:09:35.105371] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:44.765 [2024-11-30 04:09:35.105458] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2254722 ] 00:07:44.765 EAL: No free 2048 kB hugepages reported on node 1 00:07:44.765 [2024-11-30 04:09:35.166879] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:44.765 [2024-11-30 04:09:35.256921] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.137 04:09:36 -- accel/accel.sh@18 -- # out='Preparing input file... 00:07:46.137 00:07:46.137 SPDK Configuration: 00:07:46.137 Core mask: 0x1 00:07:46.137 00:07:46.137 Accel Perf Configuration: 00:07:46.137 Workload Type: decompress 00:07:46.137 Transfer size: 111250 bytes 00:07:46.137 Vector count 1 00:07:46.137 Module: software 00:07:46.137 File Name: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.137 Queue depth: 32 00:07:46.137 Allocate depth: 32 00:07:46.137 # threads/core: 2 00:07:46.137 Run time: 1 seconds 00:07:46.137 Verify: Yes 00:07:46.137 00:07:46.137 Running for 1 seconds... 00:07:46.137 00:07:46.137 Core,Thread Transfers Bandwidth Failed Miscompares 00:07:46.137 ------------------------------------------------------------------------------------ 00:07:46.137 0,1 1952/s 80 MiB/s 0 0 00:07:46.137 0,0 1920/s 79 MiB/s 0 0 00:07:46.137 ==================================================================================== 00:07:46.137 Total 3872/s 410 MiB/s 0 0' 00:07:46.137 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.137 04:09:36 -- accel/accel.sh@15 -- # accel_perf -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:46.137 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.137 04:09:36 -- accel/accel.sh@12 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/accel_perf -c /dev/fd/62 -t 1 -w decompress -l /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib -y -o 0 -T 2 00:07:46.137 04:09:36 -- accel/accel.sh@12 -- # build_accel_config 00:07:46.137 04:09:36 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:46.137 04:09:36 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:46.137 04:09:36 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:46.138 04:09:36 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:46.138 04:09:36 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:46.138 04:09:36 -- accel/accel.sh@41 -- # local IFS=, 00:07:46.138 04:09:36 -- accel/accel.sh@42 -- # jq -r . 00:07:46.138 [2024-11-30 04:09:36.536661] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:46.138 [2024-11-30 04:09:36.536753] [ DPDK EAL parameters: accel_perf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2254870 ] 00:07:46.138 EAL: No free 2048 kB hugepages reported on node 1 00:07:46.138 [2024-11-30 04:09:36.598954] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:46.138 [2024-11-30 04:09:36.690910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val= 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val= 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val= 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val=0x1 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val= 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val= 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val=decompress 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@24 -- # accel_opc=decompress 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val='111250 bytes' 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val= 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val=software 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@23 -- # accel_module=software 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/bib 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val=32 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val=32 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val=2 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val='1 seconds' 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val=Yes 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val= 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:46.138 04:09:36 -- accel/accel.sh@21 -- # val= 00:07:46.138 04:09:36 -- accel/accel.sh@22 -- # case "$var" in 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # IFS=: 00:07:46.138 04:09:36 -- accel/accel.sh@20 -- # read -r var val 00:07:47.511 04:09:37 -- accel/accel.sh@21 -- # val= 00:07:47.511 04:09:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.511 04:09:37 -- accel/accel.sh@20 -- # IFS=: 00:07:47.511 04:09:37 -- accel/accel.sh@20 -- # read -r var val 00:07:47.511 04:09:37 -- accel/accel.sh@21 -- # val= 00:07:47.511 04:09:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.511 04:09:37 -- accel/accel.sh@20 -- # IFS=: 00:07:47.511 04:09:37 -- accel/accel.sh@20 -- # read -r var val 00:07:47.511 04:09:37 -- accel/accel.sh@21 -- # val= 00:07:47.511 04:09:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.511 04:09:37 -- accel/accel.sh@20 -- # IFS=: 00:07:47.511 04:09:37 -- accel/accel.sh@20 -- # read -r var val 00:07:47.511 04:09:37 -- accel/accel.sh@21 -- # val= 00:07:47.511 04:09:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.511 04:09:37 -- accel/accel.sh@20 -- # IFS=: 00:07:47.511 04:09:37 -- accel/accel.sh@20 -- # read -r var val 00:07:47.511 04:09:37 -- accel/accel.sh@21 -- # val= 00:07:47.512 04:09:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.512 04:09:37 -- accel/accel.sh@20 -- # IFS=: 00:07:47.512 04:09:37 -- accel/accel.sh@20 -- # read -r var val 00:07:47.512 04:09:37 -- accel/accel.sh@21 -- # val= 00:07:47.512 04:09:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.512 04:09:37 -- accel/accel.sh@20 -- # IFS=: 00:07:47.512 04:09:37 -- accel/accel.sh@20 -- # read -r var val 00:07:47.512 04:09:37 -- accel/accel.sh@21 -- # val= 00:07:47.512 04:09:37 -- accel/accel.sh@22 -- # case "$var" in 00:07:47.512 04:09:37 -- accel/accel.sh@20 -- # IFS=: 00:07:47.512 04:09:37 -- accel/accel.sh@20 -- # read -r var val 00:07:47.512 04:09:37 -- accel/accel.sh@28 -- # [[ -n software ]] 00:07:47.512 04:09:37 -- accel/accel.sh@28 -- # [[ -n decompress ]] 00:07:47.512 04:09:37 -- accel/accel.sh@28 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:07:47.512 00:07:47.512 real 0m2.881s 00:07:47.512 user 0m2.598s 00:07:47.512 sys 0m0.276s 00:07:47.512 04:09:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:47.512 04:09:37 -- common/autotest_common.sh@10 -- # set +x 00:07:47.512 ************************************ 00:07:47.512 END TEST accel_deomp_full_mthread 00:07:47.512 ************************************ 00:07:47.512 04:09:37 -- accel/accel.sh@116 -- # [[ n == y ]] 00:07:47.512 04:09:37 -- accel/accel.sh@129 -- # run_test accel_dif_functional_tests /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:47.512 04:09:37 -- accel/accel.sh@129 -- # build_accel_config 00:07:47.512 04:09:37 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:07:47.512 04:09:37 -- accel/accel.sh@32 -- # accel_json_cfg=() 00:07:47.512 04:09:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:47.512 04:09:37 -- accel/accel.sh@33 -- # [[ 0 -gt 0 ]] 00:07:47.512 04:09:37 -- common/autotest_common.sh@10 -- # set +x 00:07:47.512 04:09:37 -- accel/accel.sh@34 -- # [[ 0 -gt 0 ]] 00:07:47.512 04:09:37 -- accel/accel.sh@35 -- # [[ 0 -gt 0 ]] 00:07:47.512 04:09:37 -- accel/accel.sh@37 -- # [[ -n '' ]] 00:07:47.512 04:09:37 -- accel/accel.sh@41 -- # local IFS=, 00:07:47.512 04:09:37 -- accel/accel.sh@42 -- # jq -r . 00:07:47.512 ************************************ 00:07:47.512 START TEST accel_dif_functional_tests 00:07:47.512 ************************************ 00:07:47.512 04:09:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/dif/dif -c /dev/fd/62 00:07:47.512 [2024-11-30 04:09:38.037738] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:47.512 [2024-11-30 04:09:38.037828] [ DPDK EAL parameters: DIF --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2255052 ] 00:07:47.512 EAL: No free 2048 kB hugepages reported on node 1 00:07:47.512 [2024-11-30 04:09:38.105284] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:07:47.771 [2024-11-30 04:09:38.201766] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:07:47.771 [2024-11-30 04:09:38.201822] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:07:47.771 [2024-11-30 04:09:38.201825] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:47.771 00:07:47.771 00:07:47.771 CUnit - A unit testing framework for C - Version 2.1-3 00:07:47.771 http://cunit.sourceforge.net/ 00:07:47.771 00:07:47.771 00:07:47.771 Suite: accel_dif 00:07:47.771 Test: verify: DIF generated, GUARD check ...passed 00:07:47.771 Test: verify: DIF generated, APPTAG check ...passed 00:07:47.771 Test: verify: DIF generated, REFTAG check ...passed 00:07:47.771 Test: verify: DIF not generated, GUARD check ...[2024-11-30 04:09:38.300866] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:47.771 [2024-11-30 04:09:38.300938] dif.c: 777:_dif_verify: *ERROR*: Failed to compare Guard: LBA=10, Expected=5a5a, Actual=7867 00:07:47.771 passed 00:07:47.771 Test: verify: DIF not generated, APPTAG check ...[2024-11-30 04:09:38.300990] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:47.771 [2024-11-30 04:09:38.301023] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=10, Expected=14, Actual=5a5a 00:07:47.771 passed 00:07:47.771 Test: verify: DIF not generated, REFTAG check ...[2024-11-30 04:09:38.301060] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:47.771 [2024-11-30 04:09:38.301089] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=5a5a5a5a 00:07:47.771 passed 00:07:47.771 Test: verify: APPTAG correct, APPTAG check ...passed 00:07:47.771 Test: verify: APPTAG incorrect, APPTAG check ...[2024-11-30 04:09:38.301166] dif.c: 792:_dif_verify: *ERROR*: Failed to compare App Tag: LBA=30, Expected=28, Actual=14 00:07:47.771 passed 00:07:47.771 Test: verify: APPTAG incorrect, no APPTAG check ...passed 00:07:47.771 Test: verify: REFTAG incorrect, REFTAG ignore ...passed 00:07:47.771 Test: verify: REFTAG_INIT correct, REFTAG check ...passed 00:07:47.771 Test: verify: REFTAG_INIT incorrect, REFTAG check ...[2024-11-30 04:09:38.301324] dif.c: 813:_dif_verify: *ERROR*: Failed to compare Ref Tag: LBA=10, Expected=a, Actual=10 00:07:47.771 passed 00:07:47.771 Test: generate copy: DIF generated, GUARD check ...passed 00:07:47.771 Test: generate copy: DIF generated, APTTAG check ...passed 00:07:47.771 Test: generate copy: DIF generated, REFTAG check ...passed 00:07:47.771 Test: generate copy: DIF generated, no GUARD check flag set ...passed 00:07:47.771 Test: generate copy: DIF generated, no APPTAG check flag set ...passed 00:07:47.771 Test: generate copy: DIF generated, no REFTAG check flag set ...passed 00:07:47.771 Test: generate copy: iovecs-len validate ...[2024-11-30 04:09:38.301579] dif.c:1167:spdk_dif_generate_copy: *ERROR*: Size of bounce_iovs arrays are not valid or misaligned with block_size. 00:07:47.771 passed 00:07:47.771 Test: generate copy: buffer alignment validate ...passed 00:07:47.771 00:07:47.771 Run Summary: Type Total Ran Passed Failed Inactive 00:07:47.771 suites 1 1 n/a 0 0 00:07:47.771 tests 20 20 20 0 0 00:07:47.771 asserts 204 204 204 0 n/a 00:07:47.771 00:07:47.771 Elapsed time = 0.003 seconds 00:07:48.029 00:07:48.029 real 0m0.528s 00:07:48.029 user 0m0.821s 00:07:48.029 sys 0m0.195s 00:07:48.029 04:09:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:48.029 04:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:48.029 ************************************ 00:07:48.029 END TEST accel_dif_functional_tests 00:07:48.029 ************************************ 00:07:48.029 00:07:48.029 real 0m59.984s 00:07:48.029 user 1m7.701s 00:07:48.029 sys 0m7.350s 00:07:48.029 04:09:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:48.029 04:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:48.029 ************************************ 00:07:48.029 END TEST accel 00:07:48.029 ************************************ 00:07:48.029 04:09:38 -- spdk/autotest.sh@177 -- # run_test accel_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:48.029 04:09:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:48.029 04:09:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.029 04:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:48.029 ************************************ 00:07:48.029 START TEST accel_rpc 00:07:48.029 ************************************ 00:07:48.029 04:09:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel/accel_rpc.sh 00:07:48.029 * Looking for test storage... 00:07:48.029 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/accel 00:07:48.029 04:09:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:48.029 04:09:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:48.029 04:09:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:48.286 04:09:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:48.286 04:09:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:48.286 04:09:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:48.286 04:09:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:48.286 04:09:38 -- scripts/common.sh@335 -- # IFS=.-: 00:07:48.286 04:09:38 -- scripts/common.sh@335 -- # read -ra ver1 00:07:48.286 04:09:38 -- scripts/common.sh@336 -- # IFS=.-: 00:07:48.286 04:09:38 -- scripts/common.sh@336 -- # read -ra ver2 00:07:48.286 04:09:38 -- scripts/common.sh@337 -- # local 'op=<' 00:07:48.286 04:09:38 -- scripts/common.sh@339 -- # ver1_l=2 00:07:48.286 04:09:38 -- scripts/common.sh@340 -- # ver2_l=1 00:07:48.286 04:09:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:48.286 04:09:38 -- scripts/common.sh@343 -- # case "$op" in 00:07:48.286 04:09:38 -- scripts/common.sh@344 -- # : 1 00:07:48.286 04:09:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:48.286 04:09:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:48.286 04:09:38 -- scripts/common.sh@364 -- # decimal 1 00:07:48.286 04:09:38 -- scripts/common.sh@352 -- # local d=1 00:07:48.286 04:09:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:48.286 04:09:38 -- scripts/common.sh@354 -- # echo 1 00:07:48.286 04:09:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:48.286 04:09:38 -- scripts/common.sh@365 -- # decimal 2 00:07:48.286 04:09:38 -- scripts/common.sh@352 -- # local d=2 00:07:48.286 04:09:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:48.286 04:09:38 -- scripts/common.sh@354 -- # echo 2 00:07:48.286 04:09:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:48.286 04:09:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:48.286 04:09:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:48.286 04:09:38 -- scripts/common.sh@367 -- # return 0 00:07:48.286 04:09:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:48.286 04:09:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:48.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.286 --rc genhtml_branch_coverage=1 00:07:48.286 --rc genhtml_function_coverage=1 00:07:48.286 --rc genhtml_legend=1 00:07:48.286 --rc geninfo_all_blocks=1 00:07:48.286 --rc geninfo_unexecuted_blocks=1 00:07:48.286 00:07:48.286 ' 00:07:48.286 04:09:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:48.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.286 --rc genhtml_branch_coverage=1 00:07:48.286 --rc genhtml_function_coverage=1 00:07:48.286 --rc genhtml_legend=1 00:07:48.286 --rc geninfo_all_blocks=1 00:07:48.286 --rc geninfo_unexecuted_blocks=1 00:07:48.286 00:07:48.286 ' 00:07:48.286 04:09:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:48.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.286 --rc genhtml_branch_coverage=1 00:07:48.286 --rc genhtml_function_coverage=1 00:07:48.286 --rc genhtml_legend=1 00:07:48.286 --rc geninfo_all_blocks=1 00:07:48.286 --rc geninfo_unexecuted_blocks=1 00:07:48.286 00:07:48.286 ' 00:07:48.286 04:09:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:48.286 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:48.286 --rc genhtml_branch_coverage=1 00:07:48.286 --rc genhtml_function_coverage=1 00:07:48.286 --rc genhtml_legend=1 00:07:48.286 --rc geninfo_all_blocks=1 00:07:48.286 --rc geninfo_unexecuted_blocks=1 00:07:48.286 00:07:48.286 ' 00:07:48.286 04:09:38 -- accel/accel_rpc.sh@11 -- # trap 'killprocess $spdk_tgt_pid; exit 1' ERR 00:07:48.286 04:09:38 -- accel/accel_rpc.sh@14 -- # spdk_tgt_pid=2255230 00:07:48.286 04:09:38 -- accel/accel_rpc.sh@13 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --wait-for-rpc 00:07:48.286 04:09:38 -- accel/accel_rpc.sh@15 -- # waitforlisten 2255230 00:07:48.286 04:09:38 -- common/autotest_common.sh@829 -- # '[' -z 2255230 ']' 00:07:48.286 04:09:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:48.286 04:09:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:48.286 04:09:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:48.286 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:48.286 04:09:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:48.286 04:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:48.286 [2024-11-30 04:09:38.758806] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:48.286 [2024-11-30 04:09:38.758905] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2255230 ] 00:07:48.286 EAL: No free 2048 kB hugepages reported on node 1 00:07:48.286 [2024-11-30 04:09:38.815851] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:48.286 [2024-11-30 04:09:38.900101] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:48.286 [2024-11-30 04:09:38.900267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:48.543 04:09:38 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:48.543 04:09:38 -- common/autotest_common.sh@862 -- # return 0 00:07:48.543 04:09:38 -- accel/accel_rpc.sh@45 -- # [[ y == y ]] 00:07:48.543 04:09:38 -- accel/accel_rpc.sh@45 -- # [[ 0 -gt 0 ]] 00:07:48.543 04:09:38 -- accel/accel_rpc.sh@49 -- # [[ y == y ]] 00:07:48.543 04:09:38 -- accel/accel_rpc.sh@49 -- # [[ 0 -gt 0 ]] 00:07:48.543 04:09:38 -- accel/accel_rpc.sh@53 -- # run_test accel_assign_opcode accel_assign_opcode_test_suite 00:07:48.543 04:09:38 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:48.543 04:09:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:48.543 04:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:48.543 ************************************ 00:07:48.543 START TEST accel_assign_opcode 00:07:48.543 ************************************ 00:07:48.543 04:09:38 -- common/autotest_common.sh@1114 -- # accel_assign_opcode_test_suite 00:07:48.543 04:09:38 -- accel/accel_rpc.sh@38 -- # rpc_cmd accel_assign_opc -o copy -m incorrect 00:07:48.543 04:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.543 04:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:48.543 [2024-11-30 04:09:38.980845] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module incorrect 00:07:48.543 04:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.543 04:09:38 -- accel/accel_rpc.sh@40 -- # rpc_cmd accel_assign_opc -o copy -m software 00:07:48.543 04:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.543 04:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:48.543 [2024-11-30 04:09:38.988856] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation copy will be assigned to module software 00:07:48.543 04:09:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.543 04:09:38 -- accel/accel_rpc.sh@41 -- # rpc_cmd framework_start_init 00:07:48.543 04:09:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.543 04:09:38 -- common/autotest_common.sh@10 -- # set +x 00:07:48.801 04:09:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.801 04:09:39 -- accel/accel_rpc.sh@42 -- # rpc_cmd accel_get_opc_assignments 00:07:48.801 04:09:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:48.801 04:09:39 -- accel/accel_rpc.sh@42 -- # jq -r .copy 00:07:48.801 04:09:39 -- common/autotest_common.sh@10 -- # set +x 00:07:48.801 04:09:39 -- accel/accel_rpc.sh@42 -- # grep software 00:07:48.801 04:09:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:48.801 software 00:07:48.801 00:07:48.801 real 0m0.303s 00:07:48.801 user 0m0.045s 00:07:48.801 sys 0m0.006s 00:07:48.801 04:09:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:48.801 04:09:39 -- common/autotest_common.sh@10 -- # set +x 00:07:48.801 ************************************ 00:07:48.801 END TEST accel_assign_opcode 00:07:48.801 ************************************ 00:07:48.801 04:09:39 -- accel/accel_rpc.sh@55 -- # killprocess 2255230 00:07:48.801 04:09:39 -- common/autotest_common.sh@936 -- # '[' -z 2255230 ']' 00:07:48.801 04:09:39 -- common/autotest_common.sh@940 -- # kill -0 2255230 00:07:48.801 04:09:39 -- common/autotest_common.sh@941 -- # uname 00:07:48.801 04:09:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:48.801 04:09:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2255230 00:07:48.801 04:09:39 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:48.801 04:09:39 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:48.801 04:09:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2255230' 00:07:48.801 killing process with pid 2255230 00:07:48.801 04:09:39 -- common/autotest_common.sh@955 -- # kill 2255230 00:07:48.801 04:09:39 -- common/autotest_common.sh@960 -- # wait 2255230 00:07:49.367 00:07:49.367 real 0m1.187s 00:07:49.367 user 0m1.111s 00:07:49.367 sys 0m0.438s 00:07:49.367 04:09:39 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:49.367 04:09:39 -- common/autotest_common.sh@10 -- # set +x 00:07:49.367 ************************************ 00:07:49.367 END TEST accel_rpc 00:07:49.367 ************************************ 00:07:49.367 04:09:39 -- spdk/autotest.sh@178 -- # run_test app_cmdline /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:49.367 04:09:39 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:49.367 04:09:39 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:49.367 04:09:39 -- common/autotest_common.sh@10 -- # set +x 00:07:49.367 ************************************ 00:07:49.367 START TEST app_cmdline 00:07:49.367 ************************************ 00:07:49.367 04:09:39 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/cmdline.sh 00:07:49.367 * Looking for test storage... 00:07:49.367 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:49.367 04:09:39 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:49.367 04:09:39 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:49.367 04:09:39 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:49.367 04:09:39 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:49.367 04:09:39 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:49.367 04:09:39 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:49.367 04:09:39 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:49.367 04:09:39 -- scripts/common.sh@335 -- # IFS=.-: 00:07:49.367 04:09:39 -- scripts/common.sh@335 -- # read -ra ver1 00:07:49.367 04:09:39 -- scripts/common.sh@336 -- # IFS=.-: 00:07:49.367 04:09:39 -- scripts/common.sh@336 -- # read -ra ver2 00:07:49.367 04:09:39 -- scripts/common.sh@337 -- # local 'op=<' 00:07:49.368 04:09:39 -- scripts/common.sh@339 -- # ver1_l=2 00:07:49.368 04:09:39 -- scripts/common.sh@340 -- # ver2_l=1 00:07:49.368 04:09:39 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:49.368 04:09:39 -- scripts/common.sh@343 -- # case "$op" in 00:07:49.368 04:09:39 -- scripts/common.sh@344 -- # : 1 00:07:49.368 04:09:39 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:49.368 04:09:39 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:49.368 04:09:39 -- scripts/common.sh@364 -- # decimal 1 00:07:49.368 04:09:39 -- scripts/common.sh@352 -- # local d=1 00:07:49.368 04:09:39 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:49.368 04:09:39 -- scripts/common.sh@354 -- # echo 1 00:07:49.368 04:09:39 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:49.368 04:09:39 -- scripts/common.sh@365 -- # decimal 2 00:07:49.368 04:09:39 -- scripts/common.sh@352 -- # local d=2 00:07:49.368 04:09:39 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:49.368 04:09:39 -- scripts/common.sh@354 -- # echo 2 00:07:49.368 04:09:39 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:49.368 04:09:39 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:49.368 04:09:39 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:49.368 04:09:39 -- scripts/common.sh@367 -- # return 0 00:07:49.368 04:09:39 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:49.368 04:09:39 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:49.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.368 --rc genhtml_branch_coverage=1 00:07:49.368 --rc genhtml_function_coverage=1 00:07:49.368 --rc genhtml_legend=1 00:07:49.368 --rc geninfo_all_blocks=1 00:07:49.368 --rc geninfo_unexecuted_blocks=1 00:07:49.368 00:07:49.368 ' 00:07:49.368 04:09:39 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:49.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.368 --rc genhtml_branch_coverage=1 00:07:49.368 --rc genhtml_function_coverage=1 00:07:49.368 --rc genhtml_legend=1 00:07:49.368 --rc geninfo_all_blocks=1 00:07:49.368 --rc geninfo_unexecuted_blocks=1 00:07:49.368 00:07:49.368 ' 00:07:49.368 04:09:39 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:49.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.368 --rc genhtml_branch_coverage=1 00:07:49.368 --rc genhtml_function_coverage=1 00:07:49.368 --rc genhtml_legend=1 00:07:49.368 --rc geninfo_all_blocks=1 00:07:49.368 --rc geninfo_unexecuted_blocks=1 00:07:49.368 00:07:49.368 ' 00:07:49.368 04:09:39 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:49.368 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:49.368 --rc genhtml_branch_coverage=1 00:07:49.368 --rc genhtml_function_coverage=1 00:07:49.368 --rc genhtml_legend=1 00:07:49.368 --rc geninfo_all_blocks=1 00:07:49.368 --rc geninfo_unexecuted_blocks=1 00:07:49.368 00:07:49.368 ' 00:07:49.368 04:09:39 -- app/cmdline.sh@14 -- # trap 'killprocess $spdk_tgt_pid' EXIT 00:07:49.368 04:09:39 -- app/cmdline.sh@17 -- # spdk_tgt_pid=2255443 00:07:49.368 04:09:39 -- app/cmdline.sh@16 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_tgt --rpcs-allowed spdk_get_version,rpc_get_methods 00:07:49.368 04:09:39 -- app/cmdline.sh@18 -- # waitforlisten 2255443 00:07:49.368 04:09:39 -- common/autotest_common.sh@829 -- # '[' -z 2255443 ']' 00:07:49.368 04:09:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:49.368 04:09:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:49.368 04:09:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:49.368 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:49.368 04:09:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:49.368 04:09:39 -- common/autotest_common.sh@10 -- # set +x 00:07:49.368 [2024-11-30 04:09:39.968985] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:07:49.368 [2024-11-30 04:09:39.969085] [ DPDK EAL parameters: spdk_tgt --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2255443 ] 00:07:49.368 EAL: No free 2048 kB hugepages reported on node 1 00:07:49.625 [2024-11-30 04:09:40.030278] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:07:49.625 [2024-11-30 04:09:40.119629] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:07:49.625 [2024-11-30 04:09:40.119805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:07:50.555 04:09:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:50.555 04:09:40 -- common/autotest_common.sh@862 -- # return 0 00:07:50.555 04:09:40 -- app/cmdline.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py spdk_get_version 00:07:50.555 { 00:07:50.555 "version": "SPDK v24.01.1-pre git sha1 c13c99a5e", 00:07:50.556 "fields": { 00:07:50.556 "major": 24, 00:07:50.556 "minor": 1, 00:07:50.556 "patch": 1, 00:07:50.556 "suffix": "-pre", 00:07:50.556 "commit": "c13c99a5e" 00:07:50.556 } 00:07:50.556 } 00:07:50.556 04:09:41 -- app/cmdline.sh@22 -- # expected_methods=() 00:07:50.556 04:09:41 -- app/cmdline.sh@23 -- # expected_methods+=("rpc_get_methods") 00:07:50.556 04:09:41 -- app/cmdline.sh@24 -- # expected_methods+=("spdk_get_version") 00:07:50.556 04:09:41 -- app/cmdline.sh@26 -- # methods=($(rpc_cmd rpc_get_methods | jq -r ".[]" | sort)) 00:07:50.556 04:09:41 -- app/cmdline.sh@26 -- # rpc_cmd rpc_get_methods 00:07:50.556 04:09:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:50.556 04:09:41 -- app/cmdline.sh@26 -- # jq -r '.[]' 00:07:50.556 04:09:41 -- common/autotest_common.sh@10 -- # set +x 00:07:50.556 04:09:41 -- app/cmdline.sh@26 -- # sort 00:07:50.813 04:09:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:50.813 04:09:41 -- app/cmdline.sh@27 -- # (( 2 == 2 )) 00:07:50.813 04:09:41 -- app/cmdline.sh@28 -- # [[ rpc_get_methods spdk_get_version == \r\p\c\_\g\e\t\_\m\e\t\h\o\d\s\ \s\p\d\k\_\g\e\t\_\v\e\r\s\i\o\n ]] 00:07:50.813 04:09:41 -- app/cmdline.sh@30 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:50.813 04:09:41 -- common/autotest_common.sh@650 -- # local es=0 00:07:50.813 04:09:41 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:50.813 04:09:41 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.813 04:09:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:50.813 04:09:41 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.813 04:09:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:50.813 04:09:41 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.813 04:09:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:07:50.813 04:09:41 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:07:50.813 04:09:41 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:07:50.813 04:09:41 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py env_dpdk_get_mem_stats 00:07:51.071 request: 00:07:51.071 { 00:07:51.071 "method": "env_dpdk_get_mem_stats", 00:07:51.071 "req_id": 1 00:07:51.071 } 00:07:51.071 Got JSON-RPC error response 00:07:51.071 response: 00:07:51.071 { 00:07:51.071 "code": -32601, 00:07:51.071 "message": "Method not found" 00:07:51.071 } 00:07:51.071 04:09:41 -- common/autotest_common.sh@653 -- # es=1 00:07:51.071 04:09:41 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:07:51.071 04:09:41 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:07:51.071 04:09:41 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:07:51.071 04:09:41 -- app/cmdline.sh@1 -- # killprocess 2255443 00:07:51.071 04:09:41 -- common/autotest_common.sh@936 -- # '[' -z 2255443 ']' 00:07:51.071 04:09:41 -- common/autotest_common.sh@940 -- # kill -0 2255443 00:07:51.071 04:09:41 -- common/autotest_common.sh@941 -- # uname 00:07:51.071 04:09:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:07:51.071 04:09:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2255443 00:07:51.071 04:09:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:07:51.071 04:09:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:07:51.071 04:09:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2255443' 00:07:51.071 killing process with pid 2255443 00:07:51.071 04:09:41 -- common/autotest_common.sh@955 -- # kill 2255443 00:07:51.071 04:09:41 -- common/autotest_common.sh@960 -- # wait 2255443 00:07:51.330 00:07:51.330 real 0m2.144s 00:07:51.330 user 0m2.669s 00:07:51.330 sys 0m0.529s 00:07:51.330 04:09:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:51.330 04:09:41 -- common/autotest_common.sh@10 -- # set +x 00:07:51.330 ************************************ 00:07:51.330 END TEST app_cmdline 00:07:51.331 ************************************ 00:07:51.331 04:09:41 -- spdk/autotest.sh@179 -- # run_test version /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:51.331 04:09:41 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:07:51.331 04:09:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.331 04:09:41 -- common/autotest_common.sh@10 -- # set +x 00:07:51.589 ************************************ 00:07:51.589 START TEST version 00:07:51.589 ************************************ 00:07:51.589 04:09:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/version.sh 00:07:51.589 * Looking for test storage... 00:07:51.589 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:07:51.589 04:09:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:51.589 04:09:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:51.589 04:09:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:51.589 04:09:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:51.589 04:09:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:51.589 04:09:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:51.589 04:09:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:51.589 04:09:42 -- scripts/common.sh@335 -- # IFS=.-: 00:07:51.589 04:09:42 -- scripts/common.sh@335 -- # read -ra ver1 00:07:51.589 04:09:42 -- scripts/common.sh@336 -- # IFS=.-: 00:07:51.589 04:09:42 -- scripts/common.sh@336 -- # read -ra ver2 00:07:51.589 04:09:42 -- scripts/common.sh@337 -- # local 'op=<' 00:07:51.589 04:09:42 -- scripts/common.sh@339 -- # ver1_l=2 00:07:51.589 04:09:42 -- scripts/common.sh@340 -- # ver2_l=1 00:07:51.589 04:09:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:51.589 04:09:42 -- scripts/common.sh@343 -- # case "$op" in 00:07:51.589 04:09:42 -- scripts/common.sh@344 -- # : 1 00:07:51.589 04:09:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:51.589 04:09:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:51.589 04:09:42 -- scripts/common.sh@364 -- # decimal 1 00:07:51.589 04:09:42 -- scripts/common.sh@352 -- # local d=1 00:07:51.589 04:09:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:51.589 04:09:42 -- scripts/common.sh@354 -- # echo 1 00:07:51.589 04:09:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:51.589 04:09:42 -- scripts/common.sh@365 -- # decimal 2 00:07:51.589 04:09:42 -- scripts/common.sh@352 -- # local d=2 00:07:51.589 04:09:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:51.589 04:09:42 -- scripts/common.sh@354 -- # echo 2 00:07:51.589 04:09:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:51.589 04:09:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:51.589 04:09:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:51.589 04:09:42 -- scripts/common.sh@367 -- # return 0 00:07:51.590 04:09:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:51.590 04:09:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:51.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.590 --rc genhtml_branch_coverage=1 00:07:51.590 --rc genhtml_function_coverage=1 00:07:51.590 --rc genhtml_legend=1 00:07:51.590 --rc geninfo_all_blocks=1 00:07:51.590 --rc geninfo_unexecuted_blocks=1 00:07:51.590 00:07:51.590 ' 00:07:51.590 04:09:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:51.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.590 --rc genhtml_branch_coverage=1 00:07:51.590 --rc genhtml_function_coverage=1 00:07:51.590 --rc genhtml_legend=1 00:07:51.590 --rc geninfo_all_blocks=1 00:07:51.590 --rc geninfo_unexecuted_blocks=1 00:07:51.590 00:07:51.590 ' 00:07:51.590 04:09:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:51.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.590 --rc genhtml_branch_coverage=1 00:07:51.590 --rc genhtml_function_coverage=1 00:07:51.590 --rc genhtml_legend=1 00:07:51.590 --rc geninfo_all_blocks=1 00:07:51.590 --rc geninfo_unexecuted_blocks=1 00:07:51.590 00:07:51.590 ' 00:07:51.590 04:09:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:51.590 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.590 --rc genhtml_branch_coverage=1 00:07:51.590 --rc genhtml_function_coverage=1 00:07:51.590 --rc genhtml_legend=1 00:07:51.590 --rc geninfo_all_blocks=1 00:07:51.590 --rc geninfo_unexecuted_blocks=1 00:07:51.590 00:07:51.590 ' 00:07:51.590 04:09:42 -- app/version.sh@17 -- # get_header_version major 00:07:51.590 04:09:42 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MAJOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.590 04:09:42 -- app/version.sh@14 -- # cut -f2 00:07:51.590 04:09:42 -- app/version.sh@14 -- # tr -d '"' 00:07:51.590 04:09:42 -- app/version.sh@17 -- # major=24 00:07:51.590 04:09:42 -- app/version.sh@18 -- # get_header_version minor 00:07:51.590 04:09:42 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_MINOR[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.590 04:09:42 -- app/version.sh@14 -- # cut -f2 00:07:51.590 04:09:42 -- app/version.sh@14 -- # tr -d '"' 00:07:51.590 04:09:42 -- app/version.sh@18 -- # minor=1 00:07:51.590 04:09:42 -- app/version.sh@19 -- # get_header_version patch 00:07:51.590 04:09:42 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_PATCH[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.590 04:09:42 -- app/version.sh@14 -- # cut -f2 00:07:51.590 04:09:42 -- app/version.sh@14 -- # tr -d '"' 00:07:51.590 04:09:42 -- app/version.sh@19 -- # patch=1 00:07:51.590 04:09:42 -- app/version.sh@20 -- # get_header_version suffix 00:07:51.590 04:09:42 -- app/version.sh@13 -- # grep -E '^#define SPDK_VERSION_SUFFIX[[:space:]]+' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/version.h 00:07:51.590 04:09:42 -- app/version.sh@14 -- # cut -f2 00:07:51.590 04:09:42 -- app/version.sh@14 -- # tr -d '"' 00:07:51.590 04:09:42 -- app/version.sh@20 -- # suffix=-pre 00:07:51.590 04:09:42 -- app/version.sh@22 -- # version=24.1 00:07:51.590 04:09:42 -- app/version.sh@25 -- # (( patch != 0 )) 00:07:51.590 04:09:42 -- app/version.sh@25 -- # version=24.1.1 00:07:51.590 04:09:42 -- app/version.sh@28 -- # version=24.1.1rc0 00:07:51.590 04:09:42 -- app/version.sh@30 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:07:51.590 04:09:42 -- app/version.sh@30 -- # python3 -c 'import spdk; print(spdk.__version__)' 00:07:51.590 04:09:42 -- app/version.sh@30 -- # py_version=24.1.1rc0 00:07:51.590 04:09:42 -- app/version.sh@31 -- # [[ 24.1.1rc0 == \2\4\.\1\.\1\r\c\0 ]] 00:07:51.590 00:07:51.590 real 0m0.213s 00:07:51.590 user 0m0.153s 00:07:51.590 sys 0m0.085s 00:07:51.590 04:09:42 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:07:51.590 04:09:42 -- common/autotest_common.sh@10 -- # set +x 00:07:51.590 ************************************ 00:07:51.590 END TEST version 00:07:51.590 ************************************ 00:07:51.590 04:09:42 -- spdk/autotest.sh@181 -- # '[' 0 -eq 1 ']' 00:07:51.590 04:09:42 -- spdk/autotest.sh@191 -- # uname -s 00:07:51.590 04:09:42 -- spdk/autotest.sh@191 -- # [[ Linux == Linux ]] 00:07:51.590 04:09:42 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:51.590 04:09:42 -- spdk/autotest.sh@192 -- # [[ 0 -eq 1 ]] 00:07:51.590 04:09:42 -- spdk/autotest.sh@204 -- # '[' 0 -eq 1 ']' 00:07:51.590 04:09:42 -- spdk/autotest.sh@251 -- # '[' 0 -eq 1 ']' 00:07:51.590 04:09:42 -- spdk/autotest.sh@255 -- # timing_exit lib 00:07:51.590 04:09:42 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:51.590 04:09:42 -- common/autotest_common.sh@10 -- # set +x 00:07:51.590 04:09:42 -- spdk/autotest.sh@257 -- # '[' 0 -eq 1 ']' 00:07:51.590 04:09:42 -- spdk/autotest.sh@265 -- # '[' 0 -eq 1 ']' 00:07:51.590 04:09:42 -- spdk/autotest.sh@274 -- # '[' 1 -eq 1 ']' 00:07:51.590 04:09:42 -- spdk/autotest.sh@275 -- # export NET_TYPE 00:07:51.590 04:09:42 -- spdk/autotest.sh@278 -- # '[' tcp = rdma ']' 00:07:51.590 04:09:42 -- spdk/autotest.sh@281 -- # '[' tcp = tcp ']' 00:07:51.590 04:09:42 -- spdk/autotest.sh@282 -- # run_test nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:51.590 04:09:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:51.590 04:09:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.590 04:09:42 -- common/autotest_common.sh@10 -- # set +x 00:07:51.590 ************************************ 00:07:51.590 START TEST nvmf_tcp 00:07:51.590 ************************************ 00:07:51.590 04:09:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/nvmf.sh --transport=tcp 00:07:51.848 * Looking for test storage... 00:07:51.848 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf 00:07:51.848 04:09:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:51.848 04:09:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:51.848 04:09:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:51.849 04:09:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:51.849 04:09:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:51.849 04:09:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:51.849 04:09:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:51.849 04:09:42 -- scripts/common.sh@335 -- # IFS=.-: 00:07:51.849 04:09:42 -- scripts/common.sh@335 -- # read -ra ver1 00:07:51.849 04:09:42 -- scripts/common.sh@336 -- # IFS=.-: 00:07:51.849 04:09:42 -- scripts/common.sh@336 -- # read -ra ver2 00:07:51.849 04:09:42 -- scripts/common.sh@337 -- # local 'op=<' 00:07:51.849 04:09:42 -- scripts/common.sh@339 -- # ver1_l=2 00:07:51.849 04:09:42 -- scripts/common.sh@340 -- # ver2_l=1 00:07:51.849 04:09:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:51.849 04:09:42 -- scripts/common.sh@343 -- # case "$op" in 00:07:51.849 04:09:42 -- scripts/common.sh@344 -- # : 1 00:07:51.849 04:09:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:51.849 04:09:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:51.849 04:09:42 -- scripts/common.sh@364 -- # decimal 1 00:07:51.849 04:09:42 -- scripts/common.sh@352 -- # local d=1 00:07:51.849 04:09:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:51.849 04:09:42 -- scripts/common.sh@354 -- # echo 1 00:07:51.849 04:09:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:51.849 04:09:42 -- scripts/common.sh@365 -- # decimal 2 00:07:51.849 04:09:42 -- scripts/common.sh@352 -- # local d=2 00:07:51.849 04:09:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:51.849 04:09:42 -- scripts/common.sh@354 -- # echo 2 00:07:51.849 04:09:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:51.849 04:09:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:51.849 04:09:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:51.849 04:09:42 -- scripts/common.sh@367 -- # return 0 00:07:51.849 04:09:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:51.849 04:09:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:51.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.849 --rc genhtml_branch_coverage=1 00:07:51.849 --rc genhtml_function_coverage=1 00:07:51.849 --rc genhtml_legend=1 00:07:51.849 --rc geninfo_all_blocks=1 00:07:51.849 --rc geninfo_unexecuted_blocks=1 00:07:51.849 00:07:51.849 ' 00:07:51.849 04:09:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:51.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.849 --rc genhtml_branch_coverage=1 00:07:51.849 --rc genhtml_function_coverage=1 00:07:51.849 --rc genhtml_legend=1 00:07:51.849 --rc geninfo_all_blocks=1 00:07:51.849 --rc geninfo_unexecuted_blocks=1 00:07:51.849 00:07:51.849 ' 00:07:51.849 04:09:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:51.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.849 --rc genhtml_branch_coverage=1 00:07:51.849 --rc genhtml_function_coverage=1 00:07:51.849 --rc genhtml_legend=1 00:07:51.849 --rc geninfo_all_blocks=1 00:07:51.849 --rc geninfo_unexecuted_blocks=1 00:07:51.849 00:07:51.849 ' 00:07:51.849 04:09:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:51.849 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:51.849 --rc genhtml_branch_coverage=1 00:07:51.849 --rc genhtml_function_coverage=1 00:07:51.849 --rc genhtml_legend=1 00:07:51.849 --rc geninfo_all_blocks=1 00:07:51.849 --rc geninfo_unexecuted_blocks=1 00:07:51.849 00:07:51.849 ' 00:07:51.849 04:09:42 -- nvmf/nvmf.sh@10 -- # uname -s 00:07:51.849 04:09:42 -- nvmf/nvmf.sh@10 -- # '[' '!' Linux = Linux ']' 00:07:51.849 04:09:42 -- nvmf/nvmf.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:51.849 04:09:42 -- nvmf/common.sh@7 -- # uname -s 00:07:51.849 04:09:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:51.849 04:09:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:51.849 04:09:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:51.849 04:09:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:51.849 04:09:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:51.849 04:09:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:51.849 04:09:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:51.849 04:09:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:51.849 04:09:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:51.849 04:09:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:51.849 04:09:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:51.849 04:09:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:51.849 04:09:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:51.849 04:09:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:51.849 04:09:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:51.849 04:09:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:51.849 04:09:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:51.849 04:09:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:51.849 04:09:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:51.849 04:09:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.849 04:09:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.849 04:09:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.849 04:09:42 -- paths/export.sh@5 -- # export PATH 00:07:51.849 04:09:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:51.849 04:09:42 -- nvmf/common.sh@46 -- # : 0 00:07:51.849 04:09:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:51.849 04:09:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:51.849 04:09:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:51.849 04:09:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:51.849 04:09:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:51.849 04:09:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:51.849 04:09:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:51.849 04:09:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:51.849 04:09:42 -- nvmf/nvmf.sh@16 -- # trap 'exit 1' SIGINT SIGTERM EXIT 00:07:51.849 04:09:42 -- nvmf/nvmf.sh@18 -- # TEST_ARGS=("$@") 00:07:51.849 04:09:42 -- nvmf/nvmf.sh@20 -- # timing_enter target 00:07:51.849 04:09:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:51.849 04:09:42 -- common/autotest_common.sh@10 -- # set +x 00:07:51.849 04:09:42 -- nvmf/nvmf.sh@22 -- # [[ 0 -eq 0 ]] 00:07:51.850 04:09:42 -- nvmf/nvmf.sh@23 -- # run_test nvmf_example /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:51.850 04:09:42 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:07:51.850 04:09:42 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:07:51.850 04:09:42 -- common/autotest_common.sh@10 -- # set +x 00:07:51.850 ************************************ 00:07:51.850 START TEST nvmf_example 00:07:51.850 ************************************ 00:07:51.850 04:09:42 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_example.sh --transport=tcp 00:07:51.850 * Looking for test storage... 00:07:51.850 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:07:51.850 04:09:42 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:07:51.850 04:09:42 -- common/autotest_common.sh@1690 -- # lcov --version 00:07:51.850 04:09:42 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:07:52.109 04:09:42 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:07:52.109 04:09:42 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:07:52.109 04:09:42 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:07:52.109 04:09:42 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:07:52.109 04:09:42 -- scripts/common.sh@335 -- # IFS=.-: 00:07:52.109 04:09:42 -- scripts/common.sh@335 -- # read -ra ver1 00:07:52.109 04:09:42 -- scripts/common.sh@336 -- # IFS=.-: 00:07:52.109 04:09:42 -- scripts/common.sh@336 -- # read -ra ver2 00:07:52.109 04:09:42 -- scripts/common.sh@337 -- # local 'op=<' 00:07:52.109 04:09:42 -- scripts/common.sh@339 -- # ver1_l=2 00:07:52.109 04:09:42 -- scripts/common.sh@340 -- # ver2_l=1 00:07:52.109 04:09:42 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:07:52.109 04:09:42 -- scripts/common.sh@343 -- # case "$op" in 00:07:52.109 04:09:42 -- scripts/common.sh@344 -- # : 1 00:07:52.109 04:09:42 -- scripts/common.sh@363 -- # (( v = 0 )) 00:07:52.109 04:09:42 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:07:52.109 04:09:42 -- scripts/common.sh@364 -- # decimal 1 00:07:52.109 04:09:42 -- scripts/common.sh@352 -- # local d=1 00:07:52.109 04:09:42 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:07:52.109 04:09:42 -- scripts/common.sh@354 -- # echo 1 00:07:52.109 04:09:42 -- scripts/common.sh@364 -- # ver1[v]=1 00:07:52.109 04:09:42 -- scripts/common.sh@365 -- # decimal 2 00:07:52.109 04:09:42 -- scripts/common.sh@352 -- # local d=2 00:07:52.109 04:09:42 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:07:52.109 04:09:42 -- scripts/common.sh@354 -- # echo 2 00:07:52.109 04:09:42 -- scripts/common.sh@365 -- # ver2[v]=2 00:07:52.109 04:09:42 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:07:52.109 04:09:42 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:07:52.109 04:09:42 -- scripts/common.sh@367 -- # return 0 00:07:52.109 04:09:42 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:07:52.109 04:09:42 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:07:52.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.109 --rc genhtml_branch_coverage=1 00:07:52.109 --rc genhtml_function_coverage=1 00:07:52.109 --rc genhtml_legend=1 00:07:52.109 --rc geninfo_all_blocks=1 00:07:52.109 --rc geninfo_unexecuted_blocks=1 00:07:52.109 00:07:52.109 ' 00:07:52.109 04:09:42 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:07:52.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.109 --rc genhtml_branch_coverage=1 00:07:52.109 --rc genhtml_function_coverage=1 00:07:52.109 --rc genhtml_legend=1 00:07:52.109 --rc geninfo_all_blocks=1 00:07:52.109 --rc geninfo_unexecuted_blocks=1 00:07:52.109 00:07:52.109 ' 00:07:52.109 04:09:42 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:07:52.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.109 --rc genhtml_branch_coverage=1 00:07:52.109 --rc genhtml_function_coverage=1 00:07:52.109 --rc genhtml_legend=1 00:07:52.109 --rc geninfo_all_blocks=1 00:07:52.109 --rc geninfo_unexecuted_blocks=1 00:07:52.109 00:07:52.109 ' 00:07:52.109 04:09:42 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:07:52.109 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:07:52.109 --rc genhtml_branch_coverage=1 00:07:52.109 --rc genhtml_function_coverage=1 00:07:52.109 --rc genhtml_legend=1 00:07:52.109 --rc geninfo_all_blocks=1 00:07:52.109 --rc geninfo_unexecuted_blocks=1 00:07:52.109 00:07:52.109 ' 00:07:52.109 04:09:42 -- target/nvmf_example.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:07:52.109 04:09:42 -- nvmf/common.sh@7 -- # uname -s 00:07:52.109 04:09:42 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:07:52.109 04:09:42 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:07:52.110 04:09:42 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:07:52.110 04:09:42 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:07:52.110 04:09:42 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:07:52.110 04:09:42 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:07:52.110 04:09:42 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:07:52.110 04:09:42 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:07:52.110 04:09:42 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:07:52.110 04:09:42 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:07:52.110 04:09:42 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:07:52.110 04:09:42 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:07:52.110 04:09:42 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:07:52.110 04:09:42 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:07:52.110 04:09:42 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:07:52.110 04:09:42 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:07:52.110 04:09:42 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:07:52.110 04:09:42 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:07:52.110 04:09:42 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:07:52.110 04:09:42 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.110 04:09:42 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.110 04:09:42 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.110 04:09:42 -- paths/export.sh@5 -- # export PATH 00:07:52.110 04:09:42 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:07:52.110 04:09:42 -- nvmf/common.sh@46 -- # : 0 00:07:52.110 04:09:42 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:07:52.110 04:09:42 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:07:52.110 04:09:42 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:07:52.110 04:09:42 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:07:52.110 04:09:42 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:07:52.110 04:09:42 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:07:52.110 04:09:42 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:07:52.110 04:09:42 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:07:52.110 04:09:42 -- target/nvmf_example.sh@11 -- # NVMF_EXAMPLE=("$SPDK_EXAMPLE_DIR/nvmf") 00:07:52.110 04:09:42 -- target/nvmf_example.sh@13 -- # MALLOC_BDEV_SIZE=64 00:07:52.110 04:09:42 -- target/nvmf_example.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:07:52.110 04:09:42 -- target/nvmf_example.sh@24 -- # build_nvmf_example_args 00:07:52.110 04:09:42 -- target/nvmf_example.sh@17 -- # '[' 0 -eq 1 ']' 00:07:52.110 04:09:42 -- target/nvmf_example.sh@20 -- # NVMF_EXAMPLE+=(-i "$NVMF_APP_SHM_ID" -g 10000) 00:07:52.110 04:09:42 -- target/nvmf_example.sh@21 -- # NVMF_EXAMPLE+=("${NO_HUGE[@]}") 00:07:52.110 04:09:42 -- target/nvmf_example.sh@40 -- # timing_enter nvmf_example_test 00:07:52.110 04:09:42 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:52.110 04:09:42 -- common/autotest_common.sh@10 -- # set +x 00:07:52.110 04:09:42 -- target/nvmf_example.sh@41 -- # nvmftestinit 00:07:52.110 04:09:42 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:07:52.110 04:09:42 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:07:52.110 04:09:42 -- nvmf/common.sh@436 -- # prepare_net_devs 00:07:52.110 04:09:42 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:07:52.110 04:09:42 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:07:52.110 04:09:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:07:52.110 04:09:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:07:52.110 04:09:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:07:52.110 04:09:42 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:07:52.110 04:09:42 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:07:52.110 04:09:42 -- nvmf/common.sh@284 -- # xtrace_disable 00:07:52.110 04:09:42 -- common/autotest_common.sh@10 -- # set +x 00:07:54.647 04:09:44 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:07:54.647 04:09:44 -- nvmf/common.sh@290 -- # pci_devs=() 00:07:54.647 04:09:44 -- nvmf/common.sh@290 -- # local -a pci_devs 00:07:54.647 04:09:44 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:07:54.647 04:09:44 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:07:54.647 04:09:44 -- nvmf/common.sh@292 -- # pci_drivers=() 00:07:54.647 04:09:44 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:07:54.647 04:09:44 -- nvmf/common.sh@294 -- # net_devs=() 00:07:54.647 04:09:44 -- nvmf/common.sh@294 -- # local -ga net_devs 00:07:54.647 04:09:44 -- nvmf/common.sh@295 -- # e810=() 00:07:54.647 04:09:44 -- nvmf/common.sh@295 -- # local -ga e810 00:07:54.647 04:09:44 -- nvmf/common.sh@296 -- # x722=() 00:07:54.647 04:09:44 -- nvmf/common.sh@296 -- # local -ga x722 00:07:54.648 04:09:44 -- nvmf/common.sh@297 -- # mlx=() 00:07:54.648 04:09:44 -- nvmf/common.sh@297 -- # local -ga mlx 00:07:54.648 04:09:44 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:07:54.648 04:09:44 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:07:54.648 04:09:44 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:07:54.648 04:09:44 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:07:54.648 04:09:44 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:07:54.648 04:09:44 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:07:54.648 04:09:44 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:07:54.648 04:09:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:54.648 04:09:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:07:54.648 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:07:54.648 04:09:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:54.648 04:09:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:54.648 04:09:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:54.648 04:09:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:54.648 04:09:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:54.648 04:09:44 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:07:54.648 04:09:44 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:07:54.648 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:07:54.648 04:09:44 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:07:54.649 04:09:44 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:07:54.649 04:09:44 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:07:54.649 04:09:44 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:07:54.649 04:09:44 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:07:54.649 04:09:44 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:07:54.649 04:09:44 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:07:54.649 04:09:44 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:07:54.649 04:09:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:54.649 04:09:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.649 04:09:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:54.649 04:09:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.649 04:09:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:07:54.649 Found net devices under 0000:0a:00.0: cvl_0_0 00:07:54.649 04:09:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.649 04:09:44 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:07:54.649 04:09:44 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:07:54.649 04:09:44 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:07:54.649 04:09:44 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:07:54.649 04:09:44 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:07:54.649 Found net devices under 0000:0a:00.1: cvl_0_1 00:07:54.649 04:09:44 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:07:54.649 04:09:44 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:07:54.649 04:09:44 -- nvmf/common.sh@402 -- # is_hw=yes 00:07:54.650 04:09:44 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:07:54.650 04:09:44 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:07:54.650 04:09:44 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:07:54.650 04:09:44 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:07:54.650 04:09:44 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:07:54.650 04:09:44 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:07:54.650 04:09:44 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:07:54.650 04:09:44 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:07:54.650 04:09:44 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:07:54.650 04:09:44 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:07:54.650 04:09:44 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:07:54.650 04:09:44 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:07:54.650 04:09:44 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:07:54.650 04:09:44 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:07:54.650 04:09:44 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:07:54.650 04:09:44 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:07:54.650 04:09:44 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:07:54.650 04:09:44 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:07:54.650 04:09:44 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:07:54.650 04:09:44 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:07:54.650 04:09:44 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:07:54.650 04:09:44 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:07:54.650 04:09:44 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:07:54.650 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:07:54.650 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.219 ms 00:07:54.650 00:07:54.650 --- 10.0.0.2 ping statistics --- 00:07:54.650 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:54.651 rtt min/avg/max/mdev = 0.219/0.219/0.219/0.000 ms 00:07:54.651 04:09:44 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:07:54.651 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:07:54.651 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.150 ms 00:07:54.651 00:07:54.651 --- 10.0.0.1 ping statistics --- 00:07:54.651 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:07:54.651 rtt min/avg/max/mdev = 0.150/0.150/0.150/0.000 ms 00:07:54.651 04:09:44 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:07:54.652 04:09:44 -- nvmf/common.sh@410 -- # return 0 00:07:54.652 04:09:44 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:07:54.652 04:09:44 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:07:54.652 04:09:44 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:07:54.652 04:09:44 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:07:54.652 04:09:44 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:07:54.652 04:09:44 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:07:54.652 04:09:44 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:07:54.652 04:09:44 -- target/nvmf_example.sh@42 -- # nvmfexamplestart '-m 0xF' 00:07:54.652 04:09:44 -- target/nvmf_example.sh@27 -- # timing_enter start_nvmf_example 00:07:54.652 04:09:44 -- common/autotest_common.sh@722 -- # xtrace_disable 00:07:54.652 04:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:54.652 04:09:44 -- target/nvmf_example.sh@29 -- # '[' tcp == tcp ']' 00:07:54.652 04:09:44 -- target/nvmf_example.sh@30 -- # NVMF_EXAMPLE=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_EXAMPLE[@]}") 00:07:54.652 04:09:44 -- target/nvmf_example.sh@34 -- # nvmfpid=2257541 00:07:54.652 04:09:44 -- target/nvmf_example.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/nvmf -i 0 -g 10000 -m 0xF 00:07:54.652 04:09:44 -- target/nvmf_example.sh@35 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:07:54.652 04:09:44 -- target/nvmf_example.sh@36 -- # waitforlisten 2257541 00:07:54.652 04:09:44 -- common/autotest_common.sh@829 -- # '[' -z 2257541 ']' 00:07:54.652 04:09:44 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:07:54.652 04:09:44 -- common/autotest_common.sh@834 -- # local max_retries=100 00:07:54.652 04:09:44 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:07:54.652 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:07:54.652 04:09:44 -- common/autotest_common.sh@838 -- # xtrace_disable 00:07:54.652 04:09:44 -- common/autotest_common.sh@10 -- # set +x 00:07:54.652 EAL: No free 2048 kB hugepages reported on node 1 00:07:54.652 04:09:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:07:54.652 04:09:45 -- common/autotest_common.sh@862 -- # return 0 00:07:54.652 04:09:45 -- target/nvmf_example.sh@37 -- # timing_exit start_nvmf_example 00:07:54.652 04:09:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:07:54.652 04:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:54.652 04:09:45 -- target/nvmf_example.sh@45 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:07:54.652 04:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.652 04:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:54.653 04:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.653 04:09:45 -- target/nvmf_example.sh@47 -- # rpc_cmd bdev_malloc_create 64 512 00:07:54.653 04:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.653 04:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:54.653 04:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.653 04:09:45 -- target/nvmf_example.sh@47 -- # malloc_bdevs='Malloc0 ' 00:07:54.653 04:09:45 -- target/nvmf_example.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:07:54.653 04:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.653 04:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:54.653 04:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.653 04:09:45 -- target/nvmf_example.sh@52 -- # for malloc_bdev in $malloc_bdevs 00:07:54.653 04:09:45 -- target/nvmf_example.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:07:54.653 04:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.653 04:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:54.653 04:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.653 04:09:45 -- target/nvmf_example.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:07:54.653 04:09:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:07:54.653 04:09:45 -- common/autotest_common.sh@10 -- # set +x 00:07:54.653 04:09:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:07:54.653 04:09:45 -- target/nvmf_example.sh@59 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:07:54.653 04:09:45 -- target/nvmf_example.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:07:54.653 EAL: No free 2048 kB hugepages reported on node 1 00:08:06.864 Initializing NVMe Controllers 00:08:06.864 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:08:06.864 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:08:06.864 Initialization complete. Launching workers. 00:08:06.864 ======================================================== 00:08:06.864 Latency(us) 00:08:06.864 Device Information : IOPS MiB/s Average min max 00:08:06.864 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 15017.70 58.66 4262.86 872.40 16287.38 00:08:06.864 ======================================================== 00:08:06.864 Total : 15017.70 58.66 4262.86 872.40 16287.38 00:08:06.864 00:08:06.864 04:09:55 -- target/nvmf_example.sh@65 -- # trap - SIGINT SIGTERM EXIT 00:08:06.864 04:09:55 -- target/nvmf_example.sh@66 -- # nvmftestfini 00:08:06.864 04:09:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:06.864 04:09:55 -- nvmf/common.sh@116 -- # sync 00:08:06.864 04:09:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:06.864 04:09:55 -- nvmf/common.sh@119 -- # set +e 00:08:06.864 04:09:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:06.864 04:09:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:06.864 rmmod nvme_tcp 00:08:06.864 rmmod nvme_fabrics 00:08:06.864 rmmod nvme_keyring 00:08:06.864 04:09:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:06.864 04:09:55 -- nvmf/common.sh@123 -- # set -e 00:08:06.864 04:09:55 -- nvmf/common.sh@124 -- # return 0 00:08:06.864 04:09:55 -- nvmf/common.sh@477 -- # '[' -n 2257541 ']' 00:08:06.864 04:09:55 -- nvmf/common.sh@478 -- # killprocess 2257541 00:08:06.864 04:09:55 -- common/autotest_common.sh@936 -- # '[' -z 2257541 ']' 00:08:06.864 04:09:55 -- common/autotest_common.sh@940 -- # kill -0 2257541 00:08:06.864 04:09:55 -- common/autotest_common.sh@941 -- # uname 00:08:06.864 04:09:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:06.864 04:09:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2257541 00:08:06.864 04:09:55 -- common/autotest_common.sh@942 -- # process_name=nvmf 00:08:06.864 04:09:55 -- common/autotest_common.sh@946 -- # '[' nvmf = sudo ']' 00:08:06.864 04:09:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2257541' 00:08:06.864 killing process with pid 2257541 00:08:06.864 04:09:55 -- common/autotest_common.sh@955 -- # kill 2257541 00:08:06.864 04:09:55 -- common/autotest_common.sh@960 -- # wait 2257541 00:08:06.864 nvmf threads initialize successfully 00:08:06.864 bdev subsystem init successfully 00:08:06.864 created a nvmf target service 00:08:06.864 create targets's poll groups done 00:08:06.864 all subsystems of target started 00:08:06.864 nvmf target is running 00:08:06.864 all subsystems of target stopped 00:08:06.864 destroy targets's poll groups done 00:08:06.864 destroyed the nvmf target service 00:08:06.864 bdev subsystem finish successfully 00:08:06.864 nvmf threads destroy successfully 00:08:06.864 04:09:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:06.864 04:09:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:06.864 04:09:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:06.864 04:09:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:06.864 04:09:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:06.864 04:09:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:06.864 04:09:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:06.864 04:09:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:07.430 04:09:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:07.430 04:09:57 -- target/nvmf_example.sh@67 -- # timing_exit nvmf_example_test 00:08:07.430 04:09:57 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:07.430 04:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:07.430 00:08:07.430 real 0m15.418s 00:08:07.430 user 0m41.465s 00:08:07.430 sys 0m3.746s 00:08:07.430 04:09:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:07.430 04:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:07.431 ************************************ 00:08:07.431 END TEST nvmf_example 00:08:07.431 ************************************ 00:08:07.431 04:09:57 -- nvmf/nvmf.sh@24 -- # run_test nvmf_filesystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:07.431 04:09:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:07.431 04:09:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:07.431 04:09:57 -- common/autotest_common.sh@10 -- # set +x 00:08:07.431 ************************************ 00:08:07.431 START TEST nvmf_filesystem 00:08:07.431 ************************************ 00:08:07.431 04:09:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/filesystem.sh --transport=tcp 00:08:07.431 * Looking for test storage... 00:08:07.431 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:07.431 04:09:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:07.431 04:09:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:07.431 04:09:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:07.431 04:09:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:07.431 04:09:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:07.431 04:09:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:07.431 04:09:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:07.431 04:09:57 -- scripts/common.sh@335 -- # IFS=.-: 00:08:07.431 04:09:57 -- scripts/common.sh@335 -- # read -ra ver1 00:08:07.431 04:09:57 -- scripts/common.sh@336 -- # IFS=.-: 00:08:07.431 04:09:57 -- scripts/common.sh@336 -- # read -ra ver2 00:08:07.431 04:09:57 -- scripts/common.sh@337 -- # local 'op=<' 00:08:07.431 04:09:57 -- scripts/common.sh@339 -- # ver1_l=2 00:08:07.431 04:09:57 -- scripts/common.sh@340 -- # ver2_l=1 00:08:07.431 04:09:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:07.431 04:09:57 -- scripts/common.sh@343 -- # case "$op" in 00:08:07.431 04:09:57 -- scripts/common.sh@344 -- # : 1 00:08:07.431 04:09:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:07.431 04:09:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:07.431 04:09:57 -- scripts/common.sh@364 -- # decimal 1 00:08:07.431 04:09:57 -- scripts/common.sh@352 -- # local d=1 00:08:07.431 04:09:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:07.431 04:09:57 -- scripts/common.sh@354 -- # echo 1 00:08:07.431 04:09:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:07.431 04:09:57 -- scripts/common.sh@365 -- # decimal 2 00:08:07.431 04:09:57 -- scripts/common.sh@352 -- # local d=2 00:08:07.431 04:09:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:07.431 04:09:57 -- scripts/common.sh@354 -- # echo 2 00:08:07.431 04:09:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:07.431 04:09:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:07.431 04:09:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:07.431 04:09:57 -- scripts/common.sh@367 -- # return 0 00:08:07.431 04:09:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:07.431 04:09:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:07.431 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:07.431 --rc genhtml_branch_coverage=1 00:08:07.431 --rc genhtml_function_coverage=1 00:08:07.431 --rc genhtml_legend=1 00:08:07.431 --rc geninfo_all_blocks=1 00:08:07.431 --rc geninfo_unexecuted_blocks=1 00:08:07.431 00:08:07.431 ' 00:08:07.431 04:09:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:07.431 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:07.431 --rc genhtml_branch_coverage=1 00:08:07.431 --rc genhtml_function_coverage=1 00:08:07.431 --rc genhtml_legend=1 00:08:07.431 --rc geninfo_all_blocks=1 00:08:07.431 --rc geninfo_unexecuted_blocks=1 00:08:07.431 00:08:07.431 ' 00:08:07.431 04:09:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:07.431 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:07.431 --rc genhtml_branch_coverage=1 00:08:07.431 --rc genhtml_function_coverage=1 00:08:07.431 --rc genhtml_legend=1 00:08:07.431 --rc geninfo_all_blocks=1 00:08:07.431 --rc geninfo_unexecuted_blocks=1 00:08:07.431 00:08:07.431 ' 00:08:07.431 04:09:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:07.431 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:07.431 --rc genhtml_branch_coverage=1 00:08:07.431 --rc genhtml_function_coverage=1 00:08:07.431 --rc genhtml_legend=1 00:08:07.431 --rc geninfo_all_blocks=1 00:08:07.431 --rc geninfo_unexecuted_blocks=1 00:08:07.431 00:08:07.431 ' 00:08:07.431 04:09:57 -- target/filesystem.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh 00:08:07.431 04:09:57 -- common/autotest_common.sh@7 -- # rpc_py=rpc_cmd 00:08:07.431 04:09:57 -- common/autotest_common.sh@34 -- # set -e 00:08:07.431 04:09:57 -- common/autotest_common.sh@35 -- # shopt -s nullglob 00:08:07.431 04:09:57 -- common/autotest_common.sh@36 -- # shopt -s extglob 00:08:07.431 04:09:57 -- common/autotest_common.sh@38 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh ]] 00:08:07.431 04:09:57 -- common/autotest_common.sh@39 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/build_config.sh 00:08:07.431 04:09:57 -- common/build_config.sh@1 -- # CONFIG_WPDK_DIR= 00:08:07.431 04:09:57 -- common/build_config.sh@2 -- # CONFIG_ASAN=n 00:08:07.431 04:09:57 -- common/build_config.sh@3 -- # CONFIG_VBDEV_COMPRESS=n 00:08:07.431 04:09:57 -- common/build_config.sh@4 -- # CONFIG_HAVE_EXECINFO_H=y 00:08:07.431 04:09:57 -- common/build_config.sh@5 -- # CONFIG_USDT=n 00:08:07.431 04:09:57 -- common/build_config.sh@6 -- # CONFIG_CUSTOMOCF=n 00:08:07.431 04:09:57 -- common/build_config.sh@7 -- # CONFIG_PREFIX=/usr/local 00:08:07.431 04:09:57 -- common/build_config.sh@8 -- # CONFIG_RBD=n 00:08:07.431 04:09:57 -- common/build_config.sh@9 -- # CONFIG_LIBDIR= 00:08:07.431 04:09:57 -- common/build_config.sh@10 -- # CONFIG_IDXD=y 00:08:07.431 04:09:57 -- common/build_config.sh@11 -- # CONFIG_NVME_CUSE=y 00:08:07.431 04:09:57 -- common/build_config.sh@12 -- # CONFIG_SMA=n 00:08:07.431 04:09:57 -- common/build_config.sh@13 -- # CONFIG_VTUNE=n 00:08:07.431 04:09:57 -- common/build_config.sh@14 -- # CONFIG_TSAN=n 00:08:07.431 04:09:57 -- common/build_config.sh@15 -- # CONFIG_RDMA_SEND_WITH_INVAL=y 00:08:07.431 04:09:57 -- common/build_config.sh@16 -- # CONFIG_VFIO_USER_DIR= 00:08:07.431 04:09:57 -- common/build_config.sh@17 -- # CONFIG_PGO_CAPTURE=n 00:08:07.431 04:09:57 -- common/build_config.sh@18 -- # CONFIG_HAVE_UUID_GENERATE_SHA1=y 00:08:07.431 04:09:57 -- common/build_config.sh@19 -- # CONFIG_ENV=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:07.431 04:09:57 -- common/build_config.sh@20 -- # CONFIG_LTO=n 00:08:07.431 04:09:57 -- common/build_config.sh@21 -- # CONFIG_ISCSI_INITIATOR=y 00:08:07.431 04:09:57 -- common/build_config.sh@22 -- # CONFIG_CET=n 00:08:07.431 04:09:57 -- common/build_config.sh@23 -- # CONFIG_VBDEV_COMPRESS_MLX5=n 00:08:07.431 04:09:57 -- common/build_config.sh@24 -- # CONFIG_OCF_PATH= 00:08:07.431 04:09:57 -- common/build_config.sh@25 -- # CONFIG_RDMA_SET_TOS=y 00:08:07.431 04:09:57 -- common/build_config.sh@26 -- # CONFIG_HAVE_ARC4RANDOM=y 00:08:07.431 04:09:57 -- common/build_config.sh@27 -- # CONFIG_HAVE_LIBARCHIVE=n 00:08:07.431 04:09:57 -- common/build_config.sh@28 -- # CONFIG_UBLK=y 00:08:07.431 04:09:57 -- common/build_config.sh@29 -- # CONFIG_ISAL_CRYPTO=y 00:08:07.431 04:09:57 -- common/build_config.sh@30 -- # CONFIG_OPENSSL_PATH= 00:08:07.431 04:09:57 -- common/build_config.sh@31 -- # CONFIG_OCF=n 00:08:07.431 04:09:57 -- common/build_config.sh@32 -- # CONFIG_FUSE=n 00:08:07.431 04:09:57 -- common/build_config.sh@33 -- # CONFIG_VTUNE_DIR= 00:08:07.431 04:09:57 -- common/build_config.sh@34 -- # CONFIG_FUZZER_LIB= 00:08:07.431 04:09:57 -- common/build_config.sh@35 -- # CONFIG_FUZZER=n 00:08:07.431 04:09:57 -- common/build_config.sh@36 -- # CONFIG_DPDK_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:07.431 04:09:57 -- common/build_config.sh@37 -- # CONFIG_CRYPTO=n 00:08:07.431 04:09:57 -- common/build_config.sh@38 -- # CONFIG_PGO_USE=n 00:08:07.431 04:09:57 -- common/build_config.sh@39 -- # CONFIG_VHOST=y 00:08:07.431 04:09:57 -- common/build_config.sh@40 -- # CONFIG_DAOS=n 00:08:07.431 04:09:57 -- common/build_config.sh@41 -- # CONFIG_DPDK_INC_DIR=//var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:07.431 04:09:57 -- common/build_config.sh@42 -- # CONFIG_DAOS_DIR= 00:08:07.431 04:09:57 -- common/build_config.sh@43 -- # CONFIG_UNIT_TESTS=n 00:08:07.431 04:09:57 -- common/build_config.sh@44 -- # CONFIG_RDMA_SET_ACK_TIMEOUT=y 00:08:07.431 04:09:57 -- common/build_config.sh@45 -- # CONFIG_VIRTIO=y 00:08:07.431 04:09:57 -- common/build_config.sh@46 -- # CONFIG_COVERAGE=y 00:08:07.431 04:09:57 -- common/build_config.sh@47 -- # CONFIG_RDMA=y 00:08:07.431 04:09:57 -- common/build_config.sh@48 -- # CONFIG_FIO_SOURCE_DIR=/usr/src/fio 00:08:07.431 04:09:57 -- common/build_config.sh@49 -- # CONFIG_URING_PATH= 00:08:07.431 04:09:57 -- common/build_config.sh@50 -- # CONFIG_XNVME=n 00:08:07.431 04:09:57 -- common/build_config.sh@51 -- # CONFIG_VFIO_USER=y 00:08:07.431 04:09:57 -- common/build_config.sh@52 -- # CONFIG_ARCH=native 00:08:07.431 04:09:57 -- common/build_config.sh@53 -- # CONFIG_URING_ZNS=n 00:08:07.431 04:09:57 -- common/build_config.sh@54 -- # CONFIG_WERROR=y 00:08:07.431 04:09:57 -- common/build_config.sh@55 -- # CONFIG_HAVE_LIBBSD=n 00:08:07.431 04:09:57 -- common/build_config.sh@56 -- # CONFIG_UBSAN=y 00:08:07.431 04:09:57 -- common/build_config.sh@57 -- # CONFIG_IPSEC_MB_DIR= 00:08:07.431 04:09:57 -- common/build_config.sh@58 -- # CONFIG_GOLANG=n 00:08:07.431 04:09:57 -- common/build_config.sh@59 -- # CONFIG_ISAL=y 00:08:07.431 04:09:57 -- common/build_config.sh@60 -- # CONFIG_IDXD_KERNEL=y 00:08:07.431 04:09:57 -- common/build_config.sh@61 -- # CONFIG_DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:07.431 04:09:57 -- common/build_config.sh@62 -- # CONFIG_RDMA_PROV=verbs 00:08:07.431 04:09:57 -- common/build_config.sh@63 -- # CONFIG_APPS=y 00:08:07.431 04:09:57 -- common/build_config.sh@64 -- # CONFIG_SHARED=y 00:08:07.431 04:09:57 -- common/build_config.sh@65 -- # CONFIG_FC_PATH= 00:08:07.431 04:09:57 -- common/build_config.sh@66 -- # CONFIG_DPDK_PKG_CONFIG=n 00:08:07.431 04:09:57 -- common/build_config.sh@67 -- # CONFIG_FC=n 00:08:07.431 04:09:57 -- common/build_config.sh@68 -- # CONFIG_AVAHI=n 00:08:07.431 04:09:57 -- common/build_config.sh@69 -- # CONFIG_FIO_PLUGIN=y 00:08:07.431 04:09:57 -- common/build_config.sh@70 -- # CONFIG_RAID5F=n 00:08:07.431 04:09:57 -- common/build_config.sh@71 -- # CONFIG_EXAMPLES=y 00:08:07.431 04:09:57 -- common/build_config.sh@72 -- # CONFIG_TESTS=y 00:08:07.431 04:09:57 -- common/build_config.sh@73 -- # CONFIG_CRYPTO_MLX5=n 00:08:07.431 04:09:57 -- common/build_config.sh@74 -- # CONFIG_MAX_LCORES= 00:08:07.431 04:09:57 -- common/build_config.sh@75 -- # CONFIG_IPSEC_MB=n 00:08:07.431 04:09:57 -- common/build_config.sh@76 -- # CONFIG_DEBUG=y 00:08:07.431 04:09:57 -- common/build_config.sh@77 -- # CONFIG_DPDK_COMPRESSDEV=n 00:08:07.431 04:09:57 -- common/build_config.sh@78 -- # CONFIG_CROSS_PREFIX= 00:08:07.431 04:09:57 -- common/build_config.sh@79 -- # CONFIG_URING=n 00:08:07.431 04:09:57 -- common/autotest_common.sh@48 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:07.431 04:09:57 -- common/applications.sh@8 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/applications.sh 00:08:07.431 04:09:57 -- common/applications.sh@8 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:07.431 04:09:57 -- common/applications.sh@8 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common 00:08:07.431 04:09:57 -- common/applications.sh@9 -- # _root=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:07.431 04:09:57 -- common/applications.sh@10 -- # _app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:07.431 04:09:57 -- common/applications.sh@11 -- # _test_app_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app 00:08:07.431 04:09:57 -- common/applications.sh@12 -- # _examples_dir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:07.431 04:09:57 -- common/applications.sh@14 -- # VHOST_FUZZ_APP=("$_test_app_dir/fuzz/vhost_fuzz/vhost_fuzz") 00:08:07.431 04:09:57 -- common/applications.sh@15 -- # ISCSI_APP=("$_app_dir/iscsi_tgt") 00:08:07.431 04:09:57 -- common/applications.sh@16 -- # NVMF_APP=("$_app_dir/nvmf_tgt") 00:08:07.431 04:09:57 -- common/applications.sh@17 -- # VHOST_APP=("$_app_dir/vhost") 00:08:07.431 04:09:57 -- common/applications.sh@18 -- # DD_APP=("$_app_dir/spdk_dd") 00:08:07.431 04:09:57 -- common/applications.sh@19 -- # SPDK_APP=("$_app_dir/spdk_tgt") 00:08:07.431 04:09:57 -- common/applications.sh@22 -- # [[ -e /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk/config.h ]] 00:08:07.431 04:09:57 -- common/applications.sh@23 -- # [[ #ifndef SPDK_CONFIG_H 00:08:07.431 #define SPDK_CONFIG_H 00:08:07.431 #define SPDK_CONFIG_APPS 1 00:08:07.431 #define SPDK_CONFIG_ARCH native 00:08:07.431 #undef SPDK_CONFIG_ASAN 00:08:07.431 #undef SPDK_CONFIG_AVAHI 00:08:07.431 #undef SPDK_CONFIG_CET 00:08:07.431 #define SPDK_CONFIG_COVERAGE 1 00:08:07.431 #define SPDK_CONFIG_CROSS_PREFIX 00:08:07.431 #undef SPDK_CONFIG_CRYPTO 00:08:07.431 #undef SPDK_CONFIG_CRYPTO_MLX5 00:08:07.431 #undef SPDK_CONFIG_CUSTOMOCF 00:08:07.431 #undef SPDK_CONFIG_DAOS 00:08:07.431 #define SPDK_CONFIG_DAOS_DIR 00:08:07.431 #define SPDK_CONFIG_DEBUG 1 00:08:07.431 #undef SPDK_CONFIG_DPDK_COMPRESSDEV 00:08:07.431 #define SPDK_CONFIG_DPDK_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:07.431 #define SPDK_CONFIG_DPDK_INC_DIR //var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/include 00:08:07.431 #define SPDK_CONFIG_DPDK_LIB_DIR /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:07.431 #undef SPDK_CONFIG_DPDK_PKG_CONFIG 00:08:07.431 #define SPDK_CONFIG_ENV /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/lib/env_dpdk 00:08:07.431 #define SPDK_CONFIG_EXAMPLES 1 00:08:07.431 #undef SPDK_CONFIG_FC 00:08:07.431 #define SPDK_CONFIG_FC_PATH 00:08:07.431 #define SPDK_CONFIG_FIO_PLUGIN 1 00:08:07.431 #define SPDK_CONFIG_FIO_SOURCE_DIR /usr/src/fio 00:08:07.431 #undef SPDK_CONFIG_FUSE 00:08:07.431 #undef SPDK_CONFIG_FUZZER 00:08:07.431 #define SPDK_CONFIG_FUZZER_LIB 00:08:07.431 #undef SPDK_CONFIG_GOLANG 00:08:07.431 #define SPDK_CONFIG_HAVE_ARC4RANDOM 1 00:08:07.431 #define SPDK_CONFIG_HAVE_EXECINFO_H 1 00:08:07.431 #undef SPDK_CONFIG_HAVE_LIBARCHIVE 00:08:07.431 #undef SPDK_CONFIG_HAVE_LIBBSD 00:08:07.431 #define SPDK_CONFIG_HAVE_UUID_GENERATE_SHA1 1 00:08:07.431 #define SPDK_CONFIG_IDXD 1 00:08:07.431 #define SPDK_CONFIG_IDXD_KERNEL 1 00:08:07.431 #undef SPDK_CONFIG_IPSEC_MB 00:08:07.431 #define SPDK_CONFIG_IPSEC_MB_DIR 00:08:07.431 #define SPDK_CONFIG_ISAL 1 00:08:07.431 #define SPDK_CONFIG_ISAL_CRYPTO 1 00:08:07.431 #define SPDK_CONFIG_ISCSI_INITIATOR 1 00:08:07.431 #define SPDK_CONFIG_LIBDIR 00:08:07.431 #undef SPDK_CONFIG_LTO 00:08:07.431 #define SPDK_CONFIG_MAX_LCORES 00:08:07.431 #define SPDK_CONFIG_NVME_CUSE 1 00:08:07.431 #undef SPDK_CONFIG_OCF 00:08:07.431 #define SPDK_CONFIG_OCF_PATH 00:08:07.431 #define SPDK_CONFIG_OPENSSL_PATH 00:08:07.431 #undef SPDK_CONFIG_PGO_CAPTURE 00:08:07.431 #undef SPDK_CONFIG_PGO_USE 00:08:07.431 #define SPDK_CONFIG_PREFIX /usr/local 00:08:07.431 #undef SPDK_CONFIG_RAID5F 00:08:07.431 #undef SPDK_CONFIG_RBD 00:08:07.431 #define SPDK_CONFIG_RDMA 1 00:08:07.431 #define SPDK_CONFIG_RDMA_PROV verbs 00:08:07.431 #define SPDK_CONFIG_RDMA_SEND_WITH_INVAL 1 00:08:07.431 #define SPDK_CONFIG_RDMA_SET_ACK_TIMEOUT 1 00:08:07.431 #define SPDK_CONFIG_RDMA_SET_TOS 1 00:08:07.431 #define SPDK_CONFIG_SHARED 1 00:08:07.431 #undef SPDK_CONFIG_SMA 00:08:07.431 #define SPDK_CONFIG_TESTS 1 00:08:07.431 #undef SPDK_CONFIG_TSAN 00:08:07.431 #define SPDK_CONFIG_UBLK 1 00:08:07.431 #define SPDK_CONFIG_UBSAN 1 00:08:07.431 #undef SPDK_CONFIG_UNIT_TESTS 00:08:07.431 #undef SPDK_CONFIG_URING 00:08:07.431 #define SPDK_CONFIG_URING_PATH 00:08:07.431 #undef SPDK_CONFIG_URING_ZNS 00:08:07.431 #undef SPDK_CONFIG_USDT 00:08:07.431 #undef SPDK_CONFIG_VBDEV_COMPRESS 00:08:07.431 #undef SPDK_CONFIG_VBDEV_COMPRESS_MLX5 00:08:07.431 #define SPDK_CONFIG_VFIO_USER 1 00:08:07.431 #define SPDK_CONFIG_VFIO_USER_DIR 00:08:07.431 #define SPDK_CONFIG_VHOST 1 00:08:07.431 #define SPDK_CONFIG_VIRTIO 1 00:08:07.431 #undef SPDK_CONFIG_VTUNE 00:08:07.431 #define SPDK_CONFIG_VTUNE_DIR 00:08:07.431 #define SPDK_CONFIG_WERROR 1 00:08:07.431 #define SPDK_CONFIG_WPDK_DIR 00:08:07.431 #undef SPDK_CONFIG_XNVME 00:08:07.431 #endif /* SPDK_CONFIG_H */ == *\#\d\e\f\i\n\e\ \S\P\D\K\_\C\O\N\F\I\G\_\D\E\B\U\G* ]] 00:08:07.431 04:09:57 -- common/applications.sh@24 -- # (( SPDK_AUTOTEST_DEBUG_APPS )) 00:08:07.431 04:09:57 -- common/autotest_common.sh@49 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:07.431 04:09:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:07.431 04:09:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:07.431 04:09:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:07.431 04:09:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:07.431 04:09:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:07.431 04:09:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:07.431 04:09:57 -- paths/export.sh@5 -- # export PATH 00:08:07.431 04:09:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:07.431 04:09:57 -- common/autotest_common.sh@50 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:07.431 04:09:57 -- pm/common@6 -- # dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/common 00:08:07.431 04:09:57 -- pm/common@6 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:07.431 04:09:57 -- pm/common@6 -- # _pmdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm 00:08:07.431 04:09:57 -- pm/common@7 -- # readlink -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/pm/../../../ 00:08:07.431 04:09:57 -- pm/common@7 -- # _pmrootdir=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:08:07.431 04:09:57 -- pm/common@16 -- # TEST_TAG=N/A 00:08:07.431 04:09:57 -- pm/common@17 -- # TEST_TAG_FILE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/.run_test_name 00:08:07.431 04:09:58 -- common/autotest_common.sh@52 -- # : 1 00:08:07.431 04:09:58 -- common/autotest_common.sh@53 -- # export RUN_NIGHTLY 00:08:07.431 04:09:58 -- common/autotest_common.sh@56 -- # : 0 00:08:07.431 04:09:58 -- common/autotest_common.sh@57 -- # export SPDK_AUTOTEST_DEBUG_APPS 00:08:07.431 04:09:58 -- common/autotest_common.sh@58 -- # : 0 00:08:07.431 04:09:58 -- common/autotest_common.sh@59 -- # export SPDK_RUN_VALGRIND 00:08:07.431 04:09:58 -- common/autotest_common.sh@60 -- # : 1 00:08:07.431 04:09:58 -- common/autotest_common.sh@61 -- # export SPDK_RUN_FUNCTIONAL_TEST 00:08:07.431 04:09:58 -- common/autotest_common.sh@62 -- # : 0 00:08:07.431 04:09:58 -- common/autotest_common.sh@63 -- # export SPDK_TEST_UNITTEST 00:08:07.431 04:09:58 -- common/autotest_common.sh@64 -- # : 00:08:07.431 04:09:58 -- common/autotest_common.sh@65 -- # export SPDK_TEST_AUTOBUILD 00:08:07.431 04:09:58 -- common/autotest_common.sh@66 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@67 -- # export SPDK_TEST_RELEASE_BUILD 00:08:07.432 04:09:58 -- common/autotest_common.sh@68 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@69 -- # export SPDK_TEST_ISAL 00:08:07.432 04:09:58 -- common/autotest_common.sh@70 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@71 -- # export SPDK_TEST_ISCSI 00:08:07.432 04:09:58 -- common/autotest_common.sh@72 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@73 -- # export SPDK_TEST_ISCSI_INITIATOR 00:08:07.432 04:09:58 -- common/autotest_common.sh@74 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@75 -- # export SPDK_TEST_NVME 00:08:07.432 04:09:58 -- common/autotest_common.sh@76 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@77 -- # export SPDK_TEST_NVME_PMR 00:08:07.432 04:09:58 -- common/autotest_common.sh@78 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@79 -- # export SPDK_TEST_NVME_BP 00:08:07.432 04:09:58 -- common/autotest_common.sh@80 -- # : 1 00:08:07.432 04:09:58 -- common/autotest_common.sh@81 -- # export SPDK_TEST_NVME_CLI 00:08:07.432 04:09:58 -- common/autotest_common.sh@82 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@83 -- # export SPDK_TEST_NVME_CUSE 00:08:07.432 04:09:58 -- common/autotest_common.sh@84 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@85 -- # export SPDK_TEST_NVME_FDP 00:08:07.432 04:09:58 -- common/autotest_common.sh@86 -- # : 1 00:08:07.432 04:09:58 -- common/autotest_common.sh@87 -- # export SPDK_TEST_NVMF 00:08:07.432 04:09:58 -- common/autotest_common.sh@88 -- # : 1 00:08:07.432 04:09:58 -- common/autotest_common.sh@89 -- # export SPDK_TEST_VFIOUSER 00:08:07.432 04:09:58 -- common/autotest_common.sh@90 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@91 -- # export SPDK_TEST_VFIOUSER_QEMU 00:08:07.432 04:09:58 -- common/autotest_common.sh@92 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@93 -- # export SPDK_TEST_FUZZER 00:08:07.432 04:09:58 -- common/autotest_common.sh@94 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@95 -- # export SPDK_TEST_FUZZER_SHORT 00:08:07.432 04:09:58 -- common/autotest_common.sh@96 -- # : tcp 00:08:07.432 04:09:58 -- common/autotest_common.sh@97 -- # export SPDK_TEST_NVMF_TRANSPORT 00:08:07.432 04:09:58 -- common/autotest_common.sh@98 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@99 -- # export SPDK_TEST_RBD 00:08:07.432 04:09:58 -- common/autotest_common.sh@100 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@101 -- # export SPDK_TEST_VHOST 00:08:07.432 04:09:58 -- common/autotest_common.sh@102 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@103 -- # export SPDK_TEST_BLOCKDEV 00:08:07.432 04:09:58 -- common/autotest_common.sh@104 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@105 -- # export SPDK_TEST_IOAT 00:08:07.432 04:09:58 -- common/autotest_common.sh@106 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@107 -- # export SPDK_TEST_BLOBFS 00:08:07.432 04:09:58 -- common/autotest_common.sh@108 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@109 -- # export SPDK_TEST_VHOST_INIT 00:08:07.432 04:09:58 -- common/autotest_common.sh@110 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@111 -- # export SPDK_TEST_LVOL 00:08:07.432 04:09:58 -- common/autotest_common.sh@112 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@113 -- # export SPDK_TEST_VBDEV_COMPRESS 00:08:07.432 04:09:58 -- common/autotest_common.sh@114 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@115 -- # export SPDK_RUN_ASAN 00:08:07.432 04:09:58 -- common/autotest_common.sh@116 -- # : 1 00:08:07.432 04:09:58 -- common/autotest_common.sh@117 -- # export SPDK_RUN_UBSAN 00:08:07.432 04:09:58 -- common/autotest_common.sh@118 -- # : /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:08:07.432 04:09:58 -- common/autotest_common.sh@119 -- # export SPDK_RUN_EXTERNAL_DPDK 00:08:07.432 04:09:58 -- common/autotest_common.sh@120 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@121 -- # export SPDK_RUN_NON_ROOT 00:08:07.432 04:09:58 -- common/autotest_common.sh@122 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@123 -- # export SPDK_TEST_CRYPTO 00:08:07.432 04:09:58 -- common/autotest_common.sh@124 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@125 -- # export SPDK_TEST_FTL 00:08:07.432 04:09:58 -- common/autotest_common.sh@126 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@127 -- # export SPDK_TEST_OCF 00:08:07.432 04:09:58 -- common/autotest_common.sh@128 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@129 -- # export SPDK_TEST_VMD 00:08:07.432 04:09:58 -- common/autotest_common.sh@130 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@131 -- # export SPDK_TEST_OPAL 00:08:07.432 04:09:58 -- common/autotest_common.sh@132 -- # : v23.11 00:08:07.432 04:09:58 -- common/autotest_common.sh@133 -- # export SPDK_TEST_NATIVE_DPDK 00:08:07.432 04:09:58 -- common/autotest_common.sh@134 -- # : true 00:08:07.432 04:09:58 -- common/autotest_common.sh@135 -- # export SPDK_AUTOTEST_X 00:08:07.432 04:09:58 -- common/autotest_common.sh@136 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@137 -- # export SPDK_TEST_RAID5 00:08:07.432 04:09:58 -- common/autotest_common.sh@138 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@139 -- # export SPDK_TEST_URING 00:08:07.432 04:09:58 -- common/autotest_common.sh@140 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@141 -- # export SPDK_TEST_USDT 00:08:07.432 04:09:58 -- common/autotest_common.sh@142 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@143 -- # export SPDK_TEST_USE_IGB_UIO 00:08:07.432 04:09:58 -- common/autotest_common.sh@144 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@145 -- # export SPDK_TEST_SCHEDULER 00:08:07.432 04:09:58 -- common/autotest_common.sh@146 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@147 -- # export SPDK_TEST_SCANBUILD 00:08:07.432 04:09:58 -- common/autotest_common.sh@148 -- # : e810 00:08:07.432 04:09:58 -- common/autotest_common.sh@149 -- # export SPDK_TEST_NVMF_NICS 00:08:07.432 04:09:58 -- common/autotest_common.sh@150 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@151 -- # export SPDK_TEST_SMA 00:08:07.432 04:09:58 -- common/autotest_common.sh@152 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@153 -- # export SPDK_TEST_DAOS 00:08:07.432 04:09:58 -- common/autotest_common.sh@154 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@155 -- # export SPDK_TEST_XNVME 00:08:07.432 04:09:58 -- common/autotest_common.sh@156 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@157 -- # export SPDK_TEST_ACCEL_DSA 00:08:07.432 04:09:58 -- common/autotest_common.sh@158 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@159 -- # export SPDK_TEST_ACCEL_IAA 00:08:07.432 04:09:58 -- common/autotest_common.sh@160 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@161 -- # export SPDK_TEST_ACCEL_IOAT 00:08:07.432 04:09:58 -- common/autotest_common.sh@163 -- # : 00:08:07.432 04:09:58 -- common/autotest_common.sh@164 -- # export SPDK_TEST_FUZZER_TARGET 00:08:07.432 04:09:58 -- common/autotest_common.sh@165 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@166 -- # export SPDK_TEST_NVMF_MDNS 00:08:07.432 04:09:58 -- common/autotest_common.sh@167 -- # : 0 00:08:07.432 04:09:58 -- common/autotest_common.sh@168 -- # export SPDK_JSONRPC_GO_CLIENT 00:08:07.432 04:09:58 -- common/autotest_common.sh@171 -- # export SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:07.432 04:09:58 -- common/autotest_common.sh@171 -- # SPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib 00:08:07.432 04:09:58 -- common/autotest_common.sh@172 -- # export DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:07.432 04:09:58 -- common/autotest_common.sh@172 -- # DPDK_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib 00:08:07.432 04:09:58 -- common/autotest_common.sh@173 -- # export VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:07.432 04:09:58 -- common/autotest_common.sh@173 -- # VFIO_LIB_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:07.432 04:09:58 -- common/autotest_common.sh@174 -- # export LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:07.432 04:09:58 -- common/autotest_common.sh@174 -- # LD_LIBRARY_PATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build/lib:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/libvfio-user/usr/local/lib 00:08:07.432 04:09:58 -- common/autotest_common.sh@177 -- # export PCI_BLOCK_SYNC_ON_RESET=yes 00:08:07.432 04:09:58 -- common/autotest_common.sh@177 -- # PCI_BLOCK_SYNC_ON_RESET=yes 00:08:07.432 04:09:58 -- common/autotest_common.sh@181 -- # export PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:07.432 04:09:58 -- common/autotest_common.sh@181 -- # PYTHONPATH=:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/rpc_plugins:/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/python 00:08:07.432 04:09:58 -- common/autotest_common.sh@185 -- # export PYTHONDONTWRITEBYTECODE=1 00:08:07.432 04:09:58 -- common/autotest_common.sh@185 -- # PYTHONDONTWRITEBYTECODE=1 00:08:07.432 04:09:58 -- common/autotest_common.sh@189 -- # export ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:07.432 04:09:58 -- common/autotest_common.sh@189 -- # ASAN_OPTIONS=new_delete_type_mismatch=0:disable_coredump=0:abort_on_error=1:use_sigaltstack=0 00:08:07.432 04:09:58 -- common/autotest_common.sh@190 -- # export UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:07.432 04:09:58 -- common/autotest_common.sh@190 -- # UBSAN_OPTIONS=halt_on_error=1:print_stacktrace=1:abort_on_error=1:disable_coredump=0:exitcode=134 00:08:07.432 04:09:58 -- common/autotest_common.sh@194 -- # asan_suppression_file=/var/tmp/asan_suppression_file 00:08:07.432 04:09:58 -- common/autotest_common.sh@195 -- # rm -rf /var/tmp/asan_suppression_file 00:08:07.432 04:09:58 -- common/autotest_common.sh@196 -- # cat 00:08:07.432 04:09:58 -- common/autotest_common.sh@222 -- # echo leak:libfuse3.so 00:08:07.432 04:09:58 -- common/autotest_common.sh@224 -- # export LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:07.432 04:09:58 -- common/autotest_common.sh@224 -- # LSAN_OPTIONS=suppressions=/var/tmp/asan_suppression_file 00:08:07.432 04:09:58 -- common/autotest_common.sh@226 -- # export DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:07.432 04:09:58 -- common/autotest_common.sh@226 -- # DEFAULT_RPC_ADDR=/var/tmp/spdk.sock 00:08:07.432 04:09:58 -- common/autotest_common.sh@228 -- # '[' -z /var/spdk/dependencies ']' 00:08:07.432 04:09:58 -- common/autotest_common.sh@231 -- # export DEPENDENCY_DIR 00:08:07.432 04:09:58 -- common/autotest_common.sh@235 -- # export SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:07.432 04:09:58 -- common/autotest_common.sh@235 -- # SPDK_BIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin 00:08:07.432 04:09:58 -- common/autotest_common.sh@236 -- # export SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:07.432 04:09:58 -- common/autotest_common.sh@236 -- # SPDK_EXAMPLE_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples 00:08:07.432 04:09:58 -- common/autotest_common.sh@239 -- # export QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:07.432 04:09:58 -- common/autotest_common.sh@239 -- # QEMU_BIN=/usr/local/qemu/vanilla-latest/bin/qemu-system-x86_64 00:08:07.432 04:09:58 -- common/autotest_common.sh@240 -- # export VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:07.432 04:09:58 -- common/autotest_common.sh@240 -- # VFIO_QEMU_BIN=/usr/local/qemu/vfio-user-latest/bin/qemu-system-x86_64 00:08:07.432 04:09:58 -- common/autotest_common.sh@242 -- # export AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:07.432 04:09:58 -- common/autotest_common.sh@242 -- # AR_TOOL=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/ar-xnvme-fixer 00:08:07.432 04:09:58 -- common/autotest_common.sh@245 -- # export UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:07.432 04:09:58 -- common/autotest_common.sh@245 -- # UNBIND_ENTIRE_IOMMU_GROUP=yes 00:08:07.432 04:09:58 -- common/autotest_common.sh@247 -- # _LCOV_MAIN=0 00:08:07.432 04:09:58 -- common/autotest_common.sh@248 -- # _LCOV_LLVM=1 00:08:07.432 04:09:58 -- common/autotest_common.sh@249 -- # _LCOV= 00:08:07.432 04:09:58 -- common/autotest_common.sh@250 -- # [[ '' == *clang* ]] 00:08:07.432 04:09:58 -- common/autotest_common.sh@250 -- # [[ 0 -eq 1 ]] 00:08:07.432 04:09:58 -- common/autotest_common.sh@252 -- # _lcov_opt[_LCOV_LLVM]='--gcov-tool /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/fuzz/llvm/llvm-gcov.sh' 00:08:07.432 04:09:58 -- common/autotest_common.sh@253 -- # _lcov_opt[_LCOV_MAIN]= 00:08:07.432 04:09:58 -- common/autotest_common.sh@255 -- # lcov_opt= 00:08:07.432 04:09:58 -- common/autotest_common.sh@258 -- # '[' 0 -eq 0 ']' 00:08:07.432 04:09:58 -- common/autotest_common.sh@259 -- # export valgrind= 00:08:07.432 04:09:58 -- common/autotest_common.sh@259 -- # valgrind= 00:08:07.432 04:09:58 -- common/autotest_common.sh@265 -- # uname -s 00:08:07.432 04:09:58 -- common/autotest_common.sh@265 -- # '[' Linux = Linux ']' 00:08:07.432 04:09:58 -- common/autotest_common.sh@266 -- # HUGEMEM=4096 00:08:07.432 04:09:58 -- common/autotest_common.sh@267 -- # export CLEAR_HUGE=yes 00:08:07.432 04:09:58 -- common/autotest_common.sh@267 -- # CLEAR_HUGE=yes 00:08:07.432 04:09:58 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:07.432 04:09:58 -- common/autotest_common.sh@268 -- # [[ 0 -eq 1 ]] 00:08:07.432 04:09:58 -- common/autotest_common.sh@275 -- # MAKE=make 00:08:07.432 04:09:58 -- common/autotest_common.sh@276 -- # MAKEFLAGS=-j48 00:08:07.432 04:09:58 -- common/autotest_common.sh@292 -- # export HUGEMEM=4096 00:08:07.432 04:09:58 -- common/autotest_common.sh@292 -- # HUGEMEM=4096 00:08:07.432 04:09:58 -- common/autotest_common.sh@294 -- # '[' -z /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output ']' 00:08:07.432 04:09:58 -- common/autotest_common.sh@299 -- # NO_HUGE=() 00:08:07.432 04:09:58 -- common/autotest_common.sh@300 -- # TEST_MODE= 00:08:07.432 04:09:58 -- common/autotest_common.sh@301 -- # for i in "$@" 00:08:07.432 04:09:58 -- common/autotest_common.sh@302 -- # case "$i" in 00:08:07.432 04:09:58 -- common/autotest_common.sh@307 -- # TEST_TRANSPORT=tcp 00:08:07.432 04:09:58 -- common/autotest_common.sh@319 -- # [[ -z 2259241 ]] 00:08:07.432 04:09:58 -- common/autotest_common.sh@319 -- # kill -0 2259241 00:08:07.432 04:09:58 -- common/autotest_common.sh@1675 -- # set_test_storage 2147483648 00:08:07.432 04:09:58 -- common/autotest_common.sh@329 -- # [[ -v testdir ]] 00:08:07.432 04:09:58 -- common/autotest_common.sh@331 -- # local requested_size=2147483648 00:08:07.432 04:09:58 -- common/autotest_common.sh@332 -- # local mount target_dir 00:08:07.432 04:09:58 -- common/autotest_common.sh@334 -- # local -A mounts fss sizes avails uses 00:08:07.432 04:09:58 -- common/autotest_common.sh@335 -- # local source fs size avail mount use 00:08:07.432 04:09:58 -- common/autotest_common.sh@337 -- # local storage_fallback storage_candidates 00:08:07.432 04:09:58 -- common/autotest_common.sh@339 -- # mktemp -udt spdk.XXXXXX 00:08:07.432 04:09:58 -- common/autotest_common.sh@339 -- # storage_fallback=/tmp/spdk.CAK7aJ 00:08:07.432 04:09:58 -- common/autotest_common.sh@344 -- # storage_candidates=("$testdir" "$storage_fallback/tests/${testdir##*/}" "$storage_fallback") 00:08:07.432 04:09:58 -- common/autotest_common.sh@346 -- # [[ -n '' ]] 00:08:07.432 04:09:58 -- common/autotest_common.sh@351 -- # [[ -n '' ]] 00:08:07.432 04:09:58 -- common/autotest_common.sh@356 -- # mkdir -p /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target /tmp/spdk.CAK7aJ/tests/target /tmp/spdk.CAK7aJ 00:08:07.432 04:09:58 -- common/autotest_common.sh@359 -- # requested_size=2214592512 00:08:07.432 04:09:58 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:07.432 04:09:58 -- common/autotest_common.sh@328 -- # df -T 00:08:07.432 04:09:58 -- common/autotest_common.sh@328 -- # grep -v Filesystem 00:08:07.432 04:09:58 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_devtmpfs 00:08:07.432 04:09:58 -- common/autotest_common.sh@362 -- # fss["$mount"]=devtmpfs 00:08:07.432 04:09:58 -- common/autotest_common.sh@363 -- # avails["$mount"]=67108864 00:08:07.432 04:09:58 -- common/autotest_common.sh@363 -- # sizes["$mount"]=67108864 00:08:07.432 04:09:58 -- common/autotest_common.sh@364 -- # uses["$mount"]=0 00:08:07.432 04:09:58 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:07.432 04:09:58 -- common/autotest_common.sh@362 -- # mounts["$mount"]=/dev/pmem0 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # fss["$mount"]=ext2 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # avails["$mount"]=4096 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # sizes["$mount"]=5284429824 00:08:07.690 04:09:58 -- common/autotest_common.sh@364 -- # uses["$mount"]=5284425728 00:08:07.690 04:09:58 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # mounts["$mount"]=spdk_root 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # fss["$mount"]=overlay 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # avails["$mount"]=52681424896 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # sizes["$mount"]=61988528128 00:08:07.690 04:09:58 -- common/autotest_common.sh@364 -- # uses["$mount"]=9307103232 00:08:07.690 04:09:58 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # avails["$mount"]=30991671296 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:08:07.690 04:09:58 -- common/autotest_common.sh@364 -- # uses["$mount"]=2592768 00:08:07.690 04:09:58 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # avails["$mount"]=12388917248 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # sizes["$mount"]=12397707264 00:08:07.690 04:09:58 -- common/autotest_common.sh@364 -- # uses["$mount"]=8790016 00:08:07.690 04:09:58 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # avails["$mount"]=30993756160 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # sizes["$mount"]=30994264064 00:08:07.690 04:09:58 -- common/autotest_common.sh@364 -- # uses["$mount"]=507904 00:08:07.690 04:09:58 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # mounts["$mount"]=tmpfs 00:08:07.690 04:09:58 -- common/autotest_common.sh@362 -- # fss["$mount"]=tmpfs 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # avails["$mount"]=6198837248 00:08:07.690 04:09:58 -- common/autotest_common.sh@363 -- # sizes["$mount"]=6198849536 00:08:07.690 04:09:58 -- common/autotest_common.sh@364 -- # uses["$mount"]=12288 00:08:07.690 04:09:58 -- common/autotest_common.sh@361 -- # read -r source fs size use avail _ mount 00:08:07.690 04:09:58 -- common/autotest_common.sh@367 -- # printf '* Looking for test storage...\n' 00:08:07.690 * Looking for test storage... 00:08:07.690 04:09:58 -- common/autotest_common.sh@369 -- # local target_space new_size 00:08:07.690 04:09:58 -- common/autotest_common.sh@370 -- # for target_dir in "${storage_candidates[@]}" 00:08:07.690 04:09:58 -- common/autotest_common.sh@373 -- # df /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:07.690 04:09:58 -- common/autotest_common.sh@373 -- # awk '$1 !~ /Filesystem/{print $6}' 00:08:07.690 04:09:58 -- common/autotest_common.sh@373 -- # mount=/ 00:08:07.690 04:09:58 -- common/autotest_common.sh@375 -- # target_space=52681424896 00:08:07.690 04:09:58 -- common/autotest_common.sh@376 -- # (( target_space == 0 || target_space < requested_size )) 00:08:07.690 04:09:58 -- common/autotest_common.sh@379 -- # (( target_space >= requested_size )) 00:08:07.690 04:09:58 -- common/autotest_common.sh@381 -- # [[ overlay == tmpfs ]] 00:08:07.690 04:09:58 -- common/autotest_common.sh@381 -- # [[ overlay == ramfs ]] 00:08:07.690 04:09:58 -- common/autotest_common.sh@381 -- # [[ / == / ]] 00:08:07.690 04:09:58 -- common/autotest_common.sh@382 -- # new_size=11521695744 00:08:07.690 04:09:58 -- common/autotest_common.sh@383 -- # (( new_size * 100 / sizes[/] > 95 )) 00:08:07.690 04:09:58 -- common/autotest_common.sh@388 -- # export SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:07.690 04:09:58 -- common/autotest_common.sh@388 -- # SPDK_TEST_STORAGE=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:07.690 04:09:58 -- common/autotest_common.sh@389 -- # printf '* Found test storage at %s\n' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:07.690 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:07.690 04:09:58 -- common/autotest_common.sh@390 -- # return 0 00:08:07.691 04:09:58 -- common/autotest_common.sh@1677 -- # set -o errtrace 00:08:07.691 04:09:58 -- common/autotest_common.sh@1678 -- # shopt -s extdebug 00:08:07.691 04:09:58 -- common/autotest_common.sh@1679 -- # trap 'trap - ERR; print_backtrace >&2' ERR 00:08:07.691 04:09:58 -- common/autotest_common.sh@1681 -- # PS4=' \t -- ${BASH_SOURCE#${BASH_SOURCE%/*/*}/}@${LINENO} -- \$ ' 00:08:07.691 04:09:58 -- common/autotest_common.sh@1682 -- # true 00:08:07.691 04:09:58 -- common/autotest_common.sh@1684 -- # xtrace_fd 00:08:07.691 04:09:58 -- common/autotest_common.sh@25 -- # [[ -n 14 ]] 00:08:07.691 04:09:58 -- common/autotest_common.sh@25 -- # [[ -e /proc/self/fd/14 ]] 00:08:07.691 04:09:58 -- common/autotest_common.sh@27 -- # exec 00:08:07.691 04:09:58 -- common/autotest_common.sh@29 -- # exec 00:08:07.691 04:09:58 -- common/autotest_common.sh@31 -- # xtrace_restore 00:08:07.691 04:09:58 -- common/autotest_common.sh@16 -- # unset -v 'X_STACK[0 - 1 < 0 ? 0 : 0 - 1]' 00:08:07.691 04:09:58 -- common/autotest_common.sh@17 -- # (( 0 == 0 )) 00:08:07.691 04:09:58 -- common/autotest_common.sh@18 -- # set -x 00:08:07.691 04:09:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:07.691 04:09:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:07.691 04:09:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:07.691 04:09:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:07.691 04:09:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:07.691 04:09:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:07.691 04:09:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:07.691 04:09:58 -- scripts/common.sh@335 -- # IFS=.-: 00:08:07.691 04:09:58 -- scripts/common.sh@335 -- # read -ra ver1 00:08:07.691 04:09:58 -- scripts/common.sh@336 -- # IFS=.-: 00:08:07.691 04:09:58 -- scripts/common.sh@336 -- # read -ra ver2 00:08:07.691 04:09:58 -- scripts/common.sh@337 -- # local 'op=<' 00:08:07.691 04:09:58 -- scripts/common.sh@339 -- # ver1_l=2 00:08:07.691 04:09:58 -- scripts/common.sh@340 -- # ver2_l=1 00:08:07.691 04:09:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:07.691 04:09:58 -- scripts/common.sh@343 -- # case "$op" in 00:08:07.691 04:09:58 -- scripts/common.sh@344 -- # : 1 00:08:07.691 04:09:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:07.691 04:09:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:07.691 04:09:58 -- scripts/common.sh@364 -- # decimal 1 00:08:07.691 04:09:58 -- scripts/common.sh@352 -- # local d=1 00:08:07.691 04:09:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:07.691 04:09:58 -- scripts/common.sh@354 -- # echo 1 00:08:07.691 04:09:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:07.691 04:09:58 -- scripts/common.sh@365 -- # decimal 2 00:08:07.691 04:09:58 -- scripts/common.sh@352 -- # local d=2 00:08:07.691 04:09:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:07.691 04:09:58 -- scripts/common.sh@354 -- # echo 2 00:08:07.691 04:09:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:07.691 04:09:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:07.691 04:09:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:07.691 04:09:58 -- scripts/common.sh@367 -- # return 0 00:08:07.691 04:09:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:07.691 04:09:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:07.691 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:07.691 --rc genhtml_branch_coverage=1 00:08:07.691 --rc genhtml_function_coverage=1 00:08:07.691 --rc genhtml_legend=1 00:08:07.691 --rc geninfo_all_blocks=1 00:08:07.691 --rc geninfo_unexecuted_blocks=1 00:08:07.691 00:08:07.691 ' 00:08:07.691 04:09:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:07.691 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:07.691 --rc genhtml_branch_coverage=1 00:08:07.691 --rc genhtml_function_coverage=1 00:08:07.691 --rc genhtml_legend=1 00:08:07.691 --rc geninfo_all_blocks=1 00:08:07.691 --rc geninfo_unexecuted_blocks=1 00:08:07.691 00:08:07.691 ' 00:08:07.691 04:09:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:07.691 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:07.691 --rc genhtml_branch_coverage=1 00:08:07.691 --rc genhtml_function_coverage=1 00:08:07.691 --rc genhtml_legend=1 00:08:07.691 --rc geninfo_all_blocks=1 00:08:07.691 --rc geninfo_unexecuted_blocks=1 00:08:07.691 00:08:07.691 ' 00:08:07.691 04:09:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:07.691 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:07.691 --rc genhtml_branch_coverage=1 00:08:07.691 --rc genhtml_function_coverage=1 00:08:07.691 --rc genhtml_legend=1 00:08:07.691 --rc geninfo_all_blocks=1 00:08:07.691 --rc geninfo_unexecuted_blocks=1 00:08:07.691 00:08:07.691 ' 00:08:07.691 04:09:58 -- target/filesystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:07.691 04:09:58 -- nvmf/common.sh@7 -- # uname -s 00:08:07.691 04:09:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:07.691 04:09:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:07.691 04:09:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:07.691 04:09:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:07.691 04:09:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:07.691 04:09:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:07.691 04:09:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:07.691 04:09:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:07.691 04:09:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:07.691 04:09:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:07.691 04:09:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:07.691 04:09:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:07.691 04:09:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:07.691 04:09:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:07.691 04:09:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:07.691 04:09:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:07.691 04:09:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:07.691 04:09:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:07.691 04:09:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:07.691 04:09:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:07.691 04:09:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:07.691 04:09:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:07.691 04:09:58 -- paths/export.sh@5 -- # export PATH 00:08:07.691 04:09:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:07.691 04:09:58 -- nvmf/common.sh@46 -- # : 0 00:08:07.691 04:09:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:07.691 04:09:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:07.691 04:09:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:07.691 04:09:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:07.691 04:09:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:07.691 04:09:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:07.691 04:09:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:07.691 04:09:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:07.691 04:09:58 -- target/filesystem.sh@12 -- # MALLOC_BDEV_SIZE=512 00:08:07.691 04:09:58 -- target/filesystem.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:08:07.691 04:09:58 -- target/filesystem.sh@15 -- # nvmftestinit 00:08:07.691 04:09:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:07.691 04:09:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:07.691 04:09:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:07.691 04:09:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:07.691 04:09:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:07.691 04:09:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:07.691 04:09:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:07.691 04:09:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:07.691 04:09:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:07.692 04:09:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:07.692 04:09:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:07.692 04:09:58 -- common/autotest_common.sh@10 -- # set +x 00:08:10.274 04:10:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:10.274 04:10:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:10.274 04:10:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:10.274 04:10:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:10.274 04:10:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:10.274 04:10:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:10.274 04:10:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:10.274 04:10:00 -- nvmf/common.sh@294 -- # net_devs=() 00:08:10.274 04:10:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:10.274 04:10:00 -- nvmf/common.sh@295 -- # e810=() 00:08:10.274 04:10:00 -- nvmf/common.sh@295 -- # local -ga e810 00:08:10.274 04:10:00 -- nvmf/common.sh@296 -- # x722=() 00:08:10.274 04:10:00 -- nvmf/common.sh@296 -- # local -ga x722 00:08:10.274 04:10:00 -- nvmf/common.sh@297 -- # mlx=() 00:08:10.274 04:10:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:10.275 04:10:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:10.275 04:10:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:10.275 04:10:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:10.275 04:10:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:10.275 04:10:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:10.275 04:10:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:10.275 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:10.275 04:10:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:10.275 04:10:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:10.275 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:10.275 04:10:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:10.275 04:10:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:10.275 04:10:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:10.275 04:10:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:10.275 04:10:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:10.275 04:10:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:10.275 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:10.275 04:10:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:10.275 04:10:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:10.275 04:10:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:10.275 04:10:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:10.275 04:10:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:10.275 04:10:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:10.275 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:10.275 04:10:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:10.275 04:10:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:10.275 04:10:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:10.275 04:10:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:10.275 04:10:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:10.275 04:10:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:10.275 04:10:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:10.275 04:10:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:10.275 04:10:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:10.275 04:10:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:10.275 04:10:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:10.275 04:10:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:10.275 04:10:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:10.275 04:10:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:10.275 04:10:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:10.275 04:10:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:10.275 04:10:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:10.275 04:10:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:10.275 04:10:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:10.275 04:10:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:10.275 04:10:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:10.275 04:10:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:10.275 04:10:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:10.275 04:10:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:10.275 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:10.275 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.394 ms 00:08:10.275 00:08:10.275 --- 10.0.0.2 ping statistics --- 00:08:10.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:10.275 rtt min/avg/max/mdev = 0.394/0.394/0.394/0.000 ms 00:08:10.275 04:10:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:10.275 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:10.275 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:08:10.275 00:08:10.275 --- 10.0.0.1 ping statistics --- 00:08:10.275 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:10.275 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:08:10.275 04:10:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:10.275 04:10:00 -- nvmf/common.sh@410 -- # return 0 00:08:10.275 04:10:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:10.275 04:10:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:10.275 04:10:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:10.275 04:10:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:10.275 04:10:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:10.275 04:10:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:10.275 04:10:00 -- target/filesystem.sh@105 -- # run_test nvmf_filesystem_no_in_capsule nvmf_filesystem_part 0 00:08:10.275 04:10:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:10.275 04:10:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:10.275 04:10:00 -- common/autotest_common.sh@10 -- # set +x 00:08:10.275 ************************************ 00:08:10.275 START TEST nvmf_filesystem_no_in_capsule 00:08:10.275 ************************************ 00:08:10.275 04:10:00 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 0 00:08:10.275 04:10:00 -- target/filesystem.sh@47 -- # in_capsule=0 00:08:10.275 04:10:00 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:10.275 04:10:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:10.275 04:10:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:10.275 04:10:00 -- common/autotest_common.sh@10 -- # set +x 00:08:10.275 04:10:00 -- nvmf/common.sh@469 -- # nvmfpid=2260890 00:08:10.275 04:10:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:10.275 04:10:00 -- nvmf/common.sh@470 -- # waitforlisten 2260890 00:08:10.275 04:10:00 -- common/autotest_common.sh@829 -- # '[' -z 2260890 ']' 00:08:10.275 04:10:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:10.275 04:10:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:10.275 04:10:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:10.275 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:10.275 04:10:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:10.275 04:10:00 -- common/autotest_common.sh@10 -- # set +x 00:08:10.275 [2024-11-30 04:10:00.565382] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:10.275 [2024-11-30 04:10:00.565467] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:10.275 EAL: No free 2048 kB hugepages reported on node 1 00:08:10.275 [2024-11-30 04:10:00.641049] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:10.275 [2024-11-30 04:10:00.734936] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:10.275 [2024-11-30 04:10:00.735116] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:10.275 [2024-11-30 04:10:00.735133] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:10.275 [2024-11-30 04:10:00.735145] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:10.275 [2024-11-30 04:10:00.735197] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:10.275 [2024-11-30 04:10:00.735224] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:10.275 [2024-11-30 04:10:00.735282] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:10.275 [2024-11-30 04:10:00.735285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:11.206 04:10:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:11.206 04:10:01 -- common/autotest_common.sh@862 -- # return 0 00:08:11.206 04:10:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:11.206 04:10:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:11.206 04:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:11.206 04:10:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:11.206 04:10:01 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:11.206 04:10:01 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:08:11.206 04:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.206 04:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:11.206 [2024-11-30 04:10:01.638821] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:11.206 04:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.206 04:10:01 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:11.206 04:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.206 04:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:11.206 Malloc1 00:08:11.206 04:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.206 04:10:01 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:11.206 04:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.206 04:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:11.206 04:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.206 04:10:01 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:11.206 04:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.206 04:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:11.206 04:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.206 04:10:01 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:11.206 04:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.206 04:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:11.206 [2024-11-30 04:10:01.822767] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:11.206 04:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.206 04:10:01 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:11.206 04:10:01 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:11.206 04:10:01 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:11.206 04:10:01 -- common/autotest_common.sh@1369 -- # local bs 00:08:11.206 04:10:01 -- common/autotest_common.sh@1370 -- # local nb 00:08:11.206 04:10:01 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:11.206 04:10:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:11.206 04:10:01 -- common/autotest_common.sh@10 -- # set +x 00:08:11.464 04:10:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:11.464 04:10:01 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:11.464 { 00:08:11.464 "name": "Malloc1", 00:08:11.464 "aliases": [ 00:08:11.464 "afd25849-7e6e-42b0-902f-9c03570fd0fc" 00:08:11.464 ], 00:08:11.464 "product_name": "Malloc disk", 00:08:11.464 "block_size": 512, 00:08:11.464 "num_blocks": 1048576, 00:08:11.464 "uuid": "afd25849-7e6e-42b0-902f-9c03570fd0fc", 00:08:11.464 "assigned_rate_limits": { 00:08:11.464 "rw_ios_per_sec": 0, 00:08:11.464 "rw_mbytes_per_sec": 0, 00:08:11.464 "r_mbytes_per_sec": 0, 00:08:11.464 "w_mbytes_per_sec": 0 00:08:11.464 }, 00:08:11.464 "claimed": true, 00:08:11.464 "claim_type": "exclusive_write", 00:08:11.464 "zoned": false, 00:08:11.464 "supported_io_types": { 00:08:11.464 "read": true, 00:08:11.464 "write": true, 00:08:11.464 "unmap": true, 00:08:11.464 "write_zeroes": true, 00:08:11.464 "flush": true, 00:08:11.464 "reset": true, 00:08:11.464 "compare": false, 00:08:11.464 "compare_and_write": false, 00:08:11.464 "abort": true, 00:08:11.464 "nvme_admin": false, 00:08:11.464 "nvme_io": false 00:08:11.464 }, 00:08:11.464 "memory_domains": [ 00:08:11.464 { 00:08:11.464 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:11.464 "dma_device_type": 2 00:08:11.464 } 00:08:11.464 ], 00:08:11.464 "driver_specific": {} 00:08:11.464 } 00:08:11.464 ]' 00:08:11.464 04:10:01 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:11.464 04:10:01 -- common/autotest_common.sh@1372 -- # bs=512 00:08:11.464 04:10:01 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:11.464 04:10:01 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:11.464 04:10:01 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:11.464 04:10:01 -- common/autotest_common.sh@1377 -- # echo 512 00:08:11.464 04:10:01 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:11.464 04:10:01 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:12.031 04:10:02 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:12.031 04:10:02 -- common/autotest_common.sh@1187 -- # local i=0 00:08:12.031 04:10:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:12.031 04:10:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:12.031 04:10:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:14.562 04:10:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:14.562 04:10:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:14.562 04:10:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:14.562 04:10:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:14.562 04:10:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:14.562 04:10:04 -- common/autotest_common.sh@1197 -- # return 0 00:08:14.562 04:10:04 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:14.562 04:10:04 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:14.562 04:10:04 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:14.562 04:10:04 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:14.562 04:10:04 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:14.562 04:10:04 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:14.562 04:10:04 -- setup/common.sh@80 -- # echo 536870912 00:08:14.562 04:10:04 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:14.562 04:10:04 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:14.562 04:10:04 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:14.562 04:10:04 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:14.562 04:10:05 -- target/filesystem.sh@69 -- # partprobe 00:08:15.502 04:10:05 -- target/filesystem.sh@70 -- # sleep 1 00:08:16.437 04:10:06 -- target/filesystem.sh@76 -- # '[' 0 -eq 0 ']' 00:08:16.437 04:10:06 -- target/filesystem.sh@77 -- # run_test filesystem_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:16.437 04:10:06 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:16.437 04:10:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:16.437 04:10:06 -- common/autotest_common.sh@10 -- # set +x 00:08:16.437 ************************************ 00:08:16.437 START TEST filesystem_ext4 00:08:16.437 ************************************ 00:08:16.437 04:10:06 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:16.438 04:10:06 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:16.438 04:10:06 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:16.438 04:10:06 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:16.438 04:10:06 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:16.438 04:10:06 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:16.438 04:10:06 -- common/autotest_common.sh@914 -- # local i=0 00:08:16.438 04:10:06 -- common/autotest_common.sh@915 -- # local force 00:08:16.438 04:10:06 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:16.438 04:10:06 -- common/autotest_common.sh@918 -- # force=-F 00:08:16.438 04:10:06 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:16.438 mke2fs 1.47.0 (5-Feb-2023) 00:08:16.438 Discarding device blocks: 0/522240 done 00:08:16.438 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:16.438 Filesystem UUID: 0c81d93d-04b3-4cea-bf4e-2d211942bdea 00:08:16.438 Superblock backups stored on blocks: 00:08:16.438 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:16.438 00:08:16.438 Allocating group tables: 0/64 done 00:08:16.438 Writing inode tables: 0/64 done 00:08:16.438 Creating journal (8192 blocks): done 00:08:16.438 Writing superblocks and filesystem accounting information: 0/64 done 00:08:16.438 00:08:16.438 04:10:06 -- common/autotest_common.sh@931 -- # return 0 00:08:16.438 04:10:06 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:22.998 04:10:12 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:22.998 04:10:12 -- target/filesystem.sh@25 -- # sync 00:08:22.998 04:10:12 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:22.998 04:10:12 -- target/filesystem.sh@27 -- # sync 00:08:22.998 04:10:12 -- target/filesystem.sh@29 -- # i=0 00:08:22.998 04:10:12 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:22.998 04:10:12 -- target/filesystem.sh@37 -- # kill -0 2260890 00:08:22.998 04:10:12 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:22.998 04:10:12 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:22.998 04:10:12 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:22.998 04:10:12 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:22.998 00:08:22.998 real 0m5.865s 00:08:22.998 user 0m0.021s 00:08:22.998 sys 0m0.061s 00:08:22.998 04:10:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:22.998 04:10:12 -- common/autotest_common.sh@10 -- # set +x 00:08:22.998 ************************************ 00:08:22.998 END TEST filesystem_ext4 00:08:22.998 ************************************ 00:08:22.998 04:10:12 -- target/filesystem.sh@78 -- # run_test filesystem_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:22.998 04:10:12 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:22.998 04:10:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:22.998 04:10:12 -- common/autotest_common.sh@10 -- # set +x 00:08:22.998 ************************************ 00:08:22.998 START TEST filesystem_btrfs 00:08:22.998 ************************************ 00:08:22.998 04:10:12 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:22.998 04:10:12 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:22.998 04:10:12 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:22.998 04:10:12 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:22.998 04:10:12 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:22.998 04:10:12 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:22.998 04:10:12 -- common/autotest_common.sh@914 -- # local i=0 00:08:22.998 04:10:12 -- common/autotest_common.sh@915 -- # local force 00:08:22.998 04:10:12 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:22.998 04:10:12 -- common/autotest_common.sh@920 -- # force=-f 00:08:22.998 04:10:12 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:22.998 btrfs-progs v6.8.1 00:08:22.998 See https://btrfs.readthedocs.io for more information. 00:08:22.998 00:08:22.998 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:22.998 NOTE: several default settings have changed in version 5.15, please make sure 00:08:22.998 this does not affect your deployments: 00:08:22.998 - DUP for metadata (-m dup) 00:08:22.998 - enabled no-holes (-O no-holes) 00:08:22.998 - enabled free-space-tree (-R free-space-tree) 00:08:22.998 00:08:22.998 Label: (null) 00:08:22.998 UUID: fe9191e4-dfbe-46a2-8368-3dee9a91171a 00:08:22.998 Node size: 16384 00:08:22.998 Sector size: 4096 (CPU page size: 4096) 00:08:22.998 Filesystem size: 510.00MiB 00:08:22.998 Block group profiles: 00:08:22.998 Data: single 8.00MiB 00:08:22.998 Metadata: DUP 32.00MiB 00:08:22.998 System: DUP 8.00MiB 00:08:22.998 SSD detected: yes 00:08:22.998 Zoned device: no 00:08:22.998 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:22.998 Checksum: crc32c 00:08:22.998 Number of devices: 1 00:08:22.998 Devices: 00:08:22.998 ID SIZE PATH 00:08:22.998 1 510.00MiB /dev/nvme0n1p1 00:08:22.998 00:08:22.998 04:10:12 -- common/autotest_common.sh@931 -- # return 0 00:08:22.998 04:10:12 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:23.258 04:10:13 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:23.258 04:10:13 -- target/filesystem.sh@25 -- # sync 00:08:23.258 04:10:13 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:23.258 04:10:13 -- target/filesystem.sh@27 -- # sync 00:08:23.258 04:10:13 -- target/filesystem.sh@29 -- # i=0 00:08:23.258 04:10:13 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:23.258 04:10:13 -- target/filesystem.sh@37 -- # kill -0 2260890 00:08:23.258 04:10:13 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:23.258 04:10:13 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:23.258 04:10:13 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:23.258 04:10:13 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:23.258 00:08:23.258 real 0m1.079s 00:08:23.258 user 0m0.009s 00:08:23.258 sys 0m0.111s 00:08:23.258 04:10:13 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:23.258 04:10:13 -- common/autotest_common.sh@10 -- # set +x 00:08:23.258 ************************************ 00:08:23.258 END TEST filesystem_btrfs 00:08:23.258 ************************************ 00:08:23.258 04:10:13 -- target/filesystem.sh@79 -- # run_test filesystem_xfs nvmf_filesystem_create xfs nvme0n1 00:08:23.258 04:10:13 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:23.258 04:10:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:23.258 04:10:13 -- common/autotest_common.sh@10 -- # set +x 00:08:23.258 ************************************ 00:08:23.258 START TEST filesystem_xfs 00:08:23.258 ************************************ 00:08:23.258 04:10:13 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:23.258 04:10:13 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:23.258 04:10:13 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:23.258 04:10:13 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:23.258 04:10:13 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:23.258 04:10:13 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:23.258 04:10:13 -- common/autotest_common.sh@914 -- # local i=0 00:08:23.258 04:10:13 -- common/autotest_common.sh@915 -- # local force 00:08:23.258 04:10:13 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:23.258 04:10:13 -- common/autotest_common.sh@920 -- # force=-f 00:08:23.258 04:10:13 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:23.516 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:23.516 = sectsz=512 attr=2, projid32bit=1 00:08:23.516 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:23.516 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:23.516 data = bsize=4096 blocks=130560, imaxpct=25 00:08:23.516 = sunit=0 swidth=0 blks 00:08:23.516 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:23.516 log =internal log bsize=4096 blocks=16384, version=2 00:08:23.516 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:23.516 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:24.447 Discarding blocks...Done. 00:08:24.447 04:10:15 -- common/autotest_common.sh@931 -- # return 0 00:08:24.447 04:10:15 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:27.047 04:10:17 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:27.047 04:10:17 -- target/filesystem.sh@25 -- # sync 00:08:27.047 04:10:17 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:27.047 04:10:17 -- target/filesystem.sh@27 -- # sync 00:08:27.047 04:10:17 -- target/filesystem.sh@29 -- # i=0 00:08:27.047 04:10:17 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:27.047 04:10:17 -- target/filesystem.sh@37 -- # kill -0 2260890 00:08:27.047 04:10:17 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:27.047 04:10:17 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:27.047 04:10:17 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:27.047 04:10:17 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:27.047 00:08:27.047 real 0m3.812s 00:08:27.047 user 0m0.014s 00:08:27.047 sys 0m0.067s 00:08:27.047 04:10:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:27.047 04:10:17 -- common/autotest_common.sh@10 -- # set +x 00:08:27.047 ************************************ 00:08:27.047 END TEST filesystem_xfs 00:08:27.047 ************************************ 00:08:27.047 04:10:17 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:27.305 04:10:17 -- target/filesystem.sh@93 -- # sync 00:08:27.305 04:10:17 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:27.563 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:27.563 04:10:17 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:27.563 04:10:17 -- common/autotest_common.sh@1208 -- # local i=0 00:08:27.563 04:10:17 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:27.563 04:10:17 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:27.563 04:10:17 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:27.563 04:10:17 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:27.563 04:10:17 -- common/autotest_common.sh@1220 -- # return 0 00:08:27.563 04:10:17 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:27.563 04:10:17 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:27.563 04:10:17 -- common/autotest_common.sh@10 -- # set +x 00:08:27.563 04:10:17 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:27.563 04:10:17 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:27.563 04:10:17 -- target/filesystem.sh@101 -- # killprocess 2260890 00:08:27.563 04:10:17 -- common/autotest_common.sh@936 -- # '[' -z 2260890 ']' 00:08:27.563 04:10:17 -- common/autotest_common.sh@940 -- # kill -0 2260890 00:08:27.563 04:10:17 -- common/autotest_common.sh@941 -- # uname 00:08:27.563 04:10:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:27.563 04:10:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2260890 00:08:27.563 04:10:18 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:27.563 04:10:18 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:27.563 04:10:18 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2260890' 00:08:27.563 killing process with pid 2260890 00:08:27.563 04:10:18 -- common/autotest_common.sh@955 -- # kill 2260890 00:08:27.563 04:10:18 -- common/autotest_common.sh@960 -- # wait 2260890 00:08:28.129 04:10:18 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:28.129 00:08:28.129 real 0m17.945s 00:08:28.129 user 1m9.531s 00:08:28.129 sys 0m2.263s 00:08:28.129 04:10:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:28.129 04:10:18 -- common/autotest_common.sh@10 -- # set +x 00:08:28.129 ************************************ 00:08:28.130 END TEST nvmf_filesystem_no_in_capsule 00:08:28.130 ************************************ 00:08:28.130 04:10:18 -- target/filesystem.sh@106 -- # run_test nvmf_filesystem_in_capsule nvmf_filesystem_part 4096 00:08:28.130 04:10:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:28.130 04:10:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:28.130 04:10:18 -- common/autotest_common.sh@10 -- # set +x 00:08:28.130 ************************************ 00:08:28.130 START TEST nvmf_filesystem_in_capsule 00:08:28.130 ************************************ 00:08:28.130 04:10:18 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_part 4096 00:08:28.130 04:10:18 -- target/filesystem.sh@47 -- # in_capsule=4096 00:08:28.130 04:10:18 -- target/filesystem.sh@49 -- # nvmfappstart -m 0xF 00:08:28.130 04:10:18 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:28.130 04:10:18 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:28.130 04:10:18 -- common/autotest_common.sh@10 -- # set +x 00:08:28.130 04:10:18 -- nvmf/common.sh@469 -- # nvmfpid=2263319 00:08:28.130 04:10:18 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:28.130 04:10:18 -- nvmf/common.sh@470 -- # waitforlisten 2263319 00:08:28.130 04:10:18 -- common/autotest_common.sh@829 -- # '[' -z 2263319 ']' 00:08:28.130 04:10:18 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:28.130 04:10:18 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:28.130 04:10:18 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:28.130 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:28.130 04:10:18 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:28.130 04:10:18 -- common/autotest_common.sh@10 -- # set +x 00:08:28.130 [2024-11-30 04:10:18.538439] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:28.130 [2024-11-30 04:10:18.538541] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:28.130 EAL: No free 2048 kB hugepages reported on node 1 00:08:28.130 [2024-11-30 04:10:18.607108] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:28.130 [2024-11-30 04:10:18.693999] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:28.130 [2024-11-30 04:10:18.694181] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:28.130 [2024-11-30 04:10:18.694203] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:28.130 [2024-11-30 04:10:18.694219] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:28.130 [2024-11-30 04:10:18.694304] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:28.130 [2024-11-30 04:10:18.694374] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:28.130 [2024-11-30 04:10:18.694470] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:28.130 [2024-11-30 04:10:18.694473] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:29.062 04:10:19 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:29.062 04:10:19 -- common/autotest_common.sh@862 -- # return 0 00:08:29.062 04:10:19 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:29.062 04:10:19 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:29.062 04:10:19 -- common/autotest_common.sh@10 -- # set +x 00:08:29.062 04:10:19 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:29.062 04:10:19 -- target/filesystem.sh@50 -- # malloc_name=Malloc1 00:08:29.062 04:10:19 -- target/filesystem.sh@52 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 4096 00:08:29.062 04:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.062 04:10:19 -- common/autotest_common.sh@10 -- # set +x 00:08:29.062 [2024-11-30 04:10:19.558805] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:29.062 04:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.062 04:10:19 -- target/filesystem.sh@53 -- # rpc_cmd bdev_malloc_create 512 512 -b Malloc1 00:08:29.062 04:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.062 04:10:19 -- common/autotest_common.sh@10 -- # set +x 00:08:29.319 Malloc1 00:08:29.319 04:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.319 04:10:19 -- target/filesystem.sh@54 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:08:29.319 04:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.319 04:10:19 -- common/autotest_common.sh@10 -- # set +x 00:08:29.319 04:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.319 04:10:19 -- target/filesystem.sh@55 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:08:29.319 04:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.319 04:10:19 -- common/autotest_common.sh@10 -- # set +x 00:08:29.319 04:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.319 04:10:19 -- target/filesystem.sh@56 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:29.319 04:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.319 04:10:19 -- common/autotest_common.sh@10 -- # set +x 00:08:29.319 [2024-11-30 04:10:19.746573] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:29.319 04:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.319 04:10:19 -- target/filesystem.sh@58 -- # get_bdev_size Malloc1 00:08:29.319 04:10:19 -- common/autotest_common.sh@1367 -- # local bdev_name=Malloc1 00:08:29.319 04:10:19 -- common/autotest_common.sh@1368 -- # local bdev_info 00:08:29.319 04:10:19 -- common/autotest_common.sh@1369 -- # local bs 00:08:29.319 04:10:19 -- common/autotest_common.sh@1370 -- # local nb 00:08:29.319 04:10:19 -- common/autotest_common.sh@1371 -- # rpc_cmd bdev_get_bdevs -b Malloc1 00:08:29.319 04:10:19 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:29.319 04:10:19 -- common/autotest_common.sh@10 -- # set +x 00:08:29.319 04:10:19 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:29.319 04:10:19 -- common/autotest_common.sh@1371 -- # bdev_info='[ 00:08:29.319 { 00:08:29.319 "name": "Malloc1", 00:08:29.319 "aliases": [ 00:08:29.319 "8a0a32ad-b1ef-4b45-88f5-f46979c7a390" 00:08:29.319 ], 00:08:29.319 "product_name": "Malloc disk", 00:08:29.319 "block_size": 512, 00:08:29.319 "num_blocks": 1048576, 00:08:29.319 "uuid": "8a0a32ad-b1ef-4b45-88f5-f46979c7a390", 00:08:29.319 "assigned_rate_limits": { 00:08:29.319 "rw_ios_per_sec": 0, 00:08:29.319 "rw_mbytes_per_sec": 0, 00:08:29.319 "r_mbytes_per_sec": 0, 00:08:29.319 "w_mbytes_per_sec": 0 00:08:29.319 }, 00:08:29.319 "claimed": true, 00:08:29.319 "claim_type": "exclusive_write", 00:08:29.319 "zoned": false, 00:08:29.319 "supported_io_types": { 00:08:29.319 "read": true, 00:08:29.319 "write": true, 00:08:29.319 "unmap": true, 00:08:29.319 "write_zeroes": true, 00:08:29.319 "flush": true, 00:08:29.319 "reset": true, 00:08:29.319 "compare": false, 00:08:29.319 "compare_and_write": false, 00:08:29.320 "abort": true, 00:08:29.320 "nvme_admin": false, 00:08:29.320 "nvme_io": false 00:08:29.320 }, 00:08:29.320 "memory_domains": [ 00:08:29.320 { 00:08:29.320 "dma_device_id": "SPDK_ACCEL_DMA_DEVICE", 00:08:29.320 "dma_device_type": 2 00:08:29.320 } 00:08:29.320 ], 00:08:29.320 "driver_specific": {} 00:08:29.320 } 00:08:29.320 ]' 00:08:29.320 04:10:19 -- common/autotest_common.sh@1372 -- # jq '.[] .block_size' 00:08:29.320 04:10:19 -- common/autotest_common.sh@1372 -- # bs=512 00:08:29.320 04:10:19 -- common/autotest_common.sh@1373 -- # jq '.[] .num_blocks' 00:08:29.320 04:10:19 -- common/autotest_common.sh@1373 -- # nb=1048576 00:08:29.320 04:10:19 -- common/autotest_common.sh@1376 -- # bdev_size=512 00:08:29.320 04:10:19 -- common/autotest_common.sh@1377 -- # echo 512 00:08:29.320 04:10:19 -- target/filesystem.sh@58 -- # malloc_size=536870912 00:08:29.320 04:10:19 -- target/filesystem.sh@60 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:08:30.252 04:10:20 -- target/filesystem.sh@62 -- # waitforserial SPDKISFASTANDAWESOME 00:08:30.252 04:10:20 -- common/autotest_common.sh@1187 -- # local i=0 00:08:30.252 04:10:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:08:30.252 04:10:20 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:08:30.252 04:10:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:08:32.152 04:10:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:08:32.152 04:10:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:08:32.152 04:10:22 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:08:32.152 04:10:22 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:08:32.152 04:10:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:08:32.152 04:10:22 -- common/autotest_common.sh@1197 -- # return 0 00:08:32.152 04:10:22 -- target/filesystem.sh@63 -- # lsblk -l -o NAME,SERIAL 00:08:32.152 04:10:22 -- target/filesystem.sh@63 -- # grep -oP '([\w]*)(?=\s+SPDKISFASTANDAWESOME)' 00:08:32.152 04:10:22 -- target/filesystem.sh@63 -- # nvme_name=nvme0n1 00:08:32.152 04:10:22 -- target/filesystem.sh@64 -- # sec_size_to_bytes nvme0n1 00:08:32.152 04:10:22 -- setup/common.sh@76 -- # local dev=nvme0n1 00:08:32.152 04:10:22 -- setup/common.sh@78 -- # [[ -e /sys/block/nvme0n1 ]] 00:08:32.152 04:10:22 -- setup/common.sh@80 -- # echo 536870912 00:08:32.152 04:10:22 -- target/filesystem.sh@64 -- # nvme_size=536870912 00:08:32.152 04:10:22 -- target/filesystem.sh@66 -- # mkdir -p /mnt/device 00:08:32.152 04:10:22 -- target/filesystem.sh@67 -- # (( nvme_size == malloc_size )) 00:08:32.152 04:10:22 -- target/filesystem.sh@68 -- # parted -s /dev/nvme0n1 mklabel gpt mkpart SPDK_TEST 0% 100% 00:08:32.152 04:10:22 -- target/filesystem.sh@69 -- # partprobe 00:08:33.084 04:10:23 -- target/filesystem.sh@70 -- # sleep 1 00:08:34.017 04:10:24 -- target/filesystem.sh@76 -- # '[' 4096 -eq 0 ']' 00:08:34.017 04:10:24 -- target/filesystem.sh@81 -- # run_test filesystem_in_capsule_ext4 nvmf_filesystem_create ext4 nvme0n1 00:08:34.017 04:10:24 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:34.017 04:10:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:34.017 04:10:24 -- common/autotest_common.sh@10 -- # set +x 00:08:34.017 ************************************ 00:08:34.017 START TEST filesystem_in_capsule_ext4 00:08:34.017 ************************************ 00:08:34.017 04:10:24 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create ext4 nvme0n1 00:08:34.017 04:10:24 -- target/filesystem.sh@18 -- # fstype=ext4 00:08:34.017 04:10:24 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:34.017 04:10:24 -- target/filesystem.sh@21 -- # make_filesystem ext4 /dev/nvme0n1p1 00:08:34.017 04:10:24 -- common/autotest_common.sh@912 -- # local fstype=ext4 00:08:34.017 04:10:24 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:34.017 04:10:24 -- common/autotest_common.sh@914 -- # local i=0 00:08:34.017 04:10:24 -- common/autotest_common.sh@915 -- # local force 00:08:34.017 04:10:24 -- common/autotest_common.sh@917 -- # '[' ext4 = ext4 ']' 00:08:34.017 04:10:24 -- common/autotest_common.sh@918 -- # force=-F 00:08:34.017 04:10:24 -- common/autotest_common.sh@923 -- # mkfs.ext4 -F /dev/nvme0n1p1 00:08:34.017 mke2fs 1.47.0 (5-Feb-2023) 00:08:34.017 Discarding device blocks: 0/522240 done 00:08:34.018 Creating filesystem with 522240 1k blocks and 130560 inodes 00:08:34.018 Filesystem UUID: 96275350-517b-424d-94a3-2197fb4d132a 00:08:34.018 Superblock backups stored on blocks: 00:08:34.018 8193, 24577, 40961, 57345, 73729, 204801, 221185, 401409 00:08:34.018 00:08:34.018 Allocating group tables: 0/64 done 00:08:34.018 Writing inode tables: 0/64 done 00:08:34.275 Creating journal (8192 blocks): done 00:08:35.404 Writing superblocks and filesystem accounting information: 0/64 done 00:08:35.404 00:08:35.404 04:10:25 -- common/autotest_common.sh@931 -- # return 0 00:08:35.404 04:10:25 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:40.667 04:10:31 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:40.667 04:10:31 -- target/filesystem.sh@25 -- # sync 00:08:40.925 04:10:31 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:40.925 04:10:31 -- target/filesystem.sh@27 -- # sync 00:08:40.925 04:10:31 -- target/filesystem.sh@29 -- # i=0 00:08:40.925 04:10:31 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:40.925 04:10:31 -- target/filesystem.sh@37 -- # kill -0 2263319 00:08:40.925 04:10:31 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:40.925 04:10:31 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:40.925 04:10:31 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:40.925 04:10:31 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:40.925 00:08:40.925 real 0m6.856s 00:08:40.925 user 0m0.011s 00:08:40.925 sys 0m0.073s 00:08:40.925 04:10:31 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:40.925 04:10:31 -- common/autotest_common.sh@10 -- # set +x 00:08:40.925 ************************************ 00:08:40.925 END TEST filesystem_in_capsule_ext4 00:08:40.925 ************************************ 00:08:40.925 04:10:31 -- target/filesystem.sh@82 -- # run_test filesystem_in_capsule_btrfs nvmf_filesystem_create btrfs nvme0n1 00:08:40.925 04:10:31 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:40.925 04:10:31 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:40.925 04:10:31 -- common/autotest_common.sh@10 -- # set +x 00:08:40.925 ************************************ 00:08:40.925 START TEST filesystem_in_capsule_btrfs 00:08:40.925 ************************************ 00:08:40.925 04:10:31 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create btrfs nvme0n1 00:08:40.925 04:10:31 -- target/filesystem.sh@18 -- # fstype=btrfs 00:08:40.925 04:10:31 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:40.925 04:10:31 -- target/filesystem.sh@21 -- # make_filesystem btrfs /dev/nvme0n1p1 00:08:40.925 04:10:31 -- common/autotest_common.sh@912 -- # local fstype=btrfs 00:08:40.925 04:10:31 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:40.925 04:10:31 -- common/autotest_common.sh@914 -- # local i=0 00:08:40.925 04:10:31 -- common/autotest_common.sh@915 -- # local force 00:08:40.925 04:10:31 -- common/autotest_common.sh@917 -- # '[' btrfs = ext4 ']' 00:08:40.925 04:10:31 -- common/autotest_common.sh@920 -- # force=-f 00:08:40.925 04:10:31 -- common/autotest_common.sh@923 -- # mkfs.btrfs -f /dev/nvme0n1p1 00:08:41.183 btrfs-progs v6.8.1 00:08:41.183 See https://btrfs.readthedocs.io for more information. 00:08:41.183 00:08:41.183 Performing full device TRIM /dev/nvme0n1p1 (510.00MiB) ... 00:08:41.183 NOTE: several default settings have changed in version 5.15, please make sure 00:08:41.183 this does not affect your deployments: 00:08:41.183 - DUP for metadata (-m dup) 00:08:41.183 - enabled no-holes (-O no-holes) 00:08:41.183 - enabled free-space-tree (-R free-space-tree) 00:08:41.183 00:08:41.183 Label: (null) 00:08:41.183 UUID: 41baa7ad-a138-44ef-a199-a50a9f95b5ea 00:08:41.183 Node size: 16384 00:08:41.183 Sector size: 4096 (CPU page size: 4096) 00:08:41.183 Filesystem size: 510.00MiB 00:08:41.183 Block group profiles: 00:08:41.183 Data: single 8.00MiB 00:08:41.183 Metadata: DUP 32.00MiB 00:08:41.183 System: DUP 8.00MiB 00:08:41.183 SSD detected: yes 00:08:41.183 Zoned device: no 00:08:41.183 Features: extref, skinny-metadata, no-holes, free-space-tree 00:08:41.183 Checksum: crc32c 00:08:41.183 Number of devices: 1 00:08:41.183 Devices: 00:08:41.183 ID SIZE PATH 00:08:41.183 1 510.00MiB /dev/nvme0n1p1 00:08:41.183 00:08:41.183 04:10:31 -- common/autotest_common.sh@931 -- # return 0 00:08:41.183 04:10:31 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:42.116 04:10:32 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:42.116 04:10:32 -- target/filesystem.sh@25 -- # sync 00:08:42.116 04:10:32 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:42.116 04:10:32 -- target/filesystem.sh@27 -- # sync 00:08:42.116 04:10:32 -- target/filesystem.sh@29 -- # i=0 00:08:42.116 04:10:32 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:42.116 04:10:32 -- target/filesystem.sh@37 -- # kill -0 2263319 00:08:42.116 04:10:32 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:42.116 04:10:32 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:42.116 04:10:32 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:42.116 04:10:32 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:42.116 00:08:42.116 real 0m1.080s 00:08:42.116 user 0m0.019s 00:08:42.116 sys 0m0.102s 00:08:42.116 04:10:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:42.116 04:10:32 -- common/autotest_common.sh@10 -- # set +x 00:08:42.116 ************************************ 00:08:42.116 END TEST filesystem_in_capsule_btrfs 00:08:42.116 ************************************ 00:08:42.116 04:10:32 -- target/filesystem.sh@83 -- # run_test filesystem_in_capsule_xfs nvmf_filesystem_create xfs nvme0n1 00:08:42.116 04:10:32 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:08:42.116 04:10:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:42.116 04:10:32 -- common/autotest_common.sh@10 -- # set +x 00:08:42.116 ************************************ 00:08:42.116 START TEST filesystem_in_capsule_xfs 00:08:42.116 ************************************ 00:08:42.116 04:10:32 -- common/autotest_common.sh@1114 -- # nvmf_filesystem_create xfs nvme0n1 00:08:42.116 04:10:32 -- target/filesystem.sh@18 -- # fstype=xfs 00:08:42.116 04:10:32 -- target/filesystem.sh@19 -- # nvme_name=nvme0n1 00:08:42.116 04:10:32 -- target/filesystem.sh@21 -- # make_filesystem xfs /dev/nvme0n1p1 00:08:42.116 04:10:32 -- common/autotest_common.sh@912 -- # local fstype=xfs 00:08:42.116 04:10:32 -- common/autotest_common.sh@913 -- # local dev_name=/dev/nvme0n1p1 00:08:42.116 04:10:32 -- common/autotest_common.sh@914 -- # local i=0 00:08:42.116 04:10:32 -- common/autotest_common.sh@915 -- # local force 00:08:42.116 04:10:32 -- common/autotest_common.sh@917 -- # '[' xfs = ext4 ']' 00:08:42.116 04:10:32 -- common/autotest_common.sh@920 -- # force=-f 00:08:42.116 04:10:32 -- common/autotest_common.sh@923 -- # mkfs.xfs -f /dev/nvme0n1p1 00:08:42.116 meta-data=/dev/nvme0n1p1 isize=512 agcount=4, agsize=32640 blks 00:08:42.116 = sectsz=512 attr=2, projid32bit=1 00:08:42.116 = crc=1 finobt=1, sparse=1, rmapbt=0 00:08:42.116 = reflink=1 bigtime=1 inobtcount=1 nrext64=0 00:08:42.116 data = bsize=4096 blocks=130560, imaxpct=25 00:08:42.116 = sunit=0 swidth=0 blks 00:08:42.116 naming =version 2 bsize=4096 ascii-ci=0, ftype=1 00:08:42.116 log =internal log bsize=4096 blocks=16384, version=2 00:08:42.116 = sectsz=512 sunit=0 blks, lazy-count=1 00:08:42.116 realtime =none extsz=4096 blocks=0, rtextents=0 00:08:43.048 Discarding blocks...Done. 00:08:43.048 04:10:33 -- common/autotest_common.sh@931 -- # return 0 00:08:43.048 04:10:33 -- target/filesystem.sh@23 -- # mount /dev/nvme0n1p1 /mnt/device 00:08:44.947 04:10:35 -- target/filesystem.sh@24 -- # touch /mnt/device/aaa 00:08:44.947 04:10:35 -- target/filesystem.sh@25 -- # sync 00:08:44.947 04:10:35 -- target/filesystem.sh@26 -- # rm /mnt/device/aaa 00:08:44.947 04:10:35 -- target/filesystem.sh@27 -- # sync 00:08:44.947 04:10:35 -- target/filesystem.sh@29 -- # i=0 00:08:44.947 04:10:35 -- target/filesystem.sh@30 -- # umount /mnt/device 00:08:44.947 04:10:35 -- target/filesystem.sh@37 -- # kill -0 2263319 00:08:44.947 04:10:35 -- target/filesystem.sh@40 -- # lsblk -l -o NAME 00:08:44.947 04:10:35 -- target/filesystem.sh@40 -- # grep -q -w nvme0n1 00:08:44.947 04:10:35 -- target/filesystem.sh@43 -- # lsblk -l -o NAME 00:08:44.947 04:10:35 -- target/filesystem.sh@43 -- # grep -q -w nvme0n1p1 00:08:44.947 00:08:44.947 real 0m2.954s 00:08:44.947 user 0m0.016s 00:08:44.947 sys 0m0.062s 00:08:44.947 04:10:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:44.947 04:10:35 -- common/autotest_common.sh@10 -- # set +x 00:08:44.947 ************************************ 00:08:44.947 END TEST filesystem_in_capsule_xfs 00:08:44.947 ************************************ 00:08:44.947 04:10:35 -- target/filesystem.sh@91 -- # flock /dev/nvme0n1 parted -s /dev/nvme0n1 rm 1 00:08:44.947 04:10:35 -- target/filesystem.sh@93 -- # sync 00:08:44.947 04:10:35 -- target/filesystem.sh@94 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:08:45.204 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:08:45.204 04:10:35 -- target/filesystem.sh@95 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:08:45.204 04:10:35 -- common/autotest_common.sh@1208 -- # local i=0 00:08:45.204 04:10:35 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:08:45.204 04:10:35 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:45.204 04:10:35 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:08:45.204 04:10:35 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:08:45.204 04:10:35 -- common/autotest_common.sh@1220 -- # return 0 00:08:45.204 04:10:35 -- target/filesystem.sh@97 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:45.204 04:10:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:45.204 04:10:35 -- common/autotest_common.sh@10 -- # set +x 00:08:45.204 04:10:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:45.204 04:10:35 -- target/filesystem.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:08:45.204 04:10:35 -- target/filesystem.sh@101 -- # killprocess 2263319 00:08:45.204 04:10:35 -- common/autotest_common.sh@936 -- # '[' -z 2263319 ']' 00:08:45.204 04:10:35 -- common/autotest_common.sh@940 -- # kill -0 2263319 00:08:45.204 04:10:35 -- common/autotest_common.sh@941 -- # uname 00:08:45.204 04:10:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:45.204 04:10:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2263319 00:08:45.204 04:10:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:45.204 04:10:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:45.204 04:10:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2263319' 00:08:45.204 killing process with pid 2263319 00:08:45.204 04:10:35 -- common/autotest_common.sh@955 -- # kill 2263319 00:08:45.204 04:10:35 -- common/autotest_common.sh@960 -- # wait 2263319 00:08:45.771 04:10:36 -- target/filesystem.sh@102 -- # nvmfpid= 00:08:45.771 00:08:45.771 real 0m17.618s 00:08:45.771 user 1m8.267s 00:08:45.771 sys 0m2.251s 00:08:45.771 04:10:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:45.771 04:10:36 -- common/autotest_common.sh@10 -- # set +x 00:08:45.771 ************************************ 00:08:45.771 END TEST nvmf_filesystem_in_capsule 00:08:45.771 ************************************ 00:08:45.771 04:10:36 -- target/filesystem.sh@108 -- # nvmftestfini 00:08:45.771 04:10:36 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:45.771 04:10:36 -- nvmf/common.sh@116 -- # sync 00:08:45.771 04:10:36 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:45.771 04:10:36 -- nvmf/common.sh@119 -- # set +e 00:08:45.771 04:10:36 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:45.771 04:10:36 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:45.771 rmmod nvme_tcp 00:08:45.771 rmmod nvme_fabrics 00:08:45.771 rmmod nvme_keyring 00:08:45.771 04:10:36 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:45.771 04:10:36 -- nvmf/common.sh@123 -- # set -e 00:08:45.771 04:10:36 -- nvmf/common.sh@124 -- # return 0 00:08:45.771 04:10:36 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:08:45.771 04:10:36 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:45.771 04:10:36 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:45.771 04:10:36 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:45.771 04:10:36 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:45.771 04:10:36 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:45.771 04:10:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:45.771 04:10:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:45.771 04:10:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:47.679 04:10:38 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:47.679 00:08:47.679 real 0m40.431s 00:08:47.679 user 2m18.936s 00:08:47.679 sys 0m6.232s 00:08:47.679 04:10:38 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:47.679 04:10:38 -- common/autotest_common.sh@10 -- # set +x 00:08:47.679 ************************************ 00:08:47.679 END TEST nvmf_filesystem 00:08:47.679 ************************************ 00:08:47.679 04:10:38 -- nvmf/nvmf.sh@25 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:47.680 04:10:38 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:47.680 04:10:38 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:47.680 04:10:38 -- common/autotest_common.sh@10 -- # set +x 00:08:47.680 ************************************ 00:08:47.680 START TEST nvmf_discovery 00:08:47.680 ************************************ 00:08:47.680 04:10:38 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/discovery.sh --transport=tcp 00:08:47.939 * Looking for test storage... 00:08:47.939 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:47.939 04:10:38 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:47.939 04:10:38 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:47.939 04:10:38 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:47.939 04:10:38 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:47.939 04:10:38 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:47.939 04:10:38 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:47.939 04:10:38 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:47.939 04:10:38 -- scripts/common.sh@335 -- # IFS=.-: 00:08:47.939 04:10:38 -- scripts/common.sh@335 -- # read -ra ver1 00:08:47.939 04:10:38 -- scripts/common.sh@336 -- # IFS=.-: 00:08:47.939 04:10:38 -- scripts/common.sh@336 -- # read -ra ver2 00:08:47.939 04:10:38 -- scripts/common.sh@337 -- # local 'op=<' 00:08:47.939 04:10:38 -- scripts/common.sh@339 -- # ver1_l=2 00:08:47.939 04:10:38 -- scripts/common.sh@340 -- # ver2_l=1 00:08:47.939 04:10:38 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:47.939 04:10:38 -- scripts/common.sh@343 -- # case "$op" in 00:08:47.939 04:10:38 -- scripts/common.sh@344 -- # : 1 00:08:47.939 04:10:38 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:47.939 04:10:38 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:47.939 04:10:38 -- scripts/common.sh@364 -- # decimal 1 00:08:47.939 04:10:38 -- scripts/common.sh@352 -- # local d=1 00:08:47.939 04:10:38 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:47.939 04:10:38 -- scripts/common.sh@354 -- # echo 1 00:08:47.939 04:10:38 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:47.939 04:10:38 -- scripts/common.sh@365 -- # decimal 2 00:08:47.939 04:10:38 -- scripts/common.sh@352 -- # local d=2 00:08:47.939 04:10:38 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:47.939 04:10:38 -- scripts/common.sh@354 -- # echo 2 00:08:47.939 04:10:38 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:47.939 04:10:38 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:47.939 04:10:38 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:47.939 04:10:38 -- scripts/common.sh@367 -- # return 0 00:08:47.939 04:10:38 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:47.939 04:10:38 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:47.939 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:47.939 --rc genhtml_branch_coverage=1 00:08:47.939 --rc genhtml_function_coverage=1 00:08:47.939 --rc genhtml_legend=1 00:08:47.939 --rc geninfo_all_blocks=1 00:08:47.939 --rc geninfo_unexecuted_blocks=1 00:08:47.939 00:08:47.939 ' 00:08:47.939 04:10:38 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:47.939 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:47.939 --rc genhtml_branch_coverage=1 00:08:47.939 --rc genhtml_function_coverage=1 00:08:47.939 --rc genhtml_legend=1 00:08:47.939 --rc geninfo_all_blocks=1 00:08:47.939 --rc geninfo_unexecuted_blocks=1 00:08:47.939 00:08:47.939 ' 00:08:47.939 04:10:38 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:47.939 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:47.939 --rc genhtml_branch_coverage=1 00:08:47.939 --rc genhtml_function_coverage=1 00:08:47.939 --rc genhtml_legend=1 00:08:47.939 --rc geninfo_all_blocks=1 00:08:47.939 --rc geninfo_unexecuted_blocks=1 00:08:47.939 00:08:47.939 ' 00:08:47.939 04:10:38 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:47.939 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:47.939 --rc genhtml_branch_coverage=1 00:08:47.939 --rc genhtml_function_coverage=1 00:08:47.939 --rc genhtml_legend=1 00:08:47.939 --rc geninfo_all_blocks=1 00:08:47.939 --rc geninfo_unexecuted_blocks=1 00:08:47.939 00:08:47.939 ' 00:08:47.939 04:10:38 -- target/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:47.939 04:10:38 -- nvmf/common.sh@7 -- # uname -s 00:08:47.939 04:10:38 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:47.939 04:10:38 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:47.939 04:10:38 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:47.940 04:10:38 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:47.940 04:10:38 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:47.940 04:10:38 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:47.940 04:10:38 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:47.940 04:10:38 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:47.940 04:10:38 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:47.940 04:10:38 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:47.940 04:10:38 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:47.940 04:10:38 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:47.940 04:10:38 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:47.940 04:10:38 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:47.940 04:10:38 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:47.940 04:10:38 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:47.940 04:10:38 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:47.940 04:10:38 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:47.940 04:10:38 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:47.940 04:10:38 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.940 04:10:38 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.940 04:10:38 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.940 04:10:38 -- paths/export.sh@5 -- # export PATH 00:08:47.940 04:10:38 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:47.940 04:10:38 -- nvmf/common.sh@46 -- # : 0 00:08:47.940 04:10:38 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:47.940 04:10:38 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:47.940 04:10:38 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:47.940 04:10:38 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:47.940 04:10:38 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:47.940 04:10:38 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:47.940 04:10:38 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:47.940 04:10:38 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:47.940 04:10:38 -- target/discovery.sh@11 -- # NULL_BDEV_SIZE=102400 00:08:47.940 04:10:38 -- target/discovery.sh@12 -- # NULL_BLOCK_SIZE=512 00:08:47.940 04:10:38 -- target/discovery.sh@13 -- # NVMF_PORT_REFERRAL=4430 00:08:47.940 04:10:38 -- target/discovery.sh@15 -- # hash nvme 00:08:47.940 04:10:38 -- target/discovery.sh@20 -- # nvmftestinit 00:08:47.940 04:10:38 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:47.940 04:10:38 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:47.940 04:10:38 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:47.940 04:10:38 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:47.940 04:10:38 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:47.940 04:10:38 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:47.940 04:10:38 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:47.940 04:10:38 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:47.940 04:10:38 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:47.940 04:10:38 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:47.940 04:10:38 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:47.940 04:10:38 -- common/autotest_common.sh@10 -- # set +x 00:08:50.475 04:10:40 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:50.475 04:10:40 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:50.475 04:10:40 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:50.475 04:10:40 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:50.475 04:10:40 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:50.475 04:10:40 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:50.475 04:10:40 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:50.475 04:10:40 -- nvmf/common.sh@294 -- # net_devs=() 00:08:50.475 04:10:40 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:50.475 04:10:40 -- nvmf/common.sh@295 -- # e810=() 00:08:50.475 04:10:40 -- nvmf/common.sh@295 -- # local -ga e810 00:08:50.475 04:10:40 -- nvmf/common.sh@296 -- # x722=() 00:08:50.475 04:10:40 -- nvmf/common.sh@296 -- # local -ga x722 00:08:50.475 04:10:40 -- nvmf/common.sh@297 -- # mlx=() 00:08:50.475 04:10:40 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:50.475 04:10:40 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:50.475 04:10:40 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:50.475 04:10:40 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:50.475 04:10:40 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:50.475 04:10:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:50.475 04:10:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:50.475 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:50.475 04:10:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:50.475 04:10:40 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:50.475 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:50.475 04:10:40 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:50.475 04:10:40 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:50.475 04:10:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:50.475 04:10:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:50.475 04:10:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:50.475 04:10:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:50.475 04:10:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:50.475 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:50.475 04:10:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:50.476 04:10:40 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:50.476 04:10:40 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:50.476 04:10:40 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:50.476 04:10:40 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:50.476 04:10:40 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:50.476 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:50.476 04:10:40 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:50.476 04:10:40 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:50.476 04:10:40 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:50.476 04:10:40 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:50.476 04:10:40 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:50.476 04:10:40 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:50.476 04:10:40 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:50.476 04:10:40 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:50.476 04:10:40 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:50.476 04:10:40 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:50.476 04:10:40 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:50.476 04:10:40 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:50.476 04:10:40 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:50.476 04:10:40 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:50.476 04:10:40 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:50.476 04:10:40 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:50.476 04:10:40 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:50.476 04:10:40 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:50.476 04:10:40 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:50.476 04:10:40 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:50.476 04:10:40 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:50.476 04:10:40 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:50.476 04:10:40 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:50.476 04:10:40 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:50.476 04:10:40 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:50.476 04:10:40 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:50.476 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:50.476 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:08:50.476 00:08:50.476 --- 10.0.0.2 ping statistics --- 00:08:50.476 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:50.476 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:08:50.476 04:10:40 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:50.476 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:50.476 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.121 ms 00:08:50.476 00:08:50.476 --- 10.0.0.1 ping statistics --- 00:08:50.476 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:50.476 rtt min/avg/max/mdev = 0.121/0.121/0.121/0.000 ms 00:08:50.476 04:10:40 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:50.476 04:10:40 -- nvmf/common.sh@410 -- # return 0 00:08:50.476 04:10:40 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:50.476 04:10:40 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:50.476 04:10:40 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:50.476 04:10:40 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:50.476 04:10:40 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:50.476 04:10:40 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:50.476 04:10:40 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:50.476 04:10:40 -- target/discovery.sh@21 -- # nvmfappstart -m 0xF 00:08:50.476 04:10:40 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:50.476 04:10:40 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:50.476 04:10:40 -- common/autotest_common.sh@10 -- # set +x 00:08:50.476 04:10:40 -- nvmf/common.sh@469 -- # nvmfpid=2267595 00:08:50.476 04:10:40 -- nvmf/common.sh@470 -- # waitforlisten 2267595 00:08:50.476 04:10:40 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:50.476 04:10:40 -- common/autotest_common.sh@829 -- # '[' -z 2267595 ']' 00:08:50.476 04:10:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:50.476 04:10:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:50.476 04:10:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:50.476 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:50.476 04:10:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:50.476 04:10:40 -- common/autotest_common.sh@10 -- # set +x 00:08:50.476 [2024-11-30 04:10:40.699864] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:50.476 [2024-11-30 04:10:40.699943] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:50.476 EAL: No free 2048 kB hugepages reported on node 1 00:08:50.476 [2024-11-30 04:10:40.773163] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:50.476 [2024-11-30 04:10:40.860144] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:50.476 [2024-11-30 04:10:40.860311] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:50.476 [2024-11-30 04:10:40.860328] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:50.476 [2024-11-30 04:10:40.860352] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:50.476 [2024-11-30 04:10:40.860424] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:50.476 [2024-11-30 04:10:40.860484] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:50.476 [2024-11-30 04:10:40.860551] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:50.476 [2024-11-30 04:10:40.860554] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:51.410 04:10:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:51.410 04:10:41 -- common/autotest_common.sh@862 -- # return 0 00:08:51.410 04:10:41 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:51.410 04:10:41 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:51.410 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.410 04:10:41 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:51.410 04:10:41 -- target/discovery.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:51.410 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.410 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.410 [2024-11-30 04:10:41.708584] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:51.410 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.410 04:10:41 -- target/discovery.sh@26 -- # seq 1 4 00:08:51.410 04:10:41 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:51.410 04:10:41 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null1 102400 512 00:08:51.410 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.410 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.410 Null1 00:08:51.410 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.410 04:10:41 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Null1 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 [2024-11-30 04:10:41.748893] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:51.411 04:10:41 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null2 102400 512 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 Null2 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Null2 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:51.411 04:10:41 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null3 102400 512 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 Null3 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000003 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Null3 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@26 -- # for i in $(seq 1 4) 00:08:51.411 04:10:41 -- target/discovery.sh@27 -- # rpc_cmd bdev_null_create Null4 102400 512 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 Null4 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK00000000000004 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Null4 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@30 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@32 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@35 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 10.0.0.2 -s 4430 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 04:10:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.411 04:10:41 -- target/discovery.sh@37 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:08:51.411 00:08:51.411 Discovery Log Number of Records 6, Generation counter 6 00:08:51.411 =====Discovery Log Entry 0====== 00:08:51.411 trtype: tcp 00:08:51.411 adrfam: ipv4 00:08:51.411 subtype: current discovery subsystem 00:08:51.411 treq: not required 00:08:51.411 portid: 0 00:08:51.411 trsvcid: 4420 00:08:51.411 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:51.411 traddr: 10.0.0.2 00:08:51.411 eflags: explicit discovery connections, duplicate discovery information 00:08:51.411 sectype: none 00:08:51.411 =====Discovery Log Entry 1====== 00:08:51.411 trtype: tcp 00:08:51.411 adrfam: ipv4 00:08:51.411 subtype: nvme subsystem 00:08:51.411 treq: not required 00:08:51.411 portid: 0 00:08:51.411 trsvcid: 4420 00:08:51.411 subnqn: nqn.2016-06.io.spdk:cnode1 00:08:51.411 traddr: 10.0.0.2 00:08:51.411 eflags: none 00:08:51.411 sectype: none 00:08:51.411 =====Discovery Log Entry 2====== 00:08:51.411 trtype: tcp 00:08:51.411 adrfam: ipv4 00:08:51.411 subtype: nvme subsystem 00:08:51.411 treq: not required 00:08:51.411 portid: 0 00:08:51.411 trsvcid: 4420 00:08:51.411 subnqn: nqn.2016-06.io.spdk:cnode2 00:08:51.411 traddr: 10.0.0.2 00:08:51.411 eflags: none 00:08:51.411 sectype: none 00:08:51.411 =====Discovery Log Entry 3====== 00:08:51.411 trtype: tcp 00:08:51.411 adrfam: ipv4 00:08:51.411 subtype: nvme subsystem 00:08:51.411 treq: not required 00:08:51.411 portid: 0 00:08:51.411 trsvcid: 4420 00:08:51.411 subnqn: nqn.2016-06.io.spdk:cnode3 00:08:51.411 traddr: 10.0.0.2 00:08:51.411 eflags: none 00:08:51.411 sectype: none 00:08:51.411 =====Discovery Log Entry 4====== 00:08:51.411 trtype: tcp 00:08:51.411 adrfam: ipv4 00:08:51.411 subtype: nvme subsystem 00:08:51.411 treq: not required 00:08:51.411 portid: 0 00:08:51.411 trsvcid: 4420 00:08:51.411 subnqn: nqn.2016-06.io.spdk:cnode4 00:08:51.411 traddr: 10.0.0.2 00:08:51.411 eflags: none 00:08:51.411 sectype: none 00:08:51.411 =====Discovery Log Entry 5====== 00:08:51.411 trtype: tcp 00:08:51.411 adrfam: ipv4 00:08:51.411 subtype: discovery subsystem referral 00:08:51.411 treq: not required 00:08:51.411 portid: 0 00:08:51.411 trsvcid: 4430 00:08:51.411 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:08:51.411 traddr: 10.0.0.2 00:08:51.411 eflags: none 00:08:51.411 sectype: none 00:08:51.411 04:10:41 -- target/discovery.sh@39 -- # echo 'Perform nvmf subsystem discovery via RPC' 00:08:51.411 Perform nvmf subsystem discovery via RPC 00:08:51.411 04:10:41 -- target/discovery.sh@40 -- # rpc_cmd nvmf_get_subsystems 00:08:51.411 04:10:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.411 04:10:41 -- common/autotest_common.sh@10 -- # set +x 00:08:51.411 [2024-11-30 04:10:42.001546] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:08:51.411 [ 00:08:51.411 { 00:08:51.411 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:08:51.411 "subtype": "Discovery", 00:08:51.411 "listen_addresses": [ 00:08:51.411 { 00:08:51.411 "transport": "TCP", 00:08:51.411 "trtype": "TCP", 00:08:51.411 "adrfam": "IPv4", 00:08:51.411 "traddr": "10.0.0.2", 00:08:51.411 "trsvcid": "4420" 00:08:51.411 } 00:08:51.411 ], 00:08:51.411 "allow_any_host": true, 00:08:51.411 "hosts": [] 00:08:51.411 }, 00:08:51.411 { 00:08:51.411 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:08:51.411 "subtype": "NVMe", 00:08:51.411 "listen_addresses": [ 00:08:51.411 { 00:08:51.411 "transport": "TCP", 00:08:51.411 "trtype": "TCP", 00:08:51.411 "adrfam": "IPv4", 00:08:51.411 "traddr": "10.0.0.2", 00:08:51.411 "trsvcid": "4420" 00:08:51.411 } 00:08:51.411 ], 00:08:51.411 "allow_any_host": true, 00:08:51.411 "hosts": [], 00:08:51.411 "serial_number": "SPDK00000000000001", 00:08:51.411 "model_number": "SPDK bdev Controller", 00:08:51.411 "max_namespaces": 32, 00:08:51.411 "min_cntlid": 1, 00:08:51.411 "max_cntlid": 65519, 00:08:51.411 "namespaces": [ 00:08:51.411 { 00:08:51.411 "nsid": 1, 00:08:51.411 "bdev_name": "Null1", 00:08:51.411 "name": "Null1", 00:08:51.411 "nguid": "81859F35B1E841FC8BF20806BE2A887A", 00:08:51.411 "uuid": "81859f35-b1e8-41fc-8bf2-0806be2a887a" 00:08:51.411 } 00:08:51.411 ] 00:08:51.411 }, 00:08:51.411 { 00:08:51.411 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:08:51.411 "subtype": "NVMe", 00:08:51.411 "listen_addresses": [ 00:08:51.411 { 00:08:51.412 "transport": "TCP", 00:08:51.412 "trtype": "TCP", 00:08:51.412 "adrfam": "IPv4", 00:08:51.412 "traddr": "10.0.0.2", 00:08:51.412 "trsvcid": "4420" 00:08:51.412 } 00:08:51.412 ], 00:08:51.412 "allow_any_host": true, 00:08:51.412 "hosts": [], 00:08:51.412 "serial_number": "SPDK00000000000002", 00:08:51.412 "model_number": "SPDK bdev Controller", 00:08:51.412 "max_namespaces": 32, 00:08:51.412 "min_cntlid": 1, 00:08:51.412 "max_cntlid": 65519, 00:08:51.412 "namespaces": [ 00:08:51.412 { 00:08:51.412 "nsid": 1, 00:08:51.412 "bdev_name": "Null2", 00:08:51.412 "name": "Null2", 00:08:51.412 "nguid": "7D2346F3519E4D2B8FC401B99387A038", 00:08:51.412 "uuid": "7d2346f3-519e-4d2b-8fc4-01b99387a038" 00:08:51.412 } 00:08:51.412 ] 00:08:51.412 }, 00:08:51.412 { 00:08:51.412 "nqn": "nqn.2016-06.io.spdk:cnode3", 00:08:51.412 "subtype": "NVMe", 00:08:51.412 "listen_addresses": [ 00:08:51.412 { 00:08:51.412 "transport": "TCP", 00:08:51.412 "trtype": "TCP", 00:08:51.412 "adrfam": "IPv4", 00:08:51.412 "traddr": "10.0.0.2", 00:08:51.412 "trsvcid": "4420" 00:08:51.412 } 00:08:51.412 ], 00:08:51.412 "allow_any_host": true, 00:08:51.412 "hosts": [], 00:08:51.412 "serial_number": "SPDK00000000000003", 00:08:51.412 "model_number": "SPDK bdev Controller", 00:08:51.412 "max_namespaces": 32, 00:08:51.412 "min_cntlid": 1, 00:08:51.412 "max_cntlid": 65519, 00:08:51.412 "namespaces": [ 00:08:51.412 { 00:08:51.412 "nsid": 1, 00:08:51.412 "bdev_name": "Null3", 00:08:51.412 "name": "Null3", 00:08:51.412 "nguid": "8C36A5AB2BE244F79754B8E1C698D7CD", 00:08:51.412 "uuid": "8c36a5ab-2be2-44f7-9754-b8e1c698d7cd" 00:08:51.412 } 00:08:51.412 ] 00:08:51.412 }, 00:08:51.412 { 00:08:51.412 "nqn": "nqn.2016-06.io.spdk:cnode4", 00:08:51.412 "subtype": "NVMe", 00:08:51.412 "listen_addresses": [ 00:08:51.412 { 00:08:51.412 "transport": "TCP", 00:08:51.412 "trtype": "TCP", 00:08:51.412 "adrfam": "IPv4", 00:08:51.412 "traddr": "10.0.0.2", 00:08:51.412 "trsvcid": "4420" 00:08:51.412 } 00:08:51.412 ], 00:08:51.412 "allow_any_host": true, 00:08:51.412 "hosts": [], 00:08:51.412 "serial_number": "SPDK00000000000004", 00:08:51.412 "model_number": "SPDK bdev Controller", 00:08:51.412 "max_namespaces": 32, 00:08:51.412 "min_cntlid": 1, 00:08:51.412 "max_cntlid": 65519, 00:08:51.412 "namespaces": [ 00:08:51.412 { 00:08:51.412 "nsid": 1, 00:08:51.412 "bdev_name": "Null4", 00:08:51.412 "name": "Null4", 00:08:51.412 "nguid": "9F6C714476A54BD19DC1321073767133", 00:08:51.412 "uuid": "9f6c7144-76a5-4bd1-9dc1-321073767133" 00:08:51.412 } 00:08:51.412 ] 00:08:51.412 } 00:08:51.412 ] 00:08:51.412 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.412 04:10:42 -- target/discovery.sh@42 -- # seq 1 4 00:08:51.412 04:10:42 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:51.412 04:10:42 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:08:51.412 04:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.412 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:08:51.412 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.412 04:10:42 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null1 00:08:51.412 04:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.412 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:08:51.412 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.412 04:10:42 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:51.412 04:10:42 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:08:51.412 04:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.412 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:08:51.671 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.671 04:10:42 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null2 00:08:51.671 04:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.671 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:08:51.671 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.671 04:10:42 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:51.671 04:10:42 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:08:51.671 04:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.671 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:08:51.671 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.671 04:10:42 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null3 00:08:51.671 04:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.671 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:08:51.671 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.671 04:10:42 -- target/discovery.sh@42 -- # for i in $(seq 1 4) 00:08:51.671 04:10:42 -- target/discovery.sh@43 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:08:51.671 04:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.671 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:08:51.671 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.671 04:10:42 -- target/discovery.sh@44 -- # rpc_cmd bdev_null_delete Null4 00:08:51.671 04:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.671 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:08:51.671 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.671 04:10:42 -- target/discovery.sh@47 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 10.0.0.2 -s 4430 00:08:51.671 04:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.671 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:08:51.671 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.671 04:10:42 -- target/discovery.sh@49 -- # rpc_cmd bdev_get_bdevs 00:08:51.671 04:10:42 -- target/discovery.sh@49 -- # jq -r '.[].name' 00:08:51.671 04:10:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:51.671 04:10:42 -- common/autotest_common.sh@10 -- # set +x 00:08:51.671 04:10:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:51.671 04:10:42 -- target/discovery.sh@49 -- # check_bdevs= 00:08:51.671 04:10:42 -- target/discovery.sh@50 -- # '[' -n '' ']' 00:08:51.671 04:10:42 -- target/discovery.sh@55 -- # trap - SIGINT SIGTERM EXIT 00:08:51.671 04:10:42 -- target/discovery.sh@57 -- # nvmftestfini 00:08:51.671 04:10:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:51.671 04:10:42 -- nvmf/common.sh@116 -- # sync 00:08:51.671 04:10:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:51.671 04:10:42 -- nvmf/common.sh@119 -- # set +e 00:08:51.671 04:10:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:51.671 04:10:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:51.671 rmmod nvme_tcp 00:08:51.671 rmmod nvme_fabrics 00:08:51.671 rmmod nvme_keyring 00:08:51.671 04:10:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:51.671 04:10:42 -- nvmf/common.sh@123 -- # set -e 00:08:51.671 04:10:42 -- nvmf/common.sh@124 -- # return 0 00:08:51.671 04:10:42 -- nvmf/common.sh@477 -- # '[' -n 2267595 ']' 00:08:51.671 04:10:42 -- nvmf/common.sh@478 -- # killprocess 2267595 00:08:51.671 04:10:42 -- common/autotest_common.sh@936 -- # '[' -z 2267595 ']' 00:08:51.671 04:10:42 -- common/autotest_common.sh@940 -- # kill -0 2267595 00:08:51.671 04:10:42 -- common/autotest_common.sh@941 -- # uname 00:08:51.671 04:10:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:51.671 04:10:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2267595 00:08:51.671 04:10:42 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:51.671 04:10:42 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:51.671 04:10:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2267595' 00:08:51.671 killing process with pid 2267595 00:08:51.671 04:10:42 -- common/autotest_common.sh@955 -- # kill 2267595 00:08:51.671 [2024-11-30 04:10:42.229183] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:08:51.671 04:10:42 -- common/autotest_common.sh@960 -- # wait 2267595 00:08:51.929 04:10:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:51.929 04:10:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:51.929 04:10:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:51.929 04:10:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:51.929 04:10:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:51.929 04:10:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:51.929 04:10:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:51.929 04:10:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:54.468 04:10:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:08:54.468 00:08:54.468 real 0m6.232s 00:08:54.468 user 0m7.444s 00:08:54.468 sys 0m1.967s 00:08:54.468 04:10:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:08:54.468 04:10:44 -- common/autotest_common.sh@10 -- # set +x 00:08:54.468 ************************************ 00:08:54.468 END TEST nvmf_discovery 00:08:54.468 ************************************ 00:08:54.468 04:10:44 -- nvmf/nvmf.sh@26 -- # run_test nvmf_referrals /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:54.468 04:10:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:08:54.468 04:10:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:08:54.468 04:10:44 -- common/autotest_common.sh@10 -- # set +x 00:08:54.468 ************************************ 00:08:54.468 START TEST nvmf_referrals 00:08:54.468 ************************************ 00:08:54.468 04:10:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/referrals.sh --transport=tcp 00:08:54.468 * Looking for test storage... 00:08:54.468 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:08:54.468 04:10:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:08:54.468 04:10:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:08:54.468 04:10:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:08:54.468 04:10:44 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:08:54.468 04:10:44 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:08:54.468 04:10:44 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:08:54.468 04:10:44 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:08:54.468 04:10:44 -- scripts/common.sh@335 -- # IFS=.-: 00:08:54.468 04:10:44 -- scripts/common.sh@335 -- # read -ra ver1 00:08:54.468 04:10:44 -- scripts/common.sh@336 -- # IFS=.-: 00:08:54.468 04:10:44 -- scripts/common.sh@336 -- # read -ra ver2 00:08:54.468 04:10:44 -- scripts/common.sh@337 -- # local 'op=<' 00:08:54.468 04:10:44 -- scripts/common.sh@339 -- # ver1_l=2 00:08:54.468 04:10:44 -- scripts/common.sh@340 -- # ver2_l=1 00:08:54.468 04:10:44 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:08:54.468 04:10:44 -- scripts/common.sh@343 -- # case "$op" in 00:08:54.468 04:10:44 -- scripts/common.sh@344 -- # : 1 00:08:54.468 04:10:44 -- scripts/common.sh@363 -- # (( v = 0 )) 00:08:54.468 04:10:44 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:08:54.468 04:10:44 -- scripts/common.sh@364 -- # decimal 1 00:08:54.468 04:10:44 -- scripts/common.sh@352 -- # local d=1 00:08:54.468 04:10:44 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:08:54.468 04:10:44 -- scripts/common.sh@354 -- # echo 1 00:08:54.468 04:10:44 -- scripts/common.sh@364 -- # ver1[v]=1 00:08:54.468 04:10:44 -- scripts/common.sh@365 -- # decimal 2 00:08:54.468 04:10:44 -- scripts/common.sh@352 -- # local d=2 00:08:54.468 04:10:44 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:08:54.468 04:10:44 -- scripts/common.sh@354 -- # echo 2 00:08:54.468 04:10:44 -- scripts/common.sh@365 -- # ver2[v]=2 00:08:54.468 04:10:44 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:08:54.468 04:10:44 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:08:54.468 04:10:44 -- scripts/common.sh@367 -- # return 0 00:08:54.468 04:10:44 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:08:54.468 04:10:44 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:08:54.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:54.468 --rc genhtml_branch_coverage=1 00:08:54.468 --rc genhtml_function_coverage=1 00:08:54.468 --rc genhtml_legend=1 00:08:54.468 --rc geninfo_all_blocks=1 00:08:54.468 --rc geninfo_unexecuted_blocks=1 00:08:54.468 00:08:54.468 ' 00:08:54.468 04:10:44 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:08:54.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:54.468 --rc genhtml_branch_coverage=1 00:08:54.468 --rc genhtml_function_coverage=1 00:08:54.468 --rc genhtml_legend=1 00:08:54.468 --rc geninfo_all_blocks=1 00:08:54.468 --rc geninfo_unexecuted_blocks=1 00:08:54.468 00:08:54.468 ' 00:08:54.468 04:10:44 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:08:54.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:54.468 --rc genhtml_branch_coverage=1 00:08:54.468 --rc genhtml_function_coverage=1 00:08:54.468 --rc genhtml_legend=1 00:08:54.468 --rc geninfo_all_blocks=1 00:08:54.468 --rc geninfo_unexecuted_blocks=1 00:08:54.468 00:08:54.468 ' 00:08:54.468 04:10:44 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:08:54.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:08:54.468 --rc genhtml_branch_coverage=1 00:08:54.468 --rc genhtml_function_coverage=1 00:08:54.468 --rc genhtml_legend=1 00:08:54.468 --rc geninfo_all_blocks=1 00:08:54.468 --rc geninfo_unexecuted_blocks=1 00:08:54.468 00:08:54.468 ' 00:08:54.468 04:10:44 -- target/referrals.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:08:54.468 04:10:44 -- nvmf/common.sh@7 -- # uname -s 00:08:54.468 04:10:44 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:08:54.468 04:10:44 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:08:54.468 04:10:44 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:08:54.468 04:10:44 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:08:54.468 04:10:44 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:08:54.468 04:10:44 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:08:54.468 04:10:44 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:08:54.468 04:10:44 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:08:54.468 04:10:44 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:08:54.468 04:10:44 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:08:54.468 04:10:44 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:08:54.468 04:10:44 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:08:54.468 04:10:44 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:08:54.468 04:10:44 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:08:54.468 04:10:44 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:08:54.469 04:10:44 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:08:54.469 04:10:44 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:08:54.469 04:10:44 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:08:54.469 04:10:44 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:08:54.469 04:10:44 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.469 04:10:44 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.469 04:10:44 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.469 04:10:44 -- paths/export.sh@5 -- # export PATH 00:08:54.469 04:10:44 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:08:54.469 04:10:44 -- nvmf/common.sh@46 -- # : 0 00:08:54.469 04:10:44 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:08:54.469 04:10:44 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:08:54.469 04:10:44 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:08:54.469 04:10:44 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:08:54.469 04:10:44 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:08:54.469 04:10:44 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:08:54.469 04:10:44 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:08:54.469 04:10:44 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:08:54.469 04:10:44 -- target/referrals.sh@11 -- # NVMF_REFERRAL_IP_1=127.0.0.2 00:08:54.469 04:10:44 -- target/referrals.sh@12 -- # NVMF_REFERRAL_IP_2=127.0.0.3 00:08:54.469 04:10:44 -- target/referrals.sh@13 -- # NVMF_REFERRAL_IP_3=127.0.0.4 00:08:54.469 04:10:44 -- target/referrals.sh@14 -- # NVMF_PORT_REFERRAL=4430 00:08:54.469 04:10:44 -- target/referrals.sh@15 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:08:54.469 04:10:44 -- target/referrals.sh@16 -- # NQN=nqn.2016-06.io.spdk:cnode1 00:08:54.469 04:10:44 -- target/referrals.sh@37 -- # nvmftestinit 00:08:54.469 04:10:44 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:08:54.469 04:10:44 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:08:54.469 04:10:44 -- nvmf/common.sh@436 -- # prepare_net_devs 00:08:54.469 04:10:44 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:08:54.469 04:10:44 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:08:54.469 04:10:44 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:54.469 04:10:44 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:54.469 04:10:44 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:08:54.469 04:10:44 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:08:54.469 04:10:44 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:08:54.469 04:10:44 -- nvmf/common.sh@284 -- # xtrace_disable 00:08:54.469 04:10:44 -- common/autotest_common.sh@10 -- # set +x 00:08:56.383 04:10:46 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:08:56.383 04:10:46 -- nvmf/common.sh@290 -- # pci_devs=() 00:08:56.383 04:10:46 -- nvmf/common.sh@290 -- # local -a pci_devs 00:08:56.383 04:10:46 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:08:56.383 04:10:46 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:08:56.383 04:10:46 -- nvmf/common.sh@292 -- # pci_drivers=() 00:08:56.383 04:10:46 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:08:56.383 04:10:46 -- nvmf/common.sh@294 -- # net_devs=() 00:08:56.384 04:10:46 -- nvmf/common.sh@294 -- # local -ga net_devs 00:08:56.384 04:10:46 -- nvmf/common.sh@295 -- # e810=() 00:08:56.384 04:10:46 -- nvmf/common.sh@295 -- # local -ga e810 00:08:56.384 04:10:46 -- nvmf/common.sh@296 -- # x722=() 00:08:56.384 04:10:46 -- nvmf/common.sh@296 -- # local -ga x722 00:08:56.384 04:10:46 -- nvmf/common.sh@297 -- # mlx=() 00:08:56.384 04:10:46 -- nvmf/common.sh@297 -- # local -ga mlx 00:08:56.384 04:10:46 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:08:56.384 04:10:46 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:08:56.384 04:10:46 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:08:56.384 04:10:46 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:08:56.384 04:10:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:56.384 04:10:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:08:56.384 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:08:56.384 04:10:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:08:56.384 04:10:46 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:08:56.384 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:08:56.384 04:10:46 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:08:56.384 04:10:46 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:56.384 04:10:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:56.384 04:10:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:56.384 04:10:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:56.384 04:10:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:08:56.384 Found net devices under 0000:0a:00.0: cvl_0_0 00:08:56.384 04:10:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:56.384 04:10:46 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:08:56.384 04:10:46 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:08:56.384 04:10:46 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:08:56.384 04:10:46 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:08:56.384 04:10:46 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:08:56.384 Found net devices under 0000:0a:00.1: cvl_0_1 00:08:56.384 04:10:46 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:08:56.384 04:10:46 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:08:56.384 04:10:46 -- nvmf/common.sh@402 -- # is_hw=yes 00:08:56.384 04:10:46 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:08:56.384 04:10:46 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:08:56.384 04:10:46 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:08:56.384 04:10:46 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:08:56.384 04:10:46 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:08:56.384 04:10:46 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:08:56.384 04:10:46 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:08:56.384 04:10:46 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:08:56.384 04:10:46 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:08:56.384 04:10:46 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:08:56.384 04:10:46 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:08:56.384 04:10:46 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:08:56.384 04:10:46 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:08:56.384 04:10:46 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:08:56.384 04:10:46 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:08:56.384 04:10:46 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:08:56.384 04:10:46 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:08:56.384 04:10:46 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:08:56.384 04:10:46 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:08:56.384 04:10:46 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:08:56.384 04:10:46 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:08:56.384 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:08:56.384 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.330 ms 00:08:56.384 00:08:56.384 --- 10.0.0.2 ping statistics --- 00:08:56.384 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:56.384 rtt min/avg/max/mdev = 0.330/0.330/0.330/0.000 ms 00:08:56.384 04:10:46 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:08:56.384 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:08:56.384 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.195 ms 00:08:56.384 00:08:56.384 --- 10.0.0.1 ping statistics --- 00:08:56.384 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:08:56.384 rtt min/avg/max/mdev = 0.195/0.195/0.195/0.000 ms 00:08:56.384 04:10:46 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:08:56.384 04:10:46 -- nvmf/common.sh@410 -- # return 0 00:08:56.384 04:10:46 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:08:56.384 04:10:46 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:08:56.384 04:10:46 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:08:56.384 04:10:46 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:08:56.384 04:10:46 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:08:56.384 04:10:46 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:08:56.641 04:10:47 -- target/referrals.sh@38 -- # nvmfappstart -m 0xF 00:08:56.641 04:10:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:08:56.641 04:10:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:08:56.641 04:10:47 -- common/autotest_common.sh@10 -- # set +x 00:08:56.641 04:10:47 -- nvmf/common.sh@469 -- # nvmfpid=2269797 00:08:56.641 04:10:47 -- nvmf/common.sh@470 -- # waitforlisten 2269797 00:08:56.641 04:10:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:08:56.641 04:10:47 -- common/autotest_common.sh@829 -- # '[' -z 2269797 ']' 00:08:56.641 04:10:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:08:56.641 04:10:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:08:56.641 04:10:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:08:56.641 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:08:56.641 04:10:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:08:56.641 04:10:47 -- common/autotest_common.sh@10 -- # set +x 00:08:56.641 [2024-11-30 04:10:47.070782] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:08:56.642 [2024-11-30 04:10:47.070876] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:08:56.642 EAL: No free 2048 kB hugepages reported on node 1 00:08:56.642 [2024-11-30 04:10:47.152425] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:08:56.642 [2024-11-30 04:10:47.249901] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:08:56.642 [2024-11-30 04:10:47.250075] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:08:56.642 [2024-11-30 04:10:47.250115] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:08:56.642 [2024-11-30 04:10:47.250130] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:08:56.642 [2024-11-30 04:10:47.250208] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:08:56.642 [2024-11-30 04:10:47.250277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:08:56.642 [2024-11-30 04:10:47.250331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:08:56.642 [2024-11-30 04:10:47.250334] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:08:57.575 04:10:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:08:57.575 04:10:48 -- common/autotest_common.sh@862 -- # return 0 00:08:57.575 04:10:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:08:57.575 04:10:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:08:57.575 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:57.575 04:10:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:08:57.575 04:10:48 -- target/referrals.sh@40 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:08:57.575 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.575 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:57.575 [2024-11-30 04:10:48.143802] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:08:57.575 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.575 04:10:48 -- target/referrals.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener -t tcp -a 10.0.0.2 -s 8009 discovery 00:08:57.575 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.575 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:57.575 [2024-11-30 04:10:48.156083] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:08:57.575 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.575 04:10:48 -- target/referrals.sh@44 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 00:08:57.575 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.575 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:57.575 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.575 04:10:48 -- target/referrals.sh@45 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.3 -s 4430 00:08:57.575 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.575 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:57.575 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.575 04:10:48 -- target/referrals.sh@46 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.4 -s 4430 00:08:57.575 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.575 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:57.575 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.575 04:10:48 -- target/referrals.sh@48 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:57.575 04:10:48 -- target/referrals.sh@48 -- # jq length 00:08:57.575 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.575 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:57.575 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.866 04:10:48 -- target/referrals.sh@48 -- # (( 3 == 3 )) 00:08:57.866 04:10:48 -- target/referrals.sh@49 -- # get_referral_ips rpc 00:08:57.866 04:10:48 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:57.866 04:10:48 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:57.866 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:57.866 04:10:48 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:57.866 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:57.866 04:10:48 -- target/referrals.sh@21 -- # sort 00:08:57.866 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:57.866 04:10:48 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:57.866 04:10:48 -- target/referrals.sh@49 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:57.866 04:10:48 -- target/referrals.sh@50 -- # get_referral_ips nvme 00:08:57.866 04:10:48 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:57.866 04:10:48 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:57.866 04:10:48 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:57.866 04:10:48 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:57.866 04:10:48 -- target/referrals.sh@26 -- # sort 00:08:58.148 04:10:48 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.3 127.0.0.4 00:08:58.148 04:10:48 -- target/referrals.sh@50 -- # [[ 127.0.0.2 127.0.0.3 127.0.0.4 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\3\ \1\2\7\.\0\.\0\.\4 ]] 00:08:58.148 04:10:48 -- target/referrals.sh@52 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 00:08:58.148 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.148 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:58.148 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.148 04:10:48 -- target/referrals.sh@53 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.3 -s 4430 00:08:58.148 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.148 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:58.148 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.148 04:10:48 -- target/referrals.sh@54 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.4 -s 4430 00:08:58.148 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.148 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:58.148 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.148 04:10:48 -- target/referrals.sh@56 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:58.148 04:10:48 -- target/referrals.sh@56 -- # jq length 00:08:58.148 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.148 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:58.148 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.149 04:10:48 -- target/referrals.sh@56 -- # (( 0 == 0 )) 00:08:58.149 04:10:48 -- target/referrals.sh@57 -- # get_referral_ips nvme 00:08:58.149 04:10:48 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:58.149 04:10:48 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:58.149 04:10:48 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:58.149 04:10:48 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:58.149 04:10:48 -- target/referrals.sh@26 -- # sort 00:08:58.149 04:10:48 -- target/referrals.sh@26 -- # echo 00:08:58.149 04:10:48 -- target/referrals.sh@57 -- # [[ '' == '' ]] 00:08:58.149 04:10:48 -- target/referrals.sh@60 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n discovery 00:08:58.149 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.149 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:58.149 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.149 04:10:48 -- target/referrals.sh@62 -- # rpc_cmd nvmf_discovery_add_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:58.149 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.149 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:58.406 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.406 04:10:48 -- target/referrals.sh@65 -- # get_referral_ips rpc 00:08:58.406 04:10:48 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:58.406 04:10:48 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:58.406 04:10:48 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:58.406 04:10:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.406 04:10:48 -- common/autotest_common.sh@10 -- # set +x 00:08:58.406 04:10:48 -- target/referrals.sh@21 -- # sort 00:08:58.406 04:10:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.406 04:10:48 -- target/referrals.sh@21 -- # echo 127.0.0.2 127.0.0.2 00:08:58.406 04:10:48 -- target/referrals.sh@65 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:58.406 04:10:48 -- target/referrals.sh@66 -- # get_referral_ips nvme 00:08:58.406 04:10:48 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:58.406 04:10:48 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:58.407 04:10:48 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:58.407 04:10:48 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:58.407 04:10:48 -- target/referrals.sh@26 -- # sort 00:08:58.407 04:10:48 -- target/referrals.sh@26 -- # echo 127.0.0.2 127.0.0.2 00:08:58.407 04:10:48 -- target/referrals.sh@66 -- # [[ 127.0.0.2 127.0.0.2 == \1\2\7\.\0\.\0\.\2\ \1\2\7\.\0\.\0\.\2 ]] 00:08:58.407 04:10:48 -- target/referrals.sh@67 -- # get_discovery_entries 'nvme subsystem' 00:08:58.407 04:10:48 -- target/referrals.sh@67 -- # jq -r .subnqn 00:08:58.407 04:10:48 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:58.407 04:10:48 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:58.407 04:10:48 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:58.664 04:10:49 -- target/referrals.sh@67 -- # [[ nqn.2016-06.io.spdk:cnode1 == \n\q\n\.\2\0\1\6\-\0\6\.\i\o\.\s\p\d\k\:\c\n\o\d\e\1 ]] 00:08:58.664 04:10:49 -- target/referrals.sh@68 -- # get_discovery_entries 'discovery subsystem referral' 00:08:58.664 04:10:49 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:58.664 04:10:49 -- target/referrals.sh@68 -- # jq -r .subnqn 00:08:58.664 04:10:49 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:58.664 04:10:49 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:58.923 04:10:49 -- target/referrals.sh@68 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:58.923 04:10:49 -- target/referrals.sh@71 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2016-06.io.spdk:cnode1 00:08:58.923 04:10:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.923 04:10:49 -- common/autotest_common.sh@10 -- # set +x 00:08:58.923 04:10:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.923 04:10:49 -- target/referrals.sh@73 -- # get_referral_ips rpc 00:08:58.923 04:10:49 -- target/referrals.sh@19 -- # [[ rpc == \r\p\c ]] 00:08:58.923 04:10:49 -- target/referrals.sh@21 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:58.923 04:10:49 -- target/referrals.sh@21 -- # jq -r '.[].address.traddr' 00:08:58.923 04:10:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:58.923 04:10:49 -- common/autotest_common.sh@10 -- # set +x 00:08:58.923 04:10:49 -- target/referrals.sh@21 -- # sort 00:08:58.923 04:10:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:58.923 04:10:49 -- target/referrals.sh@21 -- # echo 127.0.0.2 00:08:58.923 04:10:49 -- target/referrals.sh@73 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:58.923 04:10:49 -- target/referrals.sh@74 -- # get_referral_ips nvme 00:08:58.923 04:10:49 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:58.923 04:10:49 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:58.923 04:10:49 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:58.923 04:10:49 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:58.923 04:10:49 -- target/referrals.sh@26 -- # sort 00:08:59.181 04:10:49 -- target/referrals.sh@26 -- # echo 127.0.0.2 00:08:59.181 04:10:49 -- target/referrals.sh@74 -- # [[ 127.0.0.2 == \1\2\7\.\0\.\0\.\2 ]] 00:08:59.181 04:10:49 -- target/referrals.sh@75 -- # get_discovery_entries 'nvme subsystem' 00:08:59.181 04:10:49 -- target/referrals.sh@75 -- # jq -r .subnqn 00:08:59.181 04:10:49 -- target/referrals.sh@31 -- # local 'subtype=nvme subsystem' 00:08:59.181 04:10:49 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:59.181 04:10:49 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "nvme subsystem")' 00:08:59.181 04:10:49 -- target/referrals.sh@75 -- # [[ '' == '' ]] 00:08:59.181 04:10:49 -- target/referrals.sh@76 -- # get_discovery_entries 'discovery subsystem referral' 00:08:59.181 04:10:49 -- target/referrals.sh@76 -- # jq -r .subnqn 00:08:59.181 04:10:49 -- target/referrals.sh@31 -- # local 'subtype=discovery subsystem referral' 00:08:59.181 04:10:49 -- target/referrals.sh@33 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:59.181 04:10:49 -- target/referrals.sh@34 -- # jq '.records[] | select(.subtype == "discovery subsystem referral")' 00:08:59.438 04:10:49 -- target/referrals.sh@76 -- # [[ nqn.2014-08.org.nvmexpress.discovery == \n\q\n\.\2\0\1\4\-\0\8\.\o\r\g\.\n\v\m\e\x\p\r\e\s\s\.\d\i\s\c\o\v\e\r\y ]] 00:08:59.438 04:10:49 -- target/referrals.sh@79 -- # rpc_cmd nvmf_discovery_remove_referral -t tcp -a 127.0.0.2 -s 4430 -n nqn.2014-08.org.nvmexpress.discovery 00:08:59.438 04:10:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:59.438 04:10:49 -- common/autotest_common.sh@10 -- # set +x 00:08:59.438 04:10:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:59.439 04:10:49 -- target/referrals.sh@82 -- # rpc_cmd nvmf_discovery_get_referrals 00:08:59.439 04:10:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:08:59.439 04:10:49 -- target/referrals.sh@82 -- # jq length 00:08:59.439 04:10:49 -- common/autotest_common.sh@10 -- # set +x 00:08:59.439 04:10:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:08:59.439 04:10:49 -- target/referrals.sh@82 -- # (( 0 == 0 )) 00:08:59.439 04:10:49 -- target/referrals.sh@83 -- # get_referral_ips nvme 00:08:59.439 04:10:49 -- target/referrals.sh@19 -- # [[ nvme == \r\p\c ]] 00:08:59.439 04:10:49 -- target/referrals.sh@22 -- # [[ nvme == \n\v\m\e ]] 00:08:59.439 04:10:49 -- target/referrals.sh@26 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 8009 -o json 00:08:59.439 04:10:49 -- target/referrals.sh@26 -- # jq -r '.records[] | select(.subtype != "current discovery subsystem").traddr' 00:08:59.439 04:10:49 -- target/referrals.sh@26 -- # sort 00:08:59.696 04:10:50 -- target/referrals.sh@26 -- # echo 00:08:59.696 04:10:50 -- target/referrals.sh@83 -- # [[ '' == '' ]] 00:08:59.696 04:10:50 -- target/referrals.sh@85 -- # trap - SIGINT SIGTERM EXIT 00:08:59.696 04:10:50 -- target/referrals.sh@86 -- # nvmftestfini 00:08:59.696 04:10:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:08:59.696 04:10:50 -- nvmf/common.sh@116 -- # sync 00:08:59.696 04:10:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:08:59.696 04:10:50 -- nvmf/common.sh@119 -- # set +e 00:08:59.696 04:10:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:08:59.696 04:10:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:08:59.696 rmmod nvme_tcp 00:08:59.696 rmmod nvme_fabrics 00:08:59.696 rmmod nvme_keyring 00:08:59.696 04:10:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:08:59.696 04:10:50 -- nvmf/common.sh@123 -- # set -e 00:08:59.696 04:10:50 -- nvmf/common.sh@124 -- # return 0 00:08:59.696 04:10:50 -- nvmf/common.sh@477 -- # '[' -n 2269797 ']' 00:08:59.696 04:10:50 -- nvmf/common.sh@478 -- # killprocess 2269797 00:08:59.696 04:10:50 -- common/autotest_common.sh@936 -- # '[' -z 2269797 ']' 00:08:59.696 04:10:50 -- common/autotest_common.sh@940 -- # kill -0 2269797 00:08:59.696 04:10:50 -- common/autotest_common.sh@941 -- # uname 00:08:59.696 04:10:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:08:59.696 04:10:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2269797 00:08:59.696 04:10:50 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:08:59.696 04:10:50 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:08:59.696 04:10:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2269797' 00:08:59.696 killing process with pid 2269797 00:08:59.696 04:10:50 -- common/autotest_common.sh@955 -- # kill 2269797 00:08:59.696 04:10:50 -- common/autotest_common.sh@960 -- # wait 2269797 00:08:59.956 04:10:50 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:08:59.956 04:10:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:08:59.956 04:10:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:08:59.956 04:10:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:08:59.956 04:10:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:08:59.956 04:10:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:08:59.956 04:10:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:08:59.956 04:10:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:02.489 04:10:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:09:02.489 00:09:02.489 real 0m8.028s 00:09:02.489 user 0m14.786s 00:09:02.489 sys 0m2.408s 00:09:02.489 04:10:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:09:02.489 04:10:52 -- common/autotest_common.sh@10 -- # set +x 00:09:02.489 ************************************ 00:09:02.489 END TEST nvmf_referrals 00:09:02.489 ************************************ 00:09:02.489 04:10:52 -- nvmf/nvmf.sh@27 -- # run_test nvmf_connect_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:02.489 04:10:52 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:09:02.489 04:10:52 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:09:02.489 04:10:52 -- common/autotest_common.sh@10 -- # set +x 00:09:02.489 ************************************ 00:09:02.489 START TEST nvmf_connect_disconnect 00:09:02.489 ************************************ 00:09:02.489 04:10:52 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_disconnect.sh --transport=tcp 00:09:02.489 * Looking for test storage... 00:09:02.489 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:09:02.489 04:10:52 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:09:02.489 04:10:52 -- common/autotest_common.sh@1690 -- # lcov --version 00:09:02.489 04:10:52 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:09:02.489 04:10:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:09:02.489 04:10:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:09:02.489 04:10:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:09:02.489 04:10:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:09:02.489 04:10:52 -- scripts/common.sh@335 -- # IFS=.-: 00:09:02.489 04:10:52 -- scripts/common.sh@335 -- # read -ra ver1 00:09:02.489 04:10:52 -- scripts/common.sh@336 -- # IFS=.-: 00:09:02.489 04:10:52 -- scripts/common.sh@336 -- # read -ra ver2 00:09:02.489 04:10:52 -- scripts/common.sh@337 -- # local 'op=<' 00:09:02.489 04:10:52 -- scripts/common.sh@339 -- # ver1_l=2 00:09:02.489 04:10:52 -- scripts/common.sh@340 -- # ver2_l=1 00:09:02.489 04:10:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:09:02.489 04:10:52 -- scripts/common.sh@343 -- # case "$op" in 00:09:02.489 04:10:52 -- scripts/common.sh@344 -- # : 1 00:09:02.489 04:10:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:09:02.489 04:10:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:09:02.489 04:10:52 -- scripts/common.sh@364 -- # decimal 1 00:09:02.489 04:10:52 -- scripts/common.sh@352 -- # local d=1 00:09:02.489 04:10:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:09:02.489 04:10:52 -- scripts/common.sh@354 -- # echo 1 00:09:02.489 04:10:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:09:02.489 04:10:52 -- scripts/common.sh@365 -- # decimal 2 00:09:02.489 04:10:52 -- scripts/common.sh@352 -- # local d=2 00:09:02.489 04:10:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:09:02.489 04:10:52 -- scripts/common.sh@354 -- # echo 2 00:09:02.489 04:10:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:09:02.489 04:10:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:09:02.489 04:10:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:09:02.489 04:10:52 -- scripts/common.sh@367 -- # return 0 00:09:02.489 04:10:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:09:02.489 04:10:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:09:02.489 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.489 --rc genhtml_branch_coverage=1 00:09:02.489 --rc genhtml_function_coverage=1 00:09:02.489 --rc genhtml_legend=1 00:09:02.489 --rc geninfo_all_blocks=1 00:09:02.489 --rc geninfo_unexecuted_blocks=1 00:09:02.489 00:09:02.489 ' 00:09:02.489 04:10:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:09:02.489 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.489 --rc genhtml_branch_coverage=1 00:09:02.489 --rc genhtml_function_coverage=1 00:09:02.489 --rc genhtml_legend=1 00:09:02.489 --rc geninfo_all_blocks=1 00:09:02.489 --rc geninfo_unexecuted_blocks=1 00:09:02.489 00:09:02.489 ' 00:09:02.489 04:10:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:09:02.489 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.489 --rc genhtml_branch_coverage=1 00:09:02.489 --rc genhtml_function_coverage=1 00:09:02.489 --rc genhtml_legend=1 00:09:02.489 --rc geninfo_all_blocks=1 00:09:02.489 --rc geninfo_unexecuted_blocks=1 00:09:02.489 00:09:02.489 ' 00:09:02.489 04:10:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:09:02.489 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:09:02.489 --rc genhtml_branch_coverage=1 00:09:02.489 --rc genhtml_function_coverage=1 00:09:02.490 --rc genhtml_legend=1 00:09:02.490 --rc geninfo_all_blocks=1 00:09:02.490 --rc geninfo_unexecuted_blocks=1 00:09:02.490 00:09:02.490 ' 00:09:02.490 04:10:52 -- target/connect_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:09:02.490 04:10:52 -- nvmf/common.sh@7 -- # uname -s 00:09:02.490 04:10:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:09:02.490 04:10:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:09:02.490 04:10:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:09:02.490 04:10:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:09:02.490 04:10:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:09:02.490 04:10:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:09:02.490 04:10:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:09:02.490 04:10:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:09:02.490 04:10:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:09:02.490 04:10:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:09:02.490 04:10:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:09:02.490 04:10:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:09:02.490 04:10:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:09:02.490 04:10:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:09:02.490 04:10:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:09:02.490 04:10:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:09:02.490 04:10:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:09:02.490 04:10:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:09:02.490 04:10:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:09:02.490 04:10:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.490 04:10:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.490 04:10:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.490 04:10:52 -- paths/export.sh@5 -- # export PATH 00:09:02.490 04:10:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:09:02.490 04:10:52 -- nvmf/common.sh@46 -- # : 0 00:09:02.490 04:10:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:09:02.490 04:10:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:09:02.490 04:10:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:09:02.490 04:10:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:09:02.490 04:10:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:09:02.490 04:10:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:09:02.490 04:10:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:09:02.490 04:10:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:09:02.490 04:10:52 -- target/connect_disconnect.sh@11 -- # MALLOC_BDEV_SIZE=64 00:09:02.490 04:10:52 -- target/connect_disconnect.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:09:02.490 04:10:52 -- target/connect_disconnect.sh@15 -- # nvmftestinit 00:09:02.490 04:10:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:09:02.490 04:10:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:09:02.490 04:10:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:09:02.490 04:10:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:09:02.490 04:10:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:09:02.490 04:10:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:09:02.490 04:10:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:09:02.490 04:10:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:09:02.490 04:10:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:09:02.490 04:10:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:09:02.490 04:10:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:09:02.490 04:10:52 -- common/autotest_common.sh@10 -- # set +x 00:09:04.392 04:10:54 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:09:04.392 04:10:54 -- nvmf/common.sh@290 -- # pci_devs=() 00:09:04.392 04:10:54 -- nvmf/common.sh@290 -- # local -a pci_devs 00:09:04.392 04:10:54 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:09:04.392 04:10:54 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:09:04.392 04:10:54 -- nvmf/common.sh@292 -- # pci_drivers=() 00:09:04.392 04:10:54 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:09:04.392 04:10:54 -- nvmf/common.sh@294 -- # net_devs=() 00:09:04.392 04:10:54 -- nvmf/common.sh@294 -- # local -ga net_devs 00:09:04.392 04:10:54 -- nvmf/common.sh@295 -- # e810=() 00:09:04.392 04:10:54 -- nvmf/common.sh@295 -- # local -ga e810 00:09:04.392 04:10:54 -- nvmf/common.sh@296 -- # x722=() 00:09:04.392 04:10:54 -- nvmf/common.sh@296 -- # local -ga x722 00:09:04.392 04:10:54 -- nvmf/common.sh@297 -- # mlx=() 00:09:04.392 04:10:54 -- nvmf/common.sh@297 -- # local -ga mlx 00:09:04.392 04:10:54 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:09:04.392 04:10:54 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:09:04.392 04:10:54 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:09:04.392 04:10:54 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:09:04.392 04:10:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:04.392 04:10:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:09:04.392 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:09:04.392 04:10:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:09:04.392 04:10:54 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:09:04.392 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:09:04.392 04:10:54 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:09:04.392 04:10:54 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:04.392 04:10:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:04.392 04:10:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:04.392 04:10:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:04.392 04:10:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:09:04.392 Found net devices under 0000:0a:00.0: cvl_0_0 00:09:04.392 04:10:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:04.392 04:10:54 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:09:04.392 04:10:54 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:09:04.392 04:10:54 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:09:04.392 04:10:54 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:09:04.392 04:10:54 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:09:04.392 Found net devices under 0000:0a:00.1: cvl_0_1 00:09:04.392 04:10:54 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:09:04.392 04:10:54 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:09:04.392 04:10:54 -- nvmf/common.sh@402 -- # is_hw=yes 00:09:04.392 04:10:54 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:09:04.392 04:10:54 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:09:04.392 04:10:54 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:09:04.392 04:10:54 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:09:04.392 04:10:54 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:09:04.392 04:10:54 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:09:04.392 04:10:54 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:09:04.392 04:10:54 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:09:04.392 04:10:54 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:09:04.392 04:10:54 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:09:04.392 04:10:54 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:09:04.392 04:10:54 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:09:04.392 04:10:54 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:09:04.392 04:10:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:09:04.392 04:10:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:09:04.649 04:10:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:09:04.649 04:10:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:09:04.649 04:10:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:09:04.649 04:10:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:09:04.649 04:10:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:09:04.649 04:10:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:09:04.649 04:10:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:09:04.649 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:09:04.649 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.340 ms 00:09:04.649 00:09:04.649 --- 10.0.0.2 ping statistics --- 00:09:04.649 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:04.649 rtt min/avg/max/mdev = 0.340/0.340/0.340/0.000 ms 00:09:04.649 04:10:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:09:04.649 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:09:04.649 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.145 ms 00:09:04.649 00:09:04.649 --- 10.0.0.1 ping statistics --- 00:09:04.649 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:09:04.649 rtt min/avg/max/mdev = 0.145/0.145/0.145/0.000 ms 00:09:04.649 04:10:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:09:04.649 04:10:55 -- nvmf/common.sh@410 -- # return 0 00:09:04.649 04:10:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:09:04.649 04:10:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:09:04.649 04:10:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:09:04.649 04:10:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:09:04.649 04:10:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:09:04.649 04:10:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:09:04.649 04:10:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:09:04.649 04:10:55 -- target/connect_disconnect.sh@16 -- # nvmfappstart -m 0xF 00:09:04.649 04:10:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:09:04.649 04:10:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:09:04.649 04:10:55 -- common/autotest_common.sh@10 -- # set +x 00:09:04.649 04:10:55 -- nvmf/common.sh@469 -- # nvmfpid=2272262 00:09:04.649 04:10:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:09:04.649 04:10:55 -- nvmf/common.sh@470 -- # waitforlisten 2272262 00:09:04.649 04:10:55 -- common/autotest_common.sh@829 -- # '[' -z 2272262 ']' 00:09:04.649 04:10:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:09:04.649 04:10:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:09:04.649 04:10:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:09:04.649 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:09:04.649 04:10:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:09:04.649 04:10:55 -- common/autotest_common.sh@10 -- # set +x 00:09:04.906 [2024-11-30 04:10:55.302210] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:09:04.906 [2024-11-30 04:10:55.302302] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:09:04.906 EAL: No free 2048 kB hugepages reported on node 1 00:09:04.906 [2024-11-30 04:10:55.379478] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:09:04.906 [2024-11-30 04:10:55.475226] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:09:04.906 [2024-11-30 04:10:55.475388] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:09:04.906 [2024-11-30 04:10:55.475408] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:09:04.906 [2024-11-30 04:10:55.475422] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:09:04.906 [2024-11-30 04:10:55.475505] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:09:04.906 [2024-11-30 04:10:55.475536] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:09:04.906 [2024-11-30 04:10:55.475592] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:09:04.906 [2024-11-30 04:10:55.475595] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:09:05.896 04:10:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:09:05.896 04:10:56 -- common/autotest_common.sh@862 -- # return 0 00:09:05.896 04:10:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:09:05.896 04:10:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:09:05.896 04:10:56 -- common/autotest_common.sh@10 -- # set +x 00:09:05.896 04:10:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:09:05.896 04:10:56 -- target/connect_disconnect.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -c 0 00:09:05.896 04:10:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.896 04:10:56 -- common/autotest_common.sh@10 -- # set +x 00:09:05.896 [2024-11-30 04:10:56.346781] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:09:05.896 04:10:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.896 04:10:56 -- target/connect_disconnect.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 00:09:05.896 04:10:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.896 04:10:56 -- common/autotest_common.sh@10 -- # set +x 00:09:05.896 04:10:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.896 04:10:56 -- target/connect_disconnect.sh@20 -- # bdev=Malloc0 00:09:05.896 04:10:56 -- target/connect_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:09:05.896 04:10:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.896 04:10:56 -- common/autotest_common.sh@10 -- # set +x 00:09:05.897 04:10:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.897 04:10:56 -- target/connect_disconnect.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:09:05.897 04:10:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.897 04:10:56 -- common/autotest_common.sh@10 -- # set +x 00:09:05.897 04:10:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.897 04:10:56 -- target/connect_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:09:05.897 04:10:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:09:05.897 04:10:56 -- common/autotest_common.sh@10 -- # set +x 00:09:05.897 [2024-11-30 04:10:56.399998] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:09:05.897 04:10:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:09:05.897 04:10:56 -- target/connect_disconnect.sh@26 -- # '[' 1 -eq 1 ']' 00:09:05.897 04:10:56 -- target/connect_disconnect.sh@27 -- # num_iterations=100 00:09:05.897 04:10:56 -- target/connect_disconnect.sh@29 -- # NVME_CONNECT='nvme connect -i 8' 00:09:05.897 04:10:56 -- target/connect_disconnect.sh@34 -- # set +x 00:09:08.418 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:10.943 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:13.467 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:15.364 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:17.886 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:20.413 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:22.311 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:24.836 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:26.732 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:29.259 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:31.784 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:33.705 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:36.229 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:38.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:40.652 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:43.179 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:45.705 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:47.604 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:50.129 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:52.654 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:54.551 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:57.076 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:09:59.618 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:01.516 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:04.047 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:06.591 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:09.116 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:11.098 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:13.626 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:16.160 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:18.082 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:20.612 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:23.139 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:25.037 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:27.564 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:30.091 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:31.990 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:34.519 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:37.048 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:38.948 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:41.475 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:44.002 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:45.946 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:48.498 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:51.027 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:52.927 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:55.480 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:10:58.001 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:00.528 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:02.425 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:04.951 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:06.847 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:09.375 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:11.902 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:13.800 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:16.323 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:18.852 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:20.749 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:23.299 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:25.844 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:27.743 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:30.273 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:32.798 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:34.696 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:37.270 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:39.807 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:41.706 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:44.234 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:46.760 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:48.661 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:51.187 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:53.717 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:55.614 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:11:58.142 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:00.671 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:02.571 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:05.099 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:07.624 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:09.523 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:12.049 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:14.579 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:16.477 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:19.006 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:21.536 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:23.436 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:25.963 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:28.492 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:30.391 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:32.918 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:35.444 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:37.345 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:39.877 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:42.404 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:44.305 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:46.962 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:48.860 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:51.388 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:53.916 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:56.441 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:58.337 [2024-11-30 04:14:48.778763] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x6dfb10 is same with the state(5) to be set 00:12:58.337 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:12:58.337 04:14:48 -- target/connect_disconnect.sh@43 -- # trap - SIGINT SIGTERM EXIT 00:12:58.337 04:14:48 -- target/connect_disconnect.sh@45 -- # nvmftestfini 00:12:58.337 04:14:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:12:58.337 04:14:48 -- nvmf/common.sh@116 -- # sync 00:12:58.337 04:14:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:12:58.337 04:14:48 -- nvmf/common.sh@119 -- # set +e 00:12:58.337 04:14:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:12:58.337 04:14:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:12:58.337 rmmod nvme_tcp 00:12:58.337 rmmod nvme_fabrics 00:12:58.337 rmmod nvme_keyring 00:12:58.337 04:14:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:12:58.337 04:14:48 -- nvmf/common.sh@123 -- # set -e 00:12:58.337 04:14:48 -- nvmf/common.sh@124 -- # return 0 00:12:58.337 04:14:48 -- nvmf/common.sh@477 -- # '[' -n 2272262 ']' 00:12:58.337 04:14:48 -- nvmf/common.sh@478 -- # killprocess 2272262 00:12:58.337 04:14:48 -- common/autotest_common.sh@936 -- # '[' -z 2272262 ']' 00:12:58.337 04:14:48 -- common/autotest_common.sh@940 -- # kill -0 2272262 00:12:58.337 04:14:48 -- common/autotest_common.sh@941 -- # uname 00:12:58.337 04:14:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:12:58.337 04:14:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2272262 00:12:58.337 04:14:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:12:58.337 04:14:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:12:58.337 04:14:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2272262' 00:12:58.337 killing process with pid 2272262 00:12:58.337 04:14:48 -- common/autotest_common.sh@955 -- # kill 2272262 00:12:58.337 04:14:48 -- common/autotest_common.sh@960 -- # wait 2272262 00:12:58.595 04:14:49 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:12:58.595 04:14:49 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:12:58.595 04:14:49 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:12:58.595 04:14:49 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:12:58.595 04:14:49 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:12:58.595 04:14:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:12:58.595 04:14:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:12:58.595 04:14:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:01.129 04:14:51 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:01.129 00:13:01.129 real 3m58.587s 00:13:01.129 user 15m7.729s 00:13:01.129 sys 0m35.855s 00:13:01.129 04:14:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:01.129 04:14:51 -- common/autotest_common.sh@10 -- # set +x 00:13:01.129 ************************************ 00:13:01.129 END TEST nvmf_connect_disconnect 00:13:01.129 ************************************ 00:13:01.129 04:14:51 -- nvmf/nvmf.sh@28 -- # run_test nvmf_multitarget /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:01.129 04:14:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:01.129 04:14:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:01.129 04:14:51 -- common/autotest_common.sh@10 -- # set +x 00:13:01.129 ************************************ 00:13:01.129 START TEST nvmf_multitarget 00:13:01.129 ************************************ 00:13:01.129 04:14:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget.sh --transport=tcp 00:13:01.129 * Looking for test storage... 00:13:01.129 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:01.129 04:14:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:01.129 04:14:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:01.129 04:14:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:01.129 04:14:51 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:01.129 04:14:51 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:01.129 04:14:51 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:01.129 04:14:51 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:01.129 04:14:51 -- scripts/common.sh@335 -- # IFS=.-: 00:13:01.129 04:14:51 -- scripts/common.sh@335 -- # read -ra ver1 00:13:01.129 04:14:51 -- scripts/common.sh@336 -- # IFS=.-: 00:13:01.129 04:14:51 -- scripts/common.sh@336 -- # read -ra ver2 00:13:01.129 04:14:51 -- scripts/common.sh@337 -- # local 'op=<' 00:13:01.129 04:14:51 -- scripts/common.sh@339 -- # ver1_l=2 00:13:01.129 04:14:51 -- scripts/common.sh@340 -- # ver2_l=1 00:13:01.129 04:14:51 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:01.129 04:14:51 -- scripts/common.sh@343 -- # case "$op" in 00:13:01.129 04:14:51 -- scripts/common.sh@344 -- # : 1 00:13:01.129 04:14:51 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:01.129 04:14:51 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:01.129 04:14:51 -- scripts/common.sh@364 -- # decimal 1 00:13:01.129 04:14:51 -- scripts/common.sh@352 -- # local d=1 00:13:01.129 04:14:51 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:01.129 04:14:51 -- scripts/common.sh@354 -- # echo 1 00:13:01.129 04:14:51 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:01.129 04:14:51 -- scripts/common.sh@365 -- # decimal 2 00:13:01.129 04:14:51 -- scripts/common.sh@352 -- # local d=2 00:13:01.129 04:14:51 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:01.129 04:14:51 -- scripts/common.sh@354 -- # echo 2 00:13:01.129 04:14:51 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:01.129 04:14:51 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:01.129 04:14:51 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:01.129 04:14:51 -- scripts/common.sh@367 -- # return 0 00:13:01.129 04:14:51 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:01.129 04:14:51 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:01.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:01.129 --rc genhtml_branch_coverage=1 00:13:01.129 --rc genhtml_function_coverage=1 00:13:01.129 --rc genhtml_legend=1 00:13:01.129 --rc geninfo_all_blocks=1 00:13:01.129 --rc geninfo_unexecuted_blocks=1 00:13:01.129 00:13:01.129 ' 00:13:01.129 04:14:51 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:01.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:01.129 --rc genhtml_branch_coverage=1 00:13:01.129 --rc genhtml_function_coverage=1 00:13:01.129 --rc genhtml_legend=1 00:13:01.129 --rc geninfo_all_blocks=1 00:13:01.129 --rc geninfo_unexecuted_blocks=1 00:13:01.129 00:13:01.129 ' 00:13:01.129 04:14:51 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:01.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:01.129 --rc genhtml_branch_coverage=1 00:13:01.129 --rc genhtml_function_coverage=1 00:13:01.129 --rc genhtml_legend=1 00:13:01.129 --rc geninfo_all_blocks=1 00:13:01.129 --rc geninfo_unexecuted_blocks=1 00:13:01.129 00:13:01.129 ' 00:13:01.129 04:14:51 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:01.129 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:01.129 --rc genhtml_branch_coverage=1 00:13:01.129 --rc genhtml_function_coverage=1 00:13:01.129 --rc genhtml_legend=1 00:13:01.129 --rc geninfo_all_blocks=1 00:13:01.129 --rc geninfo_unexecuted_blocks=1 00:13:01.129 00:13:01.129 ' 00:13:01.129 04:14:51 -- target/multitarget.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:01.129 04:14:51 -- nvmf/common.sh@7 -- # uname -s 00:13:01.129 04:14:51 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:01.129 04:14:51 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:01.129 04:14:51 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:01.129 04:14:51 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:01.129 04:14:51 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:01.129 04:14:51 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:01.129 04:14:51 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:01.129 04:14:51 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:01.129 04:14:51 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:01.129 04:14:51 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:01.129 04:14:51 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:01.129 04:14:51 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:01.129 04:14:51 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:01.129 04:14:51 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:01.129 04:14:51 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:01.129 04:14:51 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:01.129 04:14:51 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:01.129 04:14:51 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:01.129 04:14:51 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:01.129 04:14:51 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:01.129 04:14:51 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:01.129 04:14:51 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:01.129 04:14:51 -- paths/export.sh@5 -- # export PATH 00:13:01.129 04:14:51 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:01.129 04:14:51 -- nvmf/common.sh@46 -- # : 0 00:13:01.129 04:14:51 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:01.129 04:14:51 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:01.129 04:14:51 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:01.129 04:14:51 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:01.129 04:14:51 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:01.129 04:14:51 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:01.129 04:14:51 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:01.129 04:14:51 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:01.129 04:14:51 -- target/multitarget.sh@13 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:01.129 04:14:51 -- target/multitarget.sh@15 -- # nvmftestinit 00:13:01.129 04:14:51 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:01.129 04:14:51 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:01.129 04:14:51 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:01.129 04:14:51 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:01.129 04:14:51 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:01.129 04:14:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:01.129 04:14:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:01.129 04:14:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:01.129 04:14:51 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:01.129 04:14:51 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:01.129 04:14:51 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:01.129 04:14:51 -- common/autotest_common.sh@10 -- # set +x 00:13:03.031 04:14:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:03.031 04:14:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:03.031 04:14:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:03.031 04:14:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:03.031 04:14:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:03.031 04:14:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:03.031 04:14:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:03.031 04:14:53 -- nvmf/common.sh@294 -- # net_devs=() 00:13:03.031 04:14:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:03.031 04:14:53 -- nvmf/common.sh@295 -- # e810=() 00:13:03.031 04:14:53 -- nvmf/common.sh@295 -- # local -ga e810 00:13:03.031 04:14:53 -- nvmf/common.sh@296 -- # x722=() 00:13:03.031 04:14:53 -- nvmf/common.sh@296 -- # local -ga x722 00:13:03.031 04:14:53 -- nvmf/common.sh@297 -- # mlx=() 00:13:03.031 04:14:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:03.031 04:14:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:03.031 04:14:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:03.031 04:14:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:03.031 04:14:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:03.031 04:14:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:03.031 04:14:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:03.031 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:03.031 04:14:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:03.031 04:14:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:03.031 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:03.031 04:14:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:03.031 04:14:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:03.031 04:14:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:03.031 04:14:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:03.031 04:14:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:03.031 04:14:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:03.031 04:14:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:03.031 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:03.031 04:14:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:03.031 04:14:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:03.031 04:14:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:03.032 04:14:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:03.032 04:14:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:03.032 04:14:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:03.032 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:03.032 04:14:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:03.032 04:14:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:03.032 04:14:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:03.032 04:14:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:03.032 04:14:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:03.032 04:14:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:03.032 04:14:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:03.032 04:14:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:03.032 04:14:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:03.032 04:14:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:03.032 04:14:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:03.032 04:14:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:03.032 04:14:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:03.032 04:14:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:03.032 04:14:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:03.032 04:14:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:03.032 04:14:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:03.032 04:14:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:03.032 04:14:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:03.032 04:14:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:03.032 04:14:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:03.032 04:14:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:03.032 04:14:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:03.032 04:14:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:03.032 04:14:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:03.032 04:14:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:03.032 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:03.032 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.299 ms 00:13:03.032 00:13:03.032 --- 10.0.0.2 ping statistics --- 00:13:03.032 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:03.032 rtt min/avg/max/mdev = 0.299/0.299/0.299/0.000 ms 00:13:03.032 04:14:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:03.032 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:03.032 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.157 ms 00:13:03.032 00:13:03.032 --- 10.0.0.1 ping statistics --- 00:13:03.032 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:03.032 rtt min/avg/max/mdev = 0.157/0.157/0.157/0.000 ms 00:13:03.032 04:14:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:03.032 04:14:53 -- nvmf/common.sh@410 -- # return 0 00:13:03.032 04:14:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:03.032 04:14:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:03.032 04:14:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:03.032 04:14:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:03.032 04:14:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:03.032 04:14:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:03.032 04:14:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:03.032 04:14:53 -- target/multitarget.sh@16 -- # nvmfappstart -m 0xF 00:13:03.032 04:14:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:03.032 04:14:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:03.032 04:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:03.032 04:14:53 -- nvmf/common.sh@469 -- # nvmfpid=2304558 00:13:03.032 04:14:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:03.032 04:14:53 -- nvmf/common.sh@470 -- # waitforlisten 2304558 00:13:03.032 04:14:53 -- common/autotest_common.sh@829 -- # '[' -z 2304558 ']' 00:13:03.032 04:14:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:03.032 04:14:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:03.032 04:14:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:03.032 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:03.032 04:14:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:03.032 04:14:53 -- common/autotest_common.sh@10 -- # set +x 00:13:03.291 [2024-11-30 04:14:53.673213] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:03.291 [2024-11-30 04:14:53.673307] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:03.291 EAL: No free 2048 kB hugepages reported on node 1 00:13:03.291 [2024-11-30 04:14:53.739111] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:03.291 [2024-11-30 04:14:53.827054] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:03.291 [2024-11-30 04:14:53.827215] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:03.291 [2024-11-30 04:14:53.827247] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:03.291 [2024-11-30 04:14:53.827260] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:03.291 [2024-11-30 04:14:53.827315] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:03.291 [2024-11-30 04:14:53.827379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:03.291 [2024-11-30 04:14:53.827427] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:03.291 [2024-11-30 04:14:53.827429] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:04.225 04:14:54 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:04.225 04:14:54 -- common/autotest_common.sh@862 -- # return 0 00:13:04.225 04:14:54 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:04.225 04:14:54 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:04.225 04:14:54 -- common/autotest_common.sh@10 -- # set +x 00:13:04.225 04:14:54 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:04.225 04:14:54 -- target/multitarget.sh@18 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:04.225 04:14:54 -- target/multitarget.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:04.225 04:14:54 -- target/multitarget.sh@21 -- # jq length 00:13:04.225 04:14:54 -- target/multitarget.sh@21 -- # '[' 1 '!=' 1 ']' 00:13:04.225 04:14:54 -- target/multitarget.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_1 -s 32 00:13:04.482 "nvmf_tgt_1" 00:13:04.482 04:14:54 -- target/multitarget.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_create_target -n nvmf_tgt_2 -s 32 00:13:04.482 "nvmf_tgt_2" 00:13:04.482 04:14:55 -- target/multitarget.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:04.482 04:14:55 -- target/multitarget.sh@28 -- # jq length 00:13:04.482 04:14:55 -- target/multitarget.sh@28 -- # '[' 3 '!=' 3 ']' 00:13:04.482 04:14:55 -- target/multitarget.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_1 00:13:04.739 true 00:13:04.739 04:14:55 -- target/multitarget.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target -n nvmf_tgt_2 00:13:04.739 true 00:13:04.739 04:14:55 -- target/multitarget.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_get_targets 00:13:04.739 04:14:55 -- target/multitarget.sh@35 -- # jq length 00:13:04.997 04:14:55 -- target/multitarget.sh@35 -- # '[' 1 '!=' 1 ']' 00:13:04.997 04:14:55 -- target/multitarget.sh@39 -- # trap - SIGINT SIGTERM EXIT 00:13:04.997 04:14:55 -- target/multitarget.sh@41 -- # nvmftestfini 00:13:04.997 04:14:55 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:04.997 04:14:55 -- nvmf/common.sh@116 -- # sync 00:13:04.997 04:14:55 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:04.997 04:14:55 -- nvmf/common.sh@119 -- # set +e 00:13:04.997 04:14:55 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:04.997 04:14:55 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:04.997 rmmod nvme_tcp 00:13:04.997 rmmod nvme_fabrics 00:13:04.997 rmmod nvme_keyring 00:13:04.997 04:14:55 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:04.997 04:14:55 -- nvmf/common.sh@123 -- # set -e 00:13:04.997 04:14:55 -- nvmf/common.sh@124 -- # return 0 00:13:04.997 04:14:55 -- nvmf/common.sh@477 -- # '[' -n 2304558 ']' 00:13:04.997 04:14:55 -- nvmf/common.sh@478 -- # killprocess 2304558 00:13:04.997 04:14:55 -- common/autotest_common.sh@936 -- # '[' -z 2304558 ']' 00:13:04.997 04:14:55 -- common/autotest_common.sh@940 -- # kill -0 2304558 00:13:04.997 04:14:55 -- common/autotest_common.sh@941 -- # uname 00:13:04.997 04:14:55 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:04.997 04:14:55 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2304558 00:13:04.997 04:14:55 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:04.997 04:14:55 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:04.997 04:14:55 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2304558' 00:13:04.997 killing process with pid 2304558 00:13:04.997 04:14:55 -- common/autotest_common.sh@955 -- # kill 2304558 00:13:04.997 04:14:55 -- common/autotest_common.sh@960 -- # wait 2304558 00:13:05.257 04:14:55 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:05.257 04:14:55 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:05.257 04:14:55 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:05.257 04:14:55 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:05.257 04:14:55 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:05.257 04:14:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:05.257 04:14:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:05.257 04:14:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:07.163 04:14:57 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:07.163 00:13:07.164 real 0m6.578s 00:13:07.164 user 0m9.496s 00:13:07.164 sys 0m2.004s 00:13:07.164 04:14:57 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:07.164 04:14:57 -- common/autotest_common.sh@10 -- # set +x 00:13:07.164 ************************************ 00:13:07.164 END TEST nvmf_multitarget 00:13:07.164 ************************************ 00:13:07.422 04:14:57 -- nvmf/nvmf.sh@29 -- # run_test nvmf_rpc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:07.422 04:14:57 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:07.422 04:14:57 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:07.422 04:14:57 -- common/autotest_common.sh@10 -- # set +x 00:13:07.422 ************************************ 00:13:07.422 START TEST nvmf_rpc 00:13:07.422 ************************************ 00:13:07.422 04:14:57 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.sh --transport=tcp 00:13:07.422 * Looking for test storage... 00:13:07.422 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:07.422 04:14:57 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:07.422 04:14:57 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:07.422 04:14:57 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:07.422 04:14:57 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:07.422 04:14:57 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:07.422 04:14:57 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:07.422 04:14:57 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:07.422 04:14:57 -- scripts/common.sh@335 -- # IFS=.-: 00:13:07.422 04:14:57 -- scripts/common.sh@335 -- # read -ra ver1 00:13:07.422 04:14:57 -- scripts/common.sh@336 -- # IFS=.-: 00:13:07.422 04:14:57 -- scripts/common.sh@336 -- # read -ra ver2 00:13:07.422 04:14:57 -- scripts/common.sh@337 -- # local 'op=<' 00:13:07.422 04:14:57 -- scripts/common.sh@339 -- # ver1_l=2 00:13:07.422 04:14:57 -- scripts/common.sh@340 -- # ver2_l=1 00:13:07.422 04:14:57 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:07.422 04:14:57 -- scripts/common.sh@343 -- # case "$op" in 00:13:07.422 04:14:57 -- scripts/common.sh@344 -- # : 1 00:13:07.422 04:14:57 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:07.422 04:14:57 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:07.422 04:14:57 -- scripts/common.sh@364 -- # decimal 1 00:13:07.422 04:14:57 -- scripts/common.sh@352 -- # local d=1 00:13:07.422 04:14:57 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:07.422 04:14:57 -- scripts/common.sh@354 -- # echo 1 00:13:07.422 04:14:57 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:07.422 04:14:57 -- scripts/common.sh@365 -- # decimal 2 00:13:07.422 04:14:57 -- scripts/common.sh@352 -- # local d=2 00:13:07.422 04:14:57 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:07.423 04:14:57 -- scripts/common.sh@354 -- # echo 2 00:13:07.423 04:14:57 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:07.423 04:14:57 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:07.423 04:14:57 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:07.423 04:14:57 -- scripts/common.sh@367 -- # return 0 00:13:07.423 04:14:57 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:07.423 04:14:57 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:07.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:07.423 --rc genhtml_branch_coverage=1 00:13:07.423 --rc genhtml_function_coverage=1 00:13:07.423 --rc genhtml_legend=1 00:13:07.423 --rc geninfo_all_blocks=1 00:13:07.423 --rc geninfo_unexecuted_blocks=1 00:13:07.423 00:13:07.423 ' 00:13:07.423 04:14:57 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:07.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:07.423 --rc genhtml_branch_coverage=1 00:13:07.423 --rc genhtml_function_coverage=1 00:13:07.423 --rc genhtml_legend=1 00:13:07.423 --rc geninfo_all_blocks=1 00:13:07.423 --rc geninfo_unexecuted_blocks=1 00:13:07.423 00:13:07.423 ' 00:13:07.423 04:14:57 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:07.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:07.423 --rc genhtml_branch_coverage=1 00:13:07.423 --rc genhtml_function_coverage=1 00:13:07.423 --rc genhtml_legend=1 00:13:07.423 --rc geninfo_all_blocks=1 00:13:07.423 --rc geninfo_unexecuted_blocks=1 00:13:07.423 00:13:07.423 ' 00:13:07.423 04:14:57 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:07.423 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:07.423 --rc genhtml_branch_coverage=1 00:13:07.423 --rc genhtml_function_coverage=1 00:13:07.423 --rc genhtml_legend=1 00:13:07.423 --rc geninfo_all_blocks=1 00:13:07.423 --rc geninfo_unexecuted_blocks=1 00:13:07.423 00:13:07.423 ' 00:13:07.423 04:14:57 -- target/rpc.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:07.423 04:14:57 -- nvmf/common.sh@7 -- # uname -s 00:13:07.423 04:14:57 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:07.423 04:14:57 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:07.423 04:14:57 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:07.423 04:14:57 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:07.423 04:14:57 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:07.423 04:14:57 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:07.423 04:14:57 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:07.423 04:14:57 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:07.423 04:14:57 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:07.423 04:14:57 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:07.423 04:14:57 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:07.423 04:14:57 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:07.423 04:14:57 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:07.423 04:14:57 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:07.423 04:14:57 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:07.423 04:14:57 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:07.423 04:14:57 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:07.423 04:14:57 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:07.423 04:14:57 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:07.423 04:14:57 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.423 04:14:57 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.423 04:14:57 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.423 04:14:57 -- paths/export.sh@5 -- # export PATH 00:13:07.423 04:14:57 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:07.423 04:14:57 -- nvmf/common.sh@46 -- # : 0 00:13:07.423 04:14:57 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:07.423 04:14:57 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:07.423 04:14:57 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:07.423 04:14:57 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:07.423 04:14:57 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:07.423 04:14:57 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:07.423 04:14:57 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:07.423 04:14:57 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:07.423 04:14:57 -- target/rpc.sh@11 -- # loops=5 00:13:07.423 04:14:57 -- target/rpc.sh@23 -- # nvmftestinit 00:13:07.423 04:14:57 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:07.423 04:14:57 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:07.423 04:14:57 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:07.423 04:14:57 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:07.423 04:14:57 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:07.423 04:14:57 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:07.423 04:14:57 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:07.423 04:14:57 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:07.423 04:14:57 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:07.423 04:14:57 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:07.423 04:14:57 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:07.423 04:14:57 -- common/autotest_common.sh@10 -- # set +x 00:13:09.955 04:15:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:09.955 04:15:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:09.955 04:15:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:09.955 04:15:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:09.955 04:15:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:09.955 04:15:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:09.955 04:15:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:09.955 04:15:00 -- nvmf/common.sh@294 -- # net_devs=() 00:13:09.955 04:15:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:09.955 04:15:00 -- nvmf/common.sh@295 -- # e810=() 00:13:09.955 04:15:00 -- nvmf/common.sh@295 -- # local -ga e810 00:13:09.955 04:15:00 -- nvmf/common.sh@296 -- # x722=() 00:13:09.955 04:15:00 -- nvmf/common.sh@296 -- # local -ga x722 00:13:09.955 04:15:00 -- nvmf/common.sh@297 -- # mlx=() 00:13:09.955 04:15:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:09.955 04:15:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:09.955 04:15:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:09.955 04:15:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:09.955 04:15:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:09.955 04:15:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:09.955 04:15:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:09.955 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:09.955 04:15:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:09.955 04:15:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:09.955 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:09.955 04:15:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:09.955 04:15:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:09.955 04:15:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:09.955 04:15:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:09.955 04:15:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:09.955 04:15:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:09.955 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:09.955 04:15:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:09.955 04:15:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:09.955 04:15:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:09.955 04:15:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:09.955 04:15:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:09.955 04:15:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:09.955 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:09.955 04:15:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:09.955 04:15:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:09.955 04:15:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:09.955 04:15:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:09.955 04:15:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:09.955 04:15:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:09.955 04:15:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:09.955 04:15:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:09.955 04:15:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:09.955 04:15:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:09.955 04:15:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:09.955 04:15:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:09.955 04:15:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:09.955 04:15:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:09.956 04:15:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:09.956 04:15:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:09.956 04:15:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:09.956 04:15:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:09.956 04:15:00 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:09.956 04:15:00 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:09.956 04:15:00 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:09.956 04:15:00 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:09.956 04:15:00 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:09.956 04:15:00 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:09.956 04:15:00 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:09.956 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:09.956 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.304 ms 00:13:09.956 00:13:09.956 --- 10.0.0.2 ping statistics --- 00:13:09.956 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:09.956 rtt min/avg/max/mdev = 0.304/0.304/0.304/0.000 ms 00:13:09.956 04:15:00 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:09.956 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:09.956 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.176 ms 00:13:09.956 00:13:09.956 --- 10.0.0.1 ping statistics --- 00:13:09.956 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:09.956 rtt min/avg/max/mdev = 0.176/0.176/0.176/0.000 ms 00:13:09.956 04:15:00 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:09.956 04:15:00 -- nvmf/common.sh@410 -- # return 0 00:13:09.956 04:15:00 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:09.956 04:15:00 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:09.956 04:15:00 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:09.956 04:15:00 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:09.956 04:15:00 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:09.956 04:15:00 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:09.956 04:15:00 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:09.956 04:15:00 -- target/rpc.sh@24 -- # nvmfappstart -m 0xF 00:13:09.956 04:15:00 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:09.956 04:15:00 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:09.956 04:15:00 -- common/autotest_common.sh@10 -- # set +x 00:13:09.956 04:15:00 -- nvmf/common.sh@469 -- # nvmfpid=2306844 00:13:09.956 04:15:00 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:09.956 04:15:00 -- nvmf/common.sh@470 -- # waitforlisten 2306844 00:13:09.956 04:15:00 -- common/autotest_common.sh@829 -- # '[' -z 2306844 ']' 00:13:09.956 04:15:00 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:09.956 04:15:00 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:09.956 04:15:00 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:09.956 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:09.956 04:15:00 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:09.956 04:15:00 -- common/autotest_common.sh@10 -- # set +x 00:13:09.956 [2024-11-30 04:15:00.378694] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:09.956 [2024-11-30 04:15:00.378770] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:09.956 EAL: No free 2048 kB hugepages reported on node 1 00:13:09.956 [2024-11-30 04:15:00.449413] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:09.956 [2024-11-30 04:15:00.540971] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:09.956 [2024-11-30 04:15:00.541144] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:09.956 [2024-11-30 04:15:00.541165] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:09.956 [2024-11-30 04:15:00.541179] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:09.956 [2024-11-30 04:15:00.541273] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:09.956 [2024-11-30 04:15:00.541330] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:09.956 [2024-11-30 04:15:00.541383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:09.956 [2024-11-30 04:15:00.541386] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:10.889 04:15:01 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:10.889 04:15:01 -- common/autotest_common.sh@862 -- # return 0 00:13:10.889 04:15:01 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:10.889 04:15:01 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:10.889 04:15:01 -- common/autotest_common.sh@10 -- # set +x 00:13:10.889 04:15:01 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:10.889 04:15:01 -- target/rpc.sh@26 -- # rpc_cmd nvmf_get_stats 00:13:10.889 04:15:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.889 04:15:01 -- common/autotest_common.sh@10 -- # set +x 00:13:10.889 04:15:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.889 04:15:01 -- target/rpc.sh@26 -- # stats='{ 00:13:10.889 "tick_rate": 2700000000, 00:13:10.889 "poll_groups": [ 00:13:10.889 { 00:13:10.889 "name": "nvmf_tgt_poll_group_0", 00:13:10.889 "admin_qpairs": 0, 00:13:10.889 "io_qpairs": 0, 00:13:10.889 "current_admin_qpairs": 0, 00:13:10.889 "current_io_qpairs": 0, 00:13:10.889 "pending_bdev_io": 0, 00:13:10.889 "completed_nvme_io": 0, 00:13:10.889 "transports": [] 00:13:10.889 }, 00:13:10.889 { 00:13:10.889 "name": "nvmf_tgt_poll_group_1", 00:13:10.889 "admin_qpairs": 0, 00:13:10.889 "io_qpairs": 0, 00:13:10.889 "current_admin_qpairs": 0, 00:13:10.889 "current_io_qpairs": 0, 00:13:10.889 "pending_bdev_io": 0, 00:13:10.889 "completed_nvme_io": 0, 00:13:10.889 "transports": [] 00:13:10.889 }, 00:13:10.889 { 00:13:10.889 "name": "nvmf_tgt_poll_group_2", 00:13:10.889 "admin_qpairs": 0, 00:13:10.889 "io_qpairs": 0, 00:13:10.889 "current_admin_qpairs": 0, 00:13:10.889 "current_io_qpairs": 0, 00:13:10.889 "pending_bdev_io": 0, 00:13:10.889 "completed_nvme_io": 0, 00:13:10.889 "transports": [] 00:13:10.889 }, 00:13:10.889 { 00:13:10.889 "name": "nvmf_tgt_poll_group_3", 00:13:10.889 "admin_qpairs": 0, 00:13:10.889 "io_qpairs": 0, 00:13:10.889 "current_admin_qpairs": 0, 00:13:10.889 "current_io_qpairs": 0, 00:13:10.889 "pending_bdev_io": 0, 00:13:10.889 "completed_nvme_io": 0, 00:13:10.889 "transports": [] 00:13:10.889 } 00:13:10.889 ] 00:13:10.889 }' 00:13:10.889 04:15:01 -- target/rpc.sh@28 -- # jcount '.poll_groups[].name' 00:13:10.889 04:15:01 -- target/rpc.sh@14 -- # local 'filter=.poll_groups[].name' 00:13:10.889 04:15:01 -- target/rpc.sh@15 -- # jq '.poll_groups[].name' 00:13:10.889 04:15:01 -- target/rpc.sh@15 -- # wc -l 00:13:10.889 04:15:01 -- target/rpc.sh@28 -- # (( 4 == 4 )) 00:13:10.889 04:15:01 -- target/rpc.sh@29 -- # jq '.poll_groups[0].transports[0]' 00:13:10.889 04:15:01 -- target/rpc.sh@29 -- # [[ null == null ]] 00:13:10.889 04:15:01 -- target/rpc.sh@31 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:13:10.889 04:15:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.889 04:15:01 -- common/autotest_common.sh@10 -- # set +x 00:13:10.889 [2024-11-30 04:15:01.485000] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:10.889 04:15:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.889 04:15:01 -- target/rpc.sh@33 -- # rpc_cmd nvmf_get_stats 00:13:10.889 04:15:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:10.889 04:15:01 -- common/autotest_common.sh@10 -- # set +x 00:13:10.889 04:15:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:10.889 04:15:01 -- target/rpc.sh@33 -- # stats='{ 00:13:10.889 "tick_rate": 2700000000, 00:13:10.889 "poll_groups": [ 00:13:10.889 { 00:13:10.889 "name": "nvmf_tgt_poll_group_0", 00:13:10.889 "admin_qpairs": 0, 00:13:10.889 "io_qpairs": 0, 00:13:10.889 "current_admin_qpairs": 0, 00:13:10.890 "current_io_qpairs": 0, 00:13:10.890 "pending_bdev_io": 0, 00:13:10.890 "completed_nvme_io": 0, 00:13:10.890 "transports": [ 00:13:10.890 { 00:13:10.890 "trtype": "TCP" 00:13:10.890 } 00:13:10.890 ] 00:13:10.890 }, 00:13:10.890 { 00:13:10.890 "name": "nvmf_tgt_poll_group_1", 00:13:10.890 "admin_qpairs": 0, 00:13:10.890 "io_qpairs": 0, 00:13:10.890 "current_admin_qpairs": 0, 00:13:10.890 "current_io_qpairs": 0, 00:13:10.890 "pending_bdev_io": 0, 00:13:10.890 "completed_nvme_io": 0, 00:13:10.890 "transports": [ 00:13:10.890 { 00:13:10.890 "trtype": "TCP" 00:13:10.890 } 00:13:10.890 ] 00:13:10.890 }, 00:13:10.890 { 00:13:10.890 "name": "nvmf_tgt_poll_group_2", 00:13:10.890 "admin_qpairs": 0, 00:13:10.890 "io_qpairs": 0, 00:13:10.890 "current_admin_qpairs": 0, 00:13:10.890 "current_io_qpairs": 0, 00:13:10.890 "pending_bdev_io": 0, 00:13:10.890 "completed_nvme_io": 0, 00:13:10.890 "transports": [ 00:13:10.890 { 00:13:10.890 "trtype": "TCP" 00:13:10.890 } 00:13:10.890 ] 00:13:10.890 }, 00:13:10.890 { 00:13:10.890 "name": "nvmf_tgt_poll_group_3", 00:13:10.890 "admin_qpairs": 0, 00:13:10.890 "io_qpairs": 0, 00:13:10.890 "current_admin_qpairs": 0, 00:13:10.890 "current_io_qpairs": 0, 00:13:10.890 "pending_bdev_io": 0, 00:13:10.890 "completed_nvme_io": 0, 00:13:10.890 "transports": [ 00:13:10.890 { 00:13:10.890 "trtype": "TCP" 00:13:10.890 } 00:13:10.890 ] 00:13:10.890 } 00:13:10.890 ] 00:13:10.890 }' 00:13:10.890 04:15:01 -- target/rpc.sh@35 -- # jsum '.poll_groups[].admin_qpairs' 00:13:10.890 04:15:01 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:10.890 04:15:01 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:10.890 04:15:01 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:11.148 04:15:01 -- target/rpc.sh@35 -- # (( 0 == 0 )) 00:13:11.148 04:15:01 -- target/rpc.sh@36 -- # jsum '.poll_groups[].io_qpairs' 00:13:11.148 04:15:01 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:11.148 04:15:01 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:11.148 04:15:01 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:11.148 04:15:01 -- target/rpc.sh@36 -- # (( 0 == 0 )) 00:13:11.148 04:15:01 -- target/rpc.sh@38 -- # '[' rdma == tcp ']' 00:13:11.148 04:15:01 -- target/rpc.sh@46 -- # MALLOC_BDEV_SIZE=64 00:13:11.148 04:15:01 -- target/rpc.sh@47 -- # MALLOC_BLOCK_SIZE=512 00:13:11.148 04:15:01 -- target/rpc.sh@49 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:13:11.148 04:15:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.148 04:15:01 -- common/autotest_common.sh@10 -- # set +x 00:13:11.148 Malloc1 00:13:11.148 04:15:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.148 04:15:01 -- target/rpc.sh@52 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:13:11.148 04:15:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.148 04:15:01 -- common/autotest_common.sh@10 -- # set +x 00:13:11.148 04:15:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.148 04:15:01 -- target/rpc.sh@53 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:11.148 04:15:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.148 04:15:01 -- common/autotest_common.sh@10 -- # set +x 00:13:11.148 04:15:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.148 04:15:01 -- target/rpc.sh@54 -- # rpc_cmd nvmf_subsystem_allow_any_host -d nqn.2016-06.io.spdk:cnode1 00:13:11.148 04:15:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.148 04:15:01 -- common/autotest_common.sh@10 -- # set +x 00:13:11.148 04:15:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.148 04:15:01 -- target/rpc.sh@55 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:11.148 04:15:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.148 04:15:01 -- common/autotest_common.sh@10 -- # set +x 00:13:11.148 [2024-11-30 04:15:01.633479] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:11.148 04:15:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.148 04:15:01 -- target/rpc.sh@58 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:11.148 04:15:01 -- common/autotest_common.sh@650 -- # local es=0 00:13:11.148 04:15:01 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:11.148 04:15:01 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:11.148 04:15:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:11.148 04:15:01 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:11.148 04:15:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:11.148 04:15:01 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:11.148 04:15:01 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:11.148 04:15:01 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:11.148 04:15:01 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:11.148 04:15:01 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -q nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.2 -s 4420 00:13:11.148 [2024-11-30 04:15:01.655925] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:11.148 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:11.148 could not add new controller: failed to write to nvme-fabrics device 00:13:11.148 04:15:01 -- common/autotest_common.sh@653 -- # es=1 00:13:11.148 04:15:01 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:11.148 04:15:01 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:11.148 04:15:01 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:11.148 04:15:01 -- target/rpc.sh@61 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:11.148 04:15:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:11.148 04:15:01 -- common/autotest_common.sh@10 -- # set +x 00:13:11.148 04:15:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:11.148 04:15:01 -- target/rpc.sh@62 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:12.081 04:15:02 -- target/rpc.sh@63 -- # waitforserial SPDKISFASTANDAWESOME 00:13:12.081 04:15:02 -- common/autotest_common.sh@1187 -- # local i=0 00:13:12.081 04:15:02 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:12.081 04:15:02 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:12.082 04:15:02 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:13.979 04:15:04 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:13.979 04:15:04 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:13.979 04:15:04 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:13.979 04:15:04 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:13.979 04:15:04 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:13.979 04:15:04 -- common/autotest_common.sh@1197 -- # return 0 00:13:13.979 04:15:04 -- target/rpc.sh@64 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:13.979 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:13.979 04:15:04 -- target/rpc.sh@65 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:13.979 04:15:04 -- common/autotest_common.sh@1208 -- # local i=0 00:13:13.979 04:15:04 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:13.979 04:15:04 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:13.979 04:15:04 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:13.979 04:15:04 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:13.979 04:15:04 -- common/autotest_common.sh@1220 -- # return 0 00:13:13.979 04:15:04 -- target/rpc.sh@68 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode1 nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:13.979 04:15:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.979 04:15:04 -- common/autotest_common.sh@10 -- # set +x 00:13:13.979 04:15:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.979 04:15:04 -- target/rpc.sh@69 -- # NOT nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:13.979 04:15:04 -- common/autotest_common.sh@650 -- # local es=0 00:13:13.979 04:15:04 -- common/autotest_common.sh@652 -- # valid_exec_arg nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:13.979 04:15:04 -- common/autotest_common.sh@638 -- # local arg=nvme 00:13:13.979 04:15:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:13.979 04:15:04 -- common/autotest_common.sh@642 -- # type -t nvme 00:13:13.979 04:15:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:13.979 04:15:04 -- common/autotest_common.sh@644 -- # type -P nvme 00:13:13.979 04:15:04 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:13:13.979 04:15:04 -- common/autotest_common.sh@644 -- # arg=/usr/sbin/nvme 00:13:13.980 04:15:04 -- common/autotest_common.sh@644 -- # [[ -x /usr/sbin/nvme ]] 00:13:13.980 04:15:04 -- common/autotest_common.sh@653 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:13.980 [2024-11-30 04:15:04.495791] ctrlr.c: 715:nvmf_qpair_access_allowed: *ERROR*: Subsystem 'nqn.2016-06.io.spdk:cnode1' does not allow host 'nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55' 00:13:13.980 Failed to write to /dev/nvme-fabrics: Input/output error 00:13:13.980 could not add new controller: failed to write to nvme-fabrics device 00:13:13.980 04:15:04 -- common/autotest_common.sh@653 -- # es=1 00:13:13.980 04:15:04 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:13:13.980 04:15:04 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:13:13.980 04:15:04 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:13:13.980 04:15:04 -- target/rpc.sh@72 -- # rpc_cmd nvmf_subsystem_allow_any_host -e nqn.2016-06.io.spdk:cnode1 00:13:13.980 04:15:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:13.980 04:15:04 -- common/autotest_common.sh@10 -- # set +x 00:13:13.980 04:15:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:13.980 04:15:04 -- target/rpc.sh@73 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:14.909 04:15:05 -- target/rpc.sh@74 -- # waitforserial SPDKISFASTANDAWESOME 00:13:14.909 04:15:05 -- common/autotest_common.sh@1187 -- # local i=0 00:13:14.909 04:15:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:14.909 04:15:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:14.909 04:15:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:16.844 04:15:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:16.844 04:15:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:16.844 04:15:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:16.844 04:15:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:16.844 04:15:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:16.844 04:15:07 -- common/autotest_common.sh@1197 -- # return 0 00:13:16.844 04:15:07 -- target/rpc.sh@75 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:16.844 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:16.844 04:15:07 -- target/rpc.sh@76 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:16.844 04:15:07 -- common/autotest_common.sh@1208 -- # local i=0 00:13:16.844 04:15:07 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:16.844 04:15:07 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:16.844 04:15:07 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:16.844 04:15:07 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:16.844 04:15:07 -- common/autotest_common.sh@1220 -- # return 0 00:13:16.844 04:15:07 -- target/rpc.sh@78 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:16.844 04:15:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.844 04:15:07 -- common/autotest_common.sh@10 -- # set +x 00:13:16.844 04:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.844 04:15:07 -- target/rpc.sh@81 -- # seq 1 5 00:13:16.844 04:15:07 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:16.844 04:15:07 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:16.844 04:15:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.844 04:15:07 -- common/autotest_common.sh@10 -- # set +x 00:13:16.844 04:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.844 04:15:07 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:16.844 04:15:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.844 04:15:07 -- common/autotest_common.sh@10 -- # set +x 00:13:16.844 [2024-11-30 04:15:07.337648] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:16.844 04:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.844 04:15:07 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:16.844 04:15:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.845 04:15:07 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 04:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.845 04:15:07 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:16.845 04:15:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:16.845 04:15:07 -- common/autotest_common.sh@10 -- # set +x 00:13:16.845 04:15:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:16.845 04:15:07 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:17.410 04:15:08 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:17.410 04:15:08 -- common/autotest_common.sh@1187 -- # local i=0 00:13:17.410 04:15:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:17.410 04:15:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:17.410 04:15:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:19.942 04:15:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:19.942 04:15:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:19.942 04:15:10 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:19.942 04:15:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:19.942 04:15:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:19.942 04:15:10 -- common/autotest_common.sh@1197 -- # return 0 00:13:19.942 04:15:10 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:19.942 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:19.942 04:15:10 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:19.942 04:15:10 -- common/autotest_common.sh@1208 -- # local i=0 00:13:19.942 04:15:10 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:19.942 04:15:10 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:19.942 04:15:10 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:19.942 04:15:10 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:19.942 04:15:10 -- common/autotest_common.sh@1220 -- # return 0 00:13:19.942 04:15:10 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:19.942 04:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.942 04:15:10 -- common/autotest_common.sh@10 -- # set +x 00:13:19.942 04:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.942 04:15:10 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:19.942 04:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.942 04:15:10 -- common/autotest_common.sh@10 -- # set +x 00:13:19.942 04:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.942 04:15:10 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:19.942 04:15:10 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:19.942 04:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.942 04:15:10 -- common/autotest_common.sh@10 -- # set +x 00:13:19.942 04:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.942 04:15:10 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:19.942 04:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.942 04:15:10 -- common/autotest_common.sh@10 -- # set +x 00:13:19.942 [2024-11-30 04:15:10.156279] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:19.942 04:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.942 04:15:10 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:19.942 04:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.942 04:15:10 -- common/autotest_common.sh@10 -- # set +x 00:13:19.942 04:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.942 04:15:10 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:19.942 04:15:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:19.942 04:15:10 -- common/autotest_common.sh@10 -- # set +x 00:13:19.942 04:15:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:19.942 04:15:10 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:20.201 04:15:10 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:20.201 04:15:10 -- common/autotest_common.sh@1187 -- # local i=0 00:13:20.201 04:15:10 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:20.201 04:15:10 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:20.201 04:15:10 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:22.728 04:15:12 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:22.728 04:15:12 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:22.728 04:15:12 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:22.728 04:15:12 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:22.728 04:15:12 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:22.728 04:15:12 -- common/autotest_common.sh@1197 -- # return 0 00:13:22.728 04:15:12 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:22.728 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:22.728 04:15:12 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:22.728 04:15:12 -- common/autotest_common.sh@1208 -- # local i=0 00:13:22.728 04:15:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:22.728 04:15:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:22.728 04:15:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:22.728 04:15:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:22.728 04:15:12 -- common/autotest_common.sh@1220 -- # return 0 00:13:22.728 04:15:12 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:22.728 04:15:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.728 04:15:12 -- common/autotest_common.sh@10 -- # set +x 00:13:22.728 04:15:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.728 04:15:12 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:22.728 04:15:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.728 04:15:12 -- common/autotest_common.sh@10 -- # set +x 00:13:22.728 04:15:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.729 04:15:12 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:22.729 04:15:12 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:22.729 04:15:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.729 04:15:12 -- common/autotest_common.sh@10 -- # set +x 00:13:22.729 04:15:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.729 04:15:12 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:22.729 04:15:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.729 04:15:12 -- common/autotest_common.sh@10 -- # set +x 00:13:22.729 [2024-11-30 04:15:12.941513] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:22.729 04:15:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.729 04:15:12 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:22.729 04:15:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.729 04:15:12 -- common/autotest_common.sh@10 -- # set +x 00:13:22.729 04:15:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.729 04:15:12 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:22.729 04:15:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:22.729 04:15:12 -- common/autotest_common.sh@10 -- # set +x 00:13:22.729 04:15:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:22.729 04:15:12 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:23.294 04:15:13 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:23.294 04:15:13 -- common/autotest_common.sh@1187 -- # local i=0 00:13:23.294 04:15:13 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:23.294 04:15:13 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:23.294 04:15:13 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:25.192 04:15:15 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:25.192 04:15:15 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:25.192 04:15:15 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:25.192 04:15:15 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:25.192 04:15:15 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:25.192 04:15:15 -- common/autotest_common.sh@1197 -- # return 0 00:13:25.192 04:15:15 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:25.192 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:25.192 04:15:15 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:25.192 04:15:15 -- common/autotest_common.sh@1208 -- # local i=0 00:13:25.192 04:15:15 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:25.192 04:15:15 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:25.192 04:15:15 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:25.192 04:15:15 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:25.192 04:15:15 -- common/autotest_common.sh@1220 -- # return 0 00:13:25.192 04:15:15 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:25.192 04:15:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.192 04:15:15 -- common/autotest_common.sh@10 -- # set +x 00:13:25.192 04:15:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.192 04:15:15 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:25.192 04:15:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.192 04:15:15 -- common/autotest_common.sh@10 -- # set +x 00:13:25.192 04:15:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.192 04:15:15 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:25.192 04:15:15 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:25.192 04:15:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.192 04:15:15 -- common/autotest_common.sh@10 -- # set +x 00:13:25.192 04:15:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.192 04:15:15 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:25.192 04:15:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.192 04:15:15 -- common/autotest_common.sh@10 -- # set +x 00:13:25.192 [2024-11-30 04:15:15.767804] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:25.192 04:15:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.192 04:15:15 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:25.192 04:15:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.192 04:15:15 -- common/autotest_common.sh@10 -- # set +x 00:13:25.192 04:15:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.192 04:15:15 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:25.192 04:15:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:25.192 04:15:15 -- common/autotest_common.sh@10 -- # set +x 00:13:25.192 04:15:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:25.192 04:15:15 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:25.757 04:15:16 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:25.757 04:15:16 -- common/autotest_common.sh@1187 -- # local i=0 00:13:25.757 04:15:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:25.757 04:15:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:25.757 04:15:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:28.284 04:15:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:28.284 04:15:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:28.284 04:15:18 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:28.284 04:15:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:28.284 04:15:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:28.284 04:15:18 -- common/autotest_common.sh@1197 -- # return 0 00:13:28.284 04:15:18 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:28.284 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:28.284 04:15:18 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:28.284 04:15:18 -- common/autotest_common.sh@1208 -- # local i=0 00:13:28.285 04:15:18 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:28.285 04:15:18 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:28.285 04:15:18 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:28.285 04:15:18 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:28.285 04:15:18 -- common/autotest_common.sh@1220 -- # return 0 00:13:28.285 04:15:18 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:28.285 04:15:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.285 04:15:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.285 04:15:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.285 04:15:18 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:28.285 04:15:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.285 04:15:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.285 04:15:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.285 04:15:18 -- target/rpc.sh@81 -- # for i in $(seq 1 $loops) 00:13:28.285 04:15:18 -- target/rpc.sh@82 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:28.285 04:15:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.285 04:15:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.285 04:15:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.285 04:15:18 -- target/rpc.sh@83 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:28.285 04:15:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.285 04:15:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.285 [2024-11-30 04:15:18.541114] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:28.285 04:15:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.285 04:15:18 -- target/rpc.sh@84 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 5 00:13:28.285 04:15:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.285 04:15:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.285 04:15:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.285 04:15:18 -- target/rpc.sh@85 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:28.285 04:15:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:28.285 04:15:18 -- common/autotest_common.sh@10 -- # set +x 00:13:28.285 04:15:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:28.285 04:15:18 -- target/rpc.sh@86 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:13:28.851 04:15:19 -- target/rpc.sh@88 -- # waitforserial SPDKISFASTANDAWESOME 00:13:28.852 04:15:19 -- common/autotest_common.sh@1187 -- # local i=0 00:13:28.852 04:15:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:13:28.852 04:15:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:13:28.852 04:15:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:13:30.750 04:15:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:13:30.750 04:15:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:13:30.750 04:15:21 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:13:30.750 04:15:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:13:30.750 04:15:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:13:30.750 04:15:21 -- common/autotest_common.sh@1197 -- # return 0 00:13:30.750 04:15:21 -- target/rpc.sh@90 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:13:30.750 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:13:30.750 04:15:21 -- target/rpc.sh@91 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:13:30.750 04:15:21 -- common/autotest_common.sh@1208 -- # local i=0 00:13:30.750 04:15:21 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:13:30.750 04:15:21 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:30.750 04:15:21 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:13:30.750 04:15:21 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:13:30.750 04:15:21 -- common/autotest_common.sh@1220 -- # return 0 00:13:30.750 04:15:21 -- target/rpc.sh@93 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:13:30.750 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.750 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:30.750 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:30.750 04:15:21 -- target/rpc.sh@94 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:30.750 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:30.750 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.008 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.008 04:15:21 -- target/rpc.sh@99 -- # seq 1 5 00:13:31.008 04:15:21 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:31.008 04:15:21 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:31.008 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.008 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.008 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.008 04:15:21 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:31.008 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.008 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.008 [2024-11-30 04:15:21.400176] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.008 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.008 04:15:21 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:31.008 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.008 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.008 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.008 04:15:21 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:31.008 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.008 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.008 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.008 04:15:21 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.008 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.008 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.008 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.008 04:15:21 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:31.009 04:15:21 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 [2024-11-30 04:15:21.448201] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:31.009 04:15:21 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 [2024-11-30 04:15:21.496390] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:31.009 04:15:21 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 [2024-11-30 04:15:21.544561] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@99 -- # for i in $(seq 1 $loops) 00:13:31.009 04:15:21 -- target/rpc.sh@100 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDKISFASTANDAWESOME 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@101 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 [2024-11-30 04:15:21.592738] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@102 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@103 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@105 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@107 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.009 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.009 04:15:21 -- target/rpc.sh@110 -- # rpc_cmd nvmf_get_stats 00:13:31.009 04:15:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:31.009 04:15:21 -- common/autotest_common.sh@10 -- # set +x 00:13:31.267 04:15:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:31.267 04:15:21 -- target/rpc.sh@110 -- # stats='{ 00:13:31.267 "tick_rate": 2700000000, 00:13:31.267 "poll_groups": [ 00:13:31.267 { 00:13:31.267 "name": "nvmf_tgt_poll_group_0", 00:13:31.267 "admin_qpairs": 2, 00:13:31.267 "io_qpairs": 84, 00:13:31.267 "current_admin_qpairs": 0, 00:13:31.267 "current_io_qpairs": 0, 00:13:31.267 "pending_bdev_io": 0, 00:13:31.267 "completed_nvme_io": 134, 00:13:31.267 "transports": [ 00:13:31.267 { 00:13:31.267 "trtype": "TCP" 00:13:31.267 } 00:13:31.267 ] 00:13:31.267 }, 00:13:31.267 { 00:13:31.267 "name": "nvmf_tgt_poll_group_1", 00:13:31.267 "admin_qpairs": 2, 00:13:31.267 "io_qpairs": 84, 00:13:31.267 "current_admin_qpairs": 0, 00:13:31.267 "current_io_qpairs": 0, 00:13:31.267 "pending_bdev_io": 0, 00:13:31.267 "completed_nvme_io": 136, 00:13:31.267 "transports": [ 00:13:31.267 { 00:13:31.267 "trtype": "TCP" 00:13:31.267 } 00:13:31.267 ] 00:13:31.267 }, 00:13:31.267 { 00:13:31.267 "name": "nvmf_tgt_poll_group_2", 00:13:31.267 "admin_qpairs": 1, 00:13:31.267 "io_qpairs": 84, 00:13:31.267 "current_admin_qpairs": 0, 00:13:31.267 "current_io_qpairs": 0, 00:13:31.267 "pending_bdev_io": 0, 00:13:31.267 "completed_nvme_io": 133, 00:13:31.267 "transports": [ 00:13:31.267 { 00:13:31.267 "trtype": "TCP" 00:13:31.267 } 00:13:31.267 ] 00:13:31.267 }, 00:13:31.267 { 00:13:31.267 "name": "nvmf_tgt_poll_group_3", 00:13:31.267 "admin_qpairs": 2, 00:13:31.267 "io_qpairs": 84, 00:13:31.267 "current_admin_qpairs": 0, 00:13:31.267 "current_io_qpairs": 0, 00:13:31.267 "pending_bdev_io": 0, 00:13:31.267 "completed_nvme_io": 283, 00:13:31.267 "transports": [ 00:13:31.267 { 00:13:31.267 "trtype": "TCP" 00:13:31.267 } 00:13:31.267 ] 00:13:31.267 } 00:13:31.267 ] 00:13:31.267 }' 00:13:31.267 04:15:21 -- target/rpc.sh@112 -- # jsum '.poll_groups[].admin_qpairs' 00:13:31.267 04:15:21 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].admin_qpairs' 00:13:31.268 04:15:21 -- target/rpc.sh@20 -- # jq '.poll_groups[].admin_qpairs' 00:13:31.268 04:15:21 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:31.268 04:15:21 -- target/rpc.sh@112 -- # (( 7 > 0 )) 00:13:31.268 04:15:21 -- target/rpc.sh@113 -- # jsum '.poll_groups[].io_qpairs' 00:13:31.268 04:15:21 -- target/rpc.sh@19 -- # local 'filter=.poll_groups[].io_qpairs' 00:13:31.268 04:15:21 -- target/rpc.sh@20 -- # jq '.poll_groups[].io_qpairs' 00:13:31.268 04:15:21 -- target/rpc.sh@20 -- # awk '{s+=$1}END{print s}' 00:13:31.268 04:15:21 -- target/rpc.sh@113 -- # (( 336 > 0 )) 00:13:31.268 04:15:21 -- target/rpc.sh@115 -- # '[' rdma == tcp ']' 00:13:31.268 04:15:21 -- target/rpc.sh@121 -- # trap - SIGINT SIGTERM EXIT 00:13:31.268 04:15:21 -- target/rpc.sh@123 -- # nvmftestfini 00:13:31.268 04:15:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:31.268 04:15:21 -- nvmf/common.sh@116 -- # sync 00:13:31.268 04:15:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:31.268 04:15:21 -- nvmf/common.sh@119 -- # set +e 00:13:31.268 04:15:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:31.268 04:15:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:31.268 rmmod nvme_tcp 00:13:31.268 rmmod nvme_fabrics 00:13:31.268 rmmod nvme_keyring 00:13:31.268 04:15:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:31.268 04:15:21 -- nvmf/common.sh@123 -- # set -e 00:13:31.268 04:15:21 -- nvmf/common.sh@124 -- # return 0 00:13:31.268 04:15:21 -- nvmf/common.sh@477 -- # '[' -n 2306844 ']' 00:13:31.268 04:15:21 -- nvmf/common.sh@478 -- # killprocess 2306844 00:13:31.268 04:15:21 -- common/autotest_common.sh@936 -- # '[' -z 2306844 ']' 00:13:31.268 04:15:21 -- common/autotest_common.sh@940 -- # kill -0 2306844 00:13:31.268 04:15:21 -- common/autotest_common.sh@941 -- # uname 00:13:31.268 04:15:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:31.268 04:15:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2306844 00:13:31.268 04:15:21 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:31.268 04:15:21 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:31.268 04:15:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2306844' 00:13:31.268 killing process with pid 2306844 00:13:31.268 04:15:21 -- common/autotest_common.sh@955 -- # kill 2306844 00:13:31.268 04:15:21 -- common/autotest_common.sh@960 -- # wait 2306844 00:13:31.530 04:15:22 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:31.530 04:15:22 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:31.530 04:15:22 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:31.530 04:15:22 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:31.530 04:15:22 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:31.530 04:15:22 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:31.530 04:15:22 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:31.530 04:15:22 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:34.067 04:15:24 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:34.067 00:13:34.067 real 0m26.279s 00:13:34.067 user 1m25.488s 00:13:34.067 sys 0m4.272s 00:13:34.067 04:15:24 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:34.067 04:15:24 -- common/autotest_common.sh@10 -- # set +x 00:13:34.067 ************************************ 00:13:34.067 END TEST nvmf_rpc 00:13:34.067 ************************************ 00:13:34.067 04:15:24 -- nvmf/nvmf.sh@30 -- # run_test nvmf_invalid /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:34.067 04:15:24 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:34.067 04:15:24 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:34.067 04:15:24 -- common/autotest_common.sh@10 -- # set +x 00:13:34.067 ************************************ 00:13:34.067 START TEST nvmf_invalid 00:13:34.067 ************************************ 00:13:34.067 04:15:24 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/invalid.sh --transport=tcp 00:13:34.067 * Looking for test storage... 00:13:34.067 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:34.067 04:15:24 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:34.067 04:15:24 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:34.067 04:15:24 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:34.067 04:15:24 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:34.067 04:15:24 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:34.067 04:15:24 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:34.067 04:15:24 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:34.067 04:15:24 -- scripts/common.sh@335 -- # IFS=.-: 00:13:34.067 04:15:24 -- scripts/common.sh@335 -- # read -ra ver1 00:13:34.067 04:15:24 -- scripts/common.sh@336 -- # IFS=.-: 00:13:34.067 04:15:24 -- scripts/common.sh@336 -- # read -ra ver2 00:13:34.067 04:15:24 -- scripts/common.sh@337 -- # local 'op=<' 00:13:34.067 04:15:24 -- scripts/common.sh@339 -- # ver1_l=2 00:13:34.067 04:15:24 -- scripts/common.sh@340 -- # ver2_l=1 00:13:34.067 04:15:24 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:34.067 04:15:24 -- scripts/common.sh@343 -- # case "$op" in 00:13:34.067 04:15:24 -- scripts/common.sh@344 -- # : 1 00:13:34.067 04:15:24 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:34.067 04:15:24 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:34.067 04:15:24 -- scripts/common.sh@364 -- # decimal 1 00:13:34.067 04:15:24 -- scripts/common.sh@352 -- # local d=1 00:13:34.067 04:15:24 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:34.067 04:15:24 -- scripts/common.sh@354 -- # echo 1 00:13:34.067 04:15:24 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:34.067 04:15:24 -- scripts/common.sh@365 -- # decimal 2 00:13:34.067 04:15:24 -- scripts/common.sh@352 -- # local d=2 00:13:34.067 04:15:24 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:34.067 04:15:24 -- scripts/common.sh@354 -- # echo 2 00:13:34.067 04:15:24 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:34.067 04:15:24 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:34.067 04:15:24 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:34.067 04:15:24 -- scripts/common.sh@367 -- # return 0 00:13:34.067 04:15:24 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:34.067 04:15:24 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:34.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.067 --rc genhtml_branch_coverage=1 00:13:34.067 --rc genhtml_function_coverage=1 00:13:34.067 --rc genhtml_legend=1 00:13:34.067 --rc geninfo_all_blocks=1 00:13:34.067 --rc geninfo_unexecuted_blocks=1 00:13:34.067 00:13:34.067 ' 00:13:34.067 04:15:24 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:34.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.067 --rc genhtml_branch_coverage=1 00:13:34.067 --rc genhtml_function_coverage=1 00:13:34.067 --rc genhtml_legend=1 00:13:34.067 --rc geninfo_all_blocks=1 00:13:34.067 --rc geninfo_unexecuted_blocks=1 00:13:34.067 00:13:34.067 ' 00:13:34.067 04:15:24 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:34.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.067 --rc genhtml_branch_coverage=1 00:13:34.067 --rc genhtml_function_coverage=1 00:13:34.067 --rc genhtml_legend=1 00:13:34.067 --rc geninfo_all_blocks=1 00:13:34.067 --rc geninfo_unexecuted_blocks=1 00:13:34.067 00:13:34.067 ' 00:13:34.067 04:15:24 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:34.067 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:34.067 --rc genhtml_branch_coverage=1 00:13:34.067 --rc genhtml_function_coverage=1 00:13:34.067 --rc genhtml_legend=1 00:13:34.067 --rc geninfo_all_blocks=1 00:13:34.067 --rc geninfo_unexecuted_blocks=1 00:13:34.067 00:13:34.067 ' 00:13:34.067 04:15:24 -- target/invalid.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:34.067 04:15:24 -- nvmf/common.sh@7 -- # uname -s 00:13:34.067 04:15:24 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:34.067 04:15:24 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:34.067 04:15:24 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:34.067 04:15:24 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:34.067 04:15:24 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:34.067 04:15:24 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:34.067 04:15:24 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:34.067 04:15:24 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:34.067 04:15:24 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:34.067 04:15:24 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:34.067 04:15:24 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:34.067 04:15:24 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:34.067 04:15:24 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:34.067 04:15:24 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:34.067 04:15:24 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:34.067 04:15:24 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:34.067 04:15:24 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:34.067 04:15:24 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:34.067 04:15:24 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:34.067 04:15:24 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.067 04:15:24 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.067 04:15:24 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.067 04:15:24 -- paths/export.sh@5 -- # export PATH 00:13:34.067 04:15:24 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:34.067 04:15:24 -- nvmf/common.sh@46 -- # : 0 00:13:34.067 04:15:24 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:34.067 04:15:24 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:34.067 04:15:24 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:34.067 04:15:24 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:34.067 04:15:24 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:34.067 04:15:24 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:34.067 04:15:24 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:34.067 04:15:24 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:34.067 04:15:24 -- target/invalid.sh@11 -- # multi_target_rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py 00:13:34.067 04:15:24 -- target/invalid.sh@12 -- # rpc=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:34.067 04:15:24 -- target/invalid.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode 00:13:34.067 04:15:24 -- target/invalid.sh@14 -- # target=foobar 00:13:34.067 04:15:24 -- target/invalid.sh@16 -- # RANDOM=0 00:13:34.067 04:15:24 -- target/invalid.sh@34 -- # nvmftestinit 00:13:34.067 04:15:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:34.067 04:15:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:34.067 04:15:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:34.067 04:15:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:34.067 04:15:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:34.067 04:15:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:34.067 04:15:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:34.067 04:15:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:34.068 04:15:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:34.068 04:15:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:34.068 04:15:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:34.068 04:15:24 -- common/autotest_common.sh@10 -- # set +x 00:13:35.967 04:15:26 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:35.967 04:15:26 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:35.967 04:15:26 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:35.967 04:15:26 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:35.967 04:15:26 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:35.967 04:15:26 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:35.967 04:15:26 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:35.967 04:15:26 -- nvmf/common.sh@294 -- # net_devs=() 00:13:35.968 04:15:26 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:35.968 04:15:26 -- nvmf/common.sh@295 -- # e810=() 00:13:35.968 04:15:26 -- nvmf/common.sh@295 -- # local -ga e810 00:13:35.968 04:15:26 -- nvmf/common.sh@296 -- # x722=() 00:13:35.968 04:15:26 -- nvmf/common.sh@296 -- # local -ga x722 00:13:35.968 04:15:26 -- nvmf/common.sh@297 -- # mlx=() 00:13:35.968 04:15:26 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:35.968 04:15:26 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:35.968 04:15:26 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:35.968 04:15:26 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:35.968 04:15:26 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:35.968 04:15:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:35.968 04:15:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:35.968 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:35.968 04:15:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:35.968 04:15:26 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:35.968 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:35.968 04:15:26 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:35.968 04:15:26 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:35.968 04:15:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:35.968 04:15:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:35.968 04:15:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.968 04:15:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:35.968 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:35.968 04:15:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.968 04:15:26 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:35.968 04:15:26 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:35.968 04:15:26 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:35.968 04:15:26 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:35.968 04:15:26 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:35.968 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:35.968 04:15:26 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:35.968 04:15:26 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:35.968 04:15:26 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:35.968 04:15:26 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:35.968 04:15:26 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:35.968 04:15:26 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:35.968 04:15:26 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:35.968 04:15:26 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:35.968 04:15:26 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:35.968 04:15:26 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:35.968 04:15:26 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:35.968 04:15:26 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:35.968 04:15:26 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:35.968 04:15:26 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:35.968 04:15:26 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:35.968 04:15:26 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:35.968 04:15:26 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:35.968 04:15:26 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:35.968 04:15:26 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:35.968 04:15:26 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:35.968 04:15:26 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:35.968 04:15:26 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:35.968 04:15:26 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:35.968 04:15:26 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:35.968 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:35.968 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.247 ms 00:13:35.968 00:13:35.968 --- 10.0.0.2 ping statistics --- 00:13:35.968 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:35.968 rtt min/avg/max/mdev = 0.247/0.247/0.247/0.000 ms 00:13:35.968 04:15:26 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:35.968 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:35.968 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:13:35.968 00:13:35.968 --- 10.0.0.1 ping statistics --- 00:13:35.968 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:35.968 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:13:35.968 04:15:26 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:35.968 04:15:26 -- nvmf/common.sh@410 -- # return 0 00:13:35.968 04:15:26 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:35.968 04:15:26 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:35.968 04:15:26 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:35.968 04:15:26 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:35.968 04:15:26 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:35.968 04:15:26 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:35.968 04:15:26 -- target/invalid.sh@35 -- # nvmfappstart -m 0xF 00:13:35.968 04:15:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:35.968 04:15:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:35.968 04:15:26 -- common/autotest_common.sh@10 -- # set +x 00:13:35.968 04:15:26 -- nvmf/common.sh@469 -- # nvmfpid=2312138 00:13:35.968 04:15:26 -- nvmf/common.sh@470 -- # waitforlisten 2312138 00:13:35.968 04:15:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:13:35.968 04:15:26 -- common/autotest_common.sh@829 -- # '[' -z 2312138 ']' 00:13:35.968 04:15:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:35.968 04:15:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:35.968 04:15:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:35.968 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:35.968 04:15:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:35.968 04:15:26 -- common/autotest_common.sh@10 -- # set +x 00:13:35.968 [2024-11-30 04:15:26.588270] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:35.968 [2024-11-30 04:15:26.588364] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:36.227 EAL: No free 2048 kB hugepages reported on node 1 00:13:36.227 [2024-11-30 04:15:26.668073] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:13:36.227 [2024-11-30 04:15:26.766441] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:36.227 [2024-11-30 04:15:26.766592] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:36.227 [2024-11-30 04:15:26.766612] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:36.227 [2024-11-30 04:15:26.766627] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:36.227 [2024-11-30 04:15:26.766790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:36.227 [2024-11-30 04:15:26.766818] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:36.227 [2024-11-30 04:15:26.766873] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:36.227 [2024-11-30 04:15:26.766876] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:13:37.160 04:15:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:37.160 04:15:27 -- common/autotest_common.sh@862 -- # return 0 00:13:37.160 04:15:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:37.160 04:15:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:37.160 04:15:27 -- common/autotest_common.sh@10 -- # set +x 00:13:37.160 04:15:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:37.160 04:15:27 -- target/invalid.sh@37 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:13:37.160 04:15:27 -- target/invalid.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -t foobar nqn.2016-06.io.spdk:cnode11993 00:13:37.417 [2024-11-30 04:15:27.837358] nvmf_rpc.c: 401:rpc_nvmf_create_subsystem: *ERROR*: Unable to find target foobar 00:13:37.417 04:15:27 -- target/invalid.sh@40 -- # out='request: 00:13:37.417 { 00:13:37.417 "nqn": "nqn.2016-06.io.spdk:cnode11993", 00:13:37.417 "tgt_name": "foobar", 00:13:37.417 "method": "nvmf_create_subsystem", 00:13:37.417 "req_id": 1 00:13:37.417 } 00:13:37.418 Got JSON-RPC error response 00:13:37.418 response: 00:13:37.418 { 00:13:37.418 "code": -32603, 00:13:37.418 "message": "Unable to find target foobar" 00:13:37.418 }' 00:13:37.418 04:15:27 -- target/invalid.sh@41 -- # [[ request: 00:13:37.418 { 00:13:37.418 "nqn": "nqn.2016-06.io.spdk:cnode11993", 00:13:37.418 "tgt_name": "foobar", 00:13:37.418 "method": "nvmf_create_subsystem", 00:13:37.418 "req_id": 1 00:13:37.418 } 00:13:37.418 Got JSON-RPC error response 00:13:37.418 response: 00:13:37.418 { 00:13:37.418 "code": -32603, 00:13:37.418 "message": "Unable to find target foobar" 00:13:37.418 } == *\U\n\a\b\l\e\ \t\o\ \f\i\n\d\ \t\a\r\g\e\t* ]] 00:13:37.418 04:15:27 -- target/invalid.sh@45 -- # echo -e '\x1f' 00:13:37.418 04:15:27 -- target/invalid.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s $'SPDKISFASTANDAWESOME\037' nqn.2016-06.io.spdk:cnode1097 00:13:37.676 [2024-11-30 04:15:28.098210] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode1097: invalid serial number 'SPDKISFASTANDAWESOME' 00:13:37.676 04:15:28 -- target/invalid.sh@45 -- # out='request: 00:13:37.676 { 00:13:37.676 "nqn": "nqn.2016-06.io.spdk:cnode1097", 00:13:37.676 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:37.676 "method": "nvmf_create_subsystem", 00:13:37.676 "req_id": 1 00:13:37.676 } 00:13:37.676 Got JSON-RPC error response 00:13:37.676 response: 00:13:37.676 { 00:13:37.676 "code": -32602, 00:13:37.676 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:37.676 }' 00:13:37.676 04:15:28 -- target/invalid.sh@46 -- # [[ request: 00:13:37.676 { 00:13:37.676 "nqn": "nqn.2016-06.io.spdk:cnode1097", 00:13:37.676 "serial_number": "SPDKISFASTANDAWESOME\u001f", 00:13:37.676 "method": "nvmf_create_subsystem", 00:13:37.676 "req_id": 1 00:13:37.676 } 00:13:37.676 Got JSON-RPC error response 00:13:37.676 response: 00:13:37.676 { 00:13:37.676 "code": -32602, 00:13:37.676 "message": "Invalid SN SPDKISFASTANDAWESOME\u001f" 00:13:37.676 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:37.676 04:15:28 -- target/invalid.sh@50 -- # echo -e '\x1f' 00:13:37.676 04:15:28 -- target/invalid.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d $'SPDK_Controller\037' nqn.2016-06.io.spdk:cnode24457 00:13:37.934 [2024-11-30 04:15:28.355061] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24457: invalid model number 'SPDK_Controller' 00:13:37.934 04:15:28 -- target/invalid.sh@50 -- # out='request: 00:13:37.934 { 00:13:37.934 "nqn": "nqn.2016-06.io.spdk:cnode24457", 00:13:37.934 "model_number": "SPDK_Controller\u001f", 00:13:37.934 "method": "nvmf_create_subsystem", 00:13:37.934 "req_id": 1 00:13:37.934 } 00:13:37.934 Got JSON-RPC error response 00:13:37.934 response: 00:13:37.934 { 00:13:37.934 "code": -32602, 00:13:37.934 "message": "Invalid MN SPDK_Controller\u001f" 00:13:37.934 }' 00:13:37.934 04:15:28 -- target/invalid.sh@51 -- # [[ request: 00:13:37.934 { 00:13:37.934 "nqn": "nqn.2016-06.io.spdk:cnode24457", 00:13:37.934 "model_number": "SPDK_Controller\u001f", 00:13:37.934 "method": "nvmf_create_subsystem", 00:13:37.934 "req_id": 1 00:13:37.934 } 00:13:37.934 Got JSON-RPC error response 00:13:37.934 response: 00:13:37.934 { 00:13:37.934 "code": -32602, 00:13:37.934 "message": "Invalid MN SPDK_Controller\u001f" 00:13:37.934 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:37.934 04:15:28 -- target/invalid.sh@54 -- # gen_random_s 21 00:13:37.934 04:15:28 -- target/invalid.sh@19 -- # local length=21 ll 00:13:37.934 04:15:28 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:37.934 04:15:28 -- target/invalid.sh@21 -- # local chars 00:13:37.934 04:15:28 -- target/invalid.sh@22 -- # local string 00:13:37.934 04:15:28 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 111 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x6f' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=o 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 100 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=d 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 54 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x36' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=6 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 97 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=a 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 85 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=U 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 103 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=g 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 67 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x43' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=C 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 74 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x4a' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=J 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 113 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x71' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=q 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 60 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x3c' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+='<' 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 125 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+='}' 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 110 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x6e' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=n 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 55 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=7 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 39 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x27' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=\' 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 71 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x47' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=G 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 37 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x25' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=% 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 106 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=j 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 106 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=j 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 64 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=@ 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 42 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x2a' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+='*' 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # printf %x 122 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:37.935 04:15:28 -- target/invalid.sh@25 -- # string+=z 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:37.935 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:37.935 04:15:28 -- target/invalid.sh@28 -- # [[ o == \- ]] 00:13:37.935 04:15:28 -- target/invalid.sh@31 -- # echo 'od6aUgCJq<}n7'\''G%jj@*z' 00:13:37.935 04:15:28 -- target/invalid.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -s 'od6aUgCJq<}n7'\''G%jj@*z' nqn.2016-06.io.spdk:cnode500 00:13:38.194 [2024-11-30 04:15:28.680125] nvmf_rpc.c: 418:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode500: invalid serial number 'od6aUgCJq<}n7'G%jj@*z' 00:13:38.195 04:15:28 -- target/invalid.sh@54 -- # out='request: 00:13:38.195 { 00:13:38.195 "nqn": "nqn.2016-06.io.spdk:cnode500", 00:13:38.195 "serial_number": "od6aUgCJq<}n7'\''G%jj@*z", 00:13:38.195 "method": "nvmf_create_subsystem", 00:13:38.195 "req_id": 1 00:13:38.195 } 00:13:38.195 Got JSON-RPC error response 00:13:38.195 response: 00:13:38.195 { 00:13:38.195 "code": -32602, 00:13:38.195 "message": "Invalid SN od6aUgCJq<}n7'\''G%jj@*z" 00:13:38.195 }' 00:13:38.195 04:15:28 -- target/invalid.sh@55 -- # [[ request: 00:13:38.195 { 00:13:38.195 "nqn": "nqn.2016-06.io.spdk:cnode500", 00:13:38.195 "serial_number": "od6aUgCJq<}n7'G%jj@*z", 00:13:38.195 "method": "nvmf_create_subsystem", 00:13:38.195 "req_id": 1 00:13:38.195 } 00:13:38.195 Got JSON-RPC error response 00:13:38.195 response: 00:13:38.195 { 00:13:38.195 "code": -32602, 00:13:38.195 "message": "Invalid SN od6aUgCJq<}n7'G%jj@*z" 00:13:38.195 } == *\I\n\v\a\l\i\d\ \S\N* ]] 00:13:38.195 04:15:28 -- target/invalid.sh@58 -- # gen_random_s 41 00:13:38.195 04:15:28 -- target/invalid.sh@19 -- # local length=41 ll 00:13:38.195 04:15:28 -- target/invalid.sh@21 -- # chars=('32' '33' '34' '35' '36' '37' '38' '39' '40' '41' '42' '43' '44' '45' '46' '47' '48' '49' '50' '51' '52' '53' '54' '55' '56' '57' '58' '59' '60' '61' '62' '63' '64' '65' '66' '67' '68' '69' '70' '71' '72' '73' '74' '75' '76' '77' '78' '79' '80' '81' '82' '83' '84' '85' '86' '87' '88' '89' '90' '91' '92' '93' '94' '95' '96' '97' '98' '99' '100' '101' '102' '103' '104' '105' '106' '107' '108' '109' '110' '111' '112' '113' '114' '115' '116' '117' '118' '119' '120' '121' '122' '123' '124' '125' '126' '127') 00:13:38.195 04:15:28 -- target/invalid.sh@21 -- # local chars 00:13:38.195 04:15:28 -- target/invalid.sh@22 -- # local string 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll = 0 )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 107 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x6b' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=k 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 34 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x22' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+='"' 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 72 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x48' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=H 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 117 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=u 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 106 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=j 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 125 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x7d' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+='}' 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 83 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=S 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 121 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x79' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=y 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 87 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x57' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=W 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 68 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=D 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 63 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x3f' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+='?' 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 85 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x55' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=U 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 78 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x4e' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=N 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 102 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x66' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=f 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 106 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=j 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 127 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x7f' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=$'\177' 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 77 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x4d' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=M 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 39 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x27' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=\' 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 96 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+='`' 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 108 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=l 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 83 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=S 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 70 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x46' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=F 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 103 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=g 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 55 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x37' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=7 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 97 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x61' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=a 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 116 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x74' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=t 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 124 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x7c' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+='|' 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # printf %x 108 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x6c' 00:13:38.195 04:15:28 -- target/invalid.sh@25 -- # string+=l 00:13:38.195 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 65 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x41' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+=A 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 64 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x40' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+=@ 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 83 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x53' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+=S 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 117 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x75' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+=u 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 33 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x21' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+='!' 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 122 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x7a' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+=z 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 103 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x67' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+=g 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 62 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x3e' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+='>' 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 90 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x5a' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+=Z 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 100 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x64' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+=d 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 96 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x60' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+='`' 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 106 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x6a' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+=j 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # printf %x 68 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # echo -e '\x44' 00:13:38.196 04:15:28 -- target/invalid.sh@25 -- # string+=D 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll++ )) 00:13:38.196 04:15:28 -- target/invalid.sh@24 -- # (( ll < length )) 00:13:38.196 04:15:28 -- target/invalid.sh@28 -- # [[ k == \- ]] 00:13:38.196 04:15:28 -- target/invalid.sh@31 -- # echo 'k"Huj}SyWD?UNfjM'\''`lSFg7at|lA@Su!zg>Zd`jD' 00:13:38.196 04:15:28 -- target/invalid.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem -d 'k"Huj}SyWD?UNfjM'\''`lSFg7at|lA@Su!zg>Zd`jD' nqn.2016-06.io.spdk:cnode15908 00:13:38.454 [2024-11-30 04:15:29.037341] nvmf_rpc.c: 427:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15908: invalid model number 'k"Huj}SyWD?UNfjM'`lSFg7at|lA@Su!zg>Zd`jD' 00:13:38.454 04:15:29 -- target/invalid.sh@58 -- # out='request: 00:13:38.454 { 00:13:38.454 "nqn": "nqn.2016-06.io.spdk:cnode15908", 00:13:38.454 "model_number": "k\"Huj}SyWD?UNfj\u007fM'\''`lSFg7at|lA@Su!zg>Zd`jD", 00:13:38.454 "method": "nvmf_create_subsystem", 00:13:38.454 "req_id": 1 00:13:38.454 } 00:13:38.454 Got JSON-RPC error response 00:13:38.454 response: 00:13:38.454 { 00:13:38.454 "code": -32602, 00:13:38.454 "message": "Invalid MN k\"Huj}SyWD?UNfj\u007fM'\''`lSFg7at|lA@Su!zg>Zd`jD" 00:13:38.454 }' 00:13:38.454 04:15:29 -- target/invalid.sh@59 -- # [[ request: 00:13:38.454 { 00:13:38.454 "nqn": "nqn.2016-06.io.spdk:cnode15908", 00:13:38.454 "model_number": "k\"Huj}SyWD?UNfj\u007fM'`lSFg7at|lA@Su!zg>Zd`jD", 00:13:38.454 "method": "nvmf_create_subsystem", 00:13:38.454 "req_id": 1 00:13:38.454 } 00:13:38.454 Got JSON-RPC error response 00:13:38.454 response: 00:13:38.454 { 00:13:38.454 "code": -32602, 00:13:38.454 "message": "Invalid MN k\"Huj}SyWD?UNfj\u007fM'`lSFg7at|lA@Su!zg>Zd`jD" 00:13:38.454 } == *\I\n\v\a\l\i\d\ \M\N* ]] 00:13:38.454 04:15:29 -- target/invalid.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport --trtype tcp 00:13:38.712 [2024-11-30 04:15:29.286232] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:38.712 04:15:29 -- target/invalid.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode -s SPDK001 -a 00:13:38.970 04:15:29 -- target/invalid.sh@64 -- # [[ tcp == \T\C\P ]] 00:13:38.970 04:15:29 -- target/invalid.sh@67 -- # echo '' 00:13:38.970 04:15:29 -- target/invalid.sh@67 -- # head -n 1 00:13:38.970 04:15:29 -- target/invalid.sh@67 -- # IP= 00:13:38.970 04:15:29 -- target/invalid.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode -t tcp -a '' -s 4421 00:13:39.229 [2024-11-30 04:15:29.808079] nvmf_rpc.c: 783:nvmf_rpc_listen_paused: *ERROR*: Unable to remove listener, rc -2 00:13:39.229 04:15:29 -- target/invalid.sh@69 -- # out='request: 00:13:39.229 { 00:13:39.229 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:39.229 "listen_address": { 00:13:39.229 "trtype": "tcp", 00:13:39.229 "traddr": "", 00:13:39.229 "trsvcid": "4421" 00:13:39.229 }, 00:13:39.229 "method": "nvmf_subsystem_remove_listener", 00:13:39.229 "req_id": 1 00:13:39.229 } 00:13:39.229 Got JSON-RPC error response 00:13:39.229 response: 00:13:39.229 { 00:13:39.229 "code": -32602, 00:13:39.229 "message": "Invalid parameters" 00:13:39.229 }' 00:13:39.229 04:15:29 -- target/invalid.sh@70 -- # [[ request: 00:13:39.229 { 00:13:39.229 "nqn": "nqn.2016-06.io.spdk:cnode", 00:13:39.229 "listen_address": { 00:13:39.229 "trtype": "tcp", 00:13:39.229 "traddr": "", 00:13:39.229 "trsvcid": "4421" 00:13:39.229 }, 00:13:39.229 "method": "nvmf_subsystem_remove_listener", 00:13:39.229 "req_id": 1 00:13:39.229 } 00:13:39.229 Got JSON-RPC error response 00:13:39.229 response: 00:13:39.229 { 00:13:39.229 "code": -32602, 00:13:39.229 "message": "Invalid parameters" 00:13:39.229 } != *\U\n\a\b\l\e\ \t\o\ \s\t\o\p\ \l\i\s\t\e\n\e\r\.* ]] 00:13:39.229 04:15:29 -- target/invalid.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10209 -i 0 00:13:39.487 [2024-11-30 04:15:30.072966] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode10209: invalid cntlid range [0-65519] 00:13:39.487 04:15:30 -- target/invalid.sh@73 -- # out='request: 00:13:39.487 { 00:13:39.487 "nqn": "nqn.2016-06.io.spdk:cnode10209", 00:13:39.487 "min_cntlid": 0, 00:13:39.487 "method": "nvmf_create_subsystem", 00:13:39.487 "req_id": 1 00:13:39.487 } 00:13:39.487 Got JSON-RPC error response 00:13:39.487 response: 00:13:39.487 { 00:13:39.487 "code": -32602, 00:13:39.487 "message": "Invalid cntlid range [0-65519]" 00:13:39.487 }' 00:13:39.487 04:15:30 -- target/invalid.sh@74 -- # [[ request: 00:13:39.487 { 00:13:39.487 "nqn": "nqn.2016-06.io.spdk:cnode10209", 00:13:39.487 "min_cntlid": 0, 00:13:39.487 "method": "nvmf_create_subsystem", 00:13:39.487 "req_id": 1 00:13:39.487 } 00:13:39.487 Got JSON-RPC error response 00:13:39.487 response: 00:13:39.487 { 00:13:39.487 "code": -32602, 00:13:39.487 "message": "Invalid cntlid range [0-65519]" 00:13:39.487 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:39.487 04:15:30 -- target/invalid.sh@75 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode15171 -i 65520 00:13:39.745 [2024-11-30 04:15:30.333814] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode15171: invalid cntlid range [65520-65519] 00:13:39.745 04:15:30 -- target/invalid.sh@75 -- # out='request: 00:13:39.745 { 00:13:39.745 "nqn": "nqn.2016-06.io.spdk:cnode15171", 00:13:39.745 "min_cntlid": 65520, 00:13:39.745 "method": "nvmf_create_subsystem", 00:13:39.745 "req_id": 1 00:13:39.745 } 00:13:39.745 Got JSON-RPC error response 00:13:39.745 response: 00:13:39.745 { 00:13:39.745 "code": -32602, 00:13:39.745 "message": "Invalid cntlid range [65520-65519]" 00:13:39.745 }' 00:13:39.745 04:15:30 -- target/invalid.sh@76 -- # [[ request: 00:13:39.745 { 00:13:39.745 "nqn": "nqn.2016-06.io.spdk:cnode15171", 00:13:39.745 "min_cntlid": 65520, 00:13:39.745 "method": "nvmf_create_subsystem", 00:13:39.745 "req_id": 1 00:13:39.745 } 00:13:39.745 Got JSON-RPC error response 00:13:39.745 response: 00:13:39.745 { 00:13:39.745 "code": -32602, 00:13:39.745 "message": "Invalid cntlid range [65520-65519]" 00:13:39.745 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:39.745 04:15:30 -- target/invalid.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode24940 -I 0 00:13:40.003 [2024-11-30 04:15:30.598746] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode24940: invalid cntlid range [1-0] 00:13:40.003 04:15:30 -- target/invalid.sh@77 -- # out='request: 00:13:40.003 { 00:13:40.003 "nqn": "nqn.2016-06.io.spdk:cnode24940", 00:13:40.003 "max_cntlid": 0, 00:13:40.003 "method": "nvmf_create_subsystem", 00:13:40.003 "req_id": 1 00:13:40.003 } 00:13:40.003 Got JSON-RPC error response 00:13:40.003 response: 00:13:40.003 { 00:13:40.003 "code": -32602, 00:13:40.003 "message": "Invalid cntlid range [1-0]" 00:13:40.003 }' 00:13:40.003 04:15:30 -- target/invalid.sh@78 -- # [[ request: 00:13:40.003 { 00:13:40.003 "nqn": "nqn.2016-06.io.spdk:cnode24940", 00:13:40.003 "max_cntlid": 0, 00:13:40.003 "method": "nvmf_create_subsystem", 00:13:40.003 "req_id": 1 00:13:40.003 } 00:13:40.003 Got JSON-RPC error response 00:13:40.003 response: 00:13:40.003 { 00:13:40.003 "code": -32602, 00:13:40.003 "message": "Invalid cntlid range [1-0]" 00:13:40.003 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:40.003 04:15:30 -- target/invalid.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode32147 -I 65520 00:13:40.261 [2024-11-30 04:15:30.851667] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode32147: invalid cntlid range [1-65520] 00:13:40.261 04:15:30 -- target/invalid.sh@79 -- # out='request: 00:13:40.261 { 00:13:40.261 "nqn": "nqn.2016-06.io.spdk:cnode32147", 00:13:40.261 "max_cntlid": 65520, 00:13:40.261 "method": "nvmf_create_subsystem", 00:13:40.261 "req_id": 1 00:13:40.261 } 00:13:40.261 Got JSON-RPC error response 00:13:40.261 response: 00:13:40.261 { 00:13:40.261 "code": -32602, 00:13:40.261 "message": "Invalid cntlid range [1-65520]" 00:13:40.261 }' 00:13:40.261 04:15:30 -- target/invalid.sh@80 -- # [[ request: 00:13:40.261 { 00:13:40.261 "nqn": "nqn.2016-06.io.spdk:cnode32147", 00:13:40.261 "max_cntlid": 65520, 00:13:40.261 "method": "nvmf_create_subsystem", 00:13:40.261 "req_id": 1 00:13:40.261 } 00:13:40.261 Got JSON-RPC error response 00:13:40.261 response: 00:13:40.261 { 00:13:40.261 "code": -32602, 00:13:40.261 "message": "Invalid cntlid range [1-65520]" 00:13:40.261 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:40.261 04:15:30 -- target/invalid.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9783 -i 6 -I 5 00:13:40.519 [2024-11-30 04:15:31.096512] nvmf_rpc.c: 439:rpc_nvmf_create_subsystem: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode9783: invalid cntlid range [6-5] 00:13:40.519 04:15:31 -- target/invalid.sh@83 -- # out='request: 00:13:40.519 { 00:13:40.519 "nqn": "nqn.2016-06.io.spdk:cnode9783", 00:13:40.519 "min_cntlid": 6, 00:13:40.519 "max_cntlid": 5, 00:13:40.519 "method": "nvmf_create_subsystem", 00:13:40.519 "req_id": 1 00:13:40.519 } 00:13:40.519 Got JSON-RPC error response 00:13:40.519 response: 00:13:40.519 { 00:13:40.519 "code": -32602, 00:13:40.519 "message": "Invalid cntlid range [6-5]" 00:13:40.519 }' 00:13:40.519 04:15:31 -- target/invalid.sh@84 -- # [[ request: 00:13:40.519 { 00:13:40.519 "nqn": "nqn.2016-06.io.spdk:cnode9783", 00:13:40.519 "min_cntlid": 6, 00:13:40.519 "max_cntlid": 5, 00:13:40.519 "method": "nvmf_create_subsystem", 00:13:40.519 "req_id": 1 00:13:40.519 } 00:13:40.519 Got JSON-RPC error response 00:13:40.519 response: 00:13:40.519 { 00:13:40.519 "code": -32602, 00:13:40.519 "message": "Invalid cntlid range [6-5]" 00:13:40.519 } == *\I\n\v\a\l\i\d\ \c\n\t\l\i\d\ \r\a\n\g\e* ]] 00:13:40.519 04:15:31 -- target/invalid.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multitarget_rpc.py nvmf_delete_target --name foobar 00:13:40.777 04:15:31 -- target/invalid.sh@87 -- # out='request: 00:13:40.777 { 00:13:40.777 "name": "foobar", 00:13:40.777 "method": "nvmf_delete_target", 00:13:40.777 "req_id": 1 00:13:40.777 } 00:13:40.777 Got JSON-RPC error response 00:13:40.777 response: 00:13:40.777 { 00:13:40.777 "code": -32602, 00:13:40.777 "message": "The specified target doesn'\''t exist, cannot delete it." 00:13:40.777 }' 00:13:40.777 04:15:31 -- target/invalid.sh@88 -- # [[ request: 00:13:40.777 { 00:13:40.777 "name": "foobar", 00:13:40.777 "method": "nvmf_delete_target", 00:13:40.777 "req_id": 1 00:13:40.777 } 00:13:40.777 Got JSON-RPC error response 00:13:40.777 response: 00:13:40.777 { 00:13:40.777 "code": -32602, 00:13:40.777 "message": "The specified target doesn't exist, cannot delete it." 00:13:40.777 } == *\T\h\e\ \s\p\e\c\i\f\i\e\d\ \t\a\r\g\e\t\ \d\o\e\s\n\'\t\ \e\x\i\s\t\,\ \c\a\n\n\o\t\ \d\e\l\e\t\e\ \i\t\.* ]] 00:13:40.777 04:15:31 -- target/invalid.sh@90 -- # trap - SIGINT SIGTERM EXIT 00:13:40.777 04:15:31 -- target/invalid.sh@91 -- # nvmftestfini 00:13:40.777 04:15:31 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:40.777 04:15:31 -- nvmf/common.sh@116 -- # sync 00:13:40.777 04:15:31 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:40.777 04:15:31 -- nvmf/common.sh@119 -- # set +e 00:13:40.777 04:15:31 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:40.777 04:15:31 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:40.777 rmmod nvme_tcp 00:13:40.777 rmmod nvme_fabrics 00:13:40.777 rmmod nvme_keyring 00:13:40.777 04:15:31 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:40.777 04:15:31 -- nvmf/common.sh@123 -- # set -e 00:13:40.777 04:15:31 -- nvmf/common.sh@124 -- # return 0 00:13:40.777 04:15:31 -- nvmf/common.sh@477 -- # '[' -n 2312138 ']' 00:13:40.777 04:15:31 -- nvmf/common.sh@478 -- # killprocess 2312138 00:13:40.777 04:15:31 -- common/autotest_common.sh@936 -- # '[' -z 2312138 ']' 00:13:40.777 04:15:31 -- common/autotest_common.sh@940 -- # kill -0 2312138 00:13:40.777 04:15:31 -- common/autotest_common.sh@941 -- # uname 00:13:40.777 04:15:31 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:40.777 04:15:31 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2312138 00:13:40.777 04:15:31 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:13:40.777 04:15:31 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:13:40.777 04:15:31 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2312138' 00:13:40.777 killing process with pid 2312138 00:13:40.777 04:15:31 -- common/autotest_common.sh@955 -- # kill 2312138 00:13:40.777 04:15:31 -- common/autotest_common.sh@960 -- # wait 2312138 00:13:41.037 04:15:31 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:41.037 04:15:31 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:41.037 04:15:31 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:41.037 04:15:31 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:41.037 04:15:31 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:41.037 04:15:31 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:41.037 04:15:31 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:41.037 04:15:31 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:42.944 04:15:33 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:42.944 00:13:42.944 real 0m9.444s 00:13:42.944 user 0m22.979s 00:13:42.944 sys 0m2.532s 00:13:42.944 04:15:33 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:42.944 04:15:33 -- common/autotest_common.sh@10 -- # set +x 00:13:42.944 ************************************ 00:13:42.944 END TEST nvmf_invalid 00:13:42.944 ************************************ 00:13:43.202 04:15:33 -- nvmf/nvmf.sh@31 -- # run_test nvmf_abort /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:43.202 04:15:33 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:43.202 04:15:33 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:43.202 04:15:33 -- common/autotest_common.sh@10 -- # set +x 00:13:43.202 ************************************ 00:13:43.202 START TEST nvmf_abort 00:13:43.202 ************************************ 00:13:43.202 04:15:33 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort.sh --transport=tcp 00:13:43.202 * Looking for test storage... 00:13:43.202 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:43.202 04:15:33 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:43.202 04:15:33 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:43.202 04:15:33 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:43.202 04:15:33 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:43.202 04:15:33 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:43.202 04:15:33 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:43.202 04:15:33 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:43.202 04:15:33 -- scripts/common.sh@335 -- # IFS=.-: 00:13:43.202 04:15:33 -- scripts/common.sh@335 -- # read -ra ver1 00:13:43.202 04:15:33 -- scripts/common.sh@336 -- # IFS=.-: 00:13:43.202 04:15:33 -- scripts/common.sh@336 -- # read -ra ver2 00:13:43.202 04:15:33 -- scripts/common.sh@337 -- # local 'op=<' 00:13:43.202 04:15:33 -- scripts/common.sh@339 -- # ver1_l=2 00:13:43.202 04:15:33 -- scripts/common.sh@340 -- # ver2_l=1 00:13:43.202 04:15:33 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:43.202 04:15:33 -- scripts/common.sh@343 -- # case "$op" in 00:13:43.202 04:15:33 -- scripts/common.sh@344 -- # : 1 00:13:43.203 04:15:33 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:43.203 04:15:33 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:43.203 04:15:33 -- scripts/common.sh@364 -- # decimal 1 00:13:43.203 04:15:33 -- scripts/common.sh@352 -- # local d=1 00:13:43.203 04:15:33 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:43.203 04:15:33 -- scripts/common.sh@354 -- # echo 1 00:13:43.203 04:15:33 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:43.203 04:15:33 -- scripts/common.sh@365 -- # decimal 2 00:13:43.203 04:15:33 -- scripts/common.sh@352 -- # local d=2 00:13:43.203 04:15:33 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:43.203 04:15:33 -- scripts/common.sh@354 -- # echo 2 00:13:43.203 04:15:33 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:43.203 04:15:33 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:43.203 04:15:33 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:43.203 04:15:33 -- scripts/common.sh@367 -- # return 0 00:13:43.203 04:15:33 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:43.203 04:15:33 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:43.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.203 --rc genhtml_branch_coverage=1 00:13:43.203 --rc genhtml_function_coverage=1 00:13:43.203 --rc genhtml_legend=1 00:13:43.203 --rc geninfo_all_blocks=1 00:13:43.203 --rc geninfo_unexecuted_blocks=1 00:13:43.203 00:13:43.203 ' 00:13:43.203 04:15:33 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:43.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.203 --rc genhtml_branch_coverage=1 00:13:43.203 --rc genhtml_function_coverage=1 00:13:43.203 --rc genhtml_legend=1 00:13:43.203 --rc geninfo_all_blocks=1 00:13:43.203 --rc geninfo_unexecuted_blocks=1 00:13:43.203 00:13:43.203 ' 00:13:43.203 04:15:33 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:43.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.203 --rc genhtml_branch_coverage=1 00:13:43.203 --rc genhtml_function_coverage=1 00:13:43.203 --rc genhtml_legend=1 00:13:43.203 --rc geninfo_all_blocks=1 00:13:43.203 --rc geninfo_unexecuted_blocks=1 00:13:43.203 00:13:43.203 ' 00:13:43.203 04:15:33 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:43.203 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:43.203 --rc genhtml_branch_coverage=1 00:13:43.203 --rc genhtml_function_coverage=1 00:13:43.203 --rc genhtml_legend=1 00:13:43.203 --rc geninfo_all_blocks=1 00:13:43.203 --rc geninfo_unexecuted_blocks=1 00:13:43.203 00:13:43.203 ' 00:13:43.203 04:15:33 -- target/abort.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:43.203 04:15:33 -- nvmf/common.sh@7 -- # uname -s 00:13:43.203 04:15:33 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:43.203 04:15:33 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:43.203 04:15:33 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:43.203 04:15:33 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:43.203 04:15:33 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:43.203 04:15:33 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:43.203 04:15:33 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:43.203 04:15:33 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:43.203 04:15:33 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:43.203 04:15:33 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:43.203 04:15:33 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:43.203 04:15:33 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:43.203 04:15:33 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:43.203 04:15:33 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:43.203 04:15:33 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:43.203 04:15:33 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:43.203 04:15:33 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:43.203 04:15:33 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:43.203 04:15:33 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:43.203 04:15:33 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.203 04:15:33 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.203 04:15:33 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.203 04:15:33 -- paths/export.sh@5 -- # export PATH 00:13:43.203 04:15:33 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:43.203 04:15:33 -- nvmf/common.sh@46 -- # : 0 00:13:43.203 04:15:33 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:43.203 04:15:33 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:43.203 04:15:33 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:43.203 04:15:33 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:43.203 04:15:33 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:43.203 04:15:33 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:43.203 04:15:33 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:43.203 04:15:33 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:43.203 04:15:33 -- target/abort.sh@11 -- # MALLOC_BDEV_SIZE=64 00:13:43.203 04:15:33 -- target/abort.sh@12 -- # MALLOC_BLOCK_SIZE=4096 00:13:43.203 04:15:33 -- target/abort.sh@14 -- # nvmftestinit 00:13:43.203 04:15:33 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:43.203 04:15:33 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:43.203 04:15:33 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:43.203 04:15:33 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:43.203 04:15:33 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:43.203 04:15:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:43.203 04:15:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:43.203 04:15:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:43.203 04:15:33 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:43.203 04:15:33 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:43.203 04:15:33 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:43.203 04:15:33 -- common/autotest_common.sh@10 -- # set +x 00:13:45.110 04:15:35 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:45.110 04:15:35 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:45.110 04:15:35 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:45.110 04:15:35 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:45.110 04:15:35 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:45.110 04:15:35 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:45.110 04:15:35 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:45.110 04:15:35 -- nvmf/common.sh@294 -- # net_devs=() 00:13:45.110 04:15:35 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:45.110 04:15:35 -- nvmf/common.sh@295 -- # e810=() 00:13:45.110 04:15:35 -- nvmf/common.sh@295 -- # local -ga e810 00:13:45.110 04:15:35 -- nvmf/common.sh@296 -- # x722=() 00:13:45.110 04:15:35 -- nvmf/common.sh@296 -- # local -ga x722 00:13:45.110 04:15:35 -- nvmf/common.sh@297 -- # mlx=() 00:13:45.110 04:15:35 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:45.110 04:15:35 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:45.110 04:15:35 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:45.110 04:15:35 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:45.110 04:15:35 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:45.110 04:15:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:45.110 04:15:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:45.110 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:45.110 04:15:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:45.110 04:15:35 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:45.110 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:45.110 04:15:35 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:45.110 04:15:35 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:45.110 04:15:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:45.110 04:15:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:45.110 04:15:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:45.110 04:15:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:45.110 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:45.110 04:15:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:45.110 04:15:35 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:45.110 04:15:35 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:45.110 04:15:35 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:45.110 04:15:35 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:45.110 04:15:35 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:45.110 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:45.110 04:15:35 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:45.110 04:15:35 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:45.110 04:15:35 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:45.110 04:15:35 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:45.110 04:15:35 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:45.110 04:15:35 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:45.110 04:15:35 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:45.110 04:15:35 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:45.110 04:15:35 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:45.110 04:15:35 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:45.110 04:15:35 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:45.110 04:15:35 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:45.110 04:15:35 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:45.110 04:15:35 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:45.110 04:15:35 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:45.110 04:15:35 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:45.110 04:15:35 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:45.110 04:15:35 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:45.369 04:15:35 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:45.369 04:15:35 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:45.369 04:15:35 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:45.369 04:15:35 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:45.369 04:15:35 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:45.369 04:15:35 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:45.369 04:15:35 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:45.369 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:45.369 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.353 ms 00:13:45.369 00:13:45.369 --- 10.0.0.2 ping statistics --- 00:13:45.369 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:45.369 rtt min/avg/max/mdev = 0.353/0.353/0.353/0.000 ms 00:13:45.369 04:15:35 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:45.369 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:45.369 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.165 ms 00:13:45.369 00:13:45.369 --- 10.0.0.1 ping statistics --- 00:13:45.369 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:45.369 rtt min/avg/max/mdev = 0.165/0.165/0.165/0.000 ms 00:13:45.369 04:15:35 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:45.369 04:15:35 -- nvmf/common.sh@410 -- # return 0 00:13:45.369 04:15:35 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:45.369 04:15:35 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:45.369 04:15:35 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:45.369 04:15:35 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:45.369 04:15:35 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:45.369 04:15:35 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:45.369 04:15:35 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:45.369 04:15:35 -- target/abort.sh@15 -- # nvmfappstart -m 0xE 00:13:45.369 04:15:35 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:45.369 04:15:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:45.369 04:15:35 -- common/autotest_common.sh@10 -- # set +x 00:13:45.369 04:15:35 -- nvmf/common.sh@469 -- # nvmfpid=2314815 00:13:45.369 04:15:35 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:45.369 04:15:35 -- nvmf/common.sh@470 -- # waitforlisten 2314815 00:13:45.369 04:15:35 -- common/autotest_common.sh@829 -- # '[' -z 2314815 ']' 00:13:45.369 04:15:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:45.369 04:15:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:45.369 04:15:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:45.369 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:45.369 04:15:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:45.369 04:15:35 -- common/autotest_common.sh@10 -- # set +x 00:13:45.369 [2024-11-30 04:15:35.890489] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:45.369 [2024-11-30 04:15:35.890564] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:45.369 EAL: No free 2048 kB hugepages reported on node 1 00:13:45.369 [2024-11-30 04:15:35.956912] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:45.627 [2024-11-30 04:15:36.048829] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:45.627 [2024-11-30 04:15:36.049014] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:45.627 [2024-11-30 04:15:36.049039] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:45.627 [2024-11-30 04:15:36.049055] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:45.627 [2024-11-30 04:15:36.049151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:45.627 [2024-11-30 04:15:36.049207] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:45.627 [2024-11-30 04:15:36.049211] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:46.563 04:15:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:46.563 04:15:36 -- common/autotest_common.sh@862 -- # return 0 00:13:46.563 04:15:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:46.563 04:15:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:46.563 04:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:46.563 04:15:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:46.563 04:15:36 -- target/abort.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 -a 256 00:13:46.563 04:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.563 04:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:46.563 [2024-11-30 04:15:36.880969] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:46.563 04:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.563 04:15:36 -- target/abort.sh@20 -- # rpc_cmd bdev_malloc_create 64 4096 -b Malloc0 00:13:46.563 04:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.563 04:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:46.563 Malloc0 00:13:46.563 04:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.563 04:15:36 -- target/abort.sh@21 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:46.563 04:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.563 04:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:46.563 Delay0 00:13:46.563 04:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.563 04:15:36 -- target/abort.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:13:46.563 04:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.563 04:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:46.563 04:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.563 04:15:36 -- target/abort.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 Delay0 00:13:46.563 04:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.563 04:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:46.563 04:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.563 04:15:36 -- target/abort.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:13:46.563 04:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.563 04:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:46.563 [2024-11-30 04:15:36.950760] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:46.563 04:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.563 04:15:36 -- target/abort.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:46.563 04:15:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:46.563 04:15:36 -- common/autotest_common.sh@10 -- # set +x 00:13:46.563 04:15:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:46.563 04:15:36 -- target/abort.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0x1 -t 1 -l warning -q 128 00:13:46.563 EAL: No free 2048 kB hugepages reported on node 1 00:13:46.563 [2024-11-30 04:15:37.045988] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:13:49.092 Initializing NVMe Controllers 00:13:49.092 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:13:49.092 controller IO queue size 128 less than required 00:13:49.092 Consider using lower queue depth or small IO size because IO requests may be queued at the NVMe driver. 00:13:49.092 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 0 00:13:49.092 Initialization complete. Launching workers. 00:13:49.092 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 I/O completed: 123, failed: 30170 00:13:49.092 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) abort submitted 30231, failed to submit 62 00:13:49.092 success 30170, unsuccess 61, failed 0 00:13:49.092 04:15:39 -- target/abort.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:13:49.092 04:15:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:13:49.092 04:15:39 -- common/autotest_common.sh@10 -- # set +x 00:13:49.092 04:15:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:13:49.092 04:15:39 -- target/abort.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:13:49.092 04:15:39 -- target/abort.sh@38 -- # nvmftestfini 00:13:49.092 04:15:39 -- nvmf/common.sh@476 -- # nvmfcleanup 00:13:49.092 04:15:39 -- nvmf/common.sh@116 -- # sync 00:13:49.092 04:15:39 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:13:49.092 04:15:39 -- nvmf/common.sh@119 -- # set +e 00:13:49.092 04:15:39 -- nvmf/common.sh@120 -- # for i in {1..20} 00:13:49.092 04:15:39 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:13:49.092 rmmod nvme_tcp 00:13:49.092 rmmod nvme_fabrics 00:13:49.092 rmmod nvme_keyring 00:13:49.092 04:15:39 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:13:49.092 04:15:39 -- nvmf/common.sh@123 -- # set -e 00:13:49.092 04:15:39 -- nvmf/common.sh@124 -- # return 0 00:13:49.092 04:15:39 -- nvmf/common.sh@477 -- # '[' -n 2314815 ']' 00:13:49.092 04:15:39 -- nvmf/common.sh@478 -- # killprocess 2314815 00:13:49.092 04:15:39 -- common/autotest_common.sh@936 -- # '[' -z 2314815 ']' 00:13:49.092 04:15:39 -- common/autotest_common.sh@940 -- # kill -0 2314815 00:13:49.092 04:15:39 -- common/autotest_common.sh@941 -- # uname 00:13:49.092 04:15:39 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:13:49.092 04:15:39 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2314815 00:13:49.092 04:15:39 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:13:49.092 04:15:39 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:13:49.092 04:15:39 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2314815' 00:13:49.092 killing process with pid 2314815 00:13:49.092 04:15:39 -- common/autotest_common.sh@955 -- # kill 2314815 00:13:49.092 04:15:39 -- common/autotest_common.sh@960 -- # wait 2314815 00:13:49.092 04:15:39 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:13:49.092 04:15:39 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:13:49.092 04:15:39 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:13:49.092 04:15:39 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:13:49.092 04:15:39 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:13:49.092 04:15:39 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:49.092 04:15:39 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:49.092 04:15:39 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:50.996 04:15:41 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:13:50.996 00:13:50.996 real 0m7.984s 00:13:50.996 user 0m13.044s 00:13:50.996 sys 0m2.497s 00:13:50.996 04:15:41 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:13:50.997 04:15:41 -- common/autotest_common.sh@10 -- # set +x 00:13:50.997 ************************************ 00:13:50.997 END TEST nvmf_abort 00:13:50.997 ************************************ 00:13:50.997 04:15:41 -- nvmf/nvmf.sh@32 -- # run_test nvmf_ns_hotplug_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:50.997 04:15:41 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:13:50.997 04:15:41 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:13:50.997 04:15:41 -- common/autotest_common.sh@10 -- # set +x 00:13:50.997 ************************************ 00:13:50.997 START TEST nvmf_ns_hotplug_stress 00:13:50.997 ************************************ 00:13:50.997 04:15:41 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh --transport=tcp 00:13:51.255 * Looking for test storage... 00:13:51.255 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:13:51.255 04:15:41 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:13:51.255 04:15:41 -- common/autotest_common.sh@1690 -- # lcov --version 00:13:51.255 04:15:41 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:13:51.255 04:15:41 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:13:51.255 04:15:41 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:13:51.255 04:15:41 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:13:51.255 04:15:41 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:13:51.255 04:15:41 -- scripts/common.sh@335 -- # IFS=.-: 00:13:51.255 04:15:41 -- scripts/common.sh@335 -- # read -ra ver1 00:13:51.255 04:15:41 -- scripts/common.sh@336 -- # IFS=.-: 00:13:51.255 04:15:41 -- scripts/common.sh@336 -- # read -ra ver2 00:13:51.255 04:15:41 -- scripts/common.sh@337 -- # local 'op=<' 00:13:51.255 04:15:41 -- scripts/common.sh@339 -- # ver1_l=2 00:13:51.255 04:15:41 -- scripts/common.sh@340 -- # ver2_l=1 00:13:51.255 04:15:41 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:13:51.255 04:15:41 -- scripts/common.sh@343 -- # case "$op" in 00:13:51.255 04:15:41 -- scripts/common.sh@344 -- # : 1 00:13:51.256 04:15:41 -- scripts/common.sh@363 -- # (( v = 0 )) 00:13:51.256 04:15:41 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:13:51.256 04:15:41 -- scripts/common.sh@364 -- # decimal 1 00:13:51.256 04:15:41 -- scripts/common.sh@352 -- # local d=1 00:13:51.256 04:15:41 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:13:51.256 04:15:41 -- scripts/common.sh@354 -- # echo 1 00:13:51.256 04:15:41 -- scripts/common.sh@364 -- # ver1[v]=1 00:13:51.256 04:15:41 -- scripts/common.sh@365 -- # decimal 2 00:13:51.256 04:15:41 -- scripts/common.sh@352 -- # local d=2 00:13:51.256 04:15:41 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:13:51.256 04:15:41 -- scripts/common.sh@354 -- # echo 2 00:13:51.256 04:15:41 -- scripts/common.sh@365 -- # ver2[v]=2 00:13:51.256 04:15:41 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:13:51.256 04:15:41 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:13:51.256 04:15:41 -- scripts/common.sh@367 -- # return 0 00:13:51.256 04:15:41 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:13:51.256 04:15:41 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:13:51.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.256 --rc genhtml_branch_coverage=1 00:13:51.256 --rc genhtml_function_coverage=1 00:13:51.256 --rc genhtml_legend=1 00:13:51.256 --rc geninfo_all_blocks=1 00:13:51.256 --rc geninfo_unexecuted_blocks=1 00:13:51.256 00:13:51.256 ' 00:13:51.256 04:15:41 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:13:51.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.256 --rc genhtml_branch_coverage=1 00:13:51.256 --rc genhtml_function_coverage=1 00:13:51.256 --rc genhtml_legend=1 00:13:51.256 --rc geninfo_all_blocks=1 00:13:51.256 --rc geninfo_unexecuted_blocks=1 00:13:51.256 00:13:51.256 ' 00:13:51.256 04:15:41 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:13:51.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.256 --rc genhtml_branch_coverage=1 00:13:51.256 --rc genhtml_function_coverage=1 00:13:51.256 --rc genhtml_legend=1 00:13:51.256 --rc geninfo_all_blocks=1 00:13:51.256 --rc geninfo_unexecuted_blocks=1 00:13:51.256 00:13:51.256 ' 00:13:51.256 04:15:41 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:13:51.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:13:51.256 --rc genhtml_branch_coverage=1 00:13:51.256 --rc genhtml_function_coverage=1 00:13:51.256 --rc genhtml_legend=1 00:13:51.256 --rc geninfo_all_blocks=1 00:13:51.256 --rc geninfo_unexecuted_blocks=1 00:13:51.256 00:13:51.256 ' 00:13:51.256 04:15:41 -- target/ns_hotplug_stress.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:13:51.256 04:15:41 -- nvmf/common.sh@7 -- # uname -s 00:13:51.256 04:15:41 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:13:51.256 04:15:41 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:13:51.256 04:15:41 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:13:51.256 04:15:41 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:13:51.256 04:15:41 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:13:51.256 04:15:41 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:13:51.256 04:15:41 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:13:51.256 04:15:41 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:13:51.256 04:15:41 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:13:51.256 04:15:41 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:13:51.256 04:15:41 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:13:51.256 04:15:41 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:13:51.256 04:15:41 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:13:51.256 04:15:41 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:13:51.256 04:15:41 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:13:51.256 04:15:41 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:13:51.256 04:15:41 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:13:51.256 04:15:41 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:13:51.256 04:15:41 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:13:51.256 04:15:41 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.256 04:15:41 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.256 04:15:41 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.256 04:15:41 -- paths/export.sh@5 -- # export PATH 00:13:51.256 04:15:41 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:13:51.256 04:15:41 -- nvmf/common.sh@46 -- # : 0 00:13:51.256 04:15:41 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:13:51.256 04:15:41 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:13:51.256 04:15:41 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:13:51.256 04:15:41 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:13:51.256 04:15:41 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:13:51.256 04:15:41 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:13:51.256 04:15:41 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:13:51.256 04:15:41 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:13:51.256 04:15:41 -- target/ns_hotplug_stress.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:13:51.256 04:15:41 -- target/ns_hotplug_stress.sh@22 -- # nvmftestinit 00:13:51.256 04:15:41 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:13:51.256 04:15:41 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:13:51.256 04:15:41 -- nvmf/common.sh@436 -- # prepare_net_devs 00:13:51.256 04:15:41 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:13:51.256 04:15:41 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:13:51.256 04:15:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:13:51.256 04:15:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:13:51.256 04:15:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:13:51.256 04:15:41 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:13:51.256 04:15:41 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:13:51.256 04:15:41 -- nvmf/common.sh@284 -- # xtrace_disable 00:13:51.256 04:15:41 -- common/autotest_common.sh@10 -- # set +x 00:13:53.789 04:15:43 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:13:53.789 04:15:43 -- nvmf/common.sh@290 -- # pci_devs=() 00:13:53.789 04:15:43 -- nvmf/common.sh@290 -- # local -a pci_devs 00:13:53.789 04:15:43 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:13:53.789 04:15:43 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:13:53.789 04:15:43 -- nvmf/common.sh@292 -- # pci_drivers=() 00:13:53.789 04:15:43 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:13:53.789 04:15:43 -- nvmf/common.sh@294 -- # net_devs=() 00:13:53.789 04:15:43 -- nvmf/common.sh@294 -- # local -ga net_devs 00:13:53.789 04:15:43 -- nvmf/common.sh@295 -- # e810=() 00:13:53.789 04:15:43 -- nvmf/common.sh@295 -- # local -ga e810 00:13:53.789 04:15:43 -- nvmf/common.sh@296 -- # x722=() 00:13:53.789 04:15:43 -- nvmf/common.sh@296 -- # local -ga x722 00:13:53.789 04:15:43 -- nvmf/common.sh@297 -- # mlx=() 00:13:53.789 04:15:43 -- nvmf/common.sh@297 -- # local -ga mlx 00:13:53.789 04:15:43 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:13:53.789 04:15:43 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:13:53.789 04:15:43 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:13:53.789 04:15:43 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:13:53.789 04:15:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:53.789 04:15:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:13:53.789 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:13:53.789 04:15:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:13:53.789 04:15:43 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:13:53.789 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:13:53.789 04:15:43 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:13:53.789 04:15:43 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:53.789 04:15:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:53.789 04:15:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:53.789 04:15:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:53.789 04:15:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:13:53.789 Found net devices under 0000:0a:00.0: cvl_0_0 00:13:53.789 04:15:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:53.789 04:15:43 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:13:53.789 04:15:43 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:13:53.789 04:15:43 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:13:53.789 04:15:43 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:13:53.789 04:15:43 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:13:53.789 Found net devices under 0000:0a:00.1: cvl_0_1 00:13:53.789 04:15:43 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:13:53.789 04:15:43 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:13:53.789 04:15:43 -- nvmf/common.sh@402 -- # is_hw=yes 00:13:53.789 04:15:43 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:13:53.789 04:15:43 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:13:53.789 04:15:43 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:13:53.789 04:15:43 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:13:53.789 04:15:43 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:13:53.789 04:15:43 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:13:53.789 04:15:43 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:13:53.789 04:15:43 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:13:53.789 04:15:43 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:13:53.789 04:15:43 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:13:53.789 04:15:43 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:13:53.789 04:15:43 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:13:53.789 04:15:43 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:13:53.789 04:15:43 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:13:53.789 04:15:43 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:13:53.789 04:15:43 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:13:53.789 04:15:43 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:13:53.789 04:15:43 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:13:53.790 04:15:43 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:13:53.790 04:15:43 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:13:53.790 04:15:43 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:13:53.790 04:15:43 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:13:53.790 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:13:53.790 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.179 ms 00:13:53.790 00:13:53.790 --- 10.0.0.2 ping statistics --- 00:13:53.790 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:53.790 rtt min/avg/max/mdev = 0.179/0.179/0.179/0.000 ms 00:13:53.790 04:15:43 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:13:53.790 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:13:53.790 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.083 ms 00:13:53.790 00:13:53.790 --- 10.0.0.1 ping statistics --- 00:13:53.790 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:13:53.790 rtt min/avg/max/mdev = 0.083/0.083/0.083/0.000 ms 00:13:53.790 04:15:43 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:13:53.790 04:15:43 -- nvmf/common.sh@410 -- # return 0 00:13:53.790 04:15:43 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:13:53.790 04:15:43 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:13:53.790 04:15:43 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:13:53.790 04:15:43 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:13:53.790 04:15:43 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:13:53.790 04:15:43 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:13:53.790 04:15:43 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:13:53.790 04:15:43 -- target/ns_hotplug_stress.sh@23 -- # nvmfappstart -m 0xE 00:13:53.790 04:15:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:13:53.790 04:15:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:13:53.790 04:15:43 -- common/autotest_common.sh@10 -- # set +x 00:13:53.790 04:15:43 -- nvmf/common.sh@469 -- # nvmfpid=2317200 00:13:53.790 04:15:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:13:53.790 04:15:43 -- nvmf/common.sh@470 -- # waitforlisten 2317200 00:13:53.790 04:15:43 -- common/autotest_common.sh@829 -- # '[' -z 2317200 ']' 00:13:53.790 04:15:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:13:53.790 04:15:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:13:53.790 04:15:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:13:53.790 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:13:53.790 04:15:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:13:53.790 04:15:43 -- common/autotest_common.sh@10 -- # set +x 00:13:53.790 [2024-11-30 04:15:44.029848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:13:53.790 [2024-11-30 04:15:44.029930] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:13:53.790 EAL: No free 2048 kB hugepages reported on node 1 00:13:53.790 [2024-11-30 04:15:44.094073] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:13:53.790 [2024-11-30 04:15:44.181545] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:13:53.790 [2024-11-30 04:15:44.181694] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:13:53.790 [2024-11-30 04:15:44.181711] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:13:53.790 [2024-11-30 04:15:44.181724] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:13:53.790 [2024-11-30 04:15:44.181798] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:13:53.790 [2024-11-30 04:15:44.181868] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:13:53.790 [2024-11-30 04:15:44.181871] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:13:54.723 04:15:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:13:54.723 04:15:45 -- common/autotest_common.sh@862 -- # return 0 00:13:54.723 04:15:45 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:13:54.723 04:15:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:13:54.723 04:15:45 -- common/autotest_common.sh@10 -- # set +x 00:13:54.724 04:15:45 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:13:54.724 04:15:45 -- target/ns_hotplug_stress.sh@25 -- # null_size=1000 00:13:54.724 04:15:45 -- target/ns_hotplug_stress.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:13:54.724 [2024-11-30 04:15:45.300342] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:13:54.724 04:15:45 -- target/ns_hotplug_stress.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:13:54.981 04:15:45 -- target/ns_hotplug_stress.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:13:55.240 [2024-11-30 04:15:45.811170] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:13:55.240 04:15:45 -- target/ns_hotplug_stress.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:13:55.498 04:15:46 -- target/ns_hotplug_stress.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 512 -b Malloc0 00:13:55.756 Malloc0 00:13:55.756 04:15:46 -- target/ns_hotplug_stress.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_delay_create -b Malloc0 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:13:56.014 Delay0 00:13:56.014 04:15:46 -- target/ns_hotplug_stress.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:56.313 04:15:46 -- target/ns_hotplug_stress.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create NULL1 1000 512 00:13:56.601 NULL1 00:13:56.601 04:15:47 -- target/ns_hotplug_stress.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:13:56.858 04:15:47 -- target/ns_hotplug_stress.sh@42 -- # PERF_PID=2317641 00:13:56.858 04:15:47 -- target/ns_hotplug_stress.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 30 -q 128 -w randread -o 512 -Q 1000 00:13:56.859 04:15:47 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:13:56.859 04:15:47 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:56.859 EAL: No free 2048 kB hugepages reported on node 1 00:13:57.117 04:15:47 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:57.375 04:15:47 -- target/ns_hotplug_stress.sh@49 -- # null_size=1001 00:13:57.375 04:15:47 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1001 00:13:57.632 true 00:13:57.632 04:15:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:13:57.632 04:15:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:57.890 04:15:48 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:58.148 04:15:48 -- target/ns_hotplug_stress.sh@49 -- # null_size=1002 00:13:58.148 04:15:48 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1002 00:13:58.406 true 00:13:58.406 04:15:48 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:13:58.406 04:15:48 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:13:59.339 Read completed with error (sct=0, sc=11) 00:13:59.339 04:15:49 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:13:59.339 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:13:59.597 04:15:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1003 00:13:59.597 04:15:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1003 00:13:59.854 true 00:13:59.854 04:15:50 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:13:59.854 04:15:50 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:00.112 04:15:50 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:00.369 04:15:50 -- target/ns_hotplug_stress.sh@49 -- # null_size=1004 00:14:00.369 04:15:50 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1004 00:14:00.626 true 00:14:00.626 04:15:51 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:00.626 04:15:51 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:01.558 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:01.558 04:15:51 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:01.558 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:01.558 04:15:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1005 00:14:01.558 04:15:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1005 00:14:01.815 true 00:14:01.815 04:15:52 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:01.815 04:15:52 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:02.072 04:15:52 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:02.330 04:15:52 -- target/ns_hotplug_stress.sh@49 -- # null_size=1006 00:14:02.330 04:15:52 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1006 00:14:02.586 true 00:14:02.586 04:15:53 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:02.586 04:15:53 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:03.517 04:15:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:03.774 04:15:54 -- target/ns_hotplug_stress.sh@49 -- # null_size=1007 00:14:03.774 04:15:54 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1007 00:14:04.032 true 00:14:04.032 04:15:54 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:04.032 04:15:54 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:04.290 04:15:54 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:04.547 04:15:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1008 00:14:04.547 04:15:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1008 00:14:04.804 true 00:14:04.804 04:15:55 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:04.804 04:15:55 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:05.061 04:15:55 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:05.319 04:15:55 -- target/ns_hotplug_stress.sh@49 -- # null_size=1009 00:14:05.319 04:15:55 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1009 00:14:05.577 true 00:14:05.577 04:15:56 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:05.577 04:15:56 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:06.508 04:15:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:06.766 04:15:57 -- target/ns_hotplug_stress.sh@49 -- # null_size=1010 00:14:06.766 04:15:57 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1010 00:14:07.022 true 00:14:07.022 04:15:57 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:07.022 04:15:57 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:07.279 04:15:57 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:07.536 04:15:58 -- target/ns_hotplug_stress.sh@49 -- # null_size=1011 00:14:07.536 04:15:58 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1011 00:14:07.793 true 00:14:07.793 04:15:58 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:07.793 04:15:58 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:08.725 04:15:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:08.725 04:15:59 -- target/ns_hotplug_stress.sh@49 -- # null_size=1012 00:14:08.725 04:15:59 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1012 00:14:08.983 true 00:14:08.983 04:15:59 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:08.983 04:15:59 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:09.241 04:15:59 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:09.499 04:16:00 -- target/ns_hotplug_stress.sh@49 -- # null_size=1013 00:14:09.499 04:16:00 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1013 00:14:09.757 true 00:14:09.757 04:16:00 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:09.757 04:16:00 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:10.689 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.689 04:16:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:10.689 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.689 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.947 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:10.947 04:16:01 -- target/ns_hotplug_stress.sh@49 -- # null_size=1014 00:14:10.947 04:16:01 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1014 00:14:11.204 true 00:14:11.204 04:16:01 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:11.204 04:16:01 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:11.461 04:16:01 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:11.719 04:16:02 -- target/ns_hotplug_stress.sh@49 -- # null_size=1015 00:14:11.719 04:16:02 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1015 00:14:11.976 true 00:14:11.976 04:16:02 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:11.976 04:16:02 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:12.908 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:12.908 04:16:03 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.166 04:16:03 -- target/ns_hotplug_stress.sh@49 -- # null_size=1016 00:14:13.166 04:16:03 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1016 00:14:13.424 true 00:14:13.424 04:16:03 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:13.424 04:16:03 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:13.682 04:16:04 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:13.957 04:16:04 -- target/ns_hotplug_stress.sh@49 -- # null_size=1017 00:14:13.957 04:16:04 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1017 00:14:14.214 true 00:14:14.214 04:16:04 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:14.214 04:16:04 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.146 04:16:05 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:15.404 04:16:05 -- target/ns_hotplug_stress.sh@49 -- # null_size=1018 00:14:15.404 04:16:05 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1018 00:14:15.661 true 00:14:15.661 04:16:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:15.661 04:16:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:15.919 04:16:06 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:16.177 04:16:06 -- target/ns_hotplug_stress.sh@49 -- # null_size=1019 00:14:16.177 04:16:06 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1019 00:14:16.434 true 00:14:16.434 04:16:06 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:16.434 04:16:06 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.368 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:17.368 04:16:07 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:17.368 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:17.368 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:17.368 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:17.368 04:16:07 -- target/ns_hotplug_stress.sh@49 -- # null_size=1020 00:14:17.368 04:16:07 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1020 00:14:17.626 true 00:14:17.626 04:16:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:17.626 04:16:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:17.883 04:16:08 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:18.140 04:16:08 -- target/ns_hotplug_stress.sh@49 -- # null_size=1021 00:14:18.141 04:16:08 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1021 00:14:18.398 true 00:14:18.398 04:16:08 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:18.398 04:16:08 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:19.331 04:16:09 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:19.331 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:19.589 04:16:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1022 00:14:19.589 04:16:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1022 00:14:19.847 true 00:14:19.847 04:16:10 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:19.847 04:16:10 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:20.104 04:16:10 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:20.362 04:16:10 -- target/ns_hotplug_stress.sh@49 -- # null_size=1023 00:14:20.362 04:16:10 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1023 00:14:20.620 true 00:14:20.620 04:16:11 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:20.620 04:16:11 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:21.553 04:16:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:21.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:21.553 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:21.811 04:16:12 -- target/ns_hotplug_stress.sh@49 -- # null_size=1024 00:14:21.811 04:16:12 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1024 00:14:22.069 true 00:14:22.069 04:16:12 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:22.069 04:16:12 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:22.327 04:16:12 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:22.584 04:16:13 -- target/ns_hotplug_stress.sh@49 -- # null_size=1025 00:14:22.584 04:16:13 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1025 00:14:22.841 true 00:14:22.841 04:16:13 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:22.841 04:16:13 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:23.772 04:16:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:23.772 Message suppressed 999 times: Read completed with error (sct=0, sc=11) 00:14:24.029 04:16:14 -- target/ns_hotplug_stress.sh@49 -- # null_size=1026 00:14:24.030 04:16:14 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1026 00:14:24.288 true 00:14:24.288 04:16:14 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:24.288 04:16:14 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:24.576 04:16:14 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:24.576 04:16:15 -- target/ns_hotplug_stress.sh@49 -- # null_size=1027 00:14:24.576 04:16:15 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1027 00:14:24.860 true 00:14:24.860 04:16:15 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:24.860 04:16:15 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:25.792 04:16:16 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.050 04:16:16 -- target/ns_hotplug_stress.sh@49 -- # null_size=1028 00:14:26.050 04:16:16 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1028 00:14:26.307 true 00:14:26.307 04:16:16 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:26.307 04:16:16 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:26.566 04:16:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:26.823 04:16:17 -- target/ns_hotplug_stress.sh@49 -- # null_size=1029 00:14:26.823 04:16:17 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1029 00:14:27.081 true 00:14:27.081 04:16:17 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:27.081 04:16:17 -- target/ns_hotplug_stress.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:27.339 04:16:17 -- target/ns_hotplug_stress.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:14:27.339 Initializing NVMe Controllers 00:14:27.339 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:27.339 Controller IO queue size 128, less than required. 00:14:27.339 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:27.339 Controller IO queue size 128, less than required. 00:14:27.339 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:14:27.339 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:14:27.340 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:14:27.340 Initialization complete. Launching workers. 00:14:27.340 ======================================================== 00:14:27.340 Latency(us) 00:14:27.340 Device Information : IOPS MiB/s Average min max 00:14:27.340 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 608.52 0.30 101569.21 3128.75 1090793.55 00:14:27.340 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 11160.72 5.45 11434.67 2486.82 446236.21 00:14:27.340 ======================================================== 00:14:27.340 Total : 11769.24 5.75 16095.00 2486.82 1090793.55 00:14:27.340 00:14:27.597 04:16:18 -- target/ns_hotplug_stress.sh@49 -- # null_size=1030 00:14:27.597 04:16:18 -- target/ns_hotplug_stress.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_resize NULL1 1030 00:14:27.855 true 00:14:27.855 04:16:18 -- target/ns_hotplug_stress.sh@44 -- # kill -0 2317641 00:14:27.855 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/ns_hotplug_stress.sh: line 44: kill: (2317641) - No such process 00:14:27.855 04:16:18 -- target/ns_hotplug_stress.sh@53 -- # wait 2317641 00:14:27.855 04:16:18 -- target/ns_hotplug_stress.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:28.114 04:16:18 -- target/ns_hotplug_stress.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:28.371 04:16:18 -- target/ns_hotplug_stress.sh@58 -- # nthreads=8 00:14:28.371 04:16:18 -- target/ns_hotplug_stress.sh@58 -- # pids=() 00:14:28.371 04:16:18 -- target/ns_hotplug_stress.sh@59 -- # (( i = 0 )) 00:14:28.371 04:16:18 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:28.371 04:16:18 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null0 100 4096 00:14:28.630 null0 00:14:28.630 04:16:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:28.630 04:16:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:28.630 04:16:19 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null1 100 4096 00:14:28.888 null1 00:14:28.888 04:16:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:28.888 04:16:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:28.888 04:16:19 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null2 100 4096 00:14:29.146 null2 00:14:29.146 04:16:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:29.146 04:16:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:29.146 04:16:19 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null3 100 4096 00:14:29.405 null3 00:14:29.405 04:16:19 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:29.405 04:16:19 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:29.405 04:16:19 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null4 100 4096 00:14:29.663 null4 00:14:29.663 04:16:20 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:29.663 04:16:20 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:29.663 04:16:20 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null5 100 4096 00:14:29.921 null5 00:14:29.921 04:16:20 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:29.921 04:16:20 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:29.921 04:16:20 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null6 100 4096 00:14:30.179 null6 00:14:30.179 04:16:20 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:30.180 04:16:20 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:30.180 04:16:20 -- target/ns_hotplug_stress.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_null_create null7 100 4096 00:14:30.439 null7 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@59 -- # (( ++i )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@59 -- # (( i < nthreads )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( i = 0 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 1 null0 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=1 bdev=null0 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 2 null1 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=2 bdev=null1 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 3 null2 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=3 bdev=null2 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 4 null3 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=4 bdev=null3 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 5 null4 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=5 bdev=null4 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 6 null5 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=6 bdev=null5 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 7 null6 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=7 bdev=null6 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@64 -- # pids+=($!) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@63 -- # add_remove 8 null7 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( ++i )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@62 -- # (( i < nthreads )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@14 -- # local nsid=8 bdev=null7 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i = 0 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@66 -- # wait 2321808 2321809 2321811 2321813 2321815 2321817 2321819 2321821 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.439 04:16:20 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:30.698 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:30.698 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:30.698 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:30.698 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:30.698 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:30.698 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:30.698 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:30.698 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:30.956 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:31.214 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:31.214 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:31.214 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:31.214 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:31.214 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:31.214 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:31.214 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.214 04:16:21 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.473 04:16:21 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:31.731 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:31.731 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:31.731 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:31.731 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:31.731 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:31.731 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:31.731 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:31.731 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.989 04:16:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:31.990 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:31.990 04:16:22 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:31.990 04:16:22 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:32.248 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:32.248 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:32.248 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:32.248 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:32.248 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:32.248 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.248 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:32.248 04:16:22 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:32.506 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:32.765 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:32.765 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:32.765 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:32.765 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:32.765 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:32.765 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:32.765 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:32.765 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:33.023 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.024 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.024 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:33.282 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.282 04:16:23 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.282 04:16:23 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:33.282 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:33.282 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:33.541 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:33.541 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:33.541 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:33.541 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:33.541 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:33.541 04:16:23 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:33.798 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.798 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.798 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:33.798 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.798 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.798 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:33.798 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.798 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:33.799 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:34.056 04:16:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:34.056 04:16:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:34.056 04:16:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:34.056 04:16:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.056 04:16:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:34.056 04:16:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:34.056 04:16:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:34.056 04:16:24 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.315 04:16:24 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:34.573 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:34.573 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:34.573 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:34.573 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:34.573 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:34.573 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:34.573 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:34.573 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.829 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:34.830 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:34.830 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:34.830 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:35.087 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:35.087 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:35.087 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:35.087 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:35.087 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:35.087 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:35.087 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.087 04:16:25 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 3 nqn.2016-06.io.spdk:cnode1 null2 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 7 nqn.2016-06.io.spdk:cnode1 null6 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 5 nqn.2016-06.io.spdk:cnode1 null4 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 8 nqn.2016-06.io.spdk:cnode1 null7 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 6 nqn.2016-06.io.spdk:cnode1 null5 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 2 nqn.2016-06.io.spdk:cnode1 null1 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 1 nqn.2016-06.io.spdk:cnode1 null0 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.345 04:16:25 -- target/ns_hotplug_stress.sh@17 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns -n 4 nqn.2016-06.io.spdk:cnode1 null3 00:14:35.604 04:16:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 3 00:14:35.604 04:16:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 5 00:14:35.604 04:16:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 7 00:14:35.604 04:16:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 8 00:14:35.604 04:16:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:14:35.604 04:16:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 4 00:14:35.604 04:16:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 6 00:14:35.604 04:16:26 -- target/ns_hotplug_stress.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 2 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( ++i )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@16 -- # (( i < 10 )) 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:14:35.863 04:16:26 -- target/ns_hotplug_stress.sh@70 -- # nvmftestfini 00:14:35.863 04:16:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:35.863 04:16:26 -- nvmf/common.sh@116 -- # sync 00:14:35.863 04:16:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:35.863 04:16:26 -- nvmf/common.sh@119 -- # set +e 00:14:35.863 04:16:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:35.863 04:16:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:35.863 rmmod nvme_tcp 00:14:35.863 rmmod nvme_fabrics 00:14:35.863 rmmod nvme_keyring 00:14:36.122 04:16:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:36.122 04:16:26 -- nvmf/common.sh@123 -- # set -e 00:14:36.122 04:16:26 -- nvmf/common.sh@124 -- # return 0 00:14:36.122 04:16:26 -- nvmf/common.sh@477 -- # '[' -n 2317200 ']' 00:14:36.122 04:16:26 -- nvmf/common.sh@478 -- # killprocess 2317200 00:14:36.122 04:16:26 -- common/autotest_common.sh@936 -- # '[' -z 2317200 ']' 00:14:36.122 04:16:26 -- common/autotest_common.sh@940 -- # kill -0 2317200 00:14:36.122 04:16:26 -- common/autotest_common.sh@941 -- # uname 00:14:36.122 04:16:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:36.122 04:16:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2317200 00:14:36.122 04:16:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:36.122 04:16:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:36.122 04:16:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2317200' 00:14:36.122 killing process with pid 2317200 00:14:36.122 04:16:26 -- common/autotest_common.sh@955 -- # kill 2317200 00:14:36.122 04:16:26 -- common/autotest_common.sh@960 -- # wait 2317200 00:14:36.381 04:16:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:36.381 04:16:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:36.381 04:16:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:36.381 04:16:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:36.381 04:16:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:36.381 04:16:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:36.381 04:16:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:36.381 04:16:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:38.288 04:16:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:38.288 00:14:38.288 real 0m47.216s 00:14:38.288 user 3m36.203s 00:14:38.288 sys 0m15.211s 00:14:38.288 04:16:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:38.288 04:16:28 -- common/autotest_common.sh@10 -- # set +x 00:14:38.288 ************************************ 00:14:38.288 END TEST nvmf_ns_hotplug_stress 00:14:38.288 ************************************ 00:14:38.288 04:16:28 -- nvmf/nvmf.sh@33 -- # run_test nvmf_connect_stress /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:38.288 04:16:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:38.288 04:16:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:38.288 04:16:28 -- common/autotest_common.sh@10 -- # set +x 00:14:38.288 ************************************ 00:14:38.288 START TEST nvmf_connect_stress 00:14:38.288 ************************************ 00:14:38.288 04:16:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh --transport=tcp 00:14:38.288 * Looking for test storage... 00:14:38.288 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:38.288 04:16:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:38.288 04:16:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:38.288 04:16:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:38.545 04:16:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:38.545 04:16:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:38.545 04:16:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:38.545 04:16:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:38.545 04:16:28 -- scripts/common.sh@335 -- # IFS=.-: 00:14:38.545 04:16:28 -- scripts/common.sh@335 -- # read -ra ver1 00:14:38.545 04:16:28 -- scripts/common.sh@336 -- # IFS=.-: 00:14:38.545 04:16:28 -- scripts/common.sh@336 -- # read -ra ver2 00:14:38.545 04:16:28 -- scripts/common.sh@337 -- # local 'op=<' 00:14:38.545 04:16:28 -- scripts/common.sh@339 -- # ver1_l=2 00:14:38.545 04:16:28 -- scripts/common.sh@340 -- # ver2_l=1 00:14:38.545 04:16:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:38.545 04:16:28 -- scripts/common.sh@343 -- # case "$op" in 00:14:38.545 04:16:28 -- scripts/common.sh@344 -- # : 1 00:14:38.545 04:16:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:38.545 04:16:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:38.545 04:16:28 -- scripts/common.sh@364 -- # decimal 1 00:14:38.545 04:16:28 -- scripts/common.sh@352 -- # local d=1 00:14:38.545 04:16:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:38.545 04:16:28 -- scripts/common.sh@354 -- # echo 1 00:14:38.545 04:16:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:38.545 04:16:28 -- scripts/common.sh@365 -- # decimal 2 00:14:38.545 04:16:28 -- scripts/common.sh@352 -- # local d=2 00:14:38.545 04:16:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:38.545 04:16:28 -- scripts/common.sh@354 -- # echo 2 00:14:38.545 04:16:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:38.546 04:16:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:38.546 04:16:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:38.546 04:16:28 -- scripts/common.sh@367 -- # return 0 00:14:38.546 04:16:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:38.546 04:16:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:38.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:38.546 --rc genhtml_branch_coverage=1 00:14:38.546 --rc genhtml_function_coverage=1 00:14:38.546 --rc genhtml_legend=1 00:14:38.546 --rc geninfo_all_blocks=1 00:14:38.546 --rc geninfo_unexecuted_blocks=1 00:14:38.546 00:14:38.546 ' 00:14:38.546 04:16:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:38.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:38.546 --rc genhtml_branch_coverage=1 00:14:38.546 --rc genhtml_function_coverage=1 00:14:38.546 --rc genhtml_legend=1 00:14:38.546 --rc geninfo_all_blocks=1 00:14:38.546 --rc geninfo_unexecuted_blocks=1 00:14:38.546 00:14:38.546 ' 00:14:38.546 04:16:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:38.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:38.546 --rc genhtml_branch_coverage=1 00:14:38.546 --rc genhtml_function_coverage=1 00:14:38.546 --rc genhtml_legend=1 00:14:38.546 --rc geninfo_all_blocks=1 00:14:38.546 --rc geninfo_unexecuted_blocks=1 00:14:38.546 00:14:38.546 ' 00:14:38.546 04:16:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:38.546 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:38.546 --rc genhtml_branch_coverage=1 00:14:38.546 --rc genhtml_function_coverage=1 00:14:38.546 --rc genhtml_legend=1 00:14:38.546 --rc geninfo_all_blocks=1 00:14:38.546 --rc geninfo_unexecuted_blocks=1 00:14:38.546 00:14:38.546 ' 00:14:38.546 04:16:28 -- target/connect_stress.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:38.546 04:16:28 -- nvmf/common.sh@7 -- # uname -s 00:14:38.546 04:16:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:38.546 04:16:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:38.546 04:16:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:38.546 04:16:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:38.546 04:16:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:38.546 04:16:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:38.546 04:16:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:38.546 04:16:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:38.546 04:16:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:38.546 04:16:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:38.546 04:16:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:38.546 04:16:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:38.546 04:16:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:38.546 04:16:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:38.546 04:16:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:38.546 04:16:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:38.546 04:16:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:38.546 04:16:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:38.546 04:16:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:38.546 04:16:29 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.546 04:16:29 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.546 04:16:29 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.546 04:16:29 -- paths/export.sh@5 -- # export PATH 00:14:38.546 04:16:29 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:38.546 04:16:29 -- nvmf/common.sh@46 -- # : 0 00:14:38.546 04:16:29 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:38.546 04:16:29 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:38.546 04:16:29 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:38.546 04:16:29 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:38.546 04:16:29 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:38.546 04:16:29 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:38.546 04:16:29 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:38.546 04:16:29 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:38.546 04:16:29 -- target/connect_stress.sh@12 -- # nvmftestinit 00:14:38.546 04:16:29 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:38.546 04:16:29 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:38.546 04:16:29 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:38.546 04:16:29 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:38.546 04:16:29 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:38.546 04:16:29 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:38.546 04:16:29 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:38.546 04:16:29 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:38.546 04:16:29 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:38.546 04:16:29 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:38.546 04:16:29 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:38.546 04:16:29 -- common/autotest_common.sh@10 -- # set +x 00:14:40.443 04:16:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:40.443 04:16:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:40.443 04:16:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:40.443 04:16:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:40.443 04:16:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:40.443 04:16:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:40.443 04:16:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:40.443 04:16:30 -- nvmf/common.sh@294 -- # net_devs=() 00:14:40.443 04:16:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:40.443 04:16:30 -- nvmf/common.sh@295 -- # e810=() 00:14:40.443 04:16:30 -- nvmf/common.sh@295 -- # local -ga e810 00:14:40.443 04:16:30 -- nvmf/common.sh@296 -- # x722=() 00:14:40.443 04:16:30 -- nvmf/common.sh@296 -- # local -ga x722 00:14:40.443 04:16:30 -- nvmf/common.sh@297 -- # mlx=() 00:14:40.443 04:16:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:40.443 04:16:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:40.443 04:16:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:40.443 04:16:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:40.443 04:16:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:40.443 04:16:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:40.443 04:16:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:40.443 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:40.443 04:16:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:40.443 04:16:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:40.443 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:40.443 04:16:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:40.443 04:16:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:40.443 04:16:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:40.443 04:16:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:40.443 04:16:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:40.443 04:16:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:40.443 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:40.443 04:16:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:40.443 04:16:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:40.443 04:16:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:40.443 04:16:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:40.443 04:16:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:40.443 04:16:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:40.443 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:40.443 04:16:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:40.443 04:16:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:40.443 04:16:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:40.443 04:16:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:40.443 04:16:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:40.443 04:16:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:40.443 04:16:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:40.443 04:16:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:40.443 04:16:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:40.443 04:16:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:40.443 04:16:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:40.443 04:16:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:40.443 04:16:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:40.443 04:16:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:40.443 04:16:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:40.443 04:16:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:40.443 04:16:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:40.443 04:16:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:40.443 04:16:31 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:40.443 04:16:31 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:40.443 04:16:31 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:40.443 04:16:31 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:40.702 04:16:31 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:40.702 04:16:31 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:40.702 04:16:31 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:40.702 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:40.702 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.132 ms 00:14:40.702 00:14:40.702 --- 10.0.0.2 ping statistics --- 00:14:40.702 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:40.702 rtt min/avg/max/mdev = 0.132/0.132/0.132/0.000 ms 00:14:40.702 04:16:31 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:40.702 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:40.702 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:14:40.702 00:14:40.702 --- 10.0.0.1 ping statistics --- 00:14:40.702 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:40.702 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:14:40.702 04:16:31 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:40.702 04:16:31 -- nvmf/common.sh@410 -- # return 0 00:14:40.702 04:16:31 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:40.702 04:16:31 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:40.702 04:16:31 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:40.702 04:16:31 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:40.702 04:16:31 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:40.702 04:16:31 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:40.702 04:16:31 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:40.702 04:16:31 -- target/connect_stress.sh@13 -- # nvmfappstart -m 0xE 00:14:40.702 04:16:31 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:40.702 04:16:31 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:40.702 04:16:31 -- common/autotest_common.sh@10 -- # set +x 00:14:40.702 04:16:31 -- nvmf/common.sh@469 -- # nvmfpid=2324669 00:14:40.702 04:16:31 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:14:40.702 04:16:31 -- nvmf/common.sh@470 -- # waitforlisten 2324669 00:14:40.702 04:16:31 -- common/autotest_common.sh@829 -- # '[' -z 2324669 ']' 00:14:40.702 04:16:31 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:40.702 04:16:31 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:40.702 04:16:31 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:40.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:40.702 04:16:31 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:40.702 04:16:31 -- common/autotest_common.sh@10 -- # set +x 00:14:40.702 [2024-11-30 04:16:31.202556] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:40.702 [2024-11-30 04:16:31.202630] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:40.702 EAL: No free 2048 kB hugepages reported on node 1 00:14:40.702 [2024-11-30 04:16:31.272995] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:14:40.960 [2024-11-30 04:16:31.361847] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:40.960 [2024-11-30 04:16:31.362027] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:40.960 [2024-11-30 04:16:31.362050] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:40.960 [2024-11-30 04:16:31.362065] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:40.960 [2024-11-30 04:16:31.362166] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:14:40.960 [2024-11-30 04:16:31.362263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:14:40.960 [2024-11-30 04:16:31.362266] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:41.525 04:16:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:41.525 04:16:32 -- common/autotest_common.sh@862 -- # return 0 00:14:41.525 04:16:32 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:41.525 04:16:32 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:41.525 04:16:32 -- common/autotest_common.sh@10 -- # set +x 00:14:41.783 04:16:32 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:41.783 04:16:32 -- target/connect_stress.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:41.783 04:16:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.783 04:16:32 -- common/autotest_common.sh@10 -- # set +x 00:14:41.783 [2024-11-30 04:16:32.179921] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:41.783 04:16:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.783 04:16:32 -- target/connect_stress.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:41.783 04:16:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.783 04:16:32 -- common/autotest_common.sh@10 -- # set +x 00:14:41.783 04:16:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.783 04:16:32 -- target/connect_stress.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:41.783 04:16:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.783 04:16:32 -- common/autotest_common.sh@10 -- # set +x 00:14:41.783 [2024-11-30 04:16:32.217126] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:41.783 04:16:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.783 04:16:32 -- target/connect_stress.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:41.783 04:16:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.783 04:16:32 -- common/autotest_common.sh@10 -- # set +x 00:14:41.783 NULL1 00:14:41.783 04:16:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:41.783 04:16:32 -- target/connect_stress.sh@21 -- # PERF_PID=2324778 00:14:41.783 04:16:32 -- target/connect_stress.sh@23 -- # rpcs=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:41.783 04:16:32 -- target/connect_stress.sh@20 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/connect_stress/connect_stress -c 0x1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -t 10 00:14:41.783 04:16:32 -- target/connect_stress.sh@25 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # seq 1 20 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 EAL: No free 2048 kB hugepages reported on node 1 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@27 -- # for i in $(seq 1 20) 00:14:41.783 04:16:32 -- target/connect_stress.sh@28 -- # cat 00:14:41.783 04:16:32 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:41.783 04:16:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:41.783 04:16:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:41.783 04:16:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.041 04:16:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.041 04:16:32 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:42.041 04:16:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:42.041 04:16:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.041 04:16:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.298 04:16:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.298 04:16:32 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:42.298 04:16:32 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:42.298 04:16:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.298 04:16:32 -- common/autotest_common.sh@10 -- # set +x 00:14:42.864 04:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:42.864 04:16:33 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:42.864 04:16:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:42.864 04:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:42.864 04:16:33 -- common/autotest_common.sh@10 -- # set +x 00:14:43.122 04:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.122 04:16:33 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:43.122 04:16:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:43.122 04:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.122 04:16:33 -- common/autotest_common.sh@10 -- # set +x 00:14:43.380 04:16:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.380 04:16:33 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:43.380 04:16:33 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:43.380 04:16:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.380 04:16:33 -- common/autotest_common.sh@10 -- # set +x 00:14:43.638 04:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.638 04:16:34 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:43.638 04:16:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:43.638 04:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.638 04:16:34 -- common/autotest_common.sh@10 -- # set +x 00:14:43.896 04:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:43.896 04:16:34 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:43.896 04:16:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:43.896 04:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:43.896 04:16:34 -- common/autotest_common.sh@10 -- # set +x 00:14:44.461 04:16:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.461 04:16:34 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:44.461 04:16:34 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.461 04:16:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.461 04:16:34 -- common/autotest_common.sh@10 -- # set +x 00:14:44.718 04:16:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.718 04:16:35 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:44.718 04:16:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.718 04:16:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.718 04:16:35 -- common/autotest_common.sh@10 -- # set +x 00:14:44.975 04:16:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:44.975 04:16:35 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:44.975 04:16:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:44.975 04:16:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:44.975 04:16:35 -- common/autotest_common.sh@10 -- # set +x 00:14:45.233 04:16:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.233 04:16:35 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:45.233 04:16:35 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.233 04:16:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.233 04:16:35 -- common/autotest_common.sh@10 -- # set +x 00:14:45.799 04:16:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:45.799 04:16:36 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:45.799 04:16:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:45.799 04:16:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:45.800 04:16:36 -- common/autotest_common.sh@10 -- # set +x 00:14:46.057 04:16:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.057 04:16:36 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:46.057 04:16:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.057 04:16:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.058 04:16:36 -- common/autotest_common.sh@10 -- # set +x 00:14:46.315 04:16:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.315 04:16:36 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:46.315 04:16:36 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.315 04:16:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.315 04:16:36 -- common/autotest_common.sh@10 -- # set +x 00:14:46.573 04:16:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.573 04:16:37 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:46.573 04:16:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.573 04:16:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.573 04:16:37 -- common/autotest_common.sh@10 -- # set +x 00:14:46.831 04:16:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:46.831 04:16:37 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:46.831 04:16:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:46.831 04:16:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:46.831 04:16:37 -- common/autotest_common.sh@10 -- # set +x 00:14:47.396 04:16:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.396 04:16:37 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:47.396 04:16:37 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.396 04:16:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.396 04:16:37 -- common/autotest_common.sh@10 -- # set +x 00:14:47.654 04:16:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.654 04:16:38 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:47.654 04:16:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.654 04:16:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.654 04:16:38 -- common/autotest_common.sh@10 -- # set +x 00:14:47.912 04:16:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:47.912 04:16:38 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:47.912 04:16:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:47.912 04:16:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:47.912 04:16:38 -- common/autotest_common.sh@10 -- # set +x 00:14:48.169 04:16:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.169 04:16:38 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:48.169 04:16:38 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.169 04:16:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.169 04:16:38 -- common/autotest_common.sh@10 -- # set +x 00:14:48.427 04:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.427 04:16:39 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:48.427 04:16:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.427 04:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.427 04:16:39 -- common/autotest_common.sh@10 -- # set +x 00:14:48.993 04:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:48.993 04:16:39 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:48.993 04:16:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:48.993 04:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:48.993 04:16:39 -- common/autotest_common.sh@10 -- # set +x 00:14:49.251 04:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.251 04:16:39 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:49.251 04:16:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.251 04:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.251 04:16:39 -- common/autotest_common.sh@10 -- # set +x 00:14:49.509 04:16:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.509 04:16:39 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:49.509 04:16:39 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.509 04:16:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.509 04:16:39 -- common/autotest_common.sh@10 -- # set +x 00:14:49.766 04:16:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:49.766 04:16:40 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:49.766 04:16:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:49.766 04:16:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:49.766 04:16:40 -- common/autotest_common.sh@10 -- # set +x 00:14:50.024 04:16:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.024 04:16:40 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:50.024 04:16:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.024 04:16:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.024 04:16:40 -- common/autotest_common.sh@10 -- # set +x 00:14:50.589 04:16:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.589 04:16:40 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:50.589 04:16:40 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.589 04:16:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.589 04:16:40 -- common/autotest_common.sh@10 -- # set +x 00:14:50.846 04:16:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:50.846 04:16:41 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:50.846 04:16:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:50.846 04:16:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:50.846 04:16:41 -- common/autotest_common.sh@10 -- # set +x 00:14:51.104 04:16:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.104 04:16:41 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:51.104 04:16:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.104 04:16:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.104 04:16:41 -- common/autotest_common.sh@10 -- # set +x 00:14:51.363 04:16:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.363 04:16:41 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:51.363 04:16:41 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.363 04:16:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.363 04:16:41 -- common/autotest_common.sh@10 -- # set +x 00:14:51.622 04:16:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:51.622 04:16:42 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:51.622 04:16:42 -- target/connect_stress.sh@35 -- # rpc_cmd 00:14:51.622 04:16:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:51.622 04:16:42 -- common/autotest_common.sh@10 -- # set +x 00:14:51.880 Testing NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:14:52.138 04:16:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:52.138 04:16:42 -- target/connect_stress.sh@34 -- # kill -0 2324778 00:14:52.138 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/connect_stress.sh: line 34: kill: (2324778) - No such process 00:14:52.138 04:16:42 -- target/connect_stress.sh@38 -- # wait 2324778 00:14:52.138 04:16:42 -- target/connect_stress.sh@39 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpc.txt 00:14:52.138 04:16:42 -- target/connect_stress.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:14:52.138 04:16:42 -- target/connect_stress.sh@43 -- # nvmftestfini 00:14:52.138 04:16:42 -- nvmf/common.sh@476 -- # nvmfcleanup 00:14:52.138 04:16:42 -- nvmf/common.sh@116 -- # sync 00:14:52.138 04:16:42 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:14:52.138 04:16:42 -- nvmf/common.sh@119 -- # set +e 00:14:52.138 04:16:42 -- nvmf/common.sh@120 -- # for i in {1..20} 00:14:52.138 04:16:42 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:14:52.138 rmmod nvme_tcp 00:14:52.138 rmmod nvme_fabrics 00:14:52.138 rmmod nvme_keyring 00:14:52.138 04:16:42 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:14:52.138 04:16:42 -- nvmf/common.sh@123 -- # set -e 00:14:52.138 04:16:42 -- nvmf/common.sh@124 -- # return 0 00:14:52.138 04:16:42 -- nvmf/common.sh@477 -- # '[' -n 2324669 ']' 00:14:52.138 04:16:42 -- nvmf/common.sh@478 -- # killprocess 2324669 00:14:52.138 04:16:42 -- common/autotest_common.sh@936 -- # '[' -z 2324669 ']' 00:14:52.138 04:16:42 -- common/autotest_common.sh@940 -- # kill -0 2324669 00:14:52.138 04:16:42 -- common/autotest_common.sh@941 -- # uname 00:14:52.138 04:16:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:14:52.138 04:16:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2324669 00:14:52.138 04:16:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:14:52.138 04:16:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:14:52.138 04:16:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2324669' 00:14:52.138 killing process with pid 2324669 00:14:52.138 04:16:42 -- common/autotest_common.sh@955 -- # kill 2324669 00:14:52.138 04:16:42 -- common/autotest_common.sh@960 -- # wait 2324669 00:14:52.398 04:16:42 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:14:52.398 04:16:42 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:14:52.398 04:16:42 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:14:52.398 04:16:42 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:14:52.398 04:16:42 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:14:52.398 04:16:42 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:52.398 04:16:42 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:52.398 04:16:42 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:54.404 04:16:44 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:14:54.404 00:14:54.404 real 0m16.058s 00:14:54.404 user 0m40.888s 00:14:54.404 sys 0m5.755s 00:14:54.404 04:16:44 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:14:54.404 04:16:44 -- common/autotest_common.sh@10 -- # set +x 00:14:54.404 ************************************ 00:14:54.404 END TEST nvmf_connect_stress 00:14:54.404 ************************************ 00:14:54.404 04:16:44 -- nvmf/nvmf.sh@34 -- # run_test nvmf_fused_ordering /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:54.404 04:16:44 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:14:54.404 04:16:44 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:14:54.404 04:16:44 -- common/autotest_common.sh@10 -- # set +x 00:14:54.405 ************************************ 00:14:54.405 START TEST nvmf_fused_ordering 00:14:54.405 ************************************ 00:14:54.405 04:16:44 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fused_ordering.sh --transport=tcp 00:14:54.405 * Looking for test storage... 00:14:54.405 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:14:54.405 04:16:44 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:14:54.405 04:16:44 -- common/autotest_common.sh@1690 -- # lcov --version 00:14:54.405 04:16:44 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:14:54.690 04:16:45 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:14:54.690 04:16:45 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:14:54.690 04:16:45 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:14:54.690 04:16:45 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:14:54.690 04:16:45 -- scripts/common.sh@335 -- # IFS=.-: 00:14:54.690 04:16:45 -- scripts/common.sh@335 -- # read -ra ver1 00:14:54.690 04:16:45 -- scripts/common.sh@336 -- # IFS=.-: 00:14:54.690 04:16:45 -- scripts/common.sh@336 -- # read -ra ver2 00:14:54.690 04:16:45 -- scripts/common.sh@337 -- # local 'op=<' 00:14:54.690 04:16:45 -- scripts/common.sh@339 -- # ver1_l=2 00:14:54.690 04:16:45 -- scripts/common.sh@340 -- # ver2_l=1 00:14:54.690 04:16:45 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:14:54.690 04:16:45 -- scripts/common.sh@343 -- # case "$op" in 00:14:54.690 04:16:45 -- scripts/common.sh@344 -- # : 1 00:14:54.690 04:16:45 -- scripts/common.sh@363 -- # (( v = 0 )) 00:14:54.690 04:16:45 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:14:54.690 04:16:45 -- scripts/common.sh@364 -- # decimal 1 00:14:54.690 04:16:45 -- scripts/common.sh@352 -- # local d=1 00:14:54.690 04:16:45 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:14:54.690 04:16:45 -- scripts/common.sh@354 -- # echo 1 00:14:54.690 04:16:45 -- scripts/common.sh@364 -- # ver1[v]=1 00:14:54.690 04:16:45 -- scripts/common.sh@365 -- # decimal 2 00:14:54.690 04:16:45 -- scripts/common.sh@352 -- # local d=2 00:14:54.690 04:16:45 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:14:54.690 04:16:45 -- scripts/common.sh@354 -- # echo 2 00:14:54.690 04:16:45 -- scripts/common.sh@365 -- # ver2[v]=2 00:14:54.690 04:16:45 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:14:54.690 04:16:45 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:14:54.690 04:16:45 -- scripts/common.sh@367 -- # return 0 00:14:54.690 04:16:45 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:14:54.690 04:16:45 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:14:54.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:54.690 --rc genhtml_branch_coverage=1 00:14:54.690 --rc genhtml_function_coverage=1 00:14:54.690 --rc genhtml_legend=1 00:14:54.690 --rc geninfo_all_blocks=1 00:14:54.690 --rc geninfo_unexecuted_blocks=1 00:14:54.690 00:14:54.690 ' 00:14:54.690 04:16:45 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:14:54.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:54.690 --rc genhtml_branch_coverage=1 00:14:54.690 --rc genhtml_function_coverage=1 00:14:54.690 --rc genhtml_legend=1 00:14:54.690 --rc geninfo_all_blocks=1 00:14:54.690 --rc geninfo_unexecuted_blocks=1 00:14:54.690 00:14:54.690 ' 00:14:54.690 04:16:45 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:14:54.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:54.690 --rc genhtml_branch_coverage=1 00:14:54.690 --rc genhtml_function_coverage=1 00:14:54.690 --rc genhtml_legend=1 00:14:54.690 --rc geninfo_all_blocks=1 00:14:54.690 --rc geninfo_unexecuted_blocks=1 00:14:54.690 00:14:54.690 ' 00:14:54.690 04:16:45 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:14:54.690 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:14:54.690 --rc genhtml_branch_coverage=1 00:14:54.690 --rc genhtml_function_coverage=1 00:14:54.690 --rc genhtml_legend=1 00:14:54.690 --rc geninfo_all_blocks=1 00:14:54.690 --rc geninfo_unexecuted_blocks=1 00:14:54.690 00:14:54.690 ' 00:14:54.690 04:16:45 -- target/fused_ordering.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:14:54.690 04:16:45 -- nvmf/common.sh@7 -- # uname -s 00:14:54.690 04:16:45 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:14:54.690 04:16:45 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:14:54.690 04:16:45 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:14:54.690 04:16:45 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:14:54.690 04:16:45 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:14:54.690 04:16:45 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:14:54.690 04:16:45 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:14:54.690 04:16:45 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:14:54.690 04:16:45 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:14:54.690 04:16:45 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:14:54.690 04:16:45 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:14:54.690 04:16:45 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:14:54.690 04:16:45 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:14:54.690 04:16:45 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:14:54.690 04:16:45 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:14:54.690 04:16:45 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:14:54.690 04:16:45 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:14:54.690 04:16:45 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:14:54.690 04:16:45 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:14:54.690 04:16:45 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.690 04:16:45 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.690 04:16:45 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.690 04:16:45 -- paths/export.sh@5 -- # export PATH 00:14:54.690 04:16:45 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:14:54.690 04:16:45 -- nvmf/common.sh@46 -- # : 0 00:14:54.690 04:16:45 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:14:54.690 04:16:45 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:14:54.690 04:16:45 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:14:54.690 04:16:45 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:14:54.690 04:16:45 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:14:54.690 04:16:45 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:14:54.690 04:16:45 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:14:54.690 04:16:45 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:14:54.690 04:16:45 -- target/fused_ordering.sh@12 -- # nvmftestinit 00:14:54.690 04:16:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:14:54.690 04:16:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:14:54.690 04:16:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:14:54.690 04:16:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:14:54.690 04:16:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:14:54.690 04:16:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:14:54.690 04:16:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:14:54.690 04:16:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:14:54.690 04:16:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:14:54.691 04:16:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:14:54.691 04:16:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:14:54.691 04:16:45 -- common/autotest_common.sh@10 -- # set +x 00:14:56.591 04:16:47 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:14:56.591 04:16:47 -- nvmf/common.sh@290 -- # pci_devs=() 00:14:56.591 04:16:47 -- nvmf/common.sh@290 -- # local -a pci_devs 00:14:56.591 04:16:47 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:14:56.591 04:16:47 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:14:56.591 04:16:47 -- nvmf/common.sh@292 -- # pci_drivers=() 00:14:56.591 04:16:47 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:14:56.591 04:16:47 -- nvmf/common.sh@294 -- # net_devs=() 00:14:56.591 04:16:47 -- nvmf/common.sh@294 -- # local -ga net_devs 00:14:56.591 04:16:47 -- nvmf/common.sh@295 -- # e810=() 00:14:56.591 04:16:47 -- nvmf/common.sh@295 -- # local -ga e810 00:14:56.591 04:16:47 -- nvmf/common.sh@296 -- # x722=() 00:14:56.591 04:16:47 -- nvmf/common.sh@296 -- # local -ga x722 00:14:56.591 04:16:47 -- nvmf/common.sh@297 -- # mlx=() 00:14:56.591 04:16:47 -- nvmf/common.sh@297 -- # local -ga mlx 00:14:56.591 04:16:47 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:14:56.591 04:16:47 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:14:56.591 04:16:47 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:14:56.591 04:16:47 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:14:56.591 04:16:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:56.591 04:16:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:14:56.591 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:14:56.591 04:16:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:14:56.591 04:16:47 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:14:56.591 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:14:56.591 04:16:47 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:14:56.591 04:16:47 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:56.591 04:16:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:56.591 04:16:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:56.591 04:16:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:56.591 04:16:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:14:56.591 Found net devices under 0000:0a:00.0: cvl_0_0 00:14:56.591 04:16:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:56.591 04:16:47 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:14:56.591 04:16:47 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:14:56.591 04:16:47 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:14:56.591 04:16:47 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:14:56.591 04:16:47 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:14:56.591 Found net devices under 0000:0a:00.1: cvl_0_1 00:14:56.591 04:16:47 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:14:56.591 04:16:47 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:14:56.591 04:16:47 -- nvmf/common.sh@402 -- # is_hw=yes 00:14:56.591 04:16:47 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:14:56.591 04:16:47 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:14:56.591 04:16:47 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:14:56.591 04:16:47 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:14:56.591 04:16:47 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:14:56.591 04:16:47 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:14:56.591 04:16:47 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:14:56.591 04:16:47 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:14:56.591 04:16:47 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:14:56.591 04:16:47 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:14:56.591 04:16:47 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:14:56.591 04:16:47 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:14:56.591 04:16:47 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:14:56.591 04:16:47 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:14:56.591 04:16:47 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:14:56.850 04:16:47 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:14:56.850 04:16:47 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:14:56.850 04:16:47 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:14:56.850 04:16:47 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:14:56.850 04:16:47 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:14:56.850 04:16:47 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:14:56.850 04:16:47 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:14:56.850 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:14:56.850 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:14:56.850 00:14:56.850 --- 10.0.0.2 ping statistics --- 00:14:56.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.850 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:14:56.850 04:16:47 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:14:56.850 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:14:56.850 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.103 ms 00:14:56.850 00:14:56.850 --- 10.0.0.1 ping statistics --- 00:14:56.850 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:14:56.850 rtt min/avg/max/mdev = 0.103/0.103/0.103/0.000 ms 00:14:56.850 04:16:47 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:14:56.850 04:16:47 -- nvmf/common.sh@410 -- # return 0 00:14:56.850 04:16:47 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:14:56.850 04:16:47 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:14:56.850 04:16:47 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:14:56.850 04:16:47 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:14:56.850 04:16:47 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:14:56.850 04:16:47 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:14:56.850 04:16:47 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:14:56.850 04:16:47 -- target/fused_ordering.sh@13 -- # nvmfappstart -m 0x2 00:14:56.850 04:16:47 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:14:56.850 04:16:47 -- common/autotest_common.sh@722 -- # xtrace_disable 00:14:56.850 04:16:47 -- common/autotest_common.sh@10 -- # set +x 00:14:56.850 04:16:47 -- nvmf/common.sh@469 -- # nvmfpid=2328091 00:14:56.850 04:16:47 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:14:56.850 04:16:47 -- nvmf/common.sh@470 -- # waitforlisten 2328091 00:14:56.850 04:16:47 -- common/autotest_common.sh@829 -- # '[' -z 2328091 ']' 00:14:56.850 04:16:47 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:14:56.850 04:16:47 -- common/autotest_common.sh@834 -- # local max_retries=100 00:14:56.850 04:16:47 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:14:56.850 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:14:56.850 04:16:47 -- common/autotest_common.sh@838 -- # xtrace_disable 00:14:56.850 04:16:47 -- common/autotest_common.sh@10 -- # set +x 00:14:56.850 [2024-11-30 04:16:47.372460] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:56.850 [2024-11-30 04:16:47.372556] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:14:56.850 EAL: No free 2048 kB hugepages reported on node 1 00:14:56.850 [2024-11-30 04:16:47.441079] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:14:57.108 [2024-11-30 04:16:47.528792] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:14:57.108 [2024-11-30 04:16:47.528985] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:14:57.108 [2024-11-30 04:16:47.529009] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:14:57.108 [2024-11-30 04:16:47.529025] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:14:57.108 [2024-11-30 04:16:47.529064] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:14:58.041 04:16:48 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:14:58.041 04:16:48 -- common/autotest_common.sh@862 -- # return 0 00:14:58.041 04:16:48 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:14:58.041 04:16:48 -- common/autotest_common.sh@728 -- # xtrace_disable 00:14:58.041 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:14:58.041 04:16:48 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:14:58.041 04:16:48 -- target/fused_ordering.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:14:58.041 04:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.041 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:14:58.041 [2024-11-30 04:16:48.356894] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:14:58.041 04:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.041 04:16:48 -- target/fused_ordering.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:14:58.041 04:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.041 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:14:58.041 04:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.041 04:16:48 -- target/fused_ordering.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:14:58.041 04:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.041 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:14:58.041 [2024-11-30 04:16:48.373120] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:14:58.041 04:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.041 04:16:48 -- target/fused_ordering.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:14:58.041 04:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.041 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:14:58.041 NULL1 00:14:58.041 04:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.041 04:16:48 -- target/fused_ordering.sh@19 -- # rpc_cmd bdev_wait_for_examine 00:14:58.041 04:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.041 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:14:58.041 04:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.041 04:16:48 -- target/fused_ordering.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 NULL1 00:14:58.041 04:16:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:14:58.041 04:16:48 -- common/autotest_common.sh@10 -- # set +x 00:14:58.041 04:16:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:14:58.041 04:16:48 -- target/fused_ordering.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/fused_ordering/fused_ordering -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:14:58.041 [2024-11-30 04:16:48.416797] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:14:58.041 [2024-11-30 04:16:48.416837] [ DPDK EAL parameters: fused_ordering --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2328249 ] 00:14:58.041 EAL: No free 2048 kB hugepages reported on node 1 00:14:58.299 Attached to nqn.2016-06.io.spdk:cnode1 00:14:58.299 Namespace ID: 1 size: 1GB 00:14:58.299 fused_ordering(0) 00:14:58.299 fused_ordering(1) 00:14:58.299 fused_ordering(2) 00:14:58.299 fused_ordering(3) 00:14:58.299 fused_ordering(4) 00:14:58.299 fused_ordering(5) 00:14:58.299 fused_ordering(6) 00:14:58.299 fused_ordering(7) 00:14:58.299 fused_ordering(8) 00:14:58.299 fused_ordering(9) 00:14:58.299 fused_ordering(10) 00:14:58.299 fused_ordering(11) 00:14:58.299 fused_ordering(12) 00:14:58.299 fused_ordering(13) 00:14:58.299 fused_ordering(14) 00:14:58.299 fused_ordering(15) 00:14:58.299 fused_ordering(16) 00:14:58.299 fused_ordering(17) 00:14:58.299 fused_ordering(18) 00:14:58.299 fused_ordering(19) 00:14:58.299 fused_ordering(20) 00:14:58.299 fused_ordering(21) 00:14:58.299 fused_ordering(22) 00:14:58.299 fused_ordering(23) 00:14:58.299 fused_ordering(24) 00:14:58.299 fused_ordering(25) 00:14:58.299 fused_ordering(26) 00:14:58.299 fused_ordering(27) 00:14:58.299 fused_ordering(28) 00:14:58.299 fused_ordering(29) 00:14:58.299 fused_ordering(30) 00:14:58.299 fused_ordering(31) 00:14:58.299 fused_ordering(32) 00:14:58.299 fused_ordering(33) 00:14:58.299 fused_ordering(34) 00:14:58.299 fused_ordering(35) 00:14:58.299 fused_ordering(36) 00:14:58.299 fused_ordering(37) 00:14:58.299 fused_ordering(38) 00:14:58.299 fused_ordering(39) 00:14:58.299 fused_ordering(40) 00:14:58.299 fused_ordering(41) 00:14:58.299 fused_ordering(42) 00:14:58.299 fused_ordering(43) 00:14:58.299 fused_ordering(44) 00:14:58.299 fused_ordering(45) 00:14:58.299 fused_ordering(46) 00:14:58.299 fused_ordering(47) 00:14:58.299 fused_ordering(48) 00:14:58.299 fused_ordering(49) 00:14:58.299 fused_ordering(50) 00:14:58.299 fused_ordering(51) 00:14:58.299 fused_ordering(52) 00:14:58.299 fused_ordering(53) 00:14:58.299 fused_ordering(54) 00:14:58.299 fused_ordering(55) 00:14:58.299 fused_ordering(56) 00:14:58.299 fused_ordering(57) 00:14:58.299 fused_ordering(58) 00:14:58.299 fused_ordering(59) 00:14:58.299 fused_ordering(60) 00:14:58.299 fused_ordering(61) 00:14:58.299 fused_ordering(62) 00:14:58.299 fused_ordering(63) 00:14:58.299 fused_ordering(64) 00:14:58.299 fused_ordering(65) 00:14:58.299 fused_ordering(66) 00:14:58.299 fused_ordering(67) 00:14:58.299 fused_ordering(68) 00:14:58.299 fused_ordering(69) 00:14:58.299 fused_ordering(70) 00:14:58.299 fused_ordering(71) 00:14:58.299 fused_ordering(72) 00:14:58.299 fused_ordering(73) 00:14:58.299 fused_ordering(74) 00:14:58.299 fused_ordering(75) 00:14:58.299 fused_ordering(76) 00:14:58.299 fused_ordering(77) 00:14:58.299 fused_ordering(78) 00:14:58.299 fused_ordering(79) 00:14:58.299 fused_ordering(80) 00:14:58.299 fused_ordering(81) 00:14:58.299 fused_ordering(82) 00:14:58.299 fused_ordering(83) 00:14:58.299 fused_ordering(84) 00:14:58.299 fused_ordering(85) 00:14:58.299 fused_ordering(86) 00:14:58.299 fused_ordering(87) 00:14:58.299 fused_ordering(88) 00:14:58.299 fused_ordering(89) 00:14:58.299 fused_ordering(90) 00:14:58.299 fused_ordering(91) 00:14:58.299 fused_ordering(92) 00:14:58.299 fused_ordering(93) 00:14:58.299 fused_ordering(94) 00:14:58.299 fused_ordering(95) 00:14:58.299 fused_ordering(96) 00:14:58.299 fused_ordering(97) 00:14:58.299 fused_ordering(98) 00:14:58.299 fused_ordering(99) 00:14:58.299 fused_ordering(100) 00:14:58.299 fused_ordering(101) 00:14:58.299 fused_ordering(102) 00:14:58.299 fused_ordering(103) 00:14:58.299 fused_ordering(104) 00:14:58.299 fused_ordering(105) 00:14:58.299 fused_ordering(106) 00:14:58.299 fused_ordering(107) 00:14:58.299 fused_ordering(108) 00:14:58.299 fused_ordering(109) 00:14:58.299 fused_ordering(110) 00:14:58.299 fused_ordering(111) 00:14:58.299 fused_ordering(112) 00:14:58.299 fused_ordering(113) 00:14:58.299 fused_ordering(114) 00:14:58.299 fused_ordering(115) 00:14:58.299 fused_ordering(116) 00:14:58.299 fused_ordering(117) 00:14:58.299 fused_ordering(118) 00:14:58.299 fused_ordering(119) 00:14:58.299 fused_ordering(120) 00:14:58.299 fused_ordering(121) 00:14:58.299 fused_ordering(122) 00:14:58.299 fused_ordering(123) 00:14:58.299 fused_ordering(124) 00:14:58.299 fused_ordering(125) 00:14:58.299 fused_ordering(126) 00:14:58.299 fused_ordering(127) 00:14:58.299 fused_ordering(128) 00:14:58.299 fused_ordering(129) 00:14:58.299 fused_ordering(130) 00:14:58.299 fused_ordering(131) 00:14:58.299 fused_ordering(132) 00:14:58.299 fused_ordering(133) 00:14:58.299 fused_ordering(134) 00:14:58.299 fused_ordering(135) 00:14:58.299 fused_ordering(136) 00:14:58.299 fused_ordering(137) 00:14:58.299 fused_ordering(138) 00:14:58.299 fused_ordering(139) 00:14:58.299 fused_ordering(140) 00:14:58.299 fused_ordering(141) 00:14:58.299 fused_ordering(142) 00:14:58.299 fused_ordering(143) 00:14:58.299 fused_ordering(144) 00:14:58.299 fused_ordering(145) 00:14:58.299 fused_ordering(146) 00:14:58.299 fused_ordering(147) 00:14:58.299 fused_ordering(148) 00:14:58.299 fused_ordering(149) 00:14:58.299 fused_ordering(150) 00:14:58.299 fused_ordering(151) 00:14:58.299 fused_ordering(152) 00:14:58.299 fused_ordering(153) 00:14:58.299 fused_ordering(154) 00:14:58.299 fused_ordering(155) 00:14:58.299 fused_ordering(156) 00:14:58.299 fused_ordering(157) 00:14:58.299 fused_ordering(158) 00:14:58.299 fused_ordering(159) 00:14:58.299 fused_ordering(160) 00:14:58.299 fused_ordering(161) 00:14:58.299 fused_ordering(162) 00:14:58.299 fused_ordering(163) 00:14:58.299 fused_ordering(164) 00:14:58.299 fused_ordering(165) 00:14:58.299 fused_ordering(166) 00:14:58.299 fused_ordering(167) 00:14:58.299 fused_ordering(168) 00:14:58.299 fused_ordering(169) 00:14:58.299 fused_ordering(170) 00:14:58.299 fused_ordering(171) 00:14:58.299 fused_ordering(172) 00:14:58.299 fused_ordering(173) 00:14:58.299 fused_ordering(174) 00:14:58.299 fused_ordering(175) 00:14:58.299 fused_ordering(176) 00:14:58.299 fused_ordering(177) 00:14:58.299 fused_ordering(178) 00:14:58.299 fused_ordering(179) 00:14:58.299 fused_ordering(180) 00:14:58.299 fused_ordering(181) 00:14:58.299 fused_ordering(182) 00:14:58.299 fused_ordering(183) 00:14:58.299 fused_ordering(184) 00:14:58.299 fused_ordering(185) 00:14:58.299 fused_ordering(186) 00:14:58.299 fused_ordering(187) 00:14:58.299 fused_ordering(188) 00:14:58.299 fused_ordering(189) 00:14:58.299 fused_ordering(190) 00:14:58.299 fused_ordering(191) 00:14:58.299 fused_ordering(192) 00:14:58.299 fused_ordering(193) 00:14:58.299 fused_ordering(194) 00:14:58.299 fused_ordering(195) 00:14:58.299 fused_ordering(196) 00:14:58.299 fused_ordering(197) 00:14:58.299 fused_ordering(198) 00:14:58.299 fused_ordering(199) 00:14:58.299 fused_ordering(200) 00:14:58.299 fused_ordering(201) 00:14:58.299 fused_ordering(202) 00:14:58.299 fused_ordering(203) 00:14:58.299 fused_ordering(204) 00:14:58.299 fused_ordering(205) 00:14:58.557 fused_ordering(206) 00:14:58.557 fused_ordering(207) 00:14:58.557 fused_ordering(208) 00:14:58.557 fused_ordering(209) 00:14:58.557 fused_ordering(210) 00:14:58.557 fused_ordering(211) 00:14:58.557 fused_ordering(212) 00:14:58.557 fused_ordering(213) 00:14:58.557 fused_ordering(214) 00:14:58.557 fused_ordering(215) 00:14:58.557 fused_ordering(216) 00:14:58.557 fused_ordering(217) 00:14:58.557 fused_ordering(218) 00:14:58.557 fused_ordering(219) 00:14:58.557 fused_ordering(220) 00:14:58.557 fused_ordering(221) 00:14:58.557 fused_ordering(222) 00:14:58.557 fused_ordering(223) 00:14:58.557 fused_ordering(224) 00:14:58.557 fused_ordering(225) 00:14:58.557 fused_ordering(226) 00:14:58.557 fused_ordering(227) 00:14:58.557 fused_ordering(228) 00:14:58.557 fused_ordering(229) 00:14:58.557 fused_ordering(230) 00:14:58.557 fused_ordering(231) 00:14:58.557 fused_ordering(232) 00:14:58.557 fused_ordering(233) 00:14:58.557 fused_ordering(234) 00:14:58.557 fused_ordering(235) 00:14:58.557 fused_ordering(236) 00:14:58.557 fused_ordering(237) 00:14:58.557 fused_ordering(238) 00:14:58.557 fused_ordering(239) 00:14:58.557 fused_ordering(240) 00:14:58.557 fused_ordering(241) 00:14:58.557 fused_ordering(242) 00:14:58.557 fused_ordering(243) 00:14:58.557 fused_ordering(244) 00:14:58.557 fused_ordering(245) 00:14:58.557 fused_ordering(246) 00:14:58.557 fused_ordering(247) 00:14:58.557 fused_ordering(248) 00:14:58.557 fused_ordering(249) 00:14:58.557 fused_ordering(250) 00:14:58.557 fused_ordering(251) 00:14:58.557 fused_ordering(252) 00:14:58.557 fused_ordering(253) 00:14:58.557 fused_ordering(254) 00:14:58.557 fused_ordering(255) 00:14:58.557 fused_ordering(256) 00:14:58.557 fused_ordering(257) 00:14:58.557 fused_ordering(258) 00:14:58.557 fused_ordering(259) 00:14:58.557 fused_ordering(260) 00:14:58.557 fused_ordering(261) 00:14:58.557 fused_ordering(262) 00:14:58.557 fused_ordering(263) 00:14:58.557 fused_ordering(264) 00:14:58.557 fused_ordering(265) 00:14:58.557 fused_ordering(266) 00:14:58.557 fused_ordering(267) 00:14:58.557 fused_ordering(268) 00:14:58.557 fused_ordering(269) 00:14:58.557 fused_ordering(270) 00:14:58.557 fused_ordering(271) 00:14:58.557 fused_ordering(272) 00:14:58.557 fused_ordering(273) 00:14:58.557 fused_ordering(274) 00:14:58.557 fused_ordering(275) 00:14:58.557 fused_ordering(276) 00:14:58.557 fused_ordering(277) 00:14:58.557 fused_ordering(278) 00:14:58.557 fused_ordering(279) 00:14:58.557 fused_ordering(280) 00:14:58.557 fused_ordering(281) 00:14:58.557 fused_ordering(282) 00:14:58.557 fused_ordering(283) 00:14:58.557 fused_ordering(284) 00:14:58.557 fused_ordering(285) 00:14:58.557 fused_ordering(286) 00:14:58.557 fused_ordering(287) 00:14:58.557 fused_ordering(288) 00:14:58.557 fused_ordering(289) 00:14:58.557 fused_ordering(290) 00:14:58.557 fused_ordering(291) 00:14:58.557 fused_ordering(292) 00:14:58.557 fused_ordering(293) 00:14:58.557 fused_ordering(294) 00:14:58.557 fused_ordering(295) 00:14:58.557 fused_ordering(296) 00:14:58.557 fused_ordering(297) 00:14:58.557 fused_ordering(298) 00:14:58.557 fused_ordering(299) 00:14:58.557 fused_ordering(300) 00:14:58.557 fused_ordering(301) 00:14:58.557 fused_ordering(302) 00:14:58.557 fused_ordering(303) 00:14:58.557 fused_ordering(304) 00:14:58.557 fused_ordering(305) 00:14:58.557 fused_ordering(306) 00:14:58.557 fused_ordering(307) 00:14:58.557 fused_ordering(308) 00:14:58.557 fused_ordering(309) 00:14:58.557 fused_ordering(310) 00:14:58.557 fused_ordering(311) 00:14:58.557 fused_ordering(312) 00:14:58.557 fused_ordering(313) 00:14:58.557 fused_ordering(314) 00:14:58.557 fused_ordering(315) 00:14:58.557 fused_ordering(316) 00:14:58.557 fused_ordering(317) 00:14:58.557 fused_ordering(318) 00:14:58.557 fused_ordering(319) 00:14:58.557 fused_ordering(320) 00:14:58.557 fused_ordering(321) 00:14:58.557 fused_ordering(322) 00:14:58.557 fused_ordering(323) 00:14:58.557 fused_ordering(324) 00:14:58.557 fused_ordering(325) 00:14:58.557 fused_ordering(326) 00:14:58.557 fused_ordering(327) 00:14:58.557 fused_ordering(328) 00:14:58.557 fused_ordering(329) 00:14:58.557 fused_ordering(330) 00:14:58.557 fused_ordering(331) 00:14:58.557 fused_ordering(332) 00:14:58.557 fused_ordering(333) 00:14:58.557 fused_ordering(334) 00:14:58.557 fused_ordering(335) 00:14:58.557 fused_ordering(336) 00:14:58.557 fused_ordering(337) 00:14:58.557 fused_ordering(338) 00:14:58.557 fused_ordering(339) 00:14:58.557 fused_ordering(340) 00:14:58.557 fused_ordering(341) 00:14:58.558 fused_ordering(342) 00:14:58.558 fused_ordering(343) 00:14:58.558 fused_ordering(344) 00:14:58.558 fused_ordering(345) 00:14:58.558 fused_ordering(346) 00:14:58.558 fused_ordering(347) 00:14:58.558 fused_ordering(348) 00:14:58.558 fused_ordering(349) 00:14:58.558 fused_ordering(350) 00:14:58.558 fused_ordering(351) 00:14:58.558 fused_ordering(352) 00:14:58.558 fused_ordering(353) 00:14:58.558 fused_ordering(354) 00:14:58.558 fused_ordering(355) 00:14:58.558 fused_ordering(356) 00:14:58.558 fused_ordering(357) 00:14:58.558 fused_ordering(358) 00:14:58.558 fused_ordering(359) 00:14:58.558 fused_ordering(360) 00:14:58.558 fused_ordering(361) 00:14:58.558 fused_ordering(362) 00:14:58.558 fused_ordering(363) 00:14:58.558 fused_ordering(364) 00:14:58.558 fused_ordering(365) 00:14:58.558 fused_ordering(366) 00:14:58.558 fused_ordering(367) 00:14:58.558 fused_ordering(368) 00:14:58.558 fused_ordering(369) 00:14:58.558 fused_ordering(370) 00:14:58.558 fused_ordering(371) 00:14:58.558 fused_ordering(372) 00:14:58.558 fused_ordering(373) 00:14:58.558 fused_ordering(374) 00:14:58.558 fused_ordering(375) 00:14:58.558 fused_ordering(376) 00:14:58.558 fused_ordering(377) 00:14:58.558 fused_ordering(378) 00:14:58.558 fused_ordering(379) 00:14:58.558 fused_ordering(380) 00:14:58.558 fused_ordering(381) 00:14:58.558 fused_ordering(382) 00:14:58.558 fused_ordering(383) 00:14:58.558 fused_ordering(384) 00:14:58.558 fused_ordering(385) 00:14:58.558 fused_ordering(386) 00:14:58.558 fused_ordering(387) 00:14:58.558 fused_ordering(388) 00:14:58.558 fused_ordering(389) 00:14:58.558 fused_ordering(390) 00:14:58.558 fused_ordering(391) 00:14:58.558 fused_ordering(392) 00:14:58.558 fused_ordering(393) 00:14:58.558 fused_ordering(394) 00:14:58.558 fused_ordering(395) 00:14:58.558 fused_ordering(396) 00:14:58.558 fused_ordering(397) 00:14:58.558 fused_ordering(398) 00:14:58.558 fused_ordering(399) 00:14:58.558 fused_ordering(400) 00:14:58.558 fused_ordering(401) 00:14:58.558 fused_ordering(402) 00:14:58.558 fused_ordering(403) 00:14:58.558 fused_ordering(404) 00:14:58.558 fused_ordering(405) 00:14:58.558 fused_ordering(406) 00:14:58.558 fused_ordering(407) 00:14:58.558 fused_ordering(408) 00:14:58.558 fused_ordering(409) 00:14:58.558 fused_ordering(410) 00:14:59.123 fused_ordering(411) 00:14:59.123 fused_ordering(412) 00:14:59.123 fused_ordering(413) 00:14:59.123 fused_ordering(414) 00:14:59.123 fused_ordering(415) 00:14:59.123 fused_ordering(416) 00:14:59.123 fused_ordering(417) 00:14:59.123 fused_ordering(418) 00:14:59.123 fused_ordering(419) 00:14:59.123 fused_ordering(420) 00:14:59.123 fused_ordering(421) 00:14:59.123 fused_ordering(422) 00:14:59.123 fused_ordering(423) 00:14:59.123 fused_ordering(424) 00:14:59.123 fused_ordering(425) 00:14:59.123 fused_ordering(426) 00:14:59.123 fused_ordering(427) 00:14:59.123 fused_ordering(428) 00:14:59.123 fused_ordering(429) 00:14:59.123 fused_ordering(430) 00:14:59.123 fused_ordering(431) 00:14:59.123 fused_ordering(432) 00:14:59.123 fused_ordering(433) 00:14:59.123 fused_ordering(434) 00:14:59.123 fused_ordering(435) 00:14:59.123 fused_ordering(436) 00:14:59.123 fused_ordering(437) 00:14:59.123 fused_ordering(438) 00:14:59.123 fused_ordering(439) 00:14:59.123 fused_ordering(440) 00:14:59.123 fused_ordering(441) 00:14:59.123 fused_ordering(442) 00:14:59.123 fused_ordering(443) 00:14:59.123 fused_ordering(444) 00:14:59.123 fused_ordering(445) 00:14:59.123 fused_ordering(446) 00:14:59.123 fused_ordering(447) 00:14:59.123 fused_ordering(448) 00:14:59.123 fused_ordering(449) 00:14:59.123 fused_ordering(450) 00:14:59.123 fused_ordering(451) 00:14:59.123 fused_ordering(452) 00:14:59.123 fused_ordering(453) 00:14:59.123 fused_ordering(454) 00:14:59.123 fused_ordering(455) 00:14:59.123 fused_ordering(456) 00:14:59.123 fused_ordering(457) 00:14:59.123 fused_ordering(458) 00:14:59.123 fused_ordering(459) 00:14:59.123 fused_ordering(460) 00:14:59.123 fused_ordering(461) 00:14:59.123 fused_ordering(462) 00:14:59.123 fused_ordering(463) 00:14:59.123 fused_ordering(464) 00:14:59.123 fused_ordering(465) 00:14:59.123 fused_ordering(466) 00:14:59.123 fused_ordering(467) 00:14:59.123 fused_ordering(468) 00:14:59.123 fused_ordering(469) 00:14:59.123 fused_ordering(470) 00:14:59.123 fused_ordering(471) 00:14:59.123 fused_ordering(472) 00:14:59.123 fused_ordering(473) 00:14:59.123 fused_ordering(474) 00:14:59.123 fused_ordering(475) 00:14:59.123 fused_ordering(476) 00:14:59.123 fused_ordering(477) 00:14:59.123 fused_ordering(478) 00:14:59.123 fused_ordering(479) 00:14:59.123 fused_ordering(480) 00:14:59.123 fused_ordering(481) 00:14:59.123 fused_ordering(482) 00:14:59.123 fused_ordering(483) 00:14:59.123 fused_ordering(484) 00:14:59.123 fused_ordering(485) 00:14:59.123 fused_ordering(486) 00:14:59.123 fused_ordering(487) 00:14:59.123 fused_ordering(488) 00:14:59.123 fused_ordering(489) 00:14:59.123 fused_ordering(490) 00:14:59.123 fused_ordering(491) 00:14:59.123 fused_ordering(492) 00:14:59.123 fused_ordering(493) 00:14:59.123 fused_ordering(494) 00:14:59.123 fused_ordering(495) 00:14:59.123 fused_ordering(496) 00:14:59.123 fused_ordering(497) 00:14:59.123 fused_ordering(498) 00:14:59.123 fused_ordering(499) 00:14:59.123 fused_ordering(500) 00:14:59.123 fused_ordering(501) 00:14:59.123 fused_ordering(502) 00:14:59.123 fused_ordering(503) 00:14:59.123 fused_ordering(504) 00:14:59.123 fused_ordering(505) 00:14:59.123 fused_ordering(506) 00:14:59.123 fused_ordering(507) 00:14:59.123 fused_ordering(508) 00:14:59.123 fused_ordering(509) 00:14:59.123 fused_ordering(510) 00:14:59.123 fused_ordering(511) 00:14:59.123 fused_ordering(512) 00:14:59.123 fused_ordering(513) 00:14:59.123 fused_ordering(514) 00:14:59.123 fused_ordering(515) 00:14:59.123 fused_ordering(516) 00:14:59.123 fused_ordering(517) 00:14:59.123 fused_ordering(518) 00:14:59.123 fused_ordering(519) 00:14:59.123 fused_ordering(520) 00:14:59.123 fused_ordering(521) 00:14:59.123 fused_ordering(522) 00:14:59.123 fused_ordering(523) 00:14:59.123 fused_ordering(524) 00:14:59.123 fused_ordering(525) 00:14:59.123 fused_ordering(526) 00:14:59.123 fused_ordering(527) 00:14:59.123 fused_ordering(528) 00:14:59.123 fused_ordering(529) 00:14:59.123 fused_ordering(530) 00:14:59.123 fused_ordering(531) 00:14:59.123 fused_ordering(532) 00:14:59.123 fused_ordering(533) 00:14:59.123 fused_ordering(534) 00:14:59.123 fused_ordering(535) 00:14:59.123 fused_ordering(536) 00:14:59.123 fused_ordering(537) 00:14:59.123 fused_ordering(538) 00:14:59.123 fused_ordering(539) 00:14:59.123 fused_ordering(540) 00:14:59.123 fused_ordering(541) 00:14:59.123 fused_ordering(542) 00:14:59.123 fused_ordering(543) 00:14:59.123 fused_ordering(544) 00:14:59.123 fused_ordering(545) 00:14:59.123 fused_ordering(546) 00:14:59.123 fused_ordering(547) 00:14:59.123 fused_ordering(548) 00:14:59.123 fused_ordering(549) 00:14:59.123 fused_ordering(550) 00:14:59.123 fused_ordering(551) 00:14:59.123 fused_ordering(552) 00:14:59.123 fused_ordering(553) 00:14:59.123 fused_ordering(554) 00:14:59.123 fused_ordering(555) 00:14:59.123 fused_ordering(556) 00:14:59.123 fused_ordering(557) 00:14:59.123 fused_ordering(558) 00:14:59.123 fused_ordering(559) 00:14:59.123 fused_ordering(560) 00:14:59.123 fused_ordering(561) 00:14:59.123 fused_ordering(562) 00:14:59.123 fused_ordering(563) 00:14:59.123 fused_ordering(564) 00:14:59.123 fused_ordering(565) 00:14:59.123 fused_ordering(566) 00:14:59.123 fused_ordering(567) 00:14:59.123 fused_ordering(568) 00:14:59.123 fused_ordering(569) 00:14:59.123 fused_ordering(570) 00:14:59.123 fused_ordering(571) 00:14:59.123 fused_ordering(572) 00:14:59.123 fused_ordering(573) 00:14:59.123 fused_ordering(574) 00:14:59.123 fused_ordering(575) 00:14:59.123 fused_ordering(576) 00:14:59.123 fused_ordering(577) 00:14:59.123 fused_ordering(578) 00:14:59.123 fused_ordering(579) 00:14:59.123 fused_ordering(580) 00:14:59.123 fused_ordering(581) 00:14:59.123 fused_ordering(582) 00:14:59.123 fused_ordering(583) 00:14:59.123 fused_ordering(584) 00:14:59.123 fused_ordering(585) 00:14:59.123 fused_ordering(586) 00:14:59.123 fused_ordering(587) 00:14:59.124 fused_ordering(588) 00:14:59.124 fused_ordering(589) 00:14:59.124 fused_ordering(590) 00:14:59.124 fused_ordering(591) 00:14:59.124 fused_ordering(592) 00:14:59.124 fused_ordering(593) 00:14:59.124 fused_ordering(594) 00:14:59.124 fused_ordering(595) 00:14:59.124 fused_ordering(596) 00:14:59.124 fused_ordering(597) 00:14:59.124 fused_ordering(598) 00:14:59.124 fused_ordering(599) 00:14:59.124 fused_ordering(600) 00:14:59.124 fused_ordering(601) 00:14:59.124 fused_ordering(602) 00:14:59.124 fused_ordering(603) 00:14:59.124 fused_ordering(604) 00:14:59.124 fused_ordering(605) 00:14:59.124 fused_ordering(606) 00:14:59.124 fused_ordering(607) 00:14:59.124 fused_ordering(608) 00:14:59.124 fused_ordering(609) 00:14:59.124 fused_ordering(610) 00:14:59.124 fused_ordering(611) 00:14:59.124 fused_ordering(612) 00:14:59.124 fused_ordering(613) 00:14:59.124 fused_ordering(614) 00:14:59.124 fused_ordering(615) 00:14:59.689 fused_ordering(616) 00:14:59.689 fused_ordering(617) 00:14:59.689 fused_ordering(618) 00:14:59.689 fused_ordering(619) 00:14:59.689 fused_ordering(620) 00:14:59.689 fused_ordering(621) 00:14:59.689 fused_ordering(622) 00:14:59.689 fused_ordering(623) 00:14:59.689 fused_ordering(624) 00:14:59.689 fused_ordering(625) 00:14:59.689 fused_ordering(626) 00:14:59.689 fused_ordering(627) 00:14:59.689 fused_ordering(628) 00:14:59.689 fused_ordering(629) 00:14:59.689 fused_ordering(630) 00:14:59.689 fused_ordering(631) 00:14:59.689 fused_ordering(632) 00:14:59.689 fused_ordering(633) 00:14:59.689 fused_ordering(634) 00:14:59.689 fused_ordering(635) 00:14:59.689 fused_ordering(636) 00:14:59.689 fused_ordering(637) 00:14:59.689 fused_ordering(638) 00:14:59.689 fused_ordering(639) 00:14:59.689 fused_ordering(640) 00:14:59.689 fused_ordering(641) 00:14:59.689 fused_ordering(642) 00:14:59.689 fused_ordering(643) 00:14:59.689 fused_ordering(644) 00:14:59.689 fused_ordering(645) 00:14:59.689 fused_ordering(646) 00:14:59.689 fused_ordering(647) 00:14:59.689 fused_ordering(648) 00:14:59.689 fused_ordering(649) 00:14:59.689 fused_ordering(650) 00:14:59.689 fused_ordering(651) 00:14:59.689 fused_ordering(652) 00:14:59.689 fused_ordering(653) 00:14:59.689 fused_ordering(654) 00:14:59.689 fused_ordering(655) 00:14:59.689 fused_ordering(656) 00:14:59.689 fused_ordering(657) 00:14:59.689 fused_ordering(658) 00:14:59.689 fused_ordering(659) 00:14:59.689 fused_ordering(660) 00:14:59.689 fused_ordering(661) 00:14:59.689 fused_ordering(662) 00:14:59.689 fused_ordering(663) 00:14:59.689 fused_ordering(664) 00:14:59.689 fused_ordering(665) 00:14:59.689 fused_ordering(666) 00:14:59.689 fused_ordering(667) 00:14:59.689 fused_ordering(668) 00:14:59.689 fused_ordering(669) 00:14:59.689 fused_ordering(670) 00:14:59.689 fused_ordering(671) 00:14:59.689 fused_ordering(672) 00:14:59.689 fused_ordering(673) 00:14:59.689 fused_ordering(674) 00:14:59.689 fused_ordering(675) 00:14:59.689 fused_ordering(676) 00:14:59.689 fused_ordering(677) 00:14:59.689 fused_ordering(678) 00:14:59.689 fused_ordering(679) 00:14:59.689 fused_ordering(680) 00:14:59.689 fused_ordering(681) 00:14:59.689 fused_ordering(682) 00:14:59.689 fused_ordering(683) 00:14:59.689 fused_ordering(684) 00:14:59.689 fused_ordering(685) 00:14:59.689 fused_ordering(686) 00:14:59.689 fused_ordering(687) 00:14:59.689 fused_ordering(688) 00:14:59.689 fused_ordering(689) 00:14:59.689 fused_ordering(690) 00:14:59.689 fused_ordering(691) 00:14:59.689 fused_ordering(692) 00:14:59.689 fused_ordering(693) 00:14:59.689 fused_ordering(694) 00:14:59.689 fused_ordering(695) 00:14:59.689 fused_ordering(696) 00:14:59.689 fused_ordering(697) 00:14:59.689 fused_ordering(698) 00:14:59.689 fused_ordering(699) 00:14:59.689 fused_ordering(700) 00:14:59.689 fused_ordering(701) 00:14:59.689 fused_ordering(702) 00:14:59.689 fused_ordering(703) 00:14:59.689 fused_ordering(704) 00:14:59.689 fused_ordering(705) 00:14:59.689 fused_ordering(706) 00:14:59.689 fused_ordering(707) 00:14:59.689 fused_ordering(708) 00:14:59.689 fused_ordering(709) 00:14:59.689 fused_ordering(710) 00:14:59.689 fused_ordering(711) 00:14:59.689 fused_ordering(712) 00:14:59.689 fused_ordering(713) 00:14:59.689 fused_ordering(714) 00:14:59.689 fused_ordering(715) 00:14:59.689 fused_ordering(716) 00:14:59.689 fused_ordering(717) 00:14:59.689 fused_ordering(718) 00:14:59.689 fused_ordering(719) 00:14:59.689 fused_ordering(720) 00:14:59.689 fused_ordering(721) 00:14:59.689 fused_ordering(722) 00:14:59.689 fused_ordering(723) 00:14:59.689 fused_ordering(724) 00:14:59.689 fused_ordering(725) 00:14:59.689 fused_ordering(726) 00:14:59.689 fused_ordering(727) 00:14:59.689 fused_ordering(728) 00:14:59.689 fused_ordering(729) 00:14:59.689 fused_ordering(730) 00:14:59.689 fused_ordering(731) 00:14:59.689 fused_ordering(732) 00:14:59.689 fused_ordering(733) 00:14:59.689 fused_ordering(734) 00:14:59.689 fused_ordering(735) 00:14:59.689 fused_ordering(736) 00:14:59.689 fused_ordering(737) 00:14:59.689 fused_ordering(738) 00:14:59.689 fused_ordering(739) 00:14:59.689 fused_ordering(740) 00:14:59.689 fused_ordering(741) 00:14:59.689 fused_ordering(742) 00:14:59.689 fused_ordering(743) 00:14:59.689 fused_ordering(744) 00:14:59.689 fused_ordering(745) 00:14:59.689 fused_ordering(746) 00:14:59.689 fused_ordering(747) 00:14:59.689 fused_ordering(748) 00:14:59.689 fused_ordering(749) 00:14:59.689 fused_ordering(750) 00:14:59.689 fused_ordering(751) 00:14:59.689 fused_ordering(752) 00:14:59.689 fused_ordering(753) 00:14:59.689 fused_ordering(754) 00:14:59.689 fused_ordering(755) 00:14:59.689 fused_ordering(756) 00:14:59.689 fused_ordering(757) 00:14:59.689 fused_ordering(758) 00:14:59.689 fused_ordering(759) 00:14:59.689 fused_ordering(760) 00:14:59.689 fused_ordering(761) 00:14:59.689 fused_ordering(762) 00:14:59.689 fused_ordering(763) 00:14:59.689 fused_ordering(764) 00:14:59.689 fused_ordering(765) 00:14:59.689 fused_ordering(766) 00:14:59.689 fused_ordering(767) 00:14:59.689 fused_ordering(768) 00:14:59.689 fused_ordering(769) 00:14:59.689 fused_ordering(770) 00:14:59.689 fused_ordering(771) 00:14:59.689 fused_ordering(772) 00:14:59.689 fused_ordering(773) 00:14:59.689 fused_ordering(774) 00:14:59.689 fused_ordering(775) 00:14:59.689 fused_ordering(776) 00:14:59.689 fused_ordering(777) 00:14:59.689 fused_ordering(778) 00:14:59.689 fused_ordering(779) 00:14:59.689 fused_ordering(780) 00:14:59.689 fused_ordering(781) 00:14:59.689 fused_ordering(782) 00:14:59.689 fused_ordering(783) 00:14:59.689 fused_ordering(784) 00:14:59.689 fused_ordering(785) 00:14:59.689 fused_ordering(786) 00:14:59.689 fused_ordering(787) 00:14:59.689 fused_ordering(788) 00:14:59.689 fused_ordering(789) 00:14:59.689 fused_ordering(790) 00:14:59.689 fused_ordering(791) 00:14:59.689 fused_ordering(792) 00:14:59.689 fused_ordering(793) 00:14:59.689 fused_ordering(794) 00:14:59.689 fused_ordering(795) 00:14:59.689 fused_ordering(796) 00:14:59.689 fused_ordering(797) 00:14:59.689 fused_ordering(798) 00:14:59.689 fused_ordering(799) 00:14:59.689 fused_ordering(800) 00:14:59.689 fused_ordering(801) 00:14:59.689 fused_ordering(802) 00:14:59.689 fused_ordering(803) 00:14:59.689 fused_ordering(804) 00:14:59.689 fused_ordering(805) 00:14:59.689 fused_ordering(806) 00:14:59.689 fused_ordering(807) 00:14:59.689 fused_ordering(808) 00:14:59.689 fused_ordering(809) 00:14:59.689 fused_ordering(810) 00:14:59.689 fused_ordering(811) 00:14:59.689 fused_ordering(812) 00:14:59.689 fused_ordering(813) 00:14:59.689 fused_ordering(814) 00:14:59.689 fused_ordering(815) 00:14:59.689 fused_ordering(816) 00:14:59.689 fused_ordering(817) 00:14:59.689 fused_ordering(818) 00:14:59.689 fused_ordering(819) 00:14:59.689 fused_ordering(820) 00:15:00.625 fused_ordering(821) 00:15:00.625 fused_ordering(822) 00:15:00.625 fused_ordering(823) 00:15:00.625 fused_ordering(824) 00:15:00.625 fused_ordering(825) 00:15:00.625 fused_ordering(826) 00:15:00.625 fused_ordering(827) 00:15:00.625 fused_ordering(828) 00:15:00.625 fused_ordering(829) 00:15:00.625 fused_ordering(830) 00:15:00.625 fused_ordering(831) 00:15:00.625 fused_ordering(832) 00:15:00.625 fused_ordering(833) 00:15:00.625 fused_ordering(834) 00:15:00.625 fused_ordering(835) 00:15:00.625 fused_ordering(836) 00:15:00.625 fused_ordering(837) 00:15:00.625 fused_ordering(838) 00:15:00.625 fused_ordering(839) 00:15:00.625 fused_ordering(840) 00:15:00.625 fused_ordering(841) 00:15:00.625 fused_ordering(842) 00:15:00.625 fused_ordering(843) 00:15:00.625 fused_ordering(844) 00:15:00.625 fused_ordering(845) 00:15:00.625 fused_ordering(846) 00:15:00.625 fused_ordering(847) 00:15:00.625 fused_ordering(848) 00:15:00.625 fused_ordering(849) 00:15:00.625 fused_ordering(850) 00:15:00.625 fused_ordering(851) 00:15:00.625 fused_ordering(852) 00:15:00.625 fused_ordering(853) 00:15:00.625 fused_ordering(854) 00:15:00.625 fused_ordering(855) 00:15:00.625 fused_ordering(856) 00:15:00.625 fused_ordering(857) 00:15:00.625 fused_ordering(858) 00:15:00.625 fused_ordering(859) 00:15:00.625 fused_ordering(860) 00:15:00.625 fused_ordering(861) 00:15:00.625 fused_ordering(862) 00:15:00.625 fused_ordering(863) 00:15:00.625 fused_ordering(864) 00:15:00.625 fused_ordering(865) 00:15:00.625 fused_ordering(866) 00:15:00.625 fused_ordering(867) 00:15:00.625 fused_ordering(868) 00:15:00.625 fused_ordering(869) 00:15:00.625 fused_ordering(870) 00:15:00.625 fused_ordering(871) 00:15:00.625 fused_ordering(872) 00:15:00.625 fused_ordering(873) 00:15:00.625 fused_ordering(874) 00:15:00.625 fused_ordering(875) 00:15:00.625 fused_ordering(876) 00:15:00.625 fused_ordering(877) 00:15:00.625 fused_ordering(878) 00:15:00.625 fused_ordering(879) 00:15:00.625 fused_ordering(880) 00:15:00.625 fused_ordering(881) 00:15:00.625 fused_ordering(882) 00:15:00.625 fused_ordering(883) 00:15:00.625 fused_ordering(884) 00:15:00.625 fused_ordering(885) 00:15:00.625 fused_ordering(886) 00:15:00.625 fused_ordering(887) 00:15:00.625 fused_ordering(888) 00:15:00.625 fused_ordering(889) 00:15:00.625 fused_ordering(890) 00:15:00.625 fused_ordering(891) 00:15:00.625 fused_ordering(892) 00:15:00.625 fused_ordering(893) 00:15:00.625 fused_ordering(894) 00:15:00.625 fused_ordering(895) 00:15:00.625 fused_ordering(896) 00:15:00.625 fused_ordering(897) 00:15:00.625 fused_ordering(898) 00:15:00.625 fused_ordering(899) 00:15:00.625 fused_ordering(900) 00:15:00.625 fused_ordering(901) 00:15:00.625 fused_ordering(902) 00:15:00.625 fused_ordering(903) 00:15:00.625 fused_ordering(904) 00:15:00.625 fused_ordering(905) 00:15:00.625 fused_ordering(906) 00:15:00.625 fused_ordering(907) 00:15:00.625 fused_ordering(908) 00:15:00.625 fused_ordering(909) 00:15:00.625 fused_ordering(910) 00:15:00.625 fused_ordering(911) 00:15:00.625 fused_ordering(912) 00:15:00.625 fused_ordering(913) 00:15:00.625 fused_ordering(914) 00:15:00.625 fused_ordering(915) 00:15:00.625 fused_ordering(916) 00:15:00.625 fused_ordering(917) 00:15:00.625 fused_ordering(918) 00:15:00.625 fused_ordering(919) 00:15:00.625 fused_ordering(920) 00:15:00.625 fused_ordering(921) 00:15:00.625 fused_ordering(922) 00:15:00.625 fused_ordering(923) 00:15:00.625 fused_ordering(924) 00:15:00.625 fused_ordering(925) 00:15:00.625 fused_ordering(926) 00:15:00.625 fused_ordering(927) 00:15:00.625 fused_ordering(928) 00:15:00.625 fused_ordering(929) 00:15:00.625 fused_ordering(930) 00:15:00.625 fused_ordering(931) 00:15:00.625 fused_ordering(932) 00:15:00.625 fused_ordering(933) 00:15:00.625 fused_ordering(934) 00:15:00.625 fused_ordering(935) 00:15:00.625 fused_ordering(936) 00:15:00.625 fused_ordering(937) 00:15:00.625 fused_ordering(938) 00:15:00.625 fused_ordering(939) 00:15:00.625 fused_ordering(940) 00:15:00.625 fused_ordering(941) 00:15:00.625 fused_ordering(942) 00:15:00.625 fused_ordering(943) 00:15:00.625 fused_ordering(944) 00:15:00.625 fused_ordering(945) 00:15:00.625 fused_ordering(946) 00:15:00.625 fused_ordering(947) 00:15:00.625 fused_ordering(948) 00:15:00.625 fused_ordering(949) 00:15:00.625 fused_ordering(950) 00:15:00.625 fused_ordering(951) 00:15:00.625 fused_ordering(952) 00:15:00.625 fused_ordering(953) 00:15:00.625 fused_ordering(954) 00:15:00.625 fused_ordering(955) 00:15:00.625 fused_ordering(956) 00:15:00.625 fused_ordering(957) 00:15:00.625 fused_ordering(958) 00:15:00.625 fused_ordering(959) 00:15:00.625 fused_ordering(960) 00:15:00.625 fused_ordering(961) 00:15:00.625 fused_ordering(962) 00:15:00.625 fused_ordering(963) 00:15:00.625 fused_ordering(964) 00:15:00.625 fused_ordering(965) 00:15:00.625 fused_ordering(966) 00:15:00.625 fused_ordering(967) 00:15:00.625 fused_ordering(968) 00:15:00.625 fused_ordering(969) 00:15:00.625 fused_ordering(970) 00:15:00.625 fused_ordering(971) 00:15:00.625 fused_ordering(972) 00:15:00.625 fused_ordering(973) 00:15:00.625 fused_ordering(974) 00:15:00.625 fused_ordering(975) 00:15:00.625 fused_ordering(976) 00:15:00.625 fused_ordering(977) 00:15:00.625 fused_ordering(978) 00:15:00.625 fused_ordering(979) 00:15:00.625 fused_ordering(980) 00:15:00.625 fused_ordering(981) 00:15:00.625 fused_ordering(982) 00:15:00.625 fused_ordering(983) 00:15:00.625 fused_ordering(984) 00:15:00.625 fused_ordering(985) 00:15:00.625 fused_ordering(986) 00:15:00.625 fused_ordering(987) 00:15:00.625 fused_ordering(988) 00:15:00.625 fused_ordering(989) 00:15:00.625 fused_ordering(990) 00:15:00.625 fused_ordering(991) 00:15:00.625 fused_ordering(992) 00:15:00.625 fused_ordering(993) 00:15:00.625 fused_ordering(994) 00:15:00.625 fused_ordering(995) 00:15:00.625 fused_ordering(996) 00:15:00.625 fused_ordering(997) 00:15:00.625 fused_ordering(998) 00:15:00.625 fused_ordering(999) 00:15:00.625 fused_ordering(1000) 00:15:00.625 fused_ordering(1001) 00:15:00.625 fused_ordering(1002) 00:15:00.625 fused_ordering(1003) 00:15:00.625 fused_ordering(1004) 00:15:00.625 fused_ordering(1005) 00:15:00.625 fused_ordering(1006) 00:15:00.625 fused_ordering(1007) 00:15:00.625 fused_ordering(1008) 00:15:00.625 fused_ordering(1009) 00:15:00.625 fused_ordering(1010) 00:15:00.625 fused_ordering(1011) 00:15:00.625 fused_ordering(1012) 00:15:00.625 fused_ordering(1013) 00:15:00.625 fused_ordering(1014) 00:15:00.625 fused_ordering(1015) 00:15:00.625 fused_ordering(1016) 00:15:00.625 fused_ordering(1017) 00:15:00.625 fused_ordering(1018) 00:15:00.625 fused_ordering(1019) 00:15:00.625 fused_ordering(1020) 00:15:00.625 fused_ordering(1021) 00:15:00.625 fused_ordering(1022) 00:15:00.625 fused_ordering(1023) 00:15:00.625 04:16:50 -- target/fused_ordering.sh@23 -- # trap - SIGINT SIGTERM EXIT 00:15:00.625 04:16:50 -- target/fused_ordering.sh@25 -- # nvmftestfini 00:15:00.625 04:16:50 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:00.625 04:16:50 -- nvmf/common.sh@116 -- # sync 00:15:00.625 04:16:50 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:00.625 04:16:50 -- nvmf/common.sh@119 -- # set +e 00:15:00.625 04:16:50 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:00.625 04:16:50 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:00.625 rmmod nvme_tcp 00:15:00.625 rmmod nvme_fabrics 00:15:00.625 rmmod nvme_keyring 00:15:00.625 04:16:50 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:00.625 04:16:50 -- nvmf/common.sh@123 -- # set -e 00:15:00.625 04:16:50 -- nvmf/common.sh@124 -- # return 0 00:15:00.625 04:16:50 -- nvmf/common.sh@477 -- # '[' -n 2328091 ']' 00:15:00.625 04:16:50 -- nvmf/common.sh@478 -- # killprocess 2328091 00:15:00.625 04:16:50 -- common/autotest_common.sh@936 -- # '[' -z 2328091 ']' 00:15:00.625 04:16:50 -- common/autotest_common.sh@940 -- # kill -0 2328091 00:15:00.625 04:16:50 -- common/autotest_common.sh@941 -- # uname 00:15:00.625 04:16:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:00.625 04:16:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2328091 00:15:00.625 04:16:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:15:00.625 04:16:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:15:00.625 04:16:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2328091' 00:15:00.625 killing process with pid 2328091 00:15:00.625 04:16:50 -- common/autotest_common.sh@955 -- # kill 2328091 00:15:00.625 04:16:50 -- common/autotest_common.sh@960 -- # wait 2328091 00:15:00.625 04:16:51 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:00.625 04:16:51 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:00.625 04:16:51 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:00.625 04:16:51 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:00.625 04:16:51 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:00.626 04:16:51 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:00.626 04:16:51 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:00.626 04:16:51 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:03.157 04:16:53 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:03.157 00:15:03.157 real 0m8.313s 00:15:03.157 user 0m6.053s 00:15:03.157 sys 0m3.211s 00:15:03.157 04:16:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:03.157 04:16:53 -- common/autotest_common.sh@10 -- # set +x 00:15:03.157 ************************************ 00:15:03.157 END TEST nvmf_fused_ordering 00:15:03.157 ************************************ 00:15:03.157 04:16:53 -- nvmf/nvmf.sh@35 -- # run_test nvmf_delete_subsystem /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:03.157 04:16:53 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:03.157 04:16:53 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:03.157 04:16:53 -- common/autotest_common.sh@10 -- # set +x 00:15:03.157 ************************************ 00:15:03.157 START TEST nvmf_delete_subsystem 00:15:03.157 ************************************ 00:15:03.157 04:16:53 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh --transport=tcp 00:15:03.157 * Looking for test storage... 00:15:03.157 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:03.157 04:16:53 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:03.157 04:16:53 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:03.157 04:16:53 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:03.157 04:16:53 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:03.157 04:16:53 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:03.157 04:16:53 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:03.157 04:16:53 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:03.157 04:16:53 -- scripts/common.sh@335 -- # IFS=.-: 00:15:03.157 04:16:53 -- scripts/common.sh@335 -- # read -ra ver1 00:15:03.157 04:16:53 -- scripts/common.sh@336 -- # IFS=.-: 00:15:03.157 04:16:53 -- scripts/common.sh@336 -- # read -ra ver2 00:15:03.157 04:16:53 -- scripts/common.sh@337 -- # local 'op=<' 00:15:03.157 04:16:53 -- scripts/common.sh@339 -- # ver1_l=2 00:15:03.157 04:16:53 -- scripts/common.sh@340 -- # ver2_l=1 00:15:03.157 04:16:53 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:03.157 04:16:53 -- scripts/common.sh@343 -- # case "$op" in 00:15:03.157 04:16:53 -- scripts/common.sh@344 -- # : 1 00:15:03.157 04:16:53 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:03.157 04:16:53 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:03.157 04:16:53 -- scripts/common.sh@364 -- # decimal 1 00:15:03.157 04:16:53 -- scripts/common.sh@352 -- # local d=1 00:15:03.157 04:16:53 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:03.157 04:16:53 -- scripts/common.sh@354 -- # echo 1 00:15:03.157 04:16:53 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:03.157 04:16:53 -- scripts/common.sh@365 -- # decimal 2 00:15:03.157 04:16:53 -- scripts/common.sh@352 -- # local d=2 00:15:03.157 04:16:53 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:03.157 04:16:53 -- scripts/common.sh@354 -- # echo 2 00:15:03.157 04:16:53 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:03.157 04:16:53 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:03.157 04:16:53 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:03.157 04:16:53 -- scripts/common.sh@367 -- # return 0 00:15:03.157 04:16:53 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:03.157 04:16:53 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:03.157 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:03.157 --rc genhtml_branch_coverage=1 00:15:03.157 --rc genhtml_function_coverage=1 00:15:03.157 --rc genhtml_legend=1 00:15:03.157 --rc geninfo_all_blocks=1 00:15:03.157 --rc geninfo_unexecuted_blocks=1 00:15:03.157 00:15:03.157 ' 00:15:03.157 04:16:53 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:03.157 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:03.157 --rc genhtml_branch_coverage=1 00:15:03.157 --rc genhtml_function_coverage=1 00:15:03.157 --rc genhtml_legend=1 00:15:03.157 --rc geninfo_all_blocks=1 00:15:03.157 --rc geninfo_unexecuted_blocks=1 00:15:03.157 00:15:03.157 ' 00:15:03.157 04:16:53 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:03.157 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:03.157 --rc genhtml_branch_coverage=1 00:15:03.157 --rc genhtml_function_coverage=1 00:15:03.157 --rc genhtml_legend=1 00:15:03.157 --rc geninfo_all_blocks=1 00:15:03.157 --rc geninfo_unexecuted_blocks=1 00:15:03.157 00:15:03.157 ' 00:15:03.158 04:16:53 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:03.158 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:03.158 --rc genhtml_branch_coverage=1 00:15:03.158 --rc genhtml_function_coverage=1 00:15:03.158 --rc genhtml_legend=1 00:15:03.158 --rc geninfo_all_blocks=1 00:15:03.158 --rc geninfo_unexecuted_blocks=1 00:15:03.158 00:15:03.158 ' 00:15:03.158 04:16:53 -- target/delete_subsystem.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:03.158 04:16:53 -- nvmf/common.sh@7 -- # uname -s 00:15:03.158 04:16:53 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:03.158 04:16:53 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:03.158 04:16:53 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:03.158 04:16:53 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:03.158 04:16:53 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:03.158 04:16:53 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:03.158 04:16:53 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:03.158 04:16:53 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:03.158 04:16:53 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:03.158 04:16:53 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:03.158 04:16:53 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:03.158 04:16:53 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:03.158 04:16:53 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:03.158 04:16:53 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:03.158 04:16:53 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:03.158 04:16:53 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:03.158 04:16:53 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:03.158 04:16:53 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:03.158 04:16:53 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:03.158 04:16:53 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:03.158 04:16:53 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:03.158 04:16:53 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:03.158 04:16:53 -- paths/export.sh@5 -- # export PATH 00:15:03.158 04:16:53 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:03.158 04:16:53 -- nvmf/common.sh@46 -- # : 0 00:15:03.158 04:16:53 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:03.158 04:16:53 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:03.158 04:16:53 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:03.158 04:16:53 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:03.158 04:16:53 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:03.158 04:16:53 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:03.158 04:16:53 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:03.158 04:16:53 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:03.158 04:16:53 -- target/delete_subsystem.sh@12 -- # nvmftestinit 00:15:03.158 04:16:53 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:03.158 04:16:53 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:03.158 04:16:53 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:03.158 04:16:53 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:03.158 04:16:53 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:03.158 04:16:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:03.158 04:16:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:03.158 04:16:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:03.158 04:16:53 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:03.158 04:16:53 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:03.158 04:16:53 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:03.158 04:16:53 -- common/autotest_common.sh@10 -- # set +x 00:15:05.058 04:16:55 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:05.058 04:16:55 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:05.058 04:16:55 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:05.058 04:16:55 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:05.058 04:16:55 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:05.058 04:16:55 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:05.058 04:16:55 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:05.058 04:16:55 -- nvmf/common.sh@294 -- # net_devs=() 00:15:05.058 04:16:55 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:05.058 04:16:55 -- nvmf/common.sh@295 -- # e810=() 00:15:05.058 04:16:55 -- nvmf/common.sh@295 -- # local -ga e810 00:15:05.058 04:16:55 -- nvmf/common.sh@296 -- # x722=() 00:15:05.058 04:16:55 -- nvmf/common.sh@296 -- # local -ga x722 00:15:05.058 04:16:55 -- nvmf/common.sh@297 -- # mlx=() 00:15:05.058 04:16:55 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:05.058 04:16:55 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:05.058 04:16:55 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:05.058 04:16:55 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:05.058 04:16:55 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:05.058 04:16:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:05.058 04:16:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:05.058 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:05.058 04:16:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:05.058 04:16:55 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:05.058 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:05.058 04:16:55 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:05.058 04:16:55 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:05.058 04:16:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:05.058 04:16:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:05.058 04:16:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:05.058 04:16:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:05.058 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:05.058 04:16:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:05.058 04:16:55 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:05.058 04:16:55 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:05.058 04:16:55 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:05.058 04:16:55 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:05.058 04:16:55 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:05.058 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:05.058 04:16:55 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:05.058 04:16:55 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:05.058 04:16:55 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:05.058 04:16:55 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:05.058 04:16:55 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:05.058 04:16:55 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:05.058 04:16:55 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:05.058 04:16:55 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:05.058 04:16:55 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:05.058 04:16:55 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:05.058 04:16:55 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:05.058 04:16:55 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:05.058 04:16:55 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:05.058 04:16:55 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:05.058 04:16:55 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:05.058 04:16:55 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:05.058 04:16:55 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:05.058 04:16:55 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:05.058 04:16:55 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:05.058 04:16:55 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:05.058 04:16:55 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:05.058 04:16:55 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:05.058 04:16:55 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:05.058 04:16:55 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:05.058 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:05.058 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.251 ms 00:15:05.058 00:15:05.058 --- 10.0.0.2 ping statistics --- 00:15:05.058 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:05.058 rtt min/avg/max/mdev = 0.251/0.251/0.251/0.000 ms 00:15:05.058 04:16:55 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:05.058 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:05.058 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.142 ms 00:15:05.058 00:15:05.058 --- 10.0.0.1 ping statistics --- 00:15:05.058 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:05.058 rtt min/avg/max/mdev = 0.142/0.142/0.142/0.000 ms 00:15:05.058 04:16:55 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:05.058 04:16:55 -- nvmf/common.sh@410 -- # return 0 00:15:05.058 04:16:55 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:05.058 04:16:55 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:05.058 04:16:55 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:05.058 04:16:55 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:05.058 04:16:55 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:05.058 04:16:55 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:05.058 04:16:55 -- target/delete_subsystem.sh@13 -- # nvmfappstart -m 0x3 00:15:05.058 04:16:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:05.058 04:16:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:05.058 04:16:55 -- common/autotest_common.sh@10 -- # set +x 00:15:05.058 04:16:55 -- nvmf/common.sh@469 -- # nvmfpid=2330472 00:15:05.058 04:16:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x3 00:15:05.058 04:16:55 -- nvmf/common.sh@470 -- # waitforlisten 2330472 00:15:05.058 04:16:55 -- common/autotest_common.sh@829 -- # '[' -z 2330472 ']' 00:15:05.058 04:16:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:05.058 04:16:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:05.058 04:16:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:05.058 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:05.058 04:16:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:05.058 04:16:55 -- common/autotest_common.sh@10 -- # set +x 00:15:05.058 [2024-11-30 04:16:55.663756] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:05.058 [2024-11-30 04:16:55.663840] [ DPDK EAL parameters: nvmf -c 0x3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:05.317 EAL: No free 2048 kB hugepages reported on node 1 00:15:05.317 [2024-11-30 04:16:55.734580] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:15:05.317 [2024-11-30 04:16:55.828345] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:05.317 [2024-11-30 04:16:55.828503] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:05.317 [2024-11-30 04:16:55.828520] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:05.317 [2024-11-30 04:16:55.828532] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:05.317 [2024-11-30 04:16:55.830985] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:05.317 [2024-11-30 04:16:55.831007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:06.252 04:16:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:06.252 04:16:56 -- common/autotest_common.sh@862 -- # return 0 00:15:06.252 04:16:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:06.252 04:16:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:06.252 04:16:56 -- common/autotest_common.sh@10 -- # set +x 00:15:06.252 04:16:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:06.252 04:16:56 -- target/delete_subsystem.sh@15 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:06.252 04:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.252 04:16:56 -- common/autotest_common.sh@10 -- # set +x 00:15:06.252 [2024-11-30 04:16:56.698278] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:06.252 04:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.252 04:16:56 -- target/delete_subsystem.sh@16 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:06.252 04:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.252 04:16:56 -- common/autotest_common.sh@10 -- # set +x 00:15:06.252 04:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.252 04:16:56 -- target/delete_subsystem.sh@17 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:06.252 04:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.252 04:16:56 -- common/autotest_common.sh@10 -- # set +x 00:15:06.252 [2024-11-30 04:16:56.714523] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:06.252 04:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.252 04:16:56 -- target/delete_subsystem.sh@18 -- # rpc_cmd bdev_null_create NULL1 1000 512 00:15:06.252 04:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.252 04:16:56 -- common/autotest_common.sh@10 -- # set +x 00:15:06.252 NULL1 00:15:06.252 04:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.252 04:16:56 -- target/delete_subsystem.sh@23 -- # rpc_cmd bdev_delay_create -b NULL1 -d Delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:15:06.252 04:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.252 04:16:56 -- common/autotest_common.sh@10 -- # set +x 00:15:06.252 Delay0 00:15:06.252 04:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.252 04:16:56 -- target/delete_subsystem.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:06.252 04:16:56 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:06.252 04:16:56 -- common/autotest_common.sh@10 -- # set +x 00:15:06.252 04:16:56 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:06.252 04:16:56 -- target/delete_subsystem.sh@28 -- # perf_pid=2330628 00:15:06.252 04:16:56 -- target/delete_subsystem.sh@30 -- # sleep 2 00:15:06.252 04:16:56 -- target/delete_subsystem.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 5 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:06.252 EAL: No free 2048 kB hugepages reported on node 1 00:15:06.252 [2024-11-30 04:16:56.789173] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:08.152 04:16:58 -- target/delete_subsystem.sh@32 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:08.152 04:16:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:08.152 04:16:58 -- common/autotest_common.sh@10 -- # set +x 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 [2024-11-30 04:16:58.908089] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa7c90 is same with the state(5) to be set 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 [2024-11-30 04:16:58.910417] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa6690 is same with the state(5) to be set 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 starting I/O failed: -6 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 [2024-11-30 04:16:58.911092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff8a000c1d0 is same with the state(5) to be set 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Read completed with error (sct=0, sc=8) 00:15:08.411 Write completed with error (sct=0, sc=8) 00:15:08.412 Read completed with error (sct=0, sc=8) 00:15:08.412 Read completed with error (sct=0, sc=8) 00:15:08.412 Write completed with error (sct=0, sc=8) 00:15:08.412 Write completed with error (sct=0, sc=8) 00:15:08.412 Read completed with error (sct=0, sc=8) 00:15:08.412 Read completed with error (sct=0, sc=8) 00:15:08.412 Read completed with error (sct=0, sc=8) 00:15:08.412 Read completed with error (sct=0, sc=8) 00:15:08.412 Read completed with error (sct=0, sc=8) 00:15:09.345 [2024-11-30 04:16:59.887825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa7a40 is same with the state(5) to be set 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Write completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Write completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Write completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Write completed with error (sct=0, sc=8) 00:15:09.345 Write completed with error (sct=0, sc=8) 00:15:09.345 Write completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Write completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Write completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Write completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Read completed with error (sct=0, sc=8) 00:15:09.345 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 [2024-11-30 04:16:59.909763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff8a000bf20 is same with the state(5) to be set 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 [2024-11-30 04:16:59.909937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x7ff8a000c480 is same with the state(5) to be set 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 [2024-11-30 04:16:59.911459] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa6810 is same with the state(5) to be set 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 Write completed with error (sct=0, sc=8) 00:15:09.346 Read completed with error (sct=0, sc=8) 00:15:09.346 [2024-11-30 04:16:59.911910] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xaa7e10 is same with the state(5) to be set 00:15:09.346 [2024-11-30 04:16:59.912846] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xaa7a40 (9): Bad file descriptor 00:15:09.346 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf: errors occurred 00:15:09.346 04:16:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.346 04:16:59 -- target/delete_subsystem.sh@34 -- # delay=0 00:15:09.346 04:16:59 -- target/delete_subsystem.sh@35 -- # kill -0 2330628 00:15:09.346 04:16:59 -- target/delete_subsystem.sh@36 -- # sleep 0.5 00:15:09.346 Initializing NVMe Controllers 00:15:09.346 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:09.346 Controller IO queue size 128, less than required. 00:15:09.346 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:09.346 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:09.346 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:09.346 Initialization complete. Launching workers. 00:15:09.346 ======================================================== 00:15:09.346 Latency(us) 00:15:09.346 Device Information : IOPS MiB/s Average min max 00:15:09.346 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 158.55 0.08 920679.26 1457.34 1011729.31 00:15:09.346 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 144.14 0.07 1102326.57 272.44 2001940.84 00:15:09.346 ======================================================== 00:15:09.346 Total : 302.68 0.15 1007177.98 272.44 2001940.84 00:15:09.346 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@38 -- # (( delay++ > 30 )) 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@35 -- # kill -0 2330628 00:15:09.913 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 35: kill: (2330628) - No such process 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@45 -- # NOT wait 2330628 00:15:09.913 04:17:00 -- common/autotest_common.sh@650 -- # local es=0 00:15:09.913 04:17:00 -- common/autotest_common.sh@652 -- # valid_exec_arg wait 2330628 00:15:09.913 04:17:00 -- common/autotest_common.sh@638 -- # local arg=wait 00:15:09.913 04:17:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:09.913 04:17:00 -- common/autotest_common.sh@642 -- # type -t wait 00:15:09.913 04:17:00 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:15:09.913 04:17:00 -- common/autotest_common.sh@653 -- # wait 2330628 00:15:09.913 04:17:00 -- common/autotest_common.sh@653 -- # es=1 00:15:09.913 04:17:00 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:15:09.913 04:17:00 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:15:09.913 04:17:00 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@48 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:15:09.913 04:17:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.913 04:17:00 -- common/autotest_common.sh@10 -- # set +x 00:15:09.913 04:17:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@49 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:09.913 04:17:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.913 04:17:00 -- common/autotest_common.sh@10 -- # set +x 00:15:09.913 [2024-11-30 04:17:00.434588] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:09.913 04:17:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:15:09.913 04:17:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:09.913 04:17:00 -- common/autotest_common.sh@10 -- # set +x 00:15:09.913 04:17:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@54 -- # perf_pid=2331043 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -c 0xC -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -t 3 -q 128 -w randrw -M 70 -o 512 -P 4 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@56 -- # delay=0 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@57 -- # kill -0 2331043 00:15:09.913 04:17:00 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:09.913 EAL: No free 2048 kB hugepages reported on node 1 00:15:09.914 [2024-11-30 04:17:00.490911] subsystem.c:1344:spdk_nvmf_subsystem_listener_allowed: *WARNING*: Allowing connection to discovery subsystem on TCP/10.0.0.2/4420, even though this listener was not added to the discovery subsystem. This behavior is deprecated and will be removed in a future release. 00:15:10.479 04:17:00 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:10.479 04:17:00 -- target/delete_subsystem.sh@57 -- # kill -0 2331043 00:15:10.479 04:17:00 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:11.044 04:17:01 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:11.044 04:17:01 -- target/delete_subsystem.sh@57 -- # kill -0 2331043 00:15:11.044 04:17:01 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:11.611 04:17:01 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:11.611 04:17:01 -- target/delete_subsystem.sh@57 -- # kill -0 2331043 00:15:11.611 04:17:01 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:11.868 04:17:02 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:11.868 04:17:02 -- target/delete_subsystem.sh@57 -- # kill -0 2331043 00:15:11.868 04:17:02 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:12.434 04:17:02 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:12.434 04:17:02 -- target/delete_subsystem.sh@57 -- # kill -0 2331043 00:15:12.434 04:17:02 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:12.999 04:17:03 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:12.999 04:17:03 -- target/delete_subsystem.sh@57 -- # kill -0 2331043 00:15:12.999 04:17:03 -- target/delete_subsystem.sh@58 -- # sleep 0.5 00:15:13.257 Initializing NVMe Controllers 00:15:13.257 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:15:13.257 Controller IO queue size 128, less than required. 00:15:13.257 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:15:13.257 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 2 00:15:13.257 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 3 00:15:13.257 Initialization complete. Launching workers. 00:15:13.257 ======================================================== 00:15:13.257 Latency(us) 00:15:13.257 Device Information : IOPS MiB/s Average min max 00:15:13.257 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 2: 128.00 0.06 1004455.62 1000179.40 1043602.70 00:15:13.257 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 3: 128.00 0.06 1004431.32 1000300.27 1011497.32 00:15:13.257 ======================================================== 00:15:13.257 Total : 256.00 0.12 1004443.47 1000179.40 1043602.70 00:15:13.257 00:15:13.515 04:17:03 -- target/delete_subsystem.sh@60 -- # (( delay++ > 20 )) 00:15:13.515 04:17:03 -- target/delete_subsystem.sh@57 -- # kill -0 2331043 00:15:13.516 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/delete_subsystem.sh: line 57: kill: (2331043) - No such process 00:15:13.516 04:17:03 -- target/delete_subsystem.sh@67 -- # wait 2331043 00:15:13.516 04:17:03 -- target/delete_subsystem.sh@69 -- # trap - SIGINT SIGTERM EXIT 00:15:13.516 04:17:03 -- target/delete_subsystem.sh@71 -- # nvmftestfini 00:15:13.516 04:17:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:13.516 04:17:03 -- nvmf/common.sh@116 -- # sync 00:15:13.516 04:17:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:13.516 04:17:03 -- nvmf/common.sh@119 -- # set +e 00:15:13.516 04:17:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:13.516 04:17:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:13.516 rmmod nvme_tcp 00:15:13.516 rmmod nvme_fabrics 00:15:13.516 rmmod nvme_keyring 00:15:13.516 04:17:04 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:13.516 04:17:04 -- nvmf/common.sh@123 -- # set -e 00:15:13.516 04:17:04 -- nvmf/common.sh@124 -- # return 0 00:15:13.516 04:17:04 -- nvmf/common.sh@477 -- # '[' -n 2330472 ']' 00:15:13.516 04:17:04 -- nvmf/common.sh@478 -- # killprocess 2330472 00:15:13.516 04:17:04 -- common/autotest_common.sh@936 -- # '[' -z 2330472 ']' 00:15:13.516 04:17:04 -- common/autotest_common.sh@940 -- # kill -0 2330472 00:15:13.516 04:17:04 -- common/autotest_common.sh@941 -- # uname 00:15:13.516 04:17:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:13.516 04:17:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2330472 00:15:13.516 04:17:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:13.516 04:17:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:13.516 04:17:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2330472' 00:15:13.516 killing process with pid 2330472 00:15:13.516 04:17:04 -- common/autotest_common.sh@955 -- # kill 2330472 00:15:13.516 04:17:04 -- common/autotest_common.sh@960 -- # wait 2330472 00:15:13.774 04:17:04 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:13.774 04:17:04 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:13.774 04:17:04 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:13.774 04:17:04 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:13.774 04:17:04 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:13.774 04:17:04 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:13.774 04:17:04 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:13.774 04:17:04 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:16.306 04:17:06 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:16.306 00:15:16.306 real 0m13.052s 00:15:16.306 user 0m29.569s 00:15:16.306 sys 0m2.930s 00:15:16.307 04:17:06 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:16.307 04:17:06 -- common/autotest_common.sh@10 -- # set +x 00:15:16.307 ************************************ 00:15:16.307 END TEST nvmf_delete_subsystem 00:15:16.307 ************************************ 00:15:16.307 04:17:06 -- nvmf/nvmf.sh@36 -- # [[ 1 -eq 1 ]] 00:15:16.307 04:17:06 -- nvmf/nvmf.sh@37 -- # run_test nvmf_nvme_cli /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:16.307 04:17:06 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:16.307 04:17:06 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:16.307 04:17:06 -- common/autotest_common.sh@10 -- # set +x 00:15:16.307 ************************************ 00:15:16.307 START TEST nvmf_nvme_cli 00:15:16.307 ************************************ 00:15:16.307 04:17:06 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvme_cli.sh --transport=tcp 00:15:16.307 * Looking for test storage... 00:15:16.307 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:16.307 04:17:06 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:16.307 04:17:06 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:16.307 04:17:06 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:16.307 04:17:06 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:16.307 04:17:06 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:16.307 04:17:06 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:16.307 04:17:06 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:16.307 04:17:06 -- scripts/common.sh@335 -- # IFS=.-: 00:15:16.307 04:17:06 -- scripts/common.sh@335 -- # read -ra ver1 00:15:16.307 04:17:06 -- scripts/common.sh@336 -- # IFS=.-: 00:15:16.307 04:17:06 -- scripts/common.sh@336 -- # read -ra ver2 00:15:16.307 04:17:06 -- scripts/common.sh@337 -- # local 'op=<' 00:15:16.307 04:17:06 -- scripts/common.sh@339 -- # ver1_l=2 00:15:16.307 04:17:06 -- scripts/common.sh@340 -- # ver2_l=1 00:15:16.307 04:17:06 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:16.307 04:17:06 -- scripts/common.sh@343 -- # case "$op" in 00:15:16.307 04:17:06 -- scripts/common.sh@344 -- # : 1 00:15:16.307 04:17:06 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:16.307 04:17:06 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:16.307 04:17:06 -- scripts/common.sh@364 -- # decimal 1 00:15:16.307 04:17:06 -- scripts/common.sh@352 -- # local d=1 00:15:16.307 04:17:06 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:16.307 04:17:06 -- scripts/common.sh@354 -- # echo 1 00:15:16.307 04:17:06 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:16.307 04:17:06 -- scripts/common.sh@365 -- # decimal 2 00:15:16.307 04:17:06 -- scripts/common.sh@352 -- # local d=2 00:15:16.307 04:17:06 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:16.307 04:17:06 -- scripts/common.sh@354 -- # echo 2 00:15:16.307 04:17:06 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:16.307 04:17:06 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:16.307 04:17:06 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:16.307 04:17:06 -- scripts/common.sh@367 -- # return 0 00:15:16.307 04:17:06 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:16.307 04:17:06 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:16.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.307 --rc genhtml_branch_coverage=1 00:15:16.307 --rc genhtml_function_coverage=1 00:15:16.307 --rc genhtml_legend=1 00:15:16.307 --rc geninfo_all_blocks=1 00:15:16.307 --rc geninfo_unexecuted_blocks=1 00:15:16.307 00:15:16.307 ' 00:15:16.307 04:17:06 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:16.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.307 --rc genhtml_branch_coverage=1 00:15:16.307 --rc genhtml_function_coverage=1 00:15:16.307 --rc genhtml_legend=1 00:15:16.307 --rc geninfo_all_blocks=1 00:15:16.307 --rc geninfo_unexecuted_blocks=1 00:15:16.307 00:15:16.307 ' 00:15:16.307 04:17:06 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:16.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.307 --rc genhtml_branch_coverage=1 00:15:16.307 --rc genhtml_function_coverage=1 00:15:16.307 --rc genhtml_legend=1 00:15:16.307 --rc geninfo_all_blocks=1 00:15:16.307 --rc geninfo_unexecuted_blocks=1 00:15:16.307 00:15:16.307 ' 00:15:16.307 04:17:06 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:16.307 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:16.307 --rc genhtml_branch_coverage=1 00:15:16.307 --rc genhtml_function_coverage=1 00:15:16.307 --rc genhtml_legend=1 00:15:16.307 --rc geninfo_all_blocks=1 00:15:16.307 --rc geninfo_unexecuted_blocks=1 00:15:16.307 00:15:16.307 ' 00:15:16.307 04:17:06 -- target/nvme_cli.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:16.307 04:17:06 -- nvmf/common.sh@7 -- # uname -s 00:15:16.307 04:17:06 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:16.307 04:17:06 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:16.307 04:17:06 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:16.307 04:17:06 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:16.307 04:17:06 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:16.307 04:17:06 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:16.307 04:17:06 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:16.307 04:17:06 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:16.307 04:17:06 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:16.307 04:17:06 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:16.307 04:17:06 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:16.307 04:17:06 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:16.307 04:17:06 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:16.307 04:17:06 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:16.307 04:17:06 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:16.307 04:17:06 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:16.307 04:17:06 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:16.307 04:17:06 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:16.307 04:17:06 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:16.307 04:17:06 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.307 04:17:06 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.307 04:17:06 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.307 04:17:06 -- paths/export.sh@5 -- # export PATH 00:15:16.307 04:17:06 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:16.307 04:17:06 -- nvmf/common.sh@46 -- # : 0 00:15:16.307 04:17:06 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:16.307 04:17:06 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:16.307 04:17:06 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:16.307 04:17:06 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:16.307 04:17:06 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:16.307 04:17:06 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:16.307 04:17:06 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:16.307 04:17:06 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:16.307 04:17:06 -- target/nvme_cli.sh@11 -- # MALLOC_BDEV_SIZE=64 00:15:16.307 04:17:06 -- target/nvme_cli.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:15:16.307 04:17:06 -- target/nvme_cli.sh@14 -- # devs=() 00:15:16.307 04:17:06 -- target/nvme_cli.sh@16 -- # nvmftestinit 00:15:16.307 04:17:06 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:15:16.307 04:17:06 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:15:16.307 04:17:06 -- nvmf/common.sh@436 -- # prepare_net_devs 00:15:16.307 04:17:06 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:15:16.307 04:17:06 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:15:16.307 04:17:06 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:16.307 04:17:06 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:16.307 04:17:06 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:16.307 04:17:06 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:15:16.307 04:17:06 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:15:16.307 04:17:06 -- nvmf/common.sh@284 -- # xtrace_disable 00:15:16.307 04:17:06 -- common/autotest_common.sh@10 -- # set +x 00:15:18.208 04:17:08 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:15:18.208 04:17:08 -- nvmf/common.sh@290 -- # pci_devs=() 00:15:18.208 04:17:08 -- nvmf/common.sh@290 -- # local -a pci_devs 00:15:18.208 04:17:08 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:15:18.208 04:17:08 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:15:18.208 04:17:08 -- nvmf/common.sh@292 -- # pci_drivers=() 00:15:18.208 04:17:08 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:15:18.208 04:17:08 -- nvmf/common.sh@294 -- # net_devs=() 00:15:18.208 04:17:08 -- nvmf/common.sh@294 -- # local -ga net_devs 00:15:18.208 04:17:08 -- nvmf/common.sh@295 -- # e810=() 00:15:18.208 04:17:08 -- nvmf/common.sh@295 -- # local -ga e810 00:15:18.208 04:17:08 -- nvmf/common.sh@296 -- # x722=() 00:15:18.208 04:17:08 -- nvmf/common.sh@296 -- # local -ga x722 00:15:18.208 04:17:08 -- nvmf/common.sh@297 -- # mlx=() 00:15:18.208 04:17:08 -- nvmf/common.sh@297 -- # local -ga mlx 00:15:18.208 04:17:08 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:15:18.208 04:17:08 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:15:18.208 04:17:08 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:15:18.208 04:17:08 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:15:18.208 04:17:08 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:15:18.208 04:17:08 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:15:18.208 04:17:08 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:15:18.208 04:17:08 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:15:18.208 04:17:08 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:15:18.209 04:17:08 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:15:18.209 04:17:08 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:15:18.209 04:17:08 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:15:18.209 04:17:08 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:15:18.209 04:17:08 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:15:18.209 04:17:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:18.209 04:17:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:15:18.209 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:15:18.209 04:17:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:15:18.209 04:17:08 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:15:18.209 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:15:18.209 04:17:08 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:15:18.209 04:17:08 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:18.209 04:17:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:18.209 04:17:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:18.209 04:17:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:18.209 04:17:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:15:18.209 Found net devices under 0000:0a:00.0: cvl_0_0 00:15:18.209 04:17:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:18.209 04:17:08 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:15:18.209 04:17:08 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:15:18.209 04:17:08 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:15:18.209 04:17:08 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:15:18.209 04:17:08 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:15:18.209 Found net devices under 0000:0a:00.1: cvl_0_1 00:15:18.209 04:17:08 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:15:18.209 04:17:08 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:15:18.209 04:17:08 -- nvmf/common.sh@402 -- # is_hw=yes 00:15:18.209 04:17:08 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:15:18.209 04:17:08 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:15:18.209 04:17:08 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:15:18.209 04:17:08 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:15:18.209 04:17:08 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:15:18.209 04:17:08 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:15:18.209 04:17:08 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:15:18.209 04:17:08 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:15:18.209 04:17:08 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:15:18.209 04:17:08 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:15:18.209 04:17:08 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:15:18.209 04:17:08 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:15:18.209 04:17:08 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:15:18.209 04:17:08 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:15:18.209 04:17:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:15:18.209 04:17:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:15:18.209 04:17:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:15:18.209 04:17:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:15:18.209 04:17:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:15:18.209 04:17:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:15:18.209 04:17:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:15:18.209 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:15:18.209 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.265 ms 00:15:18.209 00:15:18.209 --- 10.0.0.2 ping statistics --- 00:15:18.209 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:18.209 rtt min/avg/max/mdev = 0.265/0.265/0.265/0.000 ms 00:15:18.209 04:17:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:15:18.209 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:15:18.209 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.125 ms 00:15:18.209 00:15:18.209 --- 10.0.0.1 ping statistics --- 00:15:18.209 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:15:18.209 rtt min/avg/max/mdev = 0.125/0.125/0.125/0.000 ms 00:15:18.209 04:17:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:15:18.209 04:17:08 -- nvmf/common.sh@410 -- # return 0 00:15:18.209 04:17:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:15:18.209 04:17:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:15:18.209 04:17:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:15:18.209 04:17:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:15:18.209 04:17:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:15:18.209 04:17:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:15:18.209 04:17:08 -- target/nvme_cli.sh@17 -- # nvmfappstart -m 0xF 00:15:18.209 04:17:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:15:18.209 04:17:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:15:18.209 04:17:08 -- common/autotest_common.sh@10 -- # set +x 00:15:18.209 04:17:08 -- nvmf/common.sh@469 -- # nvmfpid=2333536 00:15:18.209 04:17:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:15:18.209 04:17:08 -- nvmf/common.sh@470 -- # waitforlisten 2333536 00:15:18.209 04:17:08 -- common/autotest_common.sh@829 -- # '[' -z 2333536 ']' 00:15:18.209 04:17:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:18.209 04:17:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:18.209 04:17:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:18.209 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:18.209 04:17:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:18.209 04:17:08 -- common/autotest_common.sh@10 -- # set +x 00:15:18.209 [2024-11-30 04:17:08.780655] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:18.209 [2024-11-30 04:17:08.780738] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:18.209 EAL: No free 2048 kB hugepages reported on node 1 00:15:18.468 [2024-11-30 04:17:08.849801] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:18.468 [2024-11-30 04:17:08.939527] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:18.468 [2024-11-30 04:17:08.939698] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:18.468 [2024-11-30 04:17:08.939717] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:18.468 [2024-11-30 04:17:08.939732] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:18.468 [2024-11-30 04:17:08.939817] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:18.468 [2024-11-30 04:17:08.939884] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:18.468 [2024-11-30 04:17:08.939928] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:18.468 [2024-11-30 04:17:08.939930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:19.403 04:17:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:19.403 04:17:09 -- common/autotest_common.sh@862 -- # return 0 00:15:19.403 04:17:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:15:19.403 04:17:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:15:19.403 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:15:19.403 04:17:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:15:19.403 04:17:09 -- target/nvme_cli.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:15:19.403 04:17:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:19.403 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:15:19.403 [2024-11-30 04:17:09.778685] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:15:19.403 04:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:19.403 04:17:09 -- target/nvme_cli.sh@21 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:15:19.403 04:17:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:19.403 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:15:19.403 Malloc0 00:15:19.403 04:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:19.403 04:17:09 -- target/nvme_cli.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:15:19.403 04:17:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:19.403 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:15:19.403 Malloc1 00:15:19.403 04:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:19.403 04:17:09 -- target/nvme_cli.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME -d SPDK_Controller1 -i 291 00:15:19.403 04:17:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:19.403 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:15:19.403 04:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:19.403 04:17:09 -- target/nvme_cli.sh@25 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:15:19.403 04:17:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:19.403 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:15:19.403 04:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:19.403 04:17:09 -- target/nvme_cli.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:15:19.403 04:17:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:19.403 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:15:19.403 04:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:19.403 04:17:09 -- target/nvme_cli.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:15:19.403 04:17:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:19.403 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:15:19.403 [2024-11-30 04:17:09.860143] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:15:19.403 04:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:19.403 04:17:09 -- target/nvme_cli.sh@28 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:15:19.403 04:17:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:19.403 04:17:09 -- common/autotest_common.sh@10 -- # set +x 00:15:19.403 04:17:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:19.403 04:17:09 -- target/nvme_cli.sh@30 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -a 10.0.0.2 -s 4420 00:15:19.661 00:15:19.661 Discovery Log Number of Records 2, Generation counter 2 00:15:19.661 =====Discovery Log Entry 0====== 00:15:19.661 trtype: tcp 00:15:19.661 adrfam: ipv4 00:15:19.661 subtype: current discovery subsystem 00:15:19.661 treq: not required 00:15:19.661 portid: 0 00:15:19.661 trsvcid: 4420 00:15:19.661 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:15:19.661 traddr: 10.0.0.2 00:15:19.661 eflags: explicit discovery connections, duplicate discovery information 00:15:19.661 sectype: none 00:15:19.661 =====Discovery Log Entry 1====== 00:15:19.661 trtype: tcp 00:15:19.661 adrfam: ipv4 00:15:19.661 subtype: nvme subsystem 00:15:19.661 treq: not required 00:15:19.661 portid: 0 00:15:19.661 trsvcid: 4420 00:15:19.661 subnqn: nqn.2016-06.io.spdk:cnode1 00:15:19.661 traddr: 10.0.0.2 00:15:19.661 eflags: none 00:15:19.661 sectype: none 00:15:19.661 04:17:10 -- target/nvme_cli.sh@31 -- # devs=($(get_nvme_devs)) 00:15:19.661 04:17:10 -- target/nvme_cli.sh@31 -- # get_nvme_devs 00:15:19.661 04:17:10 -- nvmf/common.sh@510 -- # local dev _ 00:15:19.661 04:17:10 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:19.661 04:17:10 -- nvmf/common.sh@509 -- # nvme list 00:15:19.661 04:17:10 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:19.661 04:17:10 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:19.661 04:17:10 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:19.661 04:17:10 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:19.661 04:17:10 -- target/nvme_cli.sh@31 -- # nvme_num_before_connection=0 00:15:19.661 04:17:10 -- target/nvme_cli.sh@32 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:15:20.227 04:17:10 -- target/nvme_cli.sh@34 -- # waitforserial SPDKISFASTANDAWESOME 2 00:15:20.228 04:17:10 -- common/autotest_common.sh@1187 -- # local i=0 00:15:20.228 04:17:10 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:15:20.228 04:17:10 -- common/autotest_common.sh@1189 -- # [[ -n 2 ]] 00:15:20.228 04:17:10 -- common/autotest_common.sh@1190 -- # nvme_device_counter=2 00:15:20.228 04:17:10 -- common/autotest_common.sh@1194 -- # sleep 2 00:15:22.127 04:17:12 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:15:22.127 04:17:12 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:15:22.127 04:17:12 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:15:22.127 04:17:12 -- common/autotest_common.sh@1196 -- # nvme_devices=2 00:15:22.127 04:17:12 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:15:22.127 04:17:12 -- common/autotest_common.sh@1197 -- # return 0 00:15:22.127 04:17:12 -- target/nvme_cli.sh@35 -- # get_nvme_devs 00:15:22.127 04:17:12 -- nvmf/common.sh@510 -- # local dev _ 00:15:22.127 04:17:12 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.127 04:17:12 -- nvmf/common.sh@509 -- # nvme list 00:15:22.127 04:17:12 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:22.127 04:17:12 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.127 04:17:12 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:22.127 04:17:12 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.127 04:17:12 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:22.127 04:17:12 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:22.127 04:17:12 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.127 04:17:12 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:22.127 04:17:12 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:22.127 04:17:12 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.127 04:17:12 -- target/nvme_cli.sh@35 -- # [[ -z /dev/nvme0n1 00:15:22.127 /dev/nvme0n2 ]] 00:15:22.127 04:17:12 -- target/nvme_cli.sh@59 -- # devs=($(get_nvme_devs)) 00:15:22.127 04:17:12 -- target/nvme_cli.sh@59 -- # get_nvme_devs 00:15:22.127 04:17:12 -- nvmf/common.sh@510 -- # local dev _ 00:15:22.127 04:17:12 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.127 04:17:12 -- nvmf/common.sh@509 -- # nvme list 00:15:22.128 04:17:12 -- nvmf/common.sh@513 -- # [[ Node == /dev/nvme* ]] 00:15:22.128 04:17:12 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.128 04:17:12 -- nvmf/common.sh@513 -- # [[ --------------------- == /dev/nvme* ]] 00:15:22.128 04:17:12 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.128 04:17:12 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n1 == /dev/nvme* ]] 00:15:22.128 04:17:12 -- nvmf/common.sh@514 -- # echo /dev/nvme0n1 00:15:22.128 04:17:12 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.128 04:17:12 -- nvmf/common.sh@513 -- # [[ /dev/nvme0n2 == /dev/nvme* ]] 00:15:22.128 04:17:12 -- nvmf/common.sh@514 -- # echo /dev/nvme0n2 00:15:22.128 04:17:12 -- nvmf/common.sh@512 -- # read -r dev _ 00:15:22.128 04:17:12 -- target/nvme_cli.sh@59 -- # nvme_num=2 00:15:22.128 04:17:12 -- target/nvme_cli.sh@60 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:15:22.386 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:15:22.386 04:17:12 -- target/nvme_cli.sh@61 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:15:22.386 04:17:12 -- common/autotest_common.sh@1208 -- # local i=0 00:15:22.386 04:17:12 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:15:22.386 04:17:12 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:22.386 04:17:12 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:15:22.386 04:17:12 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:15:22.386 04:17:12 -- common/autotest_common.sh@1220 -- # return 0 00:15:22.386 04:17:12 -- target/nvme_cli.sh@62 -- # (( nvme_num <= nvme_num_before_connection )) 00:15:22.386 04:17:12 -- target/nvme_cli.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:15:22.386 04:17:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:15:22.386 04:17:12 -- common/autotest_common.sh@10 -- # set +x 00:15:22.386 04:17:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:15:22.386 04:17:12 -- target/nvme_cli.sh@68 -- # trap - SIGINT SIGTERM EXIT 00:15:22.386 04:17:12 -- target/nvme_cli.sh@70 -- # nvmftestfini 00:15:22.386 04:17:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:15:22.386 04:17:12 -- nvmf/common.sh@116 -- # sync 00:15:22.386 04:17:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:15:22.386 04:17:12 -- nvmf/common.sh@119 -- # set +e 00:15:22.386 04:17:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:15:22.386 04:17:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:15:22.386 rmmod nvme_tcp 00:15:22.386 rmmod nvme_fabrics 00:15:22.386 rmmod nvme_keyring 00:15:22.386 04:17:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:15:22.386 04:17:12 -- nvmf/common.sh@123 -- # set -e 00:15:22.386 04:17:12 -- nvmf/common.sh@124 -- # return 0 00:15:22.386 04:17:12 -- nvmf/common.sh@477 -- # '[' -n 2333536 ']' 00:15:22.386 04:17:12 -- nvmf/common.sh@478 -- # killprocess 2333536 00:15:22.386 04:17:12 -- common/autotest_common.sh@936 -- # '[' -z 2333536 ']' 00:15:22.386 04:17:12 -- common/autotest_common.sh@940 -- # kill -0 2333536 00:15:22.386 04:17:12 -- common/autotest_common.sh@941 -- # uname 00:15:22.386 04:17:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:15:22.386 04:17:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2333536 00:15:22.386 04:17:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:15:22.386 04:17:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:15:22.386 04:17:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2333536' 00:15:22.386 killing process with pid 2333536 00:15:22.386 04:17:12 -- common/autotest_common.sh@955 -- # kill 2333536 00:15:22.386 04:17:12 -- common/autotest_common.sh@960 -- # wait 2333536 00:15:22.645 04:17:13 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:15:22.645 04:17:13 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:15:22.645 04:17:13 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:15:22.645 04:17:13 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:15:22.645 04:17:13 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:15:22.645 04:17:13 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:15:22.645 04:17:13 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:15:22.645 04:17:13 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:15:25.180 04:17:15 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:15:25.180 00:15:25.180 real 0m8.887s 00:15:25.180 user 0m17.726s 00:15:25.180 sys 0m2.312s 00:15:25.180 04:17:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:15:25.180 04:17:15 -- common/autotest_common.sh@10 -- # set +x 00:15:25.180 ************************************ 00:15:25.180 END TEST nvmf_nvme_cli 00:15:25.180 ************************************ 00:15:25.180 04:17:15 -- nvmf/nvmf.sh@39 -- # [[ 1 -eq 1 ]] 00:15:25.180 04:17:15 -- nvmf/nvmf.sh@40 -- # run_test nvmf_vfio_user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:25.180 04:17:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:15:25.180 04:17:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:15:25.180 04:17:15 -- common/autotest_common.sh@10 -- # set +x 00:15:25.180 ************************************ 00:15:25.180 START TEST nvmf_vfio_user 00:15:25.180 ************************************ 00:15:25.180 04:17:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_vfio_user.sh --transport=tcp 00:15:25.180 * Looking for test storage... 00:15:25.180 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:15:25.180 04:17:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:15:25.180 04:17:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:15:25.180 04:17:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:15:25.180 04:17:15 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:15:25.180 04:17:15 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:15:25.180 04:17:15 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:15:25.180 04:17:15 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:15:25.180 04:17:15 -- scripts/common.sh@335 -- # IFS=.-: 00:15:25.180 04:17:15 -- scripts/common.sh@335 -- # read -ra ver1 00:15:25.180 04:17:15 -- scripts/common.sh@336 -- # IFS=.-: 00:15:25.180 04:17:15 -- scripts/common.sh@336 -- # read -ra ver2 00:15:25.180 04:17:15 -- scripts/common.sh@337 -- # local 'op=<' 00:15:25.180 04:17:15 -- scripts/common.sh@339 -- # ver1_l=2 00:15:25.180 04:17:15 -- scripts/common.sh@340 -- # ver2_l=1 00:15:25.180 04:17:15 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:15:25.180 04:17:15 -- scripts/common.sh@343 -- # case "$op" in 00:15:25.180 04:17:15 -- scripts/common.sh@344 -- # : 1 00:15:25.180 04:17:15 -- scripts/common.sh@363 -- # (( v = 0 )) 00:15:25.180 04:17:15 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:15:25.180 04:17:15 -- scripts/common.sh@364 -- # decimal 1 00:15:25.180 04:17:15 -- scripts/common.sh@352 -- # local d=1 00:15:25.180 04:17:15 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:15:25.180 04:17:15 -- scripts/common.sh@354 -- # echo 1 00:15:25.180 04:17:15 -- scripts/common.sh@364 -- # ver1[v]=1 00:15:25.180 04:17:15 -- scripts/common.sh@365 -- # decimal 2 00:15:25.180 04:17:15 -- scripts/common.sh@352 -- # local d=2 00:15:25.180 04:17:15 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:15:25.180 04:17:15 -- scripts/common.sh@354 -- # echo 2 00:15:25.180 04:17:15 -- scripts/common.sh@365 -- # ver2[v]=2 00:15:25.180 04:17:15 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:15:25.180 04:17:15 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:15:25.180 04:17:15 -- scripts/common.sh@367 -- # return 0 00:15:25.181 04:17:15 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:15:25.181 04:17:15 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:15:25.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.181 --rc genhtml_branch_coverage=1 00:15:25.181 --rc genhtml_function_coverage=1 00:15:25.181 --rc genhtml_legend=1 00:15:25.181 --rc geninfo_all_blocks=1 00:15:25.181 --rc geninfo_unexecuted_blocks=1 00:15:25.181 00:15:25.181 ' 00:15:25.181 04:17:15 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:15:25.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.181 --rc genhtml_branch_coverage=1 00:15:25.181 --rc genhtml_function_coverage=1 00:15:25.181 --rc genhtml_legend=1 00:15:25.181 --rc geninfo_all_blocks=1 00:15:25.181 --rc geninfo_unexecuted_blocks=1 00:15:25.181 00:15:25.181 ' 00:15:25.181 04:17:15 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:15:25.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.181 --rc genhtml_branch_coverage=1 00:15:25.181 --rc genhtml_function_coverage=1 00:15:25.181 --rc genhtml_legend=1 00:15:25.181 --rc geninfo_all_blocks=1 00:15:25.181 --rc geninfo_unexecuted_blocks=1 00:15:25.181 00:15:25.181 ' 00:15:25.181 04:17:15 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:15:25.181 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:15:25.181 --rc genhtml_branch_coverage=1 00:15:25.181 --rc genhtml_function_coverage=1 00:15:25.181 --rc genhtml_legend=1 00:15:25.181 --rc geninfo_all_blocks=1 00:15:25.181 --rc geninfo_unexecuted_blocks=1 00:15:25.181 00:15:25.181 ' 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:15:25.181 04:17:15 -- nvmf/common.sh@7 -- # uname -s 00:15:25.181 04:17:15 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:15:25.181 04:17:15 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:15:25.181 04:17:15 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:15:25.181 04:17:15 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:15:25.181 04:17:15 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:15:25.181 04:17:15 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:15:25.181 04:17:15 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:15:25.181 04:17:15 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:15:25.181 04:17:15 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:15:25.181 04:17:15 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:15:25.181 04:17:15 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:15:25.181 04:17:15 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:15:25.181 04:17:15 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:15:25.181 04:17:15 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:15:25.181 04:17:15 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:15:25.181 04:17:15 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:15:25.181 04:17:15 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:15:25.181 04:17:15 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:15:25.181 04:17:15 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:15:25.181 04:17:15 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.181 04:17:15 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.181 04:17:15 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.181 04:17:15 -- paths/export.sh@5 -- # export PATH 00:15:25.181 04:17:15 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:15:25.181 04:17:15 -- nvmf/common.sh@46 -- # : 0 00:15:25.181 04:17:15 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:15:25.181 04:17:15 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:15:25.181 04:17:15 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:15:25.181 04:17:15 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:15:25.181 04:17:15 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:15:25.181 04:17:15 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:15:25.181 04:17:15 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:15:25.181 04:17:15 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@12 -- # MALLOC_BDEV_SIZE=64 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@14 -- # NUM_DEVICES=2 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@47 -- # rm -rf /var/run/vfio-user 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@103 -- # setup_nvmf_vfio_user '' '' 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args= 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@52 -- # local transport_args= 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2334488 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2334488' 00:15:25.181 Process pid: 2334488 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:15:25.181 04:17:15 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2334488 00:15:25.181 04:17:15 -- common/autotest_common.sh@829 -- # '[' -z 2334488 ']' 00:15:25.181 04:17:15 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:15:25.181 04:17:15 -- common/autotest_common.sh@834 -- # local max_retries=100 00:15:25.181 04:17:15 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:15:25.181 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:15:25.181 04:17:15 -- common/autotest_common.sh@838 -- # xtrace_disable 00:15:25.181 04:17:15 -- common/autotest_common.sh@10 -- # set +x 00:15:25.181 [2024-11-30 04:17:15.463827] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:25.181 [2024-11-30 04:17:15.463908] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:15:25.181 EAL: No free 2048 kB hugepages reported on node 1 00:15:25.181 [2024-11-30 04:17:15.522803] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:15:25.181 [2024-11-30 04:17:15.606647] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:15:25.181 [2024-11-30 04:17:15.606814] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:15:25.181 [2024-11-30 04:17:15.606832] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:15:25.181 [2024-11-30 04:17:15.606845] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:15:25.181 [2024-11-30 04:17:15.606896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:15:25.181 [2024-11-30 04:17:15.606920] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:15:25.181 [2024-11-30 04:17:15.606949] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:15:25.181 [2024-11-30 04:17:15.606951] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:15:26.115 04:17:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:15:26.115 04:17:16 -- common/autotest_common.sh@862 -- # return 0 00:15:26.115 04:17:16 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:15:27.048 04:17:17 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER 00:15:27.307 04:17:17 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:15:27.307 04:17:17 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:15:27.307 04:17:17 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:27.307 04:17:17 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:15:27.307 04:17:17 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:15:27.565 Malloc1 00:15:27.566 04:17:18 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:15:27.824 04:17:18 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:15:28.082 04:17:18 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:15:28.339 04:17:18 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:28.339 04:17:18 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:15:28.339 04:17:18 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:15:28.608 Malloc2 00:15:28.608 04:17:19 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:15:28.909 04:17:19 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:15:29.185 04:17:19 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:15:29.444 04:17:19 -- target/nvmf_vfio_user.sh@104 -- # run_nvmf_vfio_user 00:15:29.445 04:17:19 -- target/nvmf_vfio_user.sh@80 -- # seq 1 2 00:15:29.445 04:17:19 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:29.445 04:17:19 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:29.445 04:17:19 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode1 00:15:29.445 04:17:19 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:29.445 [2024-11-30 04:17:19.872081] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:29.445 [2024-11-30 04:17:19.872119] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2335057 ] 00:15:29.445 EAL: No free 2048 kB hugepages reported on node 1 00:15:29.445 [2024-11-30 04:17:19.905566] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user1/1 00:15:29.445 [2024-11-30 04:17:19.914381] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:29.445 [2024-11-30 04:17:19.914409] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f99258d7000 00:15:29.445 [2024-11-30 04:17:19.915375] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:29.445 [2024-11-30 04:17:19.916370] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:29.445 [2024-11-30 04:17:19.917374] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:29.445 [2024-11-30 04:17:19.918383] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:29.445 [2024-11-30 04:17:19.919386] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:29.445 [2024-11-30 04:17:19.920390] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:29.445 [2024-11-30 04:17:19.921400] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:29.445 [2024-11-30 04:17:19.922405] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:29.445 [2024-11-30 04:17:19.923414] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:29.445 [2024-11-30 04:17:19.923434] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f99245cf000 00:15:29.445 [2024-11-30 04:17:19.924562] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:29.445 [2024-11-30 04:17:19.939741] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user1/1/cntrl Setup Successfully 00:15:29.445 [2024-11-30 04:17:19.939776] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to connect adminq (no timeout) 00:15:29.445 [2024-11-30 04:17:19.944571] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:29.445 [2024-11-30 04:17:19.944623] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:29.445 [2024-11-30 04:17:19.944720] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for connect adminq (no timeout) 00:15:29.445 [2024-11-30 04:17:19.944754] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs (no timeout) 00:15:29.445 [2024-11-30 04:17:19.944765] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read vs wait for vs (no timeout) 00:15:29.445 [2024-11-30 04:17:19.945565] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x8, value 0x10300 00:15:29.445 [2024-11-30 04:17:19.945584] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap (no timeout) 00:15:29.445 [2024-11-30 04:17:19.945597] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to read cap wait for cap (no timeout) 00:15:29.445 [2024-11-30 04:17:19.946569] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x0, value 0x201e0100ff 00:15:29.445 [2024-11-30 04:17:19.946588] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en (no timeout) 00:15:29.445 [2024-11-30 04:17:19.946602] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to check en wait for cc (timeout 15000 ms) 00:15:29.445 [2024-11-30 04:17:19.947572] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x0 00:15:29.445 [2024-11-30 04:17:19.947590] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:29.445 [2024-11-30 04:17:19.948577] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x0 00:15:29.445 [2024-11-30 04:17:19.948597] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 0 && CSTS.RDY = 0 00:15:29.445 [2024-11-30 04:17:19.948606] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to controller is disabled (timeout 15000 ms) 00:15:29.445 [2024-11-30 04:17:19.948617] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:29.445 [2024-11-30 04:17:19.948726] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Setting CC.EN = 1 00:15:29.445 [2024-11-30 04:17:19.948739] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:29.445 [2024-11-30 04:17:19.948748] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x28, value 0x2000003c0000 00:15:29.445 [2024-11-30 04:17:19.949582] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x30, value 0x2000003be000 00:15:29.445 [2024-11-30 04:17:19.950588] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x24, value 0xff00ff 00:15:29.445 [2024-11-30 04:17:19.953565] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:29.445 [2024-11-30 04:17:19.953649] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:29.445 [2024-11-30 04:17:19.954621] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x1 00:15:29.445 [2024-11-30 04:17:19.954638] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:29.445 [2024-11-30 04:17:19.954647] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to reset admin queue (timeout 30000 ms) 00:15:29.445 [2024-11-30 04:17:19.954671] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller (no timeout) 00:15:29.445 [2024-11-30 04:17:19.954685] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify controller (timeout 30000 ms) 00:15:29.445 [2024-11-30 04:17:19.954707] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:29.445 [2024-11-30 04:17:19.954717] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:29.445 [2024-11-30 04:17:19.954735] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:29.445 [2024-11-30 04:17:19.954811] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:29.445 [2024-11-30 04:17:19.954826] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_xfer_size 131072 00:15:29.445 [2024-11-30 04:17:19.954834] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] MDTS max_xfer_size 131072 00:15:29.445 [2024-11-30 04:17:19.954841] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] CNTLID 0x0001 00:15:29.445 [2024-11-30 04:17:19.954848] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:29.445 [2024-11-30 04:17:19.954856] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] transport max_sges 1 00:15:29.445 [2024-11-30 04:17:19.954863] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] fuses compare and write: 1 00:15:29.445 [2024-11-30 04:17:19.954870] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to configure AER (timeout 30000 ms) 00:15:29.445 [2024-11-30 04:17:19.954886] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for configure aer (timeout 30000 ms) 00:15:29.445 [2024-11-30 04:17:19.954902] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:29.445 [2024-11-30 04:17:19.954919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:29.445 [2024-11-30 04:17:19.954964] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:29.445 [2024-11-30 04:17:19.954981] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:29.445 [2024-11-30 04:17:19.954994] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:29.445 [2024-11-30 04:17:19.955017] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:29.445 [2024-11-30 04:17:19.955026] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set keep alive timeout (timeout 30000 ms) 00:15:29.445 [2024-11-30 04:17:19.955041] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:29.445 [2024-11-30 04:17:19.955056] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:29.445 [2024-11-30 04:17:19.955069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:29.445 [2024-11-30 04:17:19.955079] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Controller adjusted keep alive timeout to 0 ms 00:15:29.445 [2024-11-30 04:17:19.955087] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:29.445 [2024-11-30 04:17:19.955098] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set number of queues (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955111] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for set number of queues (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955125] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955201] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify active ns (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955215] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify active ns (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955227] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:29.446 [2024-11-30 04:17:19.955236] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:29.446 [2024-11-30 04:17:19.955245] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955261] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955286] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Namespace 1 was added 00:15:29.446 [2024-11-30 04:17:19.955306] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955336] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify ns (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955348] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:29.446 [2024-11-30 04:17:19.955356] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:29.446 [2024-11-30 04:17:19.955366] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955417] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955431] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955443] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:29.446 [2024-11-30 04:17:19.955451] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:29.446 [2024-11-30 04:17:19.955460] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955484] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955495] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported log pages (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955508] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set supported features (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955518] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955526] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to set host ID (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955534] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] NVMe-oF transport - not sending Set Features - Host ID 00:15:29.446 [2024-11-30 04:17:19.955542] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to transport ready (timeout 30000 ms) 00:15:29.446 [2024-11-30 04:17:19.955550] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] setting state to ready (no timeout) 00:15:29.446 [2024-11-30 04:17:19.955575] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955612] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955625] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955641] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955669] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955698] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:29.446 [2024-11-30 04:17:19.955707] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:29.446 [2024-11-30 04:17:19.955717] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:29.446 [2024-11-30 04:17:19.955723] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:29.446 [2024-11-30 04:17:19.955732] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:29.446 [2024-11-30 04:17:19.955744] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:29.446 [2024-11-30 04:17:19.955752] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:29.446 [2024-11-30 04:17:19.955761] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955772] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:29.446 [2024-11-30 04:17:19.955779] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:29.446 [2024-11-30 04:17:19.955788] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955800] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:29.446 [2024-11-30 04:17:19.955808] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:29.446 [2024-11-30 04:17:19.955816] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:29.446 [2024-11-30 04:17:19.955828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:29.446 [2024-11-30 04:17:19.955876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:29.446 ===================================================== 00:15:29.446 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:29.446 ===================================================== 00:15:29.446 Controller Capabilities/Features 00:15:29.446 ================================ 00:15:29.446 Vendor ID: 4e58 00:15:29.446 Subsystem Vendor ID: 4e58 00:15:29.446 Serial Number: SPDK1 00:15:29.446 Model Number: SPDK bdev Controller 00:15:29.446 Firmware Version: 24.01.1 00:15:29.446 Recommended Arb Burst: 6 00:15:29.446 IEEE OUI Identifier: 8d 6b 50 00:15:29.446 Multi-path I/O 00:15:29.446 May have multiple subsystem ports: Yes 00:15:29.446 May have multiple controllers: Yes 00:15:29.446 Associated with SR-IOV VF: No 00:15:29.446 Max Data Transfer Size: 131072 00:15:29.446 Max Number of Namespaces: 32 00:15:29.446 Max Number of I/O Queues: 127 00:15:29.446 NVMe Specification Version (VS): 1.3 00:15:29.446 NVMe Specification Version (Identify): 1.3 00:15:29.446 Maximum Queue Entries: 256 00:15:29.446 Contiguous Queues Required: Yes 00:15:29.447 Arbitration Mechanisms Supported 00:15:29.447 Weighted Round Robin: Not Supported 00:15:29.447 Vendor Specific: Not Supported 00:15:29.447 Reset Timeout: 15000 ms 00:15:29.447 Doorbell Stride: 4 bytes 00:15:29.447 NVM Subsystem Reset: Not Supported 00:15:29.447 Command Sets Supported 00:15:29.447 NVM Command Set: Supported 00:15:29.447 Boot Partition: Not Supported 00:15:29.447 Memory Page Size Minimum: 4096 bytes 00:15:29.447 Memory Page Size Maximum: 4096 bytes 00:15:29.447 Persistent Memory Region: Not Supported 00:15:29.447 Optional Asynchronous Events Supported 00:15:29.447 Namespace Attribute Notices: Supported 00:15:29.447 Firmware Activation Notices: Not Supported 00:15:29.447 ANA Change Notices: Not Supported 00:15:29.447 PLE Aggregate Log Change Notices: Not Supported 00:15:29.447 LBA Status Info Alert Notices: Not Supported 00:15:29.447 EGE Aggregate Log Change Notices: Not Supported 00:15:29.447 Normal NVM Subsystem Shutdown event: Not Supported 00:15:29.447 Zone Descriptor Change Notices: Not Supported 00:15:29.447 Discovery Log Change Notices: Not Supported 00:15:29.447 Controller Attributes 00:15:29.447 128-bit Host Identifier: Supported 00:15:29.447 Non-Operational Permissive Mode: Not Supported 00:15:29.447 NVM Sets: Not Supported 00:15:29.447 Read Recovery Levels: Not Supported 00:15:29.447 Endurance Groups: Not Supported 00:15:29.447 Predictable Latency Mode: Not Supported 00:15:29.447 Traffic Based Keep ALive: Not Supported 00:15:29.447 Namespace Granularity: Not Supported 00:15:29.447 SQ Associations: Not Supported 00:15:29.447 UUID List: Not Supported 00:15:29.447 Multi-Domain Subsystem: Not Supported 00:15:29.447 Fixed Capacity Management: Not Supported 00:15:29.447 Variable Capacity Management: Not Supported 00:15:29.447 Delete Endurance Group: Not Supported 00:15:29.447 Delete NVM Set: Not Supported 00:15:29.447 Extended LBA Formats Supported: Not Supported 00:15:29.447 Flexible Data Placement Supported: Not Supported 00:15:29.447 00:15:29.447 Controller Memory Buffer Support 00:15:29.447 ================================ 00:15:29.447 Supported: No 00:15:29.447 00:15:29.447 Persistent Memory Region Support 00:15:29.447 ================================ 00:15:29.447 Supported: No 00:15:29.447 00:15:29.447 Admin Command Set Attributes 00:15:29.447 ============================ 00:15:29.447 Security Send/Receive: Not Supported 00:15:29.447 Format NVM: Not Supported 00:15:29.447 Firmware Activate/Download: Not Supported 00:15:29.447 Namespace Management: Not Supported 00:15:29.447 Device Self-Test: Not Supported 00:15:29.447 Directives: Not Supported 00:15:29.447 NVMe-MI: Not Supported 00:15:29.447 Virtualization Management: Not Supported 00:15:29.447 Doorbell Buffer Config: Not Supported 00:15:29.447 Get LBA Status Capability: Not Supported 00:15:29.447 Command & Feature Lockdown Capability: Not Supported 00:15:29.447 Abort Command Limit: 4 00:15:29.447 Async Event Request Limit: 4 00:15:29.447 Number of Firmware Slots: N/A 00:15:29.447 Firmware Slot 1 Read-Only: N/A 00:15:29.447 Firmware Activation Without Reset: N/A 00:15:29.447 Multiple Update Detection Support: N/A 00:15:29.447 Firmware Update Granularity: No Information Provided 00:15:29.447 Per-Namespace SMART Log: No 00:15:29.447 Asymmetric Namespace Access Log Page: Not Supported 00:15:29.447 Subsystem NQN: nqn.2019-07.io.spdk:cnode1 00:15:29.447 Command Effects Log Page: Supported 00:15:29.447 Get Log Page Extended Data: Supported 00:15:29.447 Telemetry Log Pages: Not Supported 00:15:29.447 Persistent Event Log Pages: Not Supported 00:15:29.447 Supported Log Pages Log Page: May Support 00:15:29.447 Commands Supported & Effects Log Page: Not Supported 00:15:29.447 Feature Identifiers & Effects Log Page:May Support 00:15:29.447 NVMe-MI Commands & Effects Log Page: May Support 00:15:29.447 Data Area 4 for Telemetry Log: Not Supported 00:15:29.447 Error Log Page Entries Supported: 128 00:15:29.447 Keep Alive: Supported 00:15:29.447 Keep Alive Granularity: 10000 ms 00:15:29.447 00:15:29.447 NVM Command Set Attributes 00:15:29.447 ========================== 00:15:29.447 Submission Queue Entry Size 00:15:29.447 Max: 64 00:15:29.447 Min: 64 00:15:29.447 Completion Queue Entry Size 00:15:29.447 Max: 16 00:15:29.447 Min: 16 00:15:29.447 Number of Namespaces: 32 00:15:29.447 Compare Command: Supported 00:15:29.447 Write Uncorrectable Command: Not Supported 00:15:29.447 Dataset Management Command: Supported 00:15:29.447 Write Zeroes Command: Supported 00:15:29.447 Set Features Save Field: Not Supported 00:15:29.447 Reservations: Not Supported 00:15:29.447 Timestamp: Not Supported 00:15:29.447 Copy: Supported 00:15:29.447 Volatile Write Cache: Present 00:15:29.447 Atomic Write Unit (Normal): 1 00:15:29.447 Atomic Write Unit (PFail): 1 00:15:29.447 Atomic Compare & Write Unit: 1 00:15:29.447 Fused Compare & Write: Supported 00:15:29.447 Scatter-Gather List 00:15:29.447 SGL Command Set: Supported (Dword aligned) 00:15:29.447 SGL Keyed: Not Supported 00:15:29.447 SGL Bit Bucket Descriptor: Not Supported 00:15:29.447 SGL Metadata Pointer: Not Supported 00:15:29.447 Oversized SGL: Not Supported 00:15:29.447 SGL Metadata Address: Not Supported 00:15:29.447 SGL Offset: Not Supported 00:15:29.447 Transport SGL Data Block: Not Supported 00:15:29.447 Replay Protected Memory Block: Not Supported 00:15:29.447 00:15:29.447 Firmware Slot Information 00:15:29.447 ========================= 00:15:29.447 Active slot: 1 00:15:29.447 Slot 1 Firmware Revision: 24.01.1 00:15:29.447 00:15:29.447 00:15:29.447 Commands Supported and Effects 00:15:29.447 ============================== 00:15:29.447 Admin Commands 00:15:29.447 -------------- 00:15:29.447 Get Log Page (02h): Supported 00:15:29.447 Identify (06h): Supported 00:15:29.447 Abort (08h): Supported 00:15:29.447 Set Features (09h): Supported 00:15:29.447 Get Features (0Ah): Supported 00:15:29.447 Asynchronous Event Request (0Ch): Supported 00:15:29.447 Keep Alive (18h): Supported 00:15:29.447 I/O Commands 00:15:29.447 ------------ 00:15:29.447 Flush (00h): Supported LBA-Change 00:15:29.447 Write (01h): Supported LBA-Change 00:15:29.447 Read (02h): Supported 00:15:29.447 Compare (05h): Supported 00:15:29.448 Write Zeroes (08h): Supported LBA-Change 00:15:29.448 Dataset Management (09h): Supported LBA-Change 00:15:29.448 Copy (19h): Supported LBA-Change 00:15:29.448 Unknown (79h): Supported LBA-Change 00:15:29.448 Unknown (7Ah): Supported 00:15:29.448 00:15:29.448 Error Log 00:15:29.448 ========= 00:15:29.448 00:15:29.448 Arbitration 00:15:29.448 =========== 00:15:29.448 Arbitration Burst: 1 00:15:29.448 00:15:29.448 Power Management 00:15:29.448 ================ 00:15:29.448 Number of Power States: 1 00:15:29.448 Current Power State: Power State #0 00:15:29.448 Power State #0: 00:15:29.448 Max Power: 0.00 W 00:15:29.448 Non-Operational State: Operational 00:15:29.448 Entry Latency: Not Reported 00:15:29.448 Exit Latency: Not Reported 00:15:29.448 Relative Read Throughput: 0 00:15:29.448 Relative Read Latency: 0 00:15:29.448 Relative Write Throughput: 0 00:15:29.448 Relative Write Latency: 0 00:15:29.448 Idle Power: Not Reported 00:15:29.448 Active Power: Not Reported 00:15:29.448 Non-Operational Permissive Mode: Not Supported 00:15:29.448 00:15:29.448 Health Information 00:15:29.448 ================== 00:15:29.448 Critical Warnings: 00:15:29.448 Available Spare Space: OK 00:15:29.448 Temperature: OK 00:15:29.448 Device Reliability: OK 00:15:29.448 Read Only: No 00:15:29.448 Volatile Memory Backup: OK 00:15:29.448 Current Temperature: 0 Kelvin[2024-11-30 04:17:19.956031] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:29.448 [2024-11-30 04:17:19.956049] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:29.448 [2024-11-30 04:17:19.956086] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] Prepare to destruct SSD 00:15:29.448 [2024-11-30 04:17:19.956104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:29.448 [2024-11-30 04:17:19.956115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:29.448 [2024-11-30 04:17:19.956124] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:29.448 [2024-11-30 04:17:19.956134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:29.448 [2024-11-30 04:17:19.956630] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x460001 00:15:29.448 [2024-11-30 04:17:19.956651] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x14, value 0x464001 00:15:29.448 [2024-11-30 04:17:19.957672] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] RTD3E = 0 us 00:15:29.448 [2024-11-30 04:17:19.957685] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown timeout = 10000 ms 00:15:29.448 [2024-11-30 04:17:19.958637] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user1/1: offset 0x1c, value 0x9 00:15:29.448 [2024-11-30 04:17:19.958663] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user1/1] shutdown complete in 0 milliseconds 00:15:29.448 [2024-11-30 04:17:19.958716] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user1/1/cntrl 00:15:29.448 [2024-11-30 04:17:19.962968] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:29.448 (-273 Celsius) 00:15:29.448 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:29.448 Available Spare: 0% 00:15:29.448 Available Spare Threshold: 0% 00:15:29.448 Life Percentage Used: 0% 00:15:29.448 Data Units Read: 0 00:15:29.448 Data Units Written: 0 00:15:29.448 Host Read Commands: 0 00:15:29.448 Host Write Commands: 0 00:15:29.448 Controller Busy Time: 0 minutes 00:15:29.448 Power Cycles: 0 00:15:29.448 Power On Hours: 0 hours 00:15:29.448 Unsafe Shutdowns: 0 00:15:29.448 Unrecoverable Media Errors: 0 00:15:29.448 Lifetime Error Log Entries: 0 00:15:29.448 Warning Temperature Time: 0 minutes 00:15:29.448 Critical Temperature Time: 0 minutes 00:15:29.448 00:15:29.448 Number of Queues 00:15:29.448 ================ 00:15:29.448 Number of I/O Submission Queues: 127 00:15:29.448 Number of I/O Completion Queues: 127 00:15:29.448 00:15:29.448 Active Namespaces 00:15:29.448 ================= 00:15:29.448 Namespace ID:1 00:15:29.448 Error Recovery Timeout: Unlimited 00:15:29.448 Command Set Identifier: NVM (00h) 00:15:29.448 Deallocate: Supported 00:15:29.448 Deallocated/Unwritten Error: Not Supported 00:15:29.448 Deallocated Read Value: Unknown 00:15:29.448 Deallocate in Write Zeroes: Not Supported 00:15:29.448 Deallocated Guard Field: 0xFFFF 00:15:29.448 Flush: Supported 00:15:29.448 Reservation: Supported 00:15:29.448 Namespace Sharing Capabilities: Multiple Controllers 00:15:29.448 Size (in LBAs): 131072 (0GiB) 00:15:29.448 Capacity (in LBAs): 131072 (0GiB) 00:15:29.448 Utilization (in LBAs): 131072 (0GiB) 00:15:29.448 NGUID: 2C45BC1DAC6E4216ACAF566D75F4348B 00:15:29.448 UUID: 2c45bc1d-ac6e-4216-acaf-566d75f4348b 00:15:29.448 Thin Provisioning: Not Supported 00:15:29.448 Per-NS Atomic Units: Yes 00:15:29.448 Atomic Boundary Size (Normal): 0 00:15:29.448 Atomic Boundary Size (PFail): 0 00:15:29.448 Atomic Boundary Offset: 0 00:15:29.448 Maximum Single Source Range Length: 65535 00:15:29.448 Maximum Copy Length: 65535 00:15:29.448 Maximum Source Range Count: 1 00:15:29.448 NGUID/EUI64 Never Reused: No 00:15:29.448 Namespace Write Protected: No 00:15:29.448 Number of LBA Formats: 1 00:15:29.448 Current LBA Format: LBA Format #00 00:15:29.448 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:29.448 00:15:29.448 04:17:20 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:29.448 EAL: No free 2048 kB hugepages reported on node 1 00:15:34.711 Initializing NVMe Controllers 00:15:34.711 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:34.711 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:34.711 Initialization complete. Launching workers. 00:15:34.711 ======================================================== 00:15:34.711 Latency(us) 00:15:34.711 Device Information : IOPS MiB/s Average min max 00:15:34.711 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 37358.43 145.93 3425.56 1132.22 8394.44 00:15:34.711 ======================================================== 00:15:34.711 Total : 37358.43 145.93 3425.56 1132.22 8394.44 00:15:34.711 00:15:34.711 04:17:25 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:34.711 EAL: No free 2048 kB hugepages reported on node 1 00:15:39.976 Initializing NVMe Controllers 00:15:39.976 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:39.976 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 with lcore 1 00:15:39.976 Initialization complete. Launching workers. 00:15:39.976 ======================================================== 00:15:39.976 Latency(us) 00:15:39.976 Device Information : IOPS MiB/s Average min max 00:15:39.976 VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) NSID 1 from core 1: 15937.29 62.26 8030.76 5959.21 15996.15 00:15:39.976 ======================================================== 00:15:39.976 Total : 15937.29 62.26 8030.76 5959.21 15996.15 00:15:39.976 00:15:39.976 04:17:30 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:15:39.976 EAL: No free 2048 kB hugepages reported on node 1 00:15:45.244 Initializing NVMe Controllers 00:15:45.244 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:45.244 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user1/1:: nqn.2019-07.io.spdk:cnode1 00:15:45.244 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 1 00:15:45.244 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 2 00:15:45.244 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user1/1) with lcore 3 00:15:45.244 Initialization complete. Launching workers. 00:15:45.244 Starting thread on core 2 00:15:45.244 Starting thread on core 3 00:15:45.244 Starting thread on core 1 00:15:45.244 04:17:35 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -d 256 -g 00:15:45.244 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.430 Initializing NVMe Controllers 00:15:49.430 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:49.430 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:49.430 Associating SPDK bdev Controller (SPDK1 ) with lcore 0 00:15:49.430 Associating SPDK bdev Controller (SPDK1 ) with lcore 1 00:15:49.430 Associating SPDK bdev Controller (SPDK1 ) with lcore 2 00:15:49.430 Associating SPDK bdev Controller (SPDK1 ) with lcore 3 00:15:49.430 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:15:49.430 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:15:49.430 Initialization complete. Launching workers. 00:15:49.430 Starting thread on core 1 with urgent priority queue 00:15:49.430 Starting thread on core 2 with urgent priority queue 00:15:49.430 Starting thread on core 3 with urgent priority queue 00:15:49.430 Starting thread on core 0 with urgent priority queue 00:15:49.430 SPDK bdev Controller (SPDK1 ) core 0: 5585.33 IO/s 17.90 secs/100000 ios 00:15:49.430 SPDK bdev Controller (SPDK1 ) core 1: 5398.33 IO/s 18.52 secs/100000 ios 00:15:49.430 SPDK bdev Controller (SPDK1 ) core 2: 5420.00 IO/s 18.45 secs/100000 ios 00:15:49.430 SPDK bdev Controller (SPDK1 ) core 3: 5628.33 IO/s 17.77 secs/100000 ios 00:15:49.430 ======================================================== 00:15:49.430 00:15:49.430 04:17:39 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:49.430 EAL: No free 2048 kB hugepages reported on node 1 00:15:49.430 Initializing NVMe Controllers 00:15:49.430 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:49.430 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:49.430 Namespace ID: 1 size: 0GB 00:15:49.430 Initialization complete. 00:15:49.430 INFO: using host memory buffer for IO 00:15:49.430 Hello world! 00:15:49.430 04:17:39 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' 00:15:49.430 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.364 Initializing NVMe Controllers 00:15:50.364 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:50.364 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:50.364 Initialization complete. Launching workers. 00:15:50.364 submit (in ns) avg, min, max = 8567.1, 3445.6, 4014390.0 00:15:50.364 complete (in ns) avg, min, max = 23969.6, 2043.3, 5013004.4 00:15:50.364 00:15:50.364 Submit histogram 00:15:50.364 ================ 00:15:50.364 Range in us Cumulative Count 00:15:50.364 3.437 - 3.461: 0.0072% ( 1) 00:15:50.364 3.461 - 3.484: 0.1809% ( 24) 00:15:50.364 3.484 - 3.508: 0.6730% ( 68) 00:15:50.364 3.508 - 3.532: 2.3229% ( 228) 00:15:50.364 3.532 - 3.556: 5.5648% ( 448) 00:15:50.364 3.556 - 3.579: 12.5624% ( 967) 00:15:50.364 3.579 - 3.603: 20.5225% ( 1100) 00:15:50.364 3.603 - 3.627: 29.2062% ( 1200) 00:15:50.364 3.627 - 3.650: 36.7320% ( 1040) 00:15:50.364 3.650 - 3.674: 42.8468% ( 845) 00:15:50.364 3.674 - 3.698: 48.1511% ( 733) 00:15:50.364 3.698 - 3.721: 52.9923% ( 669) 00:15:50.364 3.721 - 3.745: 57.2183% ( 584) 00:15:50.364 3.745 - 3.769: 60.9161% ( 511) 00:15:50.364 3.769 - 3.793: 65.1205% ( 581) 00:15:50.364 3.793 - 3.816: 69.2814% ( 575) 00:15:50.364 3.816 - 3.840: 74.2745% ( 690) 00:15:50.364 3.840 - 3.864: 78.7032% ( 612) 00:15:50.364 3.864 - 3.887: 81.9886% ( 454) 00:15:50.364 3.887 - 3.911: 84.4272% ( 337) 00:15:50.364 3.911 - 3.935: 86.2436% ( 251) 00:15:50.364 3.935 - 3.959: 87.8139% ( 217) 00:15:50.364 3.959 - 3.982: 89.1381% ( 183) 00:15:50.364 3.982 - 4.006: 90.5854% ( 200) 00:15:50.364 4.006 - 4.030: 91.5913% ( 139) 00:15:50.364 4.030 - 4.053: 92.7202% ( 156) 00:15:50.364 4.053 - 4.077: 93.8201% ( 152) 00:15:50.364 4.077 - 4.101: 94.6233% ( 111) 00:15:50.364 4.101 - 4.124: 95.1082% ( 67) 00:15:50.364 4.124 - 4.148: 95.4411% ( 46) 00:15:50.364 4.148 - 4.172: 95.6509% ( 29) 00:15:50.364 4.172 - 4.196: 95.8463% ( 27) 00:15:50.364 4.196 - 4.219: 96.0851% ( 33) 00:15:50.364 4.219 - 4.243: 96.2660% ( 25) 00:15:50.364 4.243 - 4.267: 96.3963% ( 18) 00:15:50.364 4.267 - 4.290: 96.4976% ( 14) 00:15:50.364 4.290 - 4.314: 96.6351% ( 19) 00:15:50.364 4.314 - 4.338: 96.7074% ( 10) 00:15:50.364 4.338 - 4.361: 96.8015% ( 13) 00:15:50.364 4.361 - 4.385: 96.8594% ( 8) 00:15:50.364 4.385 - 4.409: 96.8956% ( 5) 00:15:50.364 4.409 - 4.433: 96.9535% ( 8) 00:15:50.364 4.433 - 4.456: 97.0114% ( 8) 00:15:50.364 4.480 - 4.504: 97.0475% ( 5) 00:15:50.364 4.504 - 4.527: 97.0693% ( 3) 00:15:50.364 4.527 - 4.551: 97.1054% ( 5) 00:15:50.364 4.551 - 4.575: 97.1127% ( 1) 00:15:50.364 4.575 - 4.599: 97.1271% ( 2) 00:15:50.364 4.599 - 4.622: 97.1489% ( 3) 00:15:50.364 4.622 - 4.646: 97.1850% ( 5) 00:15:50.364 4.646 - 4.670: 97.2140% ( 4) 00:15:50.364 4.670 - 4.693: 97.2357% ( 3) 00:15:50.364 4.693 - 4.717: 97.2502% ( 2) 00:15:50.364 4.717 - 4.741: 97.2646% ( 2) 00:15:50.364 4.741 - 4.764: 97.3225% ( 8) 00:15:50.364 4.764 - 4.788: 97.3587% ( 5) 00:15:50.364 4.788 - 4.812: 97.4238% ( 9) 00:15:50.364 4.812 - 4.836: 97.4600% ( 5) 00:15:50.364 4.836 - 4.859: 97.5107% ( 7) 00:15:50.364 4.859 - 4.883: 97.5251% ( 2) 00:15:50.364 4.883 - 4.907: 97.5686% ( 6) 00:15:50.364 4.907 - 4.930: 97.6047% ( 5) 00:15:50.364 4.930 - 4.954: 97.6482% ( 6) 00:15:50.364 4.954 - 4.978: 97.6699% ( 3) 00:15:50.364 4.978 - 5.001: 97.7061% ( 5) 00:15:50.364 5.001 - 5.025: 97.7133% ( 1) 00:15:50.364 5.025 - 5.049: 97.7350% ( 3) 00:15:50.364 5.049 - 5.073: 97.7712% ( 5) 00:15:50.364 5.073 - 5.096: 97.7857% ( 2) 00:15:50.364 5.096 - 5.120: 97.8001% ( 2) 00:15:50.364 5.120 - 5.144: 97.8218% ( 3) 00:15:50.364 5.144 - 5.167: 97.8435% ( 3) 00:15:50.364 5.167 - 5.191: 97.8508% ( 1) 00:15:50.364 5.191 - 5.215: 97.8580% ( 1) 00:15:50.364 5.215 - 5.239: 97.8725% ( 2) 00:15:50.364 5.333 - 5.357: 97.8797% ( 1) 00:15:50.364 5.357 - 5.381: 97.8870% ( 1) 00:15:50.364 5.381 - 5.404: 97.8942% ( 1) 00:15:50.364 5.428 - 5.452: 97.9014% ( 1) 00:15:50.364 5.452 - 5.476: 97.9087% ( 1) 00:15:50.364 5.476 - 5.499: 97.9159% ( 1) 00:15:50.364 5.499 - 5.523: 97.9231% ( 1) 00:15:50.364 5.665 - 5.689: 97.9304% ( 1) 00:15:50.364 5.689 - 5.713: 97.9376% ( 1) 00:15:50.364 5.713 - 5.736: 97.9449% ( 1) 00:15:50.364 5.855 - 5.879: 97.9521% ( 1) 00:15:50.364 5.902 - 5.926: 97.9593% ( 1) 00:15:50.365 6.068 - 6.116: 97.9666% ( 1) 00:15:50.365 6.258 - 6.305: 97.9738% ( 1) 00:15:50.365 6.495 - 6.542: 97.9810% ( 1) 00:15:50.365 6.542 - 6.590: 97.9883% ( 1) 00:15:50.365 6.637 - 6.684: 97.9955% ( 1) 00:15:50.365 6.684 - 6.732: 98.0027% ( 1) 00:15:50.365 6.732 - 6.779: 98.0172% ( 2) 00:15:50.365 6.921 - 6.969: 98.0245% ( 1) 00:15:50.365 6.969 - 7.016: 98.0389% ( 2) 00:15:50.365 7.064 - 7.111: 98.0534% ( 2) 00:15:50.365 7.111 - 7.159: 98.0606% ( 1) 00:15:50.365 7.206 - 7.253: 98.0751% ( 2) 00:15:50.365 7.253 - 7.301: 98.0824% ( 1) 00:15:50.365 7.301 - 7.348: 98.0896% ( 1) 00:15:50.365 7.348 - 7.396: 98.1041% ( 2) 00:15:50.365 7.396 - 7.443: 98.1113% ( 1) 00:15:50.365 7.443 - 7.490: 98.1258% ( 2) 00:15:50.365 7.585 - 7.633: 98.1330% ( 1) 00:15:50.365 7.633 - 7.680: 98.1475% ( 2) 00:15:50.365 7.680 - 7.727: 98.1620% ( 2) 00:15:50.365 7.727 - 7.775: 98.1692% ( 1) 00:15:50.365 7.775 - 7.822: 98.1837% ( 2) 00:15:50.365 7.822 - 7.870: 98.1909% ( 1) 00:15:50.365 7.870 - 7.917: 98.1981% ( 1) 00:15:50.365 7.964 - 8.012: 98.2126% ( 2) 00:15:50.365 8.012 - 8.059: 98.2271% ( 2) 00:15:50.365 8.059 - 8.107: 98.2343% ( 1) 00:15:50.365 8.201 - 8.249: 98.2416% ( 1) 00:15:50.365 8.344 - 8.391: 98.2560% ( 2) 00:15:50.365 8.439 - 8.486: 98.2633% ( 1) 00:15:50.365 8.486 - 8.533: 98.2777% ( 2) 00:15:50.365 8.533 - 8.581: 98.2922% ( 2) 00:15:50.365 8.581 - 8.628: 98.3067% ( 2) 00:15:50.365 8.628 - 8.676: 98.3212% ( 2) 00:15:50.365 8.676 - 8.723: 98.3284% ( 1) 00:15:50.365 8.723 - 8.770: 98.3356% ( 1) 00:15:50.365 8.770 - 8.818: 98.3429% ( 1) 00:15:50.365 8.865 - 8.913: 98.3501% ( 1) 00:15:50.365 8.960 - 9.007: 98.3573% ( 1) 00:15:50.365 9.055 - 9.102: 98.3646% ( 1) 00:15:50.365 9.102 - 9.150: 98.3790% ( 2) 00:15:50.365 9.150 - 9.197: 98.3935% ( 2) 00:15:50.365 9.197 - 9.244: 98.4008% ( 1) 00:15:50.365 9.292 - 9.339: 98.4080% ( 1) 00:15:50.365 9.387 - 9.434: 98.4152% ( 1) 00:15:50.365 9.813 - 9.861: 98.4225% ( 1) 00:15:50.365 10.145 - 10.193: 98.4297% ( 1) 00:15:50.365 10.193 - 10.240: 98.4442% ( 2) 00:15:50.365 10.240 - 10.287: 98.4514% ( 1) 00:15:50.365 10.287 - 10.335: 98.4586% ( 1) 00:15:50.365 10.619 - 10.667: 98.4659% ( 1) 00:15:50.365 10.856 - 10.904: 98.4804% ( 2) 00:15:50.365 11.093 - 11.141: 98.4876% ( 1) 00:15:50.365 11.141 - 11.188: 98.4948% ( 1) 00:15:50.365 11.188 - 11.236: 98.5165% ( 3) 00:15:50.365 11.425 - 11.473: 98.5310% ( 2) 00:15:50.365 11.567 - 11.615: 98.5382% ( 1) 00:15:50.365 11.710 - 11.757: 98.5527% ( 2) 00:15:50.365 11.757 - 11.804: 98.5600% ( 1) 00:15:50.365 11.947 - 11.994: 98.5672% ( 1) 00:15:50.365 12.089 - 12.136: 98.5744% ( 1) 00:15:50.365 12.136 - 12.231: 98.5817% ( 1) 00:15:50.365 12.231 - 12.326: 98.5889% ( 1) 00:15:50.365 12.421 - 12.516: 98.5961% ( 1) 00:15:50.365 12.516 - 12.610: 98.6034% ( 1) 00:15:50.365 12.610 - 12.705: 98.6251% ( 3) 00:15:50.365 12.705 - 12.800: 98.6323% ( 1) 00:15:50.365 13.084 - 13.179: 98.6468% ( 2) 00:15:50.365 13.274 - 13.369: 98.6613% ( 2) 00:15:50.365 13.369 - 13.464: 98.6685% ( 1) 00:15:50.365 13.464 - 13.559: 98.6757% ( 1) 00:15:50.365 13.559 - 13.653: 98.6974% ( 3) 00:15:50.365 13.653 - 13.748: 98.7047% ( 1) 00:15:50.365 13.938 - 14.033: 98.7192% ( 2) 00:15:50.365 14.127 - 14.222: 98.7336% ( 2) 00:15:50.365 14.222 - 14.317: 98.7481% ( 2) 00:15:50.365 14.317 - 14.412: 98.7626% ( 2) 00:15:50.365 14.412 - 14.507: 98.7915% ( 4) 00:15:50.365 14.507 - 14.601: 98.7988% ( 1) 00:15:50.365 14.601 - 14.696: 98.8060% ( 1) 00:15:50.365 14.696 - 14.791: 98.8132% ( 1) 00:15:50.365 14.791 - 14.886: 98.8277% ( 2) 00:15:50.365 15.360 - 15.455: 98.8349% ( 1) 00:15:50.365 15.455 - 15.550: 98.8422% ( 1) 00:15:50.365 17.256 - 17.351: 98.8494% ( 1) 00:15:50.365 17.351 - 17.446: 98.8711% ( 3) 00:15:50.365 17.446 - 17.541: 98.9073% ( 5) 00:15:50.365 17.541 - 17.636: 98.9435% ( 5) 00:15:50.365 17.636 - 17.730: 98.9724% ( 4) 00:15:50.365 17.730 - 17.825: 99.0520% ( 11) 00:15:50.365 17.825 - 17.920: 99.1172% ( 9) 00:15:50.365 17.920 - 18.015: 99.1533% ( 5) 00:15:50.365 18.015 - 18.110: 99.2402% ( 12) 00:15:50.365 18.110 - 18.204: 99.3053% ( 9) 00:15:50.365 18.204 - 18.299: 99.3632% ( 8) 00:15:50.365 18.299 - 18.394: 99.4428% ( 11) 00:15:50.365 18.394 - 18.489: 99.4935% ( 7) 00:15:50.365 18.489 - 18.584: 99.5296% ( 5) 00:15:50.365 18.584 - 18.679: 99.5441% ( 2) 00:15:50.365 18.679 - 18.773: 99.5803% ( 5) 00:15:50.365 18.773 - 18.868: 99.6237% ( 6) 00:15:50.365 18.868 - 18.963: 99.6671% ( 6) 00:15:50.365 18.963 - 19.058: 99.6816% ( 2) 00:15:50.365 19.058 - 19.153: 99.6961% ( 2) 00:15:50.365 19.153 - 19.247: 99.7105% ( 2) 00:15:50.365 19.247 - 19.342: 99.7250% ( 2) 00:15:50.365 19.342 - 19.437: 99.7323% ( 1) 00:15:50.365 19.532 - 19.627: 99.7395% ( 1) 00:15:50.365 19.627 - 19.721: 99.7612% ( 3) 00:15:50.365 19.721 - 19.816: 99.7757% ( 2) 00:15:50.365 19.816 - 19.911: 99.7829% ( 1) 00:15:50.365 19.911 - 20.006: 99.7901% ( 1) 00:15:50.365 20.101 - 20.196: 99.7974% ( 1) 00:15:50.365 20.385 - 20.480: 99.8119% ( 2) 00:15:50.365 20.480 - 20.575: 99.8191% ( 1) 00:15:50.365 21.618 - 21.713: 99.8263% ( 1) 00:15:50.365 22.092 - 22.187: 99.8336% ( 1) 00:15:50.365 23.893 - 23.988: 99.8408% ( 1) 00:15:50.365 24.841 - 25.031: 99.8480% ( 1) 00:15:50.365 25.790 - 25.979: 99.8625% ( 2) 00:15:50.365 26.359 - 26.548: 99.8697% ( 1) 00:15:50.365 29.013 - 29.203: 99.8770% ( 1) 00:15:50.365 77.748 - 78.127: 99.8842% ( 1) 00:15:50.365 3616.616 - 3640.889: 99.8915% ( 1) 00:15:50.365 3980.705 - 4004.978: 99.9928% ( 14) 00:15:50.365 4004.978 - 4029.250: 100.0000% ( 1) 00:15:50.365 00:15:50.365 Complete histogram 00:15:50.365 ================== 00:15:50.365 Range in us Cumulative Count 00:15:50.365 2.039 - 2.050: 1.8959% ( 262) 00:15:50.365 2.050 - 2.062: 9.8415% ( 1098) 00:15:50.365 2.062 - 2.074: 11.6723% ( 253) 00:15:50.365 2.074 - 2.086: 26.3623% ( 2030) 00:15:50.365 2.086 - 2.098: 47.5794% ( 2932) 00:15:50.365 2.098 - 2.110: 51.1253% ( 490) 00:15:50.365 2.110 - 2.121: 54.3816% ( 450) 00:15:50.365 2.121 - 2.133: 56.9506% ( 355) 00:15:50.365 2.133 - 2.145: 58.4557% ( 208) 00:15:50.365 2.145 - 2.157: 68.1743% ( 1343) 00:15:50.365 2.157 - 2.169: 75.3094% ( 986) 00:15:50.365 2.169 - 2.181: 76.7856% ( 204) 00:15:50.365 2.181 - 2.193: 79.0506% ( 313) 00:15:50.365 2.193 - 2.204: 80.7005% ( 228) 00:15:50.365 2.204 - 2.216: 81.6846% ( 136) 00:15:50.365 2.216 - 2.228: 87.7488% ( 838) 00:15:50.365 2.228 - 2.240: 92.0472% ( 594) 00:15:50.365 2.240 - 2.252: 93.1399% ( 151) 00:15:50.365 2.252 - 2.264: 93.8563% ( 99) 00:15:50.365 2.264 - 2.276: 94.2543% ( 55) 00:15:50.365 2.276 - 2.287: 94.6016% ( 48) 00:15:50.365 2.287 - 2.299: 95.1082% ( 70) 00:15:50.365 2.299 - 2.311: 95.2746% ( 23) 00:15:50.365 2.311 - 2.323: 95.3470% ( 10) 00:15:50.365 2.323 - 2.335: 95.5134% ( 23) 00:15:50.365 2.335 - 2.347: 95.7233% ( 29) 00:15:50.365 2.347 - 2.359: 95.9259% ( 28) 00:15:50.365 2.359 - 2.370: 96.1502% ( 31) 00:15:50.365 2.370 - 2.382: 96.4107% ( 36) 00:15:50.365 2.382 - 2.394: 96.6712% ( 36) 00:15:50.365 2.394 - 2.406: 96.9535% ( 39) 00:15:50.365 2.406 - 2.418: 97.1706% ( 30) 00:15:50.365 2.418 - 2.430: 97.3153% ( 20) 00:15:50.365 2.430 - 2.441: 97.4528% ( 19) 00:15:50.365 2.441 - 2.453: 97.6047% ( 21) 00:15:50.365 2.453 - 2.465: 97.7205% ( 16) 00:15:50.365 2.465 - 2.477: 97.8363% ( 16) 00:15:50.365 2.477 - 2.489: 97.8942% ( 8) 00:15:50.365 2.489 - 2.501: 97.9955% ( 14) 00:15:50.365 2.501 - 2.513: 98.0679% ( 10) 00:15:50.365 2.513 - 2.524: 98.1402% ( 10) 00:15:50.365 2.524 - 2.536: 98.1764% ( 5) 00:15:50.365 2.536 - 2.548: 98.2126% ( 5) 00:15:50.365 2.548 - 2.560: 98.2271% ( 2) 00:15:50.365 2.560 - 2.572: 98.2633% ( 5) 00:15:50.365 2.572 - 2.584: 98.2705% ( 1) 00:15:50.365 2.584 - 2.596: 98.2777% ( 1) 00:15:50.365 2.596 - 2.607: 98.2850% ( 1) 00:15:50.365 2.607 - 2.619: 98.2922% ( 1) 00:15:50.365 2.631 - 2.643: 98.2994% ( 1) 00:15:50.365 2.667 - 2.679: 98.3067% ( 1) 00:15:50.365 2.714 - 2.726: 98.3139% ( 1) 00:15:50.365 2.726 - 2.738: 98.3212% ( 1) 00:15:50.365 2.738 - 2.750: 98.3284% ( 1) 00:15:50.365 2.750 - 2.761: 98.3501% ( 3) 00:15:50.365 2.761 - 2.773: 98.3573% ( 1) 00:15:50.365 2.797 - 2.809: 98.3646% ( 1) 00:15:50.365 2.833 - 2.844: 98.3718% ( 1) 00:15:50.365 2.844 - 2.856: 98.3790% ( 1) 00:15:50.365 2.856 - 2.868: 98.3863% ( 1) 00:15:50.365 2.868 - 2.880: 98.3935% ( 1) 00:15:50.365 2.892 - 2.904: 98.4008% ( 1) 00:15:50.366 2.951 - 2.963: 98.4080% ( 1) 00:15:50.366 2.999 - 3.010: 98.4152% ( 1) 00:15:50.366 3.058 - 3.081: 98.4225% ( 1) 00:15:50.366 3.081 - 3.105: 98.4297% ( 1) 00:15:50.366 3.153 - 3.176: 98.4369% ( 1) 00:15:50.366 3.176 - 3.200: 98.4442% ( 1) 00:15:50.366 3.200 - 3.224: 98.4514% ( 1) 00:15:50.366 3.224 - 3.247: 98.4586% ( 1) 00:15:50.366 3.247 - 3.271: 98.4659% ( 1) 00:15:50.366 3.271 - 3.295: 98.4731% ( 1) 00:15:50.366 3.319 - 3.342: 98.4804% ( 1) 00:15:50.366 3.366 - 3.390: 98.4876% ( 1) 00:15:50.366 3.390 - 3.413: 98.5021% ( 2) 00:15:50.366 3.413 - 3.437: 98.5093% ( 1) 00:15:50.366 3.461 - 3.484: 98.5310% ( 3) 00:15:50.366 3.484 - 3.508: 98.5382% ( 1) 00:15:50.366 3.508 - 3.532: 98.5455% ( 1) 00:15:50.366 3.532 - 3.556: 98.5527% ( 1) 00:15:50.366 3.603 - 3.627: 98.5600% ( 1) 00:15:50.366 3.745 - 3.769: 98.5672% ( 1) 00:15:50.366 3.769 - 3.793: 98.5961% ( 4) 00:15:50.366 4.504 - 4.527: 98.6034% ( 1) 00:15:50.366 4.646 - 4.670: 98.6106% ( 1) 00:15:50.366 4.930 - 4.954: 98.6178% ( 1) 00:15:50.366 5.025 - 5.049: 98.6251% ( 1) 00:15:50.366 5.736 - 5.760: 98.6323% ( 1) 00:15:50.366 5.760 - 5.784: 98.6396% ( 1) 00:15:50.366 5.950 - 5.973: 98.6468% ( 1) 00:15:50.366 5.973 - 5.997: 98.6540% ( 1) 00:15:50.366 6.210 - 6.258: 98.6613% ( 1) 00:15:50.366 6.400 - 6.447: 98.6830% ( 3) 00:15:50.366 6.495 - 6.542: 98.6902% ( 1) 00:15:50.366 6.542 - 6.590: 98.6974% ( 1) 00:15:50.366 6.732 - 6.779: 98.7047% ( 1) 00:15:50.366 6.779 - 6.827: 98.7119% ( 1) 00:15:50.366 7.111 - 7.159: 98.7192% ( 1) 00:15:50.366 7.443 - 7.490: 98.7264% ( 1) 00:15:50.366 8.059 - 8.107: 98.7336% ( 1) 00:15:50.366 8.154 - 8.201: 98.7409% ( 1) 00:15:50.366 9.150 - 9.197: 98.7481% ( 1) 00:15:50.366 10.572 - 10.619: 98.7553% ( 1) 00:15:50.366 12.800 - 12.895: 98.7626% ( 1) 00:15:50.366 15.360 - 15.455: 98.7698% ( 1) 00:15:50.366 15.644 - 15.739: 98.7915% ( 3) 00:15:50.366 15.739 - 15.834: 98.8060% ( 2) 00:15:50.366 15.834 - 15.929: 98.8277% ( 3) 00:15:50.366 15.929 - 16.024: 98.8422% ( 2) 00:15:50.366 16.024 - 16.119: 98.8784% ( 5) 00:15:50.366 16.119 - 16.213: 98.8928% ( 2) 00:15:50.366 16.213 - 16.308: 98.9435% ( 7) 00:15:50.366 16.308 - 16.403: 98.9652% ( 3) 00:15:50.366 16.403 - 16.498: 98.9797% ( 2) 00:15:50.366 16.498 - 16.593: 99.0231% ( 6) 00:15:50.366 16.593 - 16.687: 99.0737% ( 7) 00:15:50.366 16.687 - 16.782: 99.1099% ( 5) 00:15:50.366 16.782 - 16.877: 99.1750% ( 9) 00:15:50.366 16.877 - 16.972: 99.2040% ( 4) 00:15:50.366 16.972 - 17.067: 99.2474% ( 6) 00:15:50.366 17.067 - 17.161: 99.2908% ( 6) 00:15:50.366 17.161 - 17.256: 99.3125% ( 3) 00:15:50.366 17.256 - 17.351: 99.3270% ( 2) 00:15:50.366 17.351 - 17.446: 99.3487% ( 3) 00:15:50.366 17.446 - 17.541: 99.3560% ( 1) 00:15:50.366 17.541 - 17.636: 99.3632% ( 1) 00:15:50.366 17.636 - 17.730: 99.3777% ( 2) 00:15:50.366 17.730 - 17.825: 99.4066% ( 4) 00:15:50.366 18.015 - 18.110: 99.4211% ( 2) 00:15:50.366 18.110 - 18.204: 99.4283% ( 1) 00:15:50.366 18.299 - 18.394: 99.4356% ( 1) 00:15:50.366 19.437 - 19.532: 99.4428% ( 1) 00:15:50.366 20.385 - 20.480: 99.4500% ( 1) 00:15:50.366 26.738 - 26.927: 99.4573% ( 1) 00:15:50.366 3021.938 - 3034.074: 99.4645% ( 1) 00:15:50.366 3980.705 - 4004.978: 99.8770% ( 57) 00:15:50.366 4004.978 - 4029.250: 99.9855% ( 15) 00:15:50.366 4077.796 - 4102.068: 99.9928% ( 1) 00:15:50.366 5000.154 - 5024.427: 100.0000% ( 1) 00:15:50.366 00:15:50.366 04:17:40 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user1/1 nqn.2019-07.io.spdk:cnode1 1 00:15:50.366 04:17:40 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user1/1 00:15:50.366 04:17:40 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode1 00:15:50.366 04:17:40 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc3 00:15:50.366 04:17:40 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:50.624 [2024-11-30 04:17:41.097767] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:15:50.624 [ 00:15:50.624 { 00:15:50.624 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:50.624 "subtype": "Discovery", 00:15:50.624 "listen_addresses": [], 00:15:50.624 "allow_any_host": true, 00:15:50.624 "hosts": [] 00:15:50.624 }, 00:15:50.624 { 00:15:50.624 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:50.624 "subtype": "NVMe", 00:15:50.624 "listen_addresses": [ 00:15:50.624 { 00:15:50.624 "transport": "VFIOUSER", 00:15:50.624 "trtype": "VFIOUSER", 00:15:50.624 "adrfam": "IPv4", 00:15:50.624 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:50.624 "trsvcid": "0" 00:15:50.624 } 00:15:50.624 ], 00:15:50.624 "allow_any_host": true, 00:15:50.624 "hosts": [], 00:15:50.624 "serial_number": "SPDK1", 00:15:50.624 "model_number": "SPDK bdev Controller", 00:15:50.624 "max_namespaces": 32, 00:15:50.624 "min_cntlid": 1, 00:15:50.624 "max_cntlid": 65519, 00:15:50.624 "namespaces": [ 00:15:50.624 { 00:15:50.624 "nsid": 1, 00:15:50.624 "bdev_name": "Malloc1", 00:15:50.624 "name": "Malloc1", 00:15:50.624 "nguid": "2C45BC1DAC6E4216ACAF566D75F4348B", 00:15:50.625 "uuid": "2c45bc1d-ac6e-4216-acaf-566d75f4348b" 00:15:50.625 } 00:15:50.625 ] 00:15:50.625 }, 00:15:50.625 { 00:15:50.625 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:50.625 "subtype": "NVMe", 00:15:50.625 "listen_addresses": [ 00:15:50.625 { 00:15:50.625 "transport": "VFIOUSER", 00:15:50.625 "trtype": "VFIOUSER", 00:15:50.625 "adrfam": "IPv4", 00:15:50.625 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:50.625 "trsvcid": "0" 00:15:50.625 } 00:15:50.625 ], 00:15:50.625 "allow_any_host": true, 00:15:50.625 "hosts": [], 00:15:50.625 "serial_number": "SPDK2", 00:15:50.625 "model_number": "SPDK bdev Controller", 00:15:50.625 "max_namespaces": 32, 00:15:50.625 "min_cntlid": 1, 00:15:50.625 "max_cntlid": 65519, 00:15:50.625 "namespaces": [ 00:15:50.625 { 00:15:50.625 "nsid": 1, 00:15:50.625 "bdev_name": "Malloc2", 00:15:50.625 "name": "Malloc2", 00:15:50.625 "nguid": "69ABF4C4EF214D589DFBB203778CB1EC", 00:15:50.625 "uuid": "69abf4c4-ef21-4d58-9dfb-b203778cb1ec" 00:15:50.625 } 00:15:50.625 ] 00:15:50.625 } 00:15:50.625 ] 00:15:50.625 04:17:41 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:15:50.625 04:17:41 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2337533 00:15:50.625 04:17:41 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user1/1 subnqn:nqn.2019-07.io.spdk:cnode1' -n 2 -g -t /tmp/aer_touch_file 00:15:50.625 04:17:41 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:15:50.625 04:17:41 -- common/autotest_common.sh@1254 -- # local i=0 00:15:50.625 04:17:41 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:50.625 04:17:41 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:15:50.625 04:17:41 -- common/autotest_common.sh@1265 -- # return 0 00:15:50.625 04:17:41 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:15:50.625 04:17:41 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc3 00:15:50.625 EAL: No free 2048 kB hugepages reported on node 1 00:15:50.883 Malloc3 00:15:50.883 04:17:41 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc3 -n 2 00:15:51.141 04:17:41 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:15:51.141 Asynchronous Event Request test 00:15:51.141 Attaching to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.141 Attached to /var/run/vfio-user/domain/vfio-user1/1 00:15:51.141 Registering asynchronous event callbacks... 00:15:51.141 Starting namespace attribute notice tests for all controllers... 00:15:51.141 /var/run/vfio-user/domain/vfio-user1/1: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:15:51.141 aer_cb - Changed Namespace 00:15:51.141 Cleaning up... 00:15:51.399 [ 00:15:51.399 { 00:15:51.399 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:15:51.399 "subtype": "Discovery", 00:15:51.399 "listen_addresses": [], 00:15:51.399 "allow_any_host": true, 00:15:51.399 "hosts": [] 00:15:51.399 }, 00:15:51.399 { 00:15:51.399 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:15:51.399 "subtype": "NVMe", 00:15:51.399 "listen_addresses": [ 00:15:51.399 { 00:15:51.399 "transport": "VFIOUSER", 00:15:51.399 "trtype": "VFIOUSER", 00:15:51.399 "adrfam": "IPv4", 00:15:51.399 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:15:51.399 "trsvcid": "0" 00:15:51.399 } 00:15:51.399 ], 00:15:51.399 "allow_any_host": true, 00:15:51.399 "hosts": [], 00:15:51.399 "serial_number": "SPDK1", 00:15:51.399 "model_number": "SPDK bdev Controller", 00:15:51.399 "max_namespaces": 32, 00:15:51.399 "min_cntlid": 1, 00:15:51.400 "max_cntlid": 65519, 00:15:51.400 "namespaces": [ 00:15:51.400 { 00:15:51.400 "nsid": 1, 00:15:51.400 "bdev_name": "Malloc1", 00:15:51.400 "name": "Malloc1", 00:15:51.400 "nguid": "2C45BC1DAC6E4216ACAF566D75F4348B", 00:15:51.400 "uuid": "2c45bc1d-ac6e-4216-acaf-566d75f4348b" 00:15:51.400 }, 00:15:51.400 { 00:15:51.400 "nsid": 2, 00:15:51.400 "bdev_name": "Malloc3", 00:15:51.400 "name": "Malloc3", 00:15:51.400 "nguid": "69287FF0577447E88762A2691C42F9C2", 00:15:51.400 "uuid": "69287ff0-5774-47e8-8762-a2691c42f9c2" 00:15:51.400 } 00:15:51.400 ] 00:15:51.400 }, 00:15:51.400 { 00:15:51.400 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:15:51.400 "subtype": "NVMe", 00:15:51.400 "listen_addresses": [ 00:15:51.400 { 00:15:51.400 "transport": "VFIOUSER", 00:15:51.400 "trtype": "VFIOUSER", 00:15:51.400 "adrfam": "IPv4", 00:15:51.400 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:15:51.400 "trsvcid": "0" 00:15:51.400 } 00:15:51.400 ], 00:15:51.400 "allow_any_host": true, 00:15:51.400 "hosts": [], 00:15:51.400 "serial_number": "SPDK2", 00:15:51.400 "model_number": "SPDK bdev Controller", 00:15:51.400 "max_namespaces": 32, 00:15:51.400 "min_cntlid": 1, 00:15:51.400 "max_cntlid": 65519, 00:15:51.400 "namespaces": [ 00:15:51.400 { 00:15:51.400 "nsid": 1, 00:15:51.400 "bdev_name": "Malloc2", 00:15:51.400 "name": "Malloc2", 00:15:51.400 "nguid": "69ABF4C4EF214D589DFBB203778CB1EC", 00:15:51.400 "uuid": "69abf4c4-ef21-4d58-9dfb-b203778cb1ec" 00:15:51.400 } 00:15:51.400 ] 00:15:51.400 } 00:15:51.400 ] 00:15:51.400 04:17:41 -- target/nvmf_vfio_user.sh@44 -- # wait 2337533 00:15:51.400 04:17:41 -- target/nvmf_vfio_user.sh@80 -- # for i in $(seq 1 $NUM_DEVICES) 00:15:51.400 04:17:41 -- target/nvmf_vfio_user.sh@81 -- # test_traddr=/var/run/vfio-user/domain/vfio-user2/2 00:15:51.400 04:17:41 -- target/nvmf_vfio_user.sh@82 -- # test_subnqn=nqn.2019-07.io.spdk:cnode2 00:15:51.400 04:17:41 -- target/nvmf_vfio_user.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -L nvme -L nvme_vfio -L vfio_pci 00:15:51.400 [2024-11-30 04:17:41.920104] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:15:51.400 [2024-11-30 04:17:41.920146] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --single-file-segments --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2337665 ] 00:15:51.400 EAL: No free 2048 kB hugepages reported on node 1 00:15:51.400 [2024-11-30 04:17:41.954136] nvme_vfio_user.c: 259:nvme_vfio_ctrlr_scan: *DEBUG*: Scan controller : /var/run/vfio-user/domain/vfio-user2/2 00:15:51.400 [2024-11-30 04:17:41.962236] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 0, Size 0x2000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:51.400 [2024-11-30 04:17:41.962266] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0x1000, Offset 0x1000, Map addr 0x7f621f0ee000 00:15:51.400 [2024-11-30 04:17:41.963235] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 1, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:51.400 [2024-11-30 04:17:41.964237] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 2, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:51.400 [2024-11-30 04:17:41.965239] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 3, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:51.400 [2024-11-30 04:17:41.966244] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 4, Size 0x2000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:51.400 [2024-11-30 04:17:41.967246] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 5, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:51.400 [2024-11-30 04:17:41.968251] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 6, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:51.400 [2024-11-30 04:17:41.969277] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 7, Size 0x1000, Offset 0x0, Flags 0x3, Cap offset 0 00:15:51.400 [2024-11-30 04:17:41.971980] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 8, Size 0x0, Offset 0x0, Flags 0x0, Cap offset 0 00:15:51.400 [2024-11-30 04:17:41.972302] vfio_user_pci.c: 304:vfio_device_map_bars_and_config_region: *DEBUG*: Bar 9, Size 0xc000, Offset 0x0, Flags 0xf, Cap offset 32 00:15:51.400 [2024-11-30 04:17:41.972324] vfio_user_pci.c: 233:vfio_device_setup_sparse_mmaps: *DEBUG*: Sparse region 0, Size 0xb000, Offset 0x1000, Map addr 0x7f621dde6000 00:15:51.400 [2024-11-30 04:17:41.973473] vfio_user_pci.c: 65:vfio_add_mr: *DEBUG*: Add memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:51.400 [2024-11-30 04:17:41.988217] vfio_user_pci.c: 386:spdk_vfio_user_setup: *DEBUG*: Device vfio-user0, Path /var/run/vfio-user/domain/vfio-user2/2/cntrl Setup Successfully 00:15:51.400 [2024-11-30 04:17:41.988251] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to connect adminq (no timeout) 00:15:51.400 [2024-11-30 04:17:41.990358] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:51.400 [2024-11-30 04:17:41.990411] nvme_pcie_common.c: 132:nvme_pcie_qpair_construct: *INFO*: max_completions_cap = 64 num_trackers = 192 00:15:51.400 [2024-11-30 04:17:41.990496] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for connect adminq (no timeout) 00:15:51.400 [2024-11-30 04:17:41.990520] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs (no timeout) 00:15:51.400 [2024-11-30 04:17:41.990530] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read vs wait for vs (no timeout) 00:15:51.400 [2024-11-30 04:17:41.991367] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x8, value 0x10300 00:15:51.400 [2024-11-30 04:17:41.991387] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap (no timeout) 00:15:51.400 [2024-11-30 04:17:41.991400] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to read cap wait for cap (no timeout) 00:15:51.400 [2024-11-30 04:17:41.992373] nvme_vfio_user.c: 103:nvme_vfio_ctrlr_get_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x0, value 0x201e0100ff 00:15:51.400 [2024-11-30 04:17:41.992392] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en (no timeout) 00:15:51.400 [2024-11-30 04:17:41.992406] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to check en wait for cc (timeout 15000 ms) 00:15:51.400 [2024-11-30 04:17:41.993374] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x0 00:15:51.400 [2024-11-30 04:17:41.993393] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:15:51.400 [2024-11-30 04:17:41.995969] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x0 00:15:51.400 [2024-11-30 04:17:41.995989] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 0 && CSTS.RDY = 0 00:15:51.400 [2024-11-30 04:17:41.995998] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to controller is disabled (timeout 15000 ms) 00:15:51.400 [2024-11-30 04:17:41.996009] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:15:51.400 [2024-11-30 04:17:41.996118] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Setting CC.EN = 1 00:15:51.400 [2024-11-30 04:17:41.996126] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:15:51.400 [2024-11-30 04:17:41.996134] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x28, value 0x2000003c0000 00:15:51.400 [2024-11-30 04:17:41.996403] nvme_vfio_user.c: 61:nvme_vfio_ctrlr_set_reg_8: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x30, value 0x2000003be000 00:15:51.400 [2024-11-30 04:17:41.997407] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x24, value 0xff00ff 00:15:51.400 [2024-11-30 04:17:41.998418] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:51.400 [2024-11-30 04:17:41.999447] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:15:51.400 [2024-11-30 04:17:42.000425] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x1 00:15:51.400 [2024-11-30 04:17:42.000444] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:15:51.400 [2024-11-30 04:17:42.000453] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to reset admin queue (timeout 30000 ms) 00:15:51.400 [2024-11-30 04:17:42.000476] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller (no timeout) 00:15:51.400 [2024-11-30 04:17:42.000488] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify controller (timeout 30000 ms) 00:15:51.400 [2024-11-30 04:17:42.000507] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:51.400 [2024-11-30 04:17:42.000516] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:51.400 [2024-11-30 04:17:42.000533] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000001 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:51.400 [2024-11-30 04:17:42.006972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0001 p:1 m:0 dnr:0 00:15:51.400 [2024-11-30 04:17:42.006994] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_xfer_size 131072 00:15:51.400 [2024-11-30 04:17:42.007003] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] MDTS max_xfer_size 131072 00:15:51.400 [2024-11-30 04:17:42.007010] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] CNTLID 0x0001 00:15:51.400 [2024-11-30 04:17:42.007018] nvme_ctrlr.c:1990:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Identify CNTLID 0x0001 != Connect CNTLID 0x0000 00:15:51.401 [2024-11-30 04:17:42.007026] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] transport max_sges 1 00:15:51.401 [2024-11-30 04:17:42.007038] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] fuses compare and write: 1 00:15:51.401 [2024-11-30 04:17:42.007046] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to configure AER (timeout 30000 ms) 00:15:51.401 [2024-11-30 04:17:42.007063] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for configure aer (timeout 30000 ms) 00:15:51.401 [2024-11-30 04:17:42.007080] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:191 cdw10:0000000b PRP1 0x0 PRP2 0x0 00:15:51.401 [2024-11-30 04:17:42.014968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0002 p:1 m:0 dnr:0 00:15:51.401 [2024-11-30 04:17:42.014997] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:190 nsid:0 cdw10:00000000 cdw11:00000000 00:15:51.401 [2024-11-30 04:17:42.015013] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:189 nsid:0 cdw10:00000000 cdw11:00000000 00:15:51.401 [2024-11-30 04:17:42.015025] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:188 nsid:0 cdw10:00000000 cdw11:00000000 00:15:51.401 [2024-11-30 04:17:42.015038] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:187 nsid:0 cdw10:00000000 cdw11:00000000 00:15:51.401 [2024-11-30 04:17:42.015047] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set keep alive timeout (timeout 30000 ms) 00:15:51.401 [2024-11-30 04:17:42.015062] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:15:51.401 [2024-11-30 04:17:42.015078] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:191 cdw10:0000000f PRP1 0x0 PRP2 0x0 00:15:51.401 [2024-11-30 04:17:42.022969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0007 p:1 m:0 dnr:0 00:15:51.401 [2024-11-30 04:17:42.022987] nvme_ctrlr.c:2878:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Controller adjusted keep alive timeout to 0 ms 00:15:51.401 [2024-11-30 04:17:42.022996] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify controller iocs specific (timeout 30000 ms) 00:15:51.401 [2024-11-30 04:17:42.023023] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set number of queues (timeout 30000 ms) 00:15:51.401 [2024-11-30 04:17:42.023038] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for set number of queues (timeout 30000 ms) 00:15:51.401 [2024-11-30 04:17:42.023053] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.030969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:0008 p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.031041] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify active ns (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.031056] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify active ns (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.031068] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f9000 len:4096 00:15:51.660 [2024-11-30 04:17:42.031077] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f9000 00:15:51.660 [2024-11-30 04:17:42.031087] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:0 cdw10:00000002 cdw11:00000000 PRP1 0x2000002f9000 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.038970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0009 p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.038996] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Namespace 1 was added 00:15:51.660 [2024-11-30 04:17:42.039012] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.039027] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify ns (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.039039] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:51.660 [2024-11-30 04:17:42.039047] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:51.660 [2024-11-30 04:17:42.039057] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000000 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.046969] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000a p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.047007] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify namespace id descriptors (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.047024] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.047037] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:4096 00:15:51.660 [2024-11-30 04:17:42.047045] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:51.660 [2024-11-30 04:17:42.047054] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:191 nsid:1 cdw10:00000003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.054970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000b p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.055004] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to identify ns iocs specific (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.055015] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported log pages (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.055029] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set supported features (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.055040] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set doorbell buffer config (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.055049] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to set host ID (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.055057] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] NVMe-oF transport - not sending Set Features - Host ID 00:15:51.660 [2024-11-30 04:17:42.055064] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to transport ready (timeout 30000 ms) 00:15:51.660 [2024-11-30 04:17:42.055072] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] setting state to ready (no timeout) 00:15:51.660 [2024-11-30 04:17:42.055095] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:191 cdw10:00000001 PRP1 0x0 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.062970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000c p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.062996] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:191 cdw10:00000002 PRP1 0x0 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.070970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000d p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.071001] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:191 cdw10:00000004 PRP1 0x0 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.078968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:000e p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.078994] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:191 cdw10:00000007 PRP1 0x0 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.086970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:7e007e sqhd:000f p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.086996] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f6000 len:8192 00:15:51.660 [2024-11-30 04:17:42.087006] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f6000 00:15:51.660 [2024-11-30 04:17:42.087012] nvme_pcie_common.c:1235:nvme_pcie_prp_list_append: *DEBUG*: prp[0] = 0x2000002f7000 00:15:51.660 [2024-11-30 04:17:42.087018] nvme_pcie_common.c:1251:nvme_pcie_prp_list_append: *DEBUG*: prp2 = 0x2000002f7000 00:15:51.660 [2024-11-30 04:17:42.087028] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:191 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 PRP1 0x2000002f6000 PRP2 0x2000002f7000 00:15:51.660 [2024-11-30 04:17:42.087039] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fc000 len:512 00:15:51.660 [2024-11-30 04:17:42.087047] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fc000 00:15:51.660 [2024-11-30 04:17:42.087056] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:186 nsid:ffffffff cdw10:007f0002 cdw11:00000000 PRP1 0x2000002fc000 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.087067] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002fb000 len:512 00:15:51.660 [2024-11-30 04:17:42.087074] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002fb000 00:15:51.660 [2024-11-30 04:17:42.087083] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:185 nsid:ffffffff cdw10:007f0003 cdw11:00000000 PRP1 0x2000002fb000 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.087094] nvme_pcie_common.c:1198:nvme_pcie_prp_list_append: *DEBUG*: prp_index:0 virt_addr:0x2000002f4000 len:4096 00:15:51.660 [2024-11-30 04:17:42.087103] nvme_pcie_common.c:1226:nvme_pcie_prp_list_append: *DEBUG*: prp1 = 0x2000002f4000 00:15:51.660 [2024-11-30 04:17:42.087111] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:184 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 PRP1 0x2000002f4000 PRP2 0x0 00:15:51.660 [2024-11-30 04:17:42.094971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:191 cdw0:0 sqhd:0010 p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.095013] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:186 cdw0:0 sqhd:0011 p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.095030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:185 cdw0:0 sqhd:0012 p:1 m:0 dnr:0 00:15:51.660 [2024-11-30 04:17:42.095042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0013 p:1 m:0 dnr:0 00:15:51.660 ===================================================== 00:15:51.660 NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:51.660 ===================================================== 00:15:51.660 Controller Capabilities/Features 00:15:51.660 ================================ 00:15:51.660 Vendor ID: 4e58 00:15:51.660 Subsystem Vendor ID: 4e58 00:15:51.660 Serial Number: SPDK2 00:15:51.660 Model Number: SPDK bdev Controller 00:15:51.660 Firmware Version: 24.01.1 00:15:51.660 Recommended Arb Burst: 6 00:15:51.660 IEEE OUI Identifier: 8d 6b 50 00:15:51.660 Multi-path I/O 00:15:51.660 May have multiple subsystem ports: Yes 00:15:51.660 May have multiple controllers: Yes 00:15:51.660 Associated with SR-IOV VF: No 00:15:51.660 Max Data Transfer Size: 131072 00:15:51.660 Max Number of Namespaces: 32 00:15:51.660 Max Number of I/O Queues: 127 00:15:51.660 NVMe Specification Version (VS): 1.3 00:15:51.660 NVMe Specification Version (Identify): 1.3 00:15:51.660 Maximum Queue Entries: 256 00:15:51.660 Contiguous Queues Required: Yes 00:15:51.661 Arbitration Mechanisms Supported 00:15:51.661 Weighted Round Robin: Not Supported 00:15:51.661 Vendor Specific: Not Supported 00:15:51.661 Reset Timeout: 15000 ms 00:15:51.661 Doorbell Stride: 4 bytes 00:15:51.661 NVM Subsystem Reset: Not Supported 00:15:51.661 Command Sets Supported 00:15:51.661 NVM Command Set: Supported 00:15:51.661 Boot Partition: Not Supported 00:15:51.661 Memory Page Size Minimum: 4096 bytes 00:15:51.661 Memory Page Size Maximum: 4096 bytes 00:15:51.661 Persistent Memory Region: Not Supported 00:15:51.661 Optional Asynchronous Events Supported 00:15:51.661 Namespace Attribute Notices: Supported 00:15:51.661 Firmware Activation Notices: Not Supported 00:15:51.661 ANA Change Notices: Not Supported 00:15:51.661 PLE Aggregate Log Change Notices: Not Supported 00:15:51.661 LBA Status Info Alert Notices: Not Supported 00:15:51.661 EGE Aggregate Log Change Notices: Not Supported 00:15:51.661 Normal NVM Subsystem Shutdown event: Not Supported 00:15:51.661 Zone Descriptor Change Notices: Not Supported 00:15:51.661 Discovery Log Change Notices: Not Supported 00:15:51.661 Controller Attributes 00:15:51.661 128-bit Host Identifier: Supported 00:15:51.661 Non-Operational Permissive Mode: Not Supported 00:15:51.661 NVM Sets: Not Supported 00:15:51.661 Read Recovery Levels: Not Supported 00:15:51.661 Endurance Groups: Not Supported 00:15:51.661 Predictable Latency Mode: Not Supported 00:15:51.661 Traffic Based Keep ALive: Not Supported 00:15:51.661 Namespace Granularity: Not Supported 00:15:51.661 SQ Associations: Not Supported 00:15:51.661 UUID List: Not Supported 00:15:51.661 Multi-Domain Subsystem: Not Supported 00:15:51.661 Fixed Capacity Management: Not Supported 00:15:51.661 Variable Capacity Management: Not Supported 00:15:51.661 Delete Endurance Group: Not Supported 00:15:51.661 Delete NVM Set: Not Supported 00:15:51.661 Extended LBA Formats Supported: Not Supported 00:15:51.661 Flexible Data Placement Supported: Not Supported 00:15:51.661 00:15:51.661 Controller Memory Buffer Support 00:15:51.661 ================================ 00:15:51.661 Supported: No 00:15:51.661 00:15:51.661 Persistent Memory Region Support 00:15:51.661 ================================ 00:15:51.661 Supported: No 00:15:51.661 00:15:51.661 Admin Command Set Attributes 00:15:51.661 ============================ 00:15:51.661 Security Send/Receive: Not Supported 00:15:51.661 Format NVM: Not Supported 00:15:51.661 Firmware Activate/Download: Not Supported 00:15:51.661 Namespace Management: Not Supported 00:15:51.661 Device Self-Test: Not Supported 00:15:51.661 Directives: Not Supported 00:15:51.661 NVMe-MI: Not Supported 00:15:51.661 Virtualization Management: Not Supported 00:15:51.661 Doorbell Buffer Config: Not Supported 00:15:51.661 Get LBA Status Capability: Not Supported 00:15:51.661 Command & Feature Lockdown Capability: Not Supported 00:15:51.661 Abort Command Limit: 4 00:15:51.661 Async Event Request Limit: 4 00:15:51.661 Number of Firmware Slots: N/A 00:15:51.661 Firmware Slot 1 Read-Only: N/A 00:15:51.661 Firmware Activation Without Reset: N/A 00:15:51.661 Multiple Update Detection Support: N/A 00:15:51.661 Firmware Update Granularity: No Information Provided 00:15:51.661 Per-Namespace SMART Log: No 00:15:51.661 Asymmetric Namespace Access Log Page: Not Supported 00:15:51.661 Subsystem NQN: nqn.2019-07.io.spdk:cnode2 00:15:51.661 Command Effects Log Page: Supported 00:15:51.661 Get Log Page Extended Data: Supported 00:15:51.661 Telemetry Log Pages: Not Supported 00:15:51.661 Persistent Event Log Pages: Not Supported 00:15:51.661 Supported Log Pages Log Page: May Support 00:15:51.661 Commands Supported & Effects Log Page: Not Supported 00:15:51.661 Feature Identifiers & Effects Log Page:May Support 00:15:51.661 NVMe-MI Commands & Effects Log Page: May Support 00:15:51.661 Data Area 4 for Telemetry Log: Not Supported 00:15:51.661 Error Log Page Entries Supported: 128 00:15:51.661 Keep Alive: Supported 00:15:51.661 Keep Alive Granularity: 10000 ms 00:15:51.661 00:15:51.661 NVM Command Set Attributes 00:15:51.661 ========================== 00:15:51.661 Submission Queue Entry Size 00:15:51.661 Max: 64 00:15:51.661 Min: 64 00:15:51.661 Completion Queue Entry Size 00:15:51.661 Max: 16 00:15:51.661 Min: 16 00:15:51.661 Number of Namespaces: 32 00:15:51.661 Compare Command: Supported 00:15:51.661 Write Uncorrectable Command: Not Supported 00:15:51.661 Dataset Management Command: Supported 00:15:51.661 Write Zeroes Command: Supported 00:15:51.661 Set Features Save Field: Not Supported 00:15:51.661 Reservations: Not Supported 00:15:51.661 Timestamp: Not Supported 00:15:51.661 Copy: Supported 00:15:51.661 Volatile Write Cache: Present 00:15:51.661 Atomic Write Unit (Normal): 1 00:15:51.661 Atomic Write Unit (PFail): 1 00:15:51.661 Atomic Compare & Write Unit: 1 00:15:51.661 Fused Compare & Write: Supported 00:15:51.661 Scatter-Gather List 00:15:51.661 SGL Command Set: Supported (Dword aligned) 00:15:51.661 SGL Keyed: Not Supported 00:15:51.661 SGL Bit Bucket Descriptor: Not Supported 00:15:51.661 SGL Metadata Pointer: Not Supported 00:15:51.661 Oversized SGL: Not Supported 00:15:51.661 SGL Metadata Address: Not Supported 00:15:51.661 SGL Offset: Not Supported 00:15:51.661 Transport SGL Data Block: Not Supported 00:15:51.661 Replay Protected Memory Block: Not Supported 00:15:51.661 00:15:51.661 Firmware Slot Information 00:15:51.661 ========================= 00:15:51.661 Active slot: 1 00:15:51.661 Slot 1 Firmware Revision: 24.01.1 00:15:51.661 00:15:51.661 00:15:51.661 Commands Supported and Effects 00:15:51.661 ============================== 00:15:51.661 Admin Commands 00:15:51.661 -------------- 00:15:51.661 Get Log Page (02h): Supported 00:15:51.661 Identify (06h): Supported 00:15:51.661 Abort (08h): Supported 00:15:51.661 Set Features (09h): Supported 00:15:51.661 Get Features (0Ah): Supported 00:15:51.661 Asynchronous Event Request (0Ch): Supported 00:15:51.661 Keep Alive (18h): Supported 00:15:51.661 I/O Commands 00:15:51.661 ------------ 00:15:51.661 Flush (00h): Supported LBA-Change 00:15:51.661 Write (01h): Supported LBA-Change 00:15:51.661 Read (02h): Supported 00:15:51.661 Compare (05h): Supported 00:15:51.661 Write Zeroes (08h): Supported LBA-Change 00:15:51.661 Dataset Management (09h): Supported LBA-Change 00:15:51.661 Copy (19h): Supported LBA-Change 00:15:51.661 Unknown (79h): Supported LBA-Change 00:15:51.661 Unknown (7Ah): Supported 00:15:51.661 00:15:51.661 Error Log 00:15:51.661 ========= 00:15:51.661 00:15:51.661 Arbitration 00:15:51.661 =========== 00:15:51.661 Arbitration Burst: 1 00:15:51.661 00:15:51.661 Power Management 00:15:51.661 ================ 00:15:51.661 Number of Power States: 1 00:15:51.661 Current Power State: Power State #0 00:15:51.661 Power State #0: 00:15:51.661 Max Power: 0.00 W 00:15:51.661 Non-Operational State: Operational 00:15:51.661 Entry Latency: Not Reported 00:15:51.661 Exit Latency: Not Reported 00:15:51.661 Relative Read Throughput: 0 00:15:51.661 Relative Read Latency: 0 00:15:51.661 Relative Write Throughput: 0 00:15:51.661 Relative Write Latency: 0 00:15:51.661 Idle Power: Not Reported 00:15:51.661 Active Power: Not Reported 00:15:51.661 Non-Operational Permissive Mode: Not Supported 00:15:51.661 00:15:51.661 Health Information 00:15:51.661 ================== 00:15:51.661 Critical Warnings: 00:15:51.661 Available Spare Space: OK 00:15:51.661 Temperature: OK 00:15:51.661 Device Reliability: OK 00:15:51.661 Read Only: No 00:15:51.661 Volatile Memory Backup: OK 00:15:51.661 Current Temperature: 0 Kelvin[2024-11-30 04:17:42.095158] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:184 cdw10:00000005 PRP1 0x0 PRP2 0x0 00:15:51.661 [2024-11-30 04:17:42.102982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: SUCCESS (00/00) qid:0 cid:184 cdw0:0 sqhd:0014 p:1 m:0 dnr:0 00:15:51.661 [2024-11-30 04:17:42.103026] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] Prepare to destruct SSD 00:15:51.661 [2024-11-30 04:17:42.103044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:190 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:51.661 [2024-11-30 04:17:42.103055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:189 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:51.661 [2024-11-30 04:17:42.103064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:188 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:51.661 [2024-11-30 04:17:42.103078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:187 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:15:51.661 [2024-11-30 04:17:42.103159] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x460001 00:15:51.661 [2024-11-30 04:17:42.103180] nvme_vfio_user.c: 49:nvme_vfio_ctrlr_set_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x14, value 0x464001 00:15:51.661 [2024-11-30 04:17:42.104202] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] RTD3E = 0 us 00:15:51.661 [2024-11-30 04:17:42.104217] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown timeout = 10000 ms 00:15:51.662 [2024-11-30 04:17:42.105167] nvme_vfio_user.c: 83:nvme_vfio_ctrlr_get_reg_4: *DEBUG*: ctrlr /var/run/vfio-user/domain/vfio-user2/2: offset 0x1c, value 0x9 00:15:51.662 [2024-11-30 04:17:42.105191] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [/var/run/vfio-user/domain/vfio-user2/2] shutdown complete in 0 milliseconds 00:15:51.662 [2024-11-30 04:17:42.105243] vfio_user_pci.c: 399:spdk_vfio_user_release: *DEBUG*: Release file /var/run/vfio-user/domain/vfio-user2/2/cntrl 00:15:51.662 [2024-11-30 04:17:42.107969] vfio_user_pci.c: 96:vfio_remove_mr: *DEBUG*: Remove memory region: FD 10, VADDR 0x200000200000, IOVA 0x200000200000, Size 0x200000 00:15:51.662 (-273 Celsius) 00:15:51.662 Temperature Threshold: 0 Kelvin (-273 Celsius) 00:15:51.662 Available Spare: 0% 00:15:51.662 Available Spare Threshold: 0% 00:15:51.662 Life Percentage Used: 0% 00:15:51.662 Data Units Read: 0 00:15:51.662 Data Units Written: 0 00:15:51.662 Host Read Commands: 0 00:15:51.662 Host Write Commands: 0 00:15:51.662 Controller Busy Time: 0 minutes 00:15:51.662 Power Cycles: 0 00:15:51.662 Power On Hours: 0 hours 00:15:51.662 Unsafe Shutdowns: 0 00:15:51.662 Unrecoverable Media Errors: 0 00:15:51.662 Lifetime Error Log Entries: 0 00:15:51.662 Warning Temperature Time: 0 minutes 00:15:51.662 Critical Temperature Time: 0 minutes 00:15:51.662 00:15:51.662 Number of Queues 00:15:51.662 ================ 00:15:51.662 Number of I/O Submission Queues: 127 00:15:51.662 Number of I/O Completion Queues: 127 00:15:51.662 00:15:51.662 Active Namespaces 00:15:51.662 ================= 00:15:51.662 Namespace ID:1 00:15:51.662 Error Recovery Timeout: Unlimited 00:15:51.662 Command Set Identifier: NVM (00h) 00:15:51.662 Deallocate: Supported 00:15:51.662 Deallocated/Unwritten Error: Not Supported 00:15:51.662 Deallocated Read Value: Unknown 00:15:51.662 Deallocate in Write Zeroes: Not Supported 00:15:51.662 Deallocated Guard Field: 0xFFFF 00:15:51.662 Flush: Supported 00:15:51.662 Reservation: Supported 00:15:51.662 Namespace Sharing Capabilities: Multiple Controllers 00:15:51.662 Size (in LBAs): 131072 (0GiB) 00:15:51.662 Capacity (in LBAs): 131072 (0GiB) 00:15:51.662 Utilization (in LBAs): 131072 (0GiB) 00:15:51.662 NGUID: 69ABF4C4EF214D589DFBB203778CB1EC 00:15:51.662 UUID: 69abf4c4-ef21-4d58-9dfb-b203778cb1ec 00:15:51.662 Thin Provisioning: Not Supported 00:15:51.662 Per-NS Atomic Units: Yes 00:15:51.662 Atomic Boundary Size (Normal): 0 00:15:51.662 Atomic Boundary Size (PFail): 0 00:15:51.662 Atomic Boundary Offset: 0 00:15:51.662 Maximum Single Source Range Length: 65535 00:15:51.662 Maximum Copy Length: 65535 00:15:51.662 Maximum Source Range Count: 1 00:15:51.662 NGUID/EUI64 Never Reused: No 00:15:51.662 Namespace Write Protected: No 00:15:51.662 Number of LBA Formats: 1 00:15:51.662 Current LBA Format: LBA Format #00 00:15:51.662 LBA Format #00: Data Size: 512 Metadata Size: 0 00:15:51.662 00:15:51.662 04:17:42 -- target/nvmf_vfio_user.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w read -t 5 -c 0x2 00:15:51.662 EAL: No free 2048 kB hugepages reported on node 1 00:15:56.925 Initializing NVMe Controllers 00:15:56.925 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:15:56.925 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:15:56.925 Initialization complete. Launching workers. 00:15:56.925 ======================================================== 00:15:56.925 Latency(us) 00:15:56.925 Device Information : IOPS MiB/s Average min max 00:15:56.925 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 37568.18 146.75 3406.51 1117.98 7615.58 00:15:56.925 ======================================================== 00:15:56.925 Total : 37568.18 146.75 3406.51 1117.98 7615.58 00:15:56.925 00:15:56.925 04:17:47 -- target/nvmf_vfio_user.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -s 256 -g -q 128 -o 4096 -w write -t 5 -c 0x2 00:15:56.925 EAL: No free 2048 kB hugepages reported on node 1 00:16:02.182 Initializing NVMe Controllers 00:16:02.182 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:02.182 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 with lcore 1 00:16:02.182 Initialization complete. Launching workers. 00:16:02.182 ======================================================== 00:16:02.182 Latency(us) 00:16:02.182 Device Information : IOPS MiB/s Average min max 00:16:02.182 VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) NSID 1 from core 1: 36329.41 141.91 3522.71 1166.18 8593.98 00:16:02.182 ======================================================== 00:16:02.182 Total : 36329.41 141.91 3522.71 1166.18 8593.98 00:16:02.182 00:16:02.182 04:17:52 -- target/nvmf_vfio_user.sh@86 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -g -q 32 -o 4096 -w randrw -M 50 -t 5 -c 0xE 00:16:02.182 EAL: No free 2048 kB hugepages reported on node 1 00:16:08.740 Initializing NVMe Controllers 00:16:08.740 Attaching to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:08.740 Attached to NVMe over Fabrics controller at /var/run/vfio-user/domain/vfio-user2/2:: nqn.2019-07.io.spdk:cnode2 00:16:08.740 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 1 00:16:08.740 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 2 00:16:08.740 Associating VFIOUSER (/var/run/vfio-user/domain/vfio-user2/2) with lcore 3 00:16:08.740 Initialization complete. Launching workers. 00:16:08.740 Starting thread on core 2 00:16:08.740 Starting thread on core 3 00:16:08.740 Starting thread on core 1 00:16:08.740 04:17:58 -- target/nvmf_vfio_user.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -t 3 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -d 256 -g 00:16:08.740 EAL: No free 2048 kB hugepages reported on node 1 00:16:11.272 Initializing NVMe Controllers 00:16:11.272 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:11.272 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:11.272 Associating SPDK bdev Controller (SPDK2 ) with lcore 0 00:16:11.272 Associating SPDK bdev Controller (SPDK2 ) with lcore 1 00:16:11.272 Associating SPDK bdev Controller (SPDK2 ) with lcore 2 00:16:11.272 Associating SPDK bdev Controller (SPDK2 ) with lcore 3 00:16:11.272 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration run with configuration: 00:16:11.272 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/arbitration -q 64 -s 131072 -w randrw -M 50 -l 0 -t 3 -c 0xf -m 0 -a 0 -b 0 -n 100000 -i -1 00:16:11.272 Initialization complete. Launching workers. 00:16:11.272 Starting thread on core 1 with urgent priority queue 00:16:11.272 Starting thread on core 2 with urgent priority queue 00:16:11.272 Starting thread on core 3 with urgent priority queue 00:16:11.272 Starting thread on core 0 with urgent priority queue 00:16:11.272 SPDK bdev Controller (SPDK2 ) core 0: 5885.67 IO/s 16.99 secs/100000 ios 00:16:11.272 SPDK bdev Controller (SPDK2 ) core 1: 6007.00 IO/s 16.65 secs/100000 ios 00:16:11.272 SPDK bdev Controller (SPDK2 ) core 2: 6429.00 IO/s 15.55 secs/100000 ios 00:16:11.272 SPDK bdev Controller (SPDK2 ) core 3: 5359.33 IO/s 18.66 secs/100000 ios 00:16:11.272 ======================================================== 00:16:11.272 00:16:11.272 04:18:01 -- target/nvmf_vfio_user.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/hello_world -d 256 -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:11.272 EAL: No free 2048 kB hugepages reported on node 1 00:16:11.272 Initializing NVMe Controllers 00:16:11.272 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:11.272 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:11.272 Namespace ID: 1 size: 0GB 00:16:11.272 Initialization complete. 00:16:11.272 INFO: using host memory buffer for IO 00:16:11.272 Hello world! 00:16:11.272 04:18:01 -- target/nvmf_vfio_user.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/overhead/overhead -o 4096 -t 1 -H -g -d 256 -r 'trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' 00:16:11.272 EAL: No free 2048 kB hugepages reported on node 1 00:16:12.645 Initializing NVMe Controllers 00:16:12.646 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:12.646 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:12.646 Initialization complete. Launching workers. 00:16:12.646 submit (in ns) avg, min, max = 8133.8, 3551.1, 4018277.8 00:16:12.646 complete (in ns) avg, min, max = 25262.3, 2092.2, 4020712.2 00:16:12.646 00:16:12.646 Submit histogram 00:16:12.646 ================ 00:16:12.646 Range in us Cumulative Count 00:16:12.646 3.532 - 3.556: 0.0224% ( 3) 00:16:12.646 3.556 - 3.579: 0.5234% ( 67) 00:16:12.646 3.579 - 3.603: 2.0561% ( 205) 00:16:12.646 3.603 - 3.627: 4.8374% ( 372) 00:16:12.646 3.627 - 3.650: 10.8785% ( 808) 00:16:12.646 3.650 - 3.674: 19.7159% ( 1182) 00:16:12.646 3.674 - 3.698: 28.2841% ( 1146) 00:16:12.646 3.698 - 3.721: 36.8299% ( 1143) 00:16:12.646 3.721 - 3.745: 42.2729% ( 728) 00:16:12.646 3.745 - 3.769: 50.0935% ( 1046) 00:16:12.646 3.769 - 3.793: 56.8449% ( 903) 00:16:12.646 3.793 - 3.816: 62.5944% ( 769) 00:16:12.646 3.816 - 3.840: 66.4673% ( 518) 00:16:12.646 3.840 - 3.864: 70.3925% ( 525) 00:16:12.646 3.864 - 3.887: 74.3178% ( 525) 00:16:12.646 3.887 - 3.911: 77.9664% ( 488) 00:16:12.646 3.911 - 3.935: 81.8467% ( 519) 00:16:12.646 3.935 - 3.959: 84.3738% ( 338) 00:16:12.646 3.959 - 3.982: 86.8037% ( 325) 00:16:12.646 3.982 - 4.006: 88.8374% ( 272) 00:16:12.646 4.006 - 4.030: 90.4897% ( 221) 00:16:12.646 4.030 - 4.053: 92.1271% ( 219) 00:16:12.646 4.053 - 4.077: 93.4056% ( 171) 00:16:12.646 4.077 - 4.101: 94.4224% ( 136) 00:16:12.646 4.101 - 4.124: 95.0804% ( 88) 00:16:12.646 4.124 - 4.148: 95.7009% ( 83) 00:16:12.646 4.148 - 4.172: 96.2019% ( 67) 00:16:12.646 4.172 - 4.196: 96.5009% ( 40) 00:16:12.646 4.196 - 4.219: 96.7850% ( 38) 00:16:12.646 4.219 - 4.243: 96.9570% ( 23) 00:16:12.646 4.243 - 4.267: 97.1140% ( 21) 00:16:12.646 4.267 - 4.290: 97.1888% ( 10) 00:16:12.646 4.290 - 4.314: 97.2636% ( 10) 00:16:12.646 4.314 - 4.338: 97.3533% ( 12) 00:16:12.646 4.338 - 4.361: 97.4280% ( 10) 00:16:12.646 4.361 - 4.385: 97.5103% ( 11) 00:16:12.646 4.385 - 4.409: 97.5925% ( 11) 00:16:12.646 4.409 - 4.433: 97.6598% ( 9) 00:16:12.646 4.433 - 4.456: 97.6972% ( 5) 00:16:12.646 4.456 - 4.480: 97.7346% ( 5) 00:16:12.646 4.480 - 4.504: 97.7944% ( 8) 00:16:12.646 4.504 - 4.527: 97.8243% ( 4) 00:16:12.646 4.527 - 4.551: 97.8318% ( 1) 00:16:12.646 4.575 - 4.599: 97.8467% ( 2) 00:16:12.646 4.599 - 4.622: 97.8542% ( 1) 00:16:12.646 4.622 - 4.646: 97.8692% ( 2) 00:16:12.646 4.646 - 4.670: 97.8766% ( 1) 00:16:12.646 4.693 - 4.717: 97.8841% ( 1) 00:16:12.646 4.717 - 4.741: 97.8991% ( 2) 00:16:12.646 4.764 - 4.788: 97.9215% ( 3) 00:16:12.646 4.788 - 4.812: 97.9813% ( 8) 00:16:12.646 4.812 - 4.836: 98.0262% ( 6) 00:16:12.646 4.836 - 4.859: 98.0561% ( 4) 00:16:12.646 4.859 - 4.883: 98.1234% ( 9) 00:16:12.646 4.883 - 4.907: 98.1383% ( 2) 00:16:12.646 4.907 - 4.930: 98.1607% ( 3) 00:16:12.646 4.930 - 4.954: 98.2131% ( 7) 00:16:12.646 4.954 - 4.978: 98.2804% ( 9) 00:16:12.646 4.978 - 5.001: 98.2953% ( 2) 00:16:12.646 5.001 - 5.025: 98.3028% ( 1) 00:16:12.646 5.025 - 5.049: 98.3327% ( 4) 00:16:12.646 5.049 - 5.073: 98.3626% ( 4) 00:16:12.646 5.073 - 5.096: 98.3701% ( 1) 00:16:12.646 5.096 - 5.120: 98.3850% ( 2) 00:16:12.646 5.120 - 5.144: 98.4374% ( 7) 00:16:12.646 5.144 - 5.167: 98.4822% ( 6) 00:16:12.646 5.167 - 5.191: 98.5121% ( 4) 00:16:12.646 5.191 - 5.215: 98.5346% ( 3) 00:16:12.646 5.215 - 5.239: 98.5495% ( 2) 00:16:12.646 5.262 - 5.286: 98.5570% ( 1) 00:16:12.646 5.286 - 5.310: 98.5794% ( 3) 00:16:12.646 5.310 - 5.333: 98.5869% ( 1) 00:16:12.646 5.357 - 5.381: 98.5944% ( 1) 00:16:12.646 5.381 - 5.404: 98.6093% ( 2) 00:16:12.646 5.404 - 5.428: 98.6243% ( 2) 00:16:12.646 5.428 - 5.452: 98.6467% ( 3) 00:16:12.646 5.452 - 5.476: 98.6617% ( 2) 00:16:12.646 5.499 - 5.523: 98.6692% ( 1) 00:16:12.646 5.523 - 5.547: 98.6766% ( 1) 00:16:12.646 5.547 - 5.570: 98.6841% ( 1) 00:16:12.646 5.665 - 5.689: 98.6916% ( 1) 00:16:12.646 6.495 - 6.542: 98.6991% ( 1) 00:16:12.646 6.637 - 6.684: 98.7065% ( 1) 00:16:12.646 7.016 - 7.064: 98.7290% ( 3) 00:16:12.646 7.253 - 7.301: 98.7439% ( 2) 00:16:12.646 7.348 - 7.396: 98.7514% ( 1) 00:16:12.646 7.443 - 7.490: 98.7589% ( 1) 00:16:12.646 7.490 - 7.538: 98.7664% ( 1) 00:16:12.646 7.633 - 7.680: 98.7813% ( 2) 00:16:12.646 7.680 - 7.727: 98.7963% ( 2) 00:16:12.646 7.727 - 7.775: 98.8037% ( 1) 00:16:12.646 7.822 - 7.870: 98.8187% ( 2) 00:16:12.646 7.870 - 7.917: 98.8336% ( 2) 00:16:12.646 7.917 - 7.964: 98.8411% ( 1) 00:16:12.646 8.012 - 8.059: 98.8486% ( 1) 00:16:12.646 8.059 - 8.107: 98.8561% ( 1) 00:16:12.646 8.107 - 8.154: 98.8636% ( 1) 00:16:12.646 8.154 - 8.201: 98.8785% ( 2) 00:16:12.646 8.201 - 8.249: 98.8935% ( 2) 00:16:12.646 8.344 - 8.391: 98.9009% ( 1) 00:16:12.646 8.391 - 8.439: 98.9084% ( 1) 00:16:12.646 8.486 - 8.533: 98.9159% ( 1) 00:16:12.646 8.628 - 8.676: 98.9234% ( 1) 00:16:12.646 8.723 - 8.770: 98.9383% ( 2) 00:16:12.646 8.770 - 8.818: 98.9458% ( 1) 00:16:12.646 8.913 - 8.960: 98.9533% ( 1) 00:16:12.646 9.197 - 9.244: 98.9607% ( 1) 00:16:12.646 9.434 - 9.481: 98.9757% ( 2) 00:16:12.646 9.481 - 9.529: 98.9832% ( 1) 00:16:12.646 10.572 - 10.619: 98.9907% ( 1) 00:16:12.646 11.141 - 11.188: 98.9981% ( 1) 00:16:12.646 11.236 - 11.283: 99.0056% ( 1) 00:16:12.646 11.425 - 11.473: 99.0131% ( 1) 00:16:12.646 11.710 - 11.757: 99.0206% ( 1) 00:16:12.646 11.757 - 11.804: 99.0355% ( 2) 00:16:12.646 11.899 - 11.947: 99.0430% ( 1) 00:16:12.646 12.326 - 12.421: 99.0505% ( 1) 00:16:12.646 12.610 - 12.705: 99.0579% ( 1) 00:16:12.646 13.084 - 13.179: 99.0729% ( 2) 00:16:12.646 13.274 - 13.369: 99.0804% ( 1) 00:16:12.646 13.843 - 13.938: 99.0879% ( 1) 00:16:12.646 13.938 - 14.033: 99.0953% ( 1) 00:16:12.646 14.127 - 14.222: 99.1028% ( 1) 00:16:12.646 14.222 - 14.317: 99.1103% ( 1) 00:16:12.646 14.317 - 14.412: 99.1178% ( 1) 00:16:12.646 14.412 - 14.507: 99.1252% ( 1) 00:16:12.646 14.507 - 14.601: 99.1327% ( 1) 00:16:12.646 14.601 - 14.696: 99.1402% ( 1) 00:16:12.646 14.696 - 14.791: 99.1477% ( 1) 00:16:12.646 15.455 - 15.550: 99.1551% ( 1) 00:16:12.646 17.446 - 17.541: 99.1626% ( 1) 00:16:12.647 17.541 - 17.636: 99.1701% ( 1) 00:16:12.647 17.636 - 17.730: 99.1925% ( 3) 00:16:12.647 17.730 - 17.825: 99.2449% ( 7) 00:16:12.647 17.825 - 17.920: 99.2523% ( 1) 00:16:12.647 17.920 - 18.015: 99.2673% ( 2) 00:16:12.647 18.015 - 18.110: 99.3047% ( 5) 00:16:12.647 18.110 - 18.204: 99.3869% ( 11) 00:16:12.647 18.204 - 18.299: 99.4393% ( 7) 00:16:12.647 18.299 - 18.394: 99.4916% ( 7) 00:16:12.647 18.394 - 18.489: 99.5439% ( 7) 00:16:12.647 18.489 - 18.584: 99.5888% ( 6) 00:16:12.647 18.584 - 18.679: 99.6187% ( 4) 00:16:12.647 18.679 - 18.773: 99.6710% ( 7) 00:16:12.647 18.773 - 18.868: 99.7308% ( 8) 00:16:12.647 18.868 - 18.963: 99.7533% ( 3) 00:16:12.647 18.963 - 19.058: 99.7757% ( 3) 00:16:12.647 19.058 - 19.153: 99.8056% ( 4) 00:16:12.647 19.153 - 19.247: 99.8355% ( 4) 00:16:12.647 19.247 - 19.342: 99.8430% ( 1) 00:16:12.647 19.342 - 19.437: 99.8505% ( 1) 00:16:12.647 19.532 - 19.627: 99.8579% ( 1) 00:16:12.647 19.721 - 19.816: 99.8654% ( 1) 00:16:12.647 19.816 - 19.911: 99.8729% ( 1) 00:16:12.647 20.196 - 20.290: 99.8804% ( 1) 00:16:12.647 21.713 - 21.807: 99.8879% ( 1) 00:16:12.647 21.997 - 22.092: 99.8953% ( 1) 00:16:12.647 3980.705 - 4004.978: 99.9701% ( 10) 00:16:12.647 4004.978 - 4029.250: 100.0000% ( 4) 00:16:12.647 00:16:12.647 Complete histogram 00:16:12.647 ================== 00:16:12.647 Range in us Cumulative Count 00:16:12.647 2.086 - 2.098: 0.0897% ( 12) 00:16:12.647 2.098 - 2.110: 4.6579% ( 611) 00:16:12.647 2.110 - 2.121: 13.6748% ( 1206) 00:16:12.647 2.121 - 2.133: 15.2075% ( 205) 00:16:12.647 2.133 - 2.145: 33.4953% ( 2446) 00:16:12.647 2.145 - 2.157: 54.0037% ( 2743) 00:16:12.647 2.157 - 2.169: 59.6636% ( 757) 00:16:12.647 2.169 - 2.181: 63.5888% ( 525) 00:16:12.647 2.181 - 2.193: 67.5065% ( 524) 00:16:12.647 2.193 - 2.204: 68.3140% ( 108) 00:16:12.647 2.204 - 2.216: 77.4131% ( 1217) 00:16:12.647 2.216 - 2.228: 88.3364% ( 1461) 00:16:12.647 2.228 - 2.240: 90.9757% ( 353) 00:16:12.647 2.240 - 2.252: 93.1439% ( 290) 00:16:12.647 2.252 - 2.264: 94.0636% ( 123) 00:16:12.647 2.264 - 2.276: 94.5271% ( 62) 00:16:12.647 2.276 - 2.287: 95.5813% ( 141) 00:16:12.647 2.287 - 2.299: 95.9701% ( 52) 00:16:12.647 2.299 - 2.311: 96.0598% ( 12) 00:16:12.647 2.311 - 2.323: 96.1421% ( 11) 00:16:12.647 2.323 - 2.335: 96.2243% ( 11) 00:16:12.647 2.335 - 2.347: 96.2916% ( 9) 00:16:12.647 2.347 - 2.359: 96.3888% ( 13) 00:16:12.647 2.359 - 2.370: 96.4785% ( 12) 00:16:12.647 2.370 - 2.382: 96.5084% ( 4) 00:16:12.647 2.382 - 2.394: 96.5308% ( 3) 00:16:12.647 2.394 - 2.406: 96.6280% ( 13) 00:16:12.647 2.406 - 2.418: 96.7626% ( 18) 00:16:12.647 2.418 - 2.430: 96.9121% ( 20) 00:16:12.647 2.430 - 2.441: 97.2262% ( 42) 00:16:12.647 2.441 - 2.453: 97.4879% ( 35) 00:16:12.647 2.453 - 2.465: 97.7794% ( 39) 00:16:12.647 2.465 - 2.477: 97.9888% ( 28) 00:16:12.647 2.477 - 2.489: 98.1981% ( 28) 00:16:12.647 2.489 - 2.501: 98.3551% ( 21) 00:16:12.647 2.501 - 2.513: 98.4449% ( 12) 00:16:12.647 2.513 - 2.524: 98.4822% ( 5) 00:16:12.647 2.524 - 2.536: 98.5196% ( 5) 00:16:12.647 2.536 - 2.548: 98.5271% ( 1) 00:16:12.647 2.548 - 2.560: 98.5346% ( 1) 00:16:12.647 2.560 - 2.572: 98.5570% ( 3) 00:16:12.647 2.572 - 2.584: 98.5720% ( 2) 00:16:12.647 2.584 - 2.596: 98.5794% ( 1) 00:16:12.647 2.596 - 2.607: 98.6019% ( 3) 00:16:12.647 2.607 - 2.619: 98.6093% ( 1) 00:16:12.647 2.619 - 2.631: 98.6318% ( 3) 00:16:12.647 2.631 - 2.643: 98.6393% ( 1) 00:16:12.647 2.679 - 2.690: 98.6542% ( 2) 00:16:12.647 2.690 - 2.702: 98.6617% ( 1) 00:16:12.647 2.714 - 2.726: 98.6692% ( 1) 00:16:12.647 2.738 - 2.750: 98.6766% ( 1) 00:16:12.647 2.750 - 2.761: 98.6916% ( 2) 00:16:12.647 2.785 - 2.797: 98.6991% ( 1) 00:16:12.647 2.809 - 2.821: 98.7140% ( 2) 00:16:12.647 2.821 - 2.833: 98.7215% ( 1) 00:16:12.647 2.975 - 2.987: 98.7290% ( 1) 00:16:12.647 3.342 - 3.366: 98.7364% ( 1) 00:16:12.647 3.390 - 3.413: 98.7439% ( 1) 00:16:12.647 3.413 - 3.437: 98.7664% ( 3) 00:16:12.647 3.437 - 3.461: 98.7888% ( 3) 00:16:12.647 3.461 - 3.484: 98.8037% ( 2) 00:16:12.647 3.484 - 3.508: 98.8486% ( 6) 00:16:12.647 3.508 - 3.532: 98.8636% ( 2) 00:16:12.647 3.556 - 3.579: 98.8710% ( 1) 00:16:12.647 3.579 - 3.603: 98.8785% ( 1) 00:16:12.647 3.603 - 3.627: 98.8935% ( 2) 00:16:12.647 3.698 - 3.721: 98.9009% ( 1) 00:16:12.647 3.721 - 3.745: 98.9084% ( 1) 00:16:12.647 3.745 - 3.769: 98.9159% ( 1) 00:16:12.647 3.887 - 3.911: 98.9234% ( 1) 00:16:12.647 3.911 - 3.935: 98.9308% ( 1) 00:16:12.647 3.959 - 3.982: 98.9383% ( 1) 00:16:12.647 4.030 - 4.053: 98.9458% ( 1) 00:16:12.647 4.053 - 4.077: 98.9533% ( 1) 00:16:12.647 4.930 - 4.954: 98.9607% ( 1) 00:16:12.647 5.452 - 5.476: 98.9682% ( 1) 00:16:12.647 5.926 - 5.950: 98.9757% ( 1) 00:16:12.647 6.116 - 6.163: 98.9832% ( 1) 00:16:12.647 6.400 - 6.447: 98.9907% ( 1) 00:16:12.647 6.684 - 6.732: 98.9981% ( 1) 00:16:12.647 6.732 - 6.779: 99.0056% ( 1) 00:16:12.647 6.874 - 6.921: 99.0131% ( 1) 00:16:12.647 6.921 - 6.969: 99.0206% ( 1) 00:16:12.647 7.016 - 7.064: 99.0280% ( 1) 00:16:12.647 7.443 - 7.490: 99.0355% ( 1) 00:16:12.647 15.455 - 15.550: 99.0430% ( 1) 00:16:12.647 15.739 - 15.834: 99.0579% ( 2) 00:16:12.647 15.834 - 15.929: 99.0654% ( 1) 00:16:12.647 15.929 - 16.024: 99.0729% ( 1) 00:16:12.647 16.024 - 16.119: 99.0804% ( 1) 00:16:12.647 16.119 - 16.213: 99.0879% ( 1) 00:16:12.647 16.213 - 16.308: 99.1103% ( 3) 00:16:12.647 16.308 - 16.403: 99.1252% ( 2) 00:16:12.647 16.403 - 16.498: 99.1327% ( 1) 00:16:12.647 16.498 - 16.593: 99.1701% ( 5) 00:16:12.647 16.593 - 16.687: 99.2000% ( 4) 00:16:12.647 16.687 - 16.782: 99.2449% ( 6) 00:16:12.647 16.782 - 16.877: 99.2822% ( 5) 00:16:12.647 16.877 - 16.972: 99.2897% ( 1) 00:16:12.647 17.067 - 17.161: 99.3271% ( 5) 00:16:12.647 17.161 - 17.256: 99.3346% ( 1) 00:16:12.647 17.256 - 17.351: 99.3495% ( 2) 00:16:12.647 17.351 - 17.446: 99.3645% ( 2) 00:16:12.647 17.446 - 17.541: 99.3720% ( 1) 00:16:12.647 17.541 - 17.636: 99.3794% ( 1) 00:16:12.648 17.636 - 17.730: 99.3869% ( 1) 00:16:12.648 17.730 - 17.825: 99.3944% ( 1) 00:16:12.648 18.204 - 18.299: 99.4019% ( 1) 00:16:12.648 18.773 - 18.868: 99.4093% ( 1) 00:16:12.648 19.247 - 19.342: 99.4168% ( 1) 00:16:12.648 19.532 - 19.627: 99.4243% ( 1) 00:16:12.648 3980.705 - 4004.978: 99.9402% ( 69) 00:16:12.648 4004.978 - 4029.250: 100.0000% ( 8) 00:16:12.648 00:16:12.648 04:18:03 -- target/nvmf_vfio_user.sh@90 -- # aer_vfio_user /var/run/vfio-user/domain/vfio-user2/2 nqn.2019-07.io.spdk:cnode2 2 00:16:12.648 04:18:03 -- target/nvmf_vfio_user.sh@22 -- # local traddr=/var/run/vfio-user/domain/vfio-user2/2 00:16:12.648 04:18:03 -- target/nvmf_vfio_user.sh@23 -- # local subnqn=nqn.2019-07.io.spdk:cnode2 00:16:12.648 04:18:03 -- target/nvmf_vfio_user.sh@24 -- # local malloc_num=Malloc4 00:16:12.648 04:18:03 -- target/nvmf_vfio_user.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:12.907 [ 00:16:12.907 { 00:16:12.907 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:12.907 "subtype": "Discovery", 00:16:12.907 "listen_addresses": [], 00:16:12.907 "allow_any_host": true, 00:16:12.907 "hosts": [] 00:16:12.907 }, 00:16:12.907 { 00:16:12.907 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:12.907 "subtype": "NVMe", 00:16:12.907 "listen_addresses": [ 00:16:12.907 { 00:16:12.907 "transport": "VFIOUSER", 00:16:12.907 "trtype": "VFIOUSER", 00:16:12.907 "adrfam": "IPv4", 00:16:12.907 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:12.907 "trsvcid": "0" 00:16:12.907 } 00:16:12.907 ], 00:16:12.907 "allow_any_host": true, 00:16:12.907 "hosts": [], 00:16:12.907 "serial_number": "SPDK1", 00:16:12.907 "model_number": "SPDK bdev Controller", 00:16:12.907 "max_namespaces": 32, 00:16:12.907 "min_cntlid": 1, 00:16:12.907 "max_cntlid": 65519, 00:16:12.907 "namespaces": [ 00:16:12.907 { 00:16:12.907 "nsid": 1, 00:16:12.907 "bdev_name": "Malloc1", 00:16:12.907 "name": "Malloc1", 00:16:12.907 "nguid": "2C45BC1DAC6E4216ACAF566D75F4348B", 00:16:12.907 "uuid": "2c45bc1d-ac6e-4216-acaf-566d75f4348b" 00:16:12.907 }, 00:16:12.907 { 00:16:12.907 "nsid": 2, 00:16:12.907 "bdev_name": "Malloc3", 00:16:12.907 "name": "Malloc3", 00:16:12.907 "nguid": "69287FF0577447E88762A2691C42F9C2", 00:16:12.907 "uuid": "69287ff0-5774-47e8-8762-a2691c42f9c2" 00:16:12.907 } 00:16:12.907 ] 00:16:12.907 }, 00:16:12.907 { 00:16:12.907 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:12.907 "subtype": "NVMe", 00:16:12.907 "listen_addresses": [ 00:16:12.907 { 00:16:12.907 "transport": "VFIOUSER", 00:16:12.907 "trtype": "VFIOUSER", 00:16:12.907 "adrfam": "IPv4", 00:16:12.907 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:12.907 "trsvcid": "0" 00:16:12.907 } 00:16:12.907 ], 00:16:12.907 "allow_any_host": true, 00:16:12.907 "hosts": [], 00:16:12.907 "serial_number": "SPDK2", 00:16:12.907 "model_number": "SPDK bdev Controller", 00:16:12.907 "max_namespaces": 32, 00:16:12.907 "min_cntlid": 1, 00:16:12.907 "max_cntlid": 65519, 00:16:12.907 "namespaces": [ 00:16:12.907 { 00:16:12.907 "nsid": 1, 00:16:12.907 "bdev_name": "Malloc2", 00:16:12.907 "name": "Malloc2", 00:16:12.907 "nguid": "69ABF4C4EF214D589DFBB203778CB1EC", 00:16:12.907 "uuid": "69abf4c4-ef21-4d58-9dfb-b203778cb1ec" 00:16:12.907 } 00:16:12.907 ] 00:16:12.907 } 00:16:12.907 ] 00:16:12.907 04:18:03 -- target/nvmf_vfio_user.sh@27 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:16:12.907 04:18:03 -- target/nvmf_vfio_user.sh@34 -- # aerpid=2340392 00:16:12.907 04:18:03 -- target/nvmf_vfio_user.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:VFIOUSER traddr:/var/run/vfio-user/domain/vfio-user2/2 subnqn:nqn.2019-07.io.spdk:cnode2' -n 2 -g -t /tmp/aer_touch_file 00:16:12.907 04:18:03 -- target/nvmf_vfio_user.sh@37 -- # waitforfile /tmp/aer_touch_file 00:16:12.907 04:18:03 -- common/autotest_common.sh@1254 -- # local i=0 00:16:12.907 04:18:03 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:12.907 04:18:03 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:16:12.907 04:18:03 -- common/autotest_common.sh@1265 -- # return 0 00:16:12.907 04:18:03 -- target/nvmf_vfio_user.sh@38 -- # rm -f /tmp/aer_touch_file 00:16:12.907 04:18:03 -- target/nvmf_vfio_user.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 --name Malloc4 00:16:12.907 EAL: No free 2048 kB hugepages reported on node 1 00:16:13.165 Malloc4 00:16:13.165 04:18:03 -- target/nvmf_vfio_user.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc4 -n 2 00:16:13.423 04:18:03 -- target/nvmf_vfio_user.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_get_subsystems 00:16:13.423 Asynchronous Event Request test 00:16:13.423 Attaching to /var/run/vfio-user/domain/vfio-user2/2 00:16:13.423 Attached to /var/run/vfio-user/domain/vfio-user2/2 00:16:13.423 Registering asynchronous event callbacks... 00:16:13.423 Starting namespace attribute notice tests for all controllers... 00:16:13.423 /var/run/vfio-user/domain/vfio-user2/2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:16:13.423 aer_cb - Changed Namespace 00:16:13.423 Cleaning up... 00:16:13.681 [ 00:16:13.681 { 00:16:13.681 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:16:13.681 "subtype": "Discovery", 00:16:13.681 "listen_addresses": [], 00:16:13.681 "allow_any_host": true, 00:16:13.681 "hosts": [] 00:16:13.681 }, 00:16:13.681 { 00:16:13.681 "nqn": "nqn.2019-07.io.spdk:cnode1", 00:16:13.681 "subtype": "NVMe", 00:16:13.681 "listen_addresses": [ 00:16:13.681 { 00:16:13.681 "transport": "VFIOUSER", 00:16:13.681 "trtype": "VFIOUSER", 00:16:13.681 "adrfam": "IPv4", 00:16:13.681 "traddr": "/var/run/vfio-user/domain/vfio-user1/1", 00:16:13.681 "trsvcid": "0" 00:16:13.681 } 00:16:13.681 ], 00:16:13.681 "allow_any_host": true, 00:16:13.681 "hosts": [], 00:16:13.681 "serial_number": "SPDK1", 00:16:13.681 "model_number": "SPDK bdev Controller", 00:16:13.681 "max_namespaces": 32, 00:16:13.681 "min_cntlid": 1, 00:16:13.681 "max_cntlid": 65519, 00:16:13.681 "namespaces": [ 00:16:13.681 { 00:16:13.681 "nsid": 1, 00:16:13.681 "bdev_name": "Malloc1", 00:16:13.681 "name": "Malloc1", 00:16:13.681 "nguid": "2C45BC1DAC6E4216ACAF566D75F4348B", 00:16:13.681 "uuid": "2c45bc1d-ac6e-4216-acaf-566d75f4348b" 00:16:13.681 }, 00:16:13.681 { 00:16:13.681 "nsid": 2, 00:16:13.681 "bdev_name": "Malloc3", 00:16:13.681 "name": "Malloc3", 00:16:13.681 "nguid": "69287FF0577447E88762A2691C42F9C2", 00:16:13.681 "uuid": "69287ff0-5774-47e8-8762-a2691c42f9c2" 00:16:13.681 } 00:16:13.681 ] 00:16:13.681 }, 00:16:13.681 { 00:16:13.681 "nqn": "nqn.2019-07.io.spdk:cnode2", 00:16:13.681 "subtype": "NVMe", 00:16:13.681 "listen_addresses": [ 00:16:13.681 { 00:16:13.681 "transport": "VFIOUSER", 00:16:13.681 "trtype": "VFIOUSER", 00:16:13.681 "adrfam": "IPv4", 00:16:13.681 "traddr": "/var/run/vfio-user/domain/vfio-user2/2", 00:16:13.681 "trsvcid": "0" 00:16:13.681 } 00:16:13.681 ], 00:16:13.681 "allow_any_host": true, 00:16:13.681 "hosts": [], 00:16:13.681 "serial_number": "SPDK2", 00:16:13.681 "model_number": "SPDK bdev Controller", 00:16:13.681 "max_namespaces": 32, 00:16:13.681 "min_cntlid": 1, 00:16:13.681 "max_cntlid": 65519, 00:16:13.681 "namespaces": [ 00:16:13.681 { 00:16:13.681 "nsid": 1, 00:16:13.681 "bdev_name": "Malloc2", 00:16:13.681 "name": "Malloc2", 00:16:13.681 "nguid": "69ABF4C4EF214D589DFBB203778CB1EC", 00:16:13.681 "uuid": "69abf4c4-ef21-4d58-9dfb-b203778cb1ec" 00:16:13.681 }, 00:16:13.681 { 00:16:13.681 "nsid": 2, 00:16:13.681 "bdev_name": "Malloc4", 00:16:13.681 "name": "Malloc4", 00:16:13.681 "nguid": "7B065407DE3C474EB3CD5B26F52C09F6", 00:16:13.681 "uuid": "7b065407-de3c-474e-b3cd-5b26f52c09f6" 00:16:13.681 } 00:16:13.681 ] 00:16:13.681 } 00:16:13.681 ] 00:16:13.681 04:18:04 -- target/nvmf_vfio_user.sh@44 -- # wait 2340392 00:16:13.681 04:18:04 -- target/nvmf_vfio_user.sh@105 -- # stop_nvmf_vfio_user 00:16:13.681 04:18:04 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2334488 00:16:13.681 04:18:04 -- common/autotest_common.sh@936 -- # '[' -z 2334488 ']' 00:16:13.681 04:18:04 -- common/autotest_common.sh@940 -- # kill -0 2334488 00:16:13.681 04:18:04 -- common/autotest_common.sh@941 -- # uname 00:16:13.681 04:18:04 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:13.681 04:18:04 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2334488 00:16:13.681 04:18:04 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:13.681 04:18:04 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:13.681 04:18:04 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2334488' 00:16:13.681 killing process with pid 2334488 00:16:13.681 04:18:04 -- common/autotest_common.sh@955 -- # kill 2334488 00:16:13.681 [2024-11-30 04:18:04.268609] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:16:13.681 04:18:04 -- common/autotest_common.sh@960 -- # wait 2334488 00:16:14.248 04:18:04 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:14.248 04:18:04 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:14.248 04:18:04 -- target/nvmf_vfio_user.sh@108 -- # setup_nvmf_vfio_user --interrupt-mode '-M -I' 00:16:14.248 04:18:04 -- target/nvmf_vfio_user.sh@51 -- # local nvmf_app_args=--interrupt-mode 00:16:14.248 04:18:04 -- target/nvmf_vfio_user.sh@52 -- # local 'transport_args=-M -I' 00:16:14.248 04:18:04 -- target/nvmf_vfio_user.sh@55 -- # nvmfpid=2340539 00:16:14.248 04:18:04 -- target/nvmf_vfio_user.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m '[0,1,2,3]' --interrupt-mode 00:16:14.248 04:18:04 -- target/nvmf_vfio_user.sh@57 -- # echo 'Process pid: 2340539' 00:16:14.248 Process pid: 2340539 00:16:14.248 04:18:04 -- target/nvmf_vfio_user.sh@59 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:14.248 04:18:04 -- target/nvmf_vfio_user.sh@60 -- # waitforlisten 2340539 00:16:14.248 04:18:04 -- common/autotest_common.sh@829 -- # '[' -z 2340539 ']' 00:16:14.248 04:18:04 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:14.248 04:18:04 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:14.248 04:18:04 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:14.248 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:14.248 04:18:04 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:14.248 04:18:04 -- common/autotest_common.sh@10 -- # set +x 00:16:14.248 [2024-11-30 04:18:04.623753] thread.c:2929:spdk_interrupt_mode_enable: *NOTICE*: Set SPDK running in interrupt mode. 00:16:14.248 [2024-11-30 04:18:04.624809] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:14.248 [2024-11-30 04:18:04.624866] [ DPDK EAL parameters: nvmf -l 0,1,2,3 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:14.248 EAL: No free 2048 kB hugepages reported on node 1 00:16:14.248 [2024-11-30 04:18:04.688534] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:16:14.248 [2024-11-30 04:18:04.777591] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:14.248 [2024-11-30 04:18:04.777754] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:14.248 [2024-11-30 04:18:04.777774] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:14.249 [2024-11-30 04:18:04.777787] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:14.249 [2024-11-30 04:18:04.777875] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:14.249 [2024-11-30 04:18:04.777967] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:14.249 [2024-11-30 04:18:04.777991] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:16:14.249 [2024-11-30 04:18:04.777994] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:14.249 [2024-11-30 04:18:04.875314] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_0) to intr mode from intr mode. 00:16:14.249 [2024-11-30 04:18:04.875582] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_1) to intr mode from intr mode. 00:16:14.249 [2024-11-30 04:18:04.875820] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_2) to intr mode from intr mode. 00:16:14.249 [2024-11-30 04:18:04.876596] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (app_thread) to intr mode from intr mode. 00:16:14.249 [2024-11-30 04:18:04.876694] thread.c:2087:spdk_thread_set_interrupt_mode: *NOTICE*: Set spdk_thread (nvmf_tgt_poll_group_3) to intr mode from intr mode. 00:16:15.180 04:18:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:15.180 04:18:05 -- common/autotest_common.sh@862 -- # return 0 00:16:15.180 04:18:05 -- target/nvmf_vfio_user.sh@62 -- # sleep 1 00:16:16.114 04:18:06 -- target/nvmf_vfio_user.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t VFIOUSER -M -I 00:16:16.372 04:18:06 -- target/nvmf_vfio_user.sh@66 -- # mkdir -p /var/run/vfio-user 00:16:16.372 04:18:06 -- target/nvmf_vfio_user.sh@68 -- # seq 1 2 00:16:16.372 04:18:06 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:16.372 04:18:06 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user1/1 00:16:16.372 04:18:06 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:16:16.630 Malloc1 00:16:16.630 04:18:07 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode1 -a -s SPDK1 00:16:16.887 04:18:07 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode1 Malloc1 00:16:17.145 04:18:07 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode1 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user1/1 -s 0 00:16:17.403 04:18:07 -- target/nvmf_vfio_user.sh@68 -- # for i in $(seq 1 $NUM_DEVICES) 00:16:17.403 04:18:07 -- target/nvmf_vfio_user.sh@69 -- # mkdir -p /var/run/vfio-user/domain/vfio-user2/2 00:16:17.403 04:18:07 -- target/nvmf_vfio_user.sh@71 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc2 00:16:17.661 Malloc2 00:16:17.661 04:18:08 -- target/nvmf_vfio_user.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2019-07.io.spdk:cnode2 -a -s SPDK2 00:16:17.918 04:18:08 -- target/nvmf_vfio_user.sh@73 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2019-07.io.spdk:cnode2 Malloc2 00:16:18.177 04:18:08 -- target/nvmf_vfio_user.sh@74 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2019-07.io.spdk:cnode2 -t VFIOUSER -a /var/run/vfio-user/domain/vfio-user2/2 -s 0 00:16:18.435 04:18:09 -- target/nvmf_vfio_user.sh@109 -- # stop_nvmf_vfio_user 00:16:18.435 04:18:09 -- target/nvmf_vfio_user.sh@95 -- # killprocess 2340539 00:16:18.435 04:18:09 -- common/autotest_common.sh@936 -- # '[' -z 2340539 ']' 00:16:18.435 04:18:09 -- common/autotest_common.sh@940 -- # kill -0 2340539 00:16:18.435 04:18:09 -- common/autotest_common.sh@941 -- # uname 00:16:18.435 04:18:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:18.435 04:18:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2340539 00:16:18.694 04:18:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:18.694 04:18:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:18.694 04:18:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2340539' 00:16:18.694 killing process with pid 2340539 00:16:18.694 04:18:09 -- common/autotest_common.sh@955 -- # kill 2340539 00:16:18.694 04:18:09 -- common/autotest_common.sh@960 -- # wait 2340539 00:16:18.982 04:18:09 -- target/nvmf_vfio_user.sh@97 -- # rm -rf /var/run/vfio-user 00:16:18.982 04:18:09 -- target/nvmf_vfio_user.sh@99 -- # trap - SIGINT SIGTERM EXIT 00:16:18.982 00:16:18.982 real 0m54.118s 00:16:18.982 user 3m34.094s 00:16:18.982 sys 0m4.599s 00:16:18.982 04:18:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:18.982 04:18:09 -- common/autotest_common.sh@10 -- # set +x 00:16:18.982 ************************************ 00:16:18.982 END TEST nvmf_vfio_user 00:16:18.982 ************************************ 00:16:18.982 04:18:09 -- nvmf/nvmf.sh@41 -- # run_test nvmf_vfio_user_nvme_compliance /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:18.982 04:18:09 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:18.982 04:18:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:18.982 04:18:09 -- common/autotest_common.sh@10 -- # set +x 00:16:18.982 ************************************ 00:16:18.982 START TEST nvmf_vfio_user_nvme_compliance 00:16:18.982 ************************************ 00:16:18.982 04:18:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/compliance.sh --transport=tcp 00:16:18.982 * Looking for test storage... 00:16:18.982 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance 00:16:18.982 04:18:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:18.982 04:18:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:18.982 04:18:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:18.982 04:18:09 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:18.982 04:18:09 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:18.982 04:18:09 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:18.982 04:18:09 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:18.982 04:18:09 -- scripts/common.sh@335 -- # IFS=.-: 00:16:18.982 04:18:09 -- scripts/common.sh@335 -- # read -ra ver1 00:16:18.982 04:18:09 -- scripts/common.sh@336 -- # IFS=.-: 00:16:18.982 04:18:09 -- scripts/common.sh@336 -- # read -ra ver2 00:16:18.982 04:18:09 -- scripts/common.sh@337 -- # local 'op=<' 00:16:18.982 04:18:09 -- scripts/common.sh@339 -- # ver1_l=2 00:16:18.982 04:18:09 -- scripts/common.sh@340 -- # ver2_l=1 00:16:18.982 04:18:09 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:18.982 04:18:09 -- scripts/common.sh@343 -- # case "$op" in 00:16:18.982 04:18:09 -- scripts/common.sh@344 -- # : 1 00:16:18.982 04:18:09 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:18.982 04:18:09 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:18.982 04:18:09 -- scripts/common.sh@364 -- # decimal 1 00:16:18.982 04:18:09 -- scripts/common.sh@352 -- # local d=1 00:16:18.982 04:18:09 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:18.982 04:18:09 -- scripts/common.sh@354 -- # echo 1 00:16:18.982 04:18:09 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:18.982 04:18:09 -- scripts/common.sh@365 -- # decimal 2 00:16:18.982 04:18:09 -- scripts/common.sh@352 -- # local d=2 00:16:18.982 04:18:09 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:18.982 04:18:09 -- scripts/common.sh@354 -- # echo 2 00:16:18.982 04:18:09 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:18.982 04:18:09 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:18.982 04:18:09 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:18.982 04:18:09 -- scripts/common.sh@367 -- # return 0 00:16:18.982 04:18:09 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:18.982 04:18:09 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:18.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.982 --rc genhtml_branch_coverage=1 00:16:18.982 --rc genhtml_function_coverage=1 00:16:18.982 --rc genhtml_legend=1 00:16:18.982 --rc geninfo_all_blocks=1 00:16:18.982 --rc geninfo_unexecuted_blocks=1 00:16:18.982 00:16:18.982 ' 00:16:18.982 04:18:09 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:18.982 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.982 --rc genhtml_branch_coverage=1 00:16:18.982 --rc genhtml_function_coverage=1 00:16:18.983 --rc genhtml_legend=1 00:16:18.983 --rc geninfo_all_blocks=1 00:16:18.983 --rc geninfo_unexecuted_blocks=1 00:16:18.983 00:16:18.983 ' 00:16:18.983 04:18:09 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:18.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.983 --rc genhtml_branch_coverage=1 00:16:18.983 --rc genhtml_function_coverage=1 00:16:18.983 --rc genhtml_legend=1 00:16:18.983 --rc geninfo_all_blocks=1 00:16:18.983 --rc geninfo_unexecuted_blocks=1 00:16:18.983 00:16:18.983 ' 00:16:18.983 04:18:09 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:18.983 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:18.983 --rc genhtml_branch_coverage=1 00:16:18.983 --rc genhtml_function_coverage=1 00:16:18.983 --rc genhtml_legend=1 00:16:18.983 --rc geninfo_all_blocks=1 00:16:18.983 --rc geninfo_unexecuted_blocks=1 00:16:18.983 00:16:18.983 ' 00:16:18.983 04:18:09 -- compliance/compliance.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:18.983 04:18:09 -- nvmf/common.sh@7 -- # uname -s 00:16:18.983 04:18:09 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:18.983 04:18:09 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:18.983 04:18:09 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:18.983 04:18:09 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:18.983 04:18:09 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:18.983 04:18:09 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:18.983 04:18:09 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:18.983 04:18:09 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:18.983 04:18:09 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:18.983 04:18:09 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:18.983 04:18:09 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:18.983 04:18:09 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:18.983 04:18:09 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:18.983 04:18:09 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:18.983 04:18:09 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:18.983 04:18:09 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:18.983 04:18:09 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:18.983 04:18:09 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:18.983 04:18:09 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:18.983 04:18:09 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.983 04:18:09 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.983 04:18:09 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.983 04:18:09 -- paths/export.sh@5 -- # export PATH 00:16:18.983 04:18:09 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:18.983 04:18:09 -- nvmf/common.sh@46 -- # : 0 00:16:18.983 04:18:09 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:18.983 04:18:09 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:18.983 04:18:09 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:18.983 04:18:09 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:18.983 04:18:09 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:18.983 04:18:09 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:18.983 04:18:09 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:18.983 04:18:09 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:18.983 04:18:09 -- compliance/compliance.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:18.983 04:18:09 -- compliance/compliance.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:18.983 04:18:09 -- compliance/compliance.sh@14 -- # export TEST_TRANSPORT=VFIOUSER 00:16:18.983 04:18:09 -- compliance/compliance.sh@14 -- # TEST_TRANSPORT=VFIOUSER 00:16:18.983 04:18:09 -- compliance/compliance.sh@16 -- # rm -rf /var/run/vfio-user 00:16:18.983 04:18:09 -- compliance/compliance.sh@20 -- # nvmfpid=2341676 00:16:18.983 04:18:09 -- compliance/compliance.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:16:18.983 04:18:09 -- compliance/compliance.sh@21 -- # echo 'Process pid: 2341676' 00:16:18.983 Process pid: 2341676 00:16:18.983 04:18:09 -- compliance/compliance.sh@23 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:18.983 04:18:09 -- compliance/compliance.sh@24 -- # waitforlisten 2341676 00:16:18.983 04:18:09 -- common/autotest_common.sh@829 -- # '[' -z 2341676 ']' 00:16:18.983 04:18:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:18.983 04:18:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:18.983 04:18:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:18.983 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:18.983 04:18:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:18.983 04:18:09 -- common/autotest_common.sh@10 -- # set +x 00:16:19.264 [2024-11-30 04:18:09.611161] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:16:19.264 [2024-11-30 04:18:09.611250] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:16:19.264 EAL: No free 2048 kB hugepages reported on node 1 00:16:19.264 [2024-11-30 04:18:09.673110] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:16:19.264 [2024-11-30 04:18:09.763516] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:16:19.264 [2024-11-30 04:18:09.763689] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:16:19.264 [2024-11-30 04:18:09.763709] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:16:19.264 [2024-11-30 04:18:09.763725] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:16:19.264 [2024-11-30 04:18:09.763805] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:16:19.264 [2024-11-30 04:18:09.763864] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:16:19.264 [2024-11-30 04:18:09.763867] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:16:20.198 04:18:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:20.198 04:18:10 -- common/autotest_common.sh@862 -- # return 0 00:16:20.198 04:18:10 -- compliance/compliance.sh@26 -- # sleep 1 00:16:21.132 04:18:11 -- compliance/compliance.sh@28 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:21.132 04:18:11 -- compliance/compliance.sh@29 -- # traddr=/var/run/vfio-user 00:16:21.132 04:18:11 -- compliance/compliance.sh@31 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:21.132 04:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.132 04:18:11 -- common/autotest_common.sh@10 -- # set +x 00:16:21.132 04:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.132 04:18:11 -- compliance/compliance.sh@33 -- # mkdir -p /var/run/vfio-user 00:16:21.132 04:18:11 -- compliance/compliance.sh@35 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:21.132 04:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.132 04:18:11 -- common/autotest_common.sh@10 -- # set +x 00:16:21.132 malloc0 00:16:21.132 04:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.132 04:18:11 -- compliance/compliance.sh@36 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk -m 32 00:16:21.132 04:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.132 04:18:11 -- common/autotest_common.sh@10 -- # set +x 00:16:21.132 04:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.133 04:18:11 -- compliance/compliance.sh@37 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:21.133 04:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.133 04:18:11 -- common/autotest_common.sh@10 -- # set +x 00:16:21.133 04:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.133 04:18:11 -- compliance/compliance.sh@38 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:21.133 04:18:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:21.133 04:18:11 -- common/autotest_common.sh@10 -- # set +x 00:16:21.133 04:18:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:21.133 04:18:11 -- compliance/compliance.sh@40 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/compliance/nvme_compliance -g -r 'trtype:VFIOUSER traddr:/var/run/vfio-user subnqn:nqn.2021-09.io.spdk:cnode0' 00:16:21.133 EAL: No free 2048 kB hugepages reported on node 1 00:16:21.391 00:16:21.391 00:16:21.391 CUnit - A unit testing framework for C - Version 2.1-3 00:16:21.391 http://cunit.sourceforge.net/ 00:16:21.391 00:16:21.391 00:16:21.391 Suite: nvme_compliance 00:16:21.391 Test: admin_identify_ctrlr_verify_dptr ...[2024-11-30 04:18:11.807746] vfio_user.c: 789:nvme_cmd_map_prps: *ERROR*: no PRP2, 3072 remaining 00:16:21.391 [2024-11-30 04:18:11.807808] vfio_user.c:5484:map_admin_cmd_req: *ERROR*: /var/run/vfio-user: map Admin Opc 6 failed 00:16:21.391 [2024-11-30 04:18:11.807837] vfio_user.c:5576:handle_cmd_req: *ERROR*: /var/run/vfio-user: process NVMe command opc 0x6 failed 00:16:21.391 passed 00:16:21.391 Test: admin_identify_ctrlr_verify_fused ...passed 00:16:21.649 Test: admin_identify_ns ...[2024-11-30 04:18:12.046992] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 0 00:16:21.649 [2024-11-30 04:18:12.054990] ctrlr.c:2598:_nvmf_subsystem_get_ns_safe: *ERROR*: Identify Namespace for invalid NSID 4294967295 00:16:21.649 passed 00:16:21.649 Test: admin_get_features_mandatory_features ...passed 00:16:21.906 Test: admin_get_features_optional_features ...passed 00:16:21.906 Test: admin_set_features_number_of_queues ...passed 00:16:22.166 Test: admin_get_log_page_mandatory_logs ...passed 00:16:22.166 Test: admin_get_log_page_with_lpo ...[2024-11-30 04:18:12.679972] ctrlr.c:2546:nvmf_ctrlr_get_log_page: *ERROR*: Get log page: offset (516) > len (512) 00:16:22.166 passed 00:16:22.423 Test: fabric_property_get ...passed 00:16:22.423 Test: admin_delete_io_sq_use_admin_qid ...[2024-11-30 04:18:12.867444] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:0 does not exist 00:16:22.423 passed 00:16:22.423 Test: admin_delete_io_sq_delete_sq_twice ...[2024-11-30 04:18:13.038998] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:22.680 [2024-11-30 04:18:13.054986] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:22.680 passed 00:16:22.680 Test: admin_delete_io_cq_use_admin_qid ...[2024-11-30 04:18:13.142115] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O cqid:0 does not exist 00:16:22.680 passed 00:16:22.680 Test: admin_delete_io_cq_delete_cq_first ...[2024-11-30 04:18:13.304965] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:22.937 [2024-11-30 04:18:13.328981] vfio_user.c:2300:handle_del_io_q: *ERROR*: /var/run/vfio-user: I/O sqid:1 does not exist 00:16:22.937 passed 00:16:22.937 Test: admin_create_io_cq_verify_iv_pc ...[2024-11-30 04:18:13.419134] vfio_user.c:2150:handle_create_io_cq: *ERROR*: /var/run/vfio-user: IV is too big 00:16:22.937 [2024-11-30 04:18:13.419178] vfio_user.c:2144:handle_create_io_cq: *ERROR*: /var/run/vfio-user: non-PC CQ not supported 00:16:22.937 passed 00:16:23.194 Test: admin_create_io_sq_verify_qsize_cqid ...[2024-11-30 04:18:13.594994] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 1 00:16:23.194 [2024-11-30 04:18:13.602970] vfio_user.c:2231:handle_create_io_q: *ERROR*: /var/run/vfio-user: invalid I/O queue size 257 00:16:23.194 [2024-11-30 04:18:13.610984] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:0 00:16:23.194 [2024-11-30 04:18:13.618965] vfio_user.c:2031:handle_create_io_sq: *ERROR*: /var/run/vfio-user: invalid cqid:128 00:16:23.194 passed 00:16:23.194 Test: admin_create_io_sq_verify_pc ...[2024-11-30 04:18:13.747983] vfio_user.c:2044:handle_create_io_sq: *ERROR*: /var/run/vfio-user: non-PC SQ not supported 00:16:23.194 passed 00:16:24.567 Test: admin_create_io_qp_max_qps ...[2024-11-30 04:18:14.947974] nvme_ctrlr.c:5318:spdk_nvme_ctrlr_alloc_qid: *ERROR*: [/var/run/vfio-user] No free I/O queue IDs 00:16:24.825 passed 00:16:25.083 Test: admin_create_io_sq_shared_cq ...[2024-11-30 04:18:15.538987] vfio_user.c:2310:handle_del_io_q: *ERROR*: /var/run/vfio-user: the associated SQ must be deleted first 00:16:25.083 passed 00:16:25.083 00:16:25.083 Run Summary: Type Total Ran Passed Failed Inactive 00:16:25.083 suites 1 1 n/a 0 0 00:16:25.083 tests 18 18 18 0 0 00:16:25.083 asserts 360 360 360 0 n/a 00:16:25.083 00:16:25.083 Elapsed time = 1.560 seconds 00:16:25.083 04:18:15 -- compliance/compliance.sh@42 -- # killprocess 2341676 00:16:25.083 04:18:15 -- common/autotest_common.sh@936 -- # '[' -z 2341676 ']' 00:16:25.083 04:18:15 -- common/autotest_common.sh@940 -- # kill -0 2341676 00:16:25.083 04:18:15 -- common/autotest_common.sh@941 -- # uname 00:16:25.083 04:18:15 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:25.083 04:18:15 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2341676 00:16:25.083 04:18:15 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:25.083 04:18:15 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:25.083 04:18:15 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2341676' 00:16:25.083 killing process with pid 2341676 00:16:25.083 04:18:15 -- common/autotest_common.sh@955 -- # kill 2341676 00:16:25.083 04:18:15 -- common/autotest_common.sh@960 -- # wait 2341676 00:16:25.342 04:18:15 -- compliance/compliance.sh@44 -- # rm -rf /var/run/vfio-user 00:16:25.342 04:18:15 -- compliance/compliance.sh@46 -- # trap - SIGINT SIGTERM EXIT 00:16:25.342 00:16:25.342 real 0m6.480s 00:16:25.342 user 0m18.458s 00:16:25.342 sys 0m0.550s 00:16:25.342 04:18:15 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:25.342 04:18:15 -- common/autotest_common.sh@10 -- # set +x 00:16:25.342 ************************************ 00:16:25.342 END TEST nvmf_vfio_user_nvme_compliance 00:16:25.342 ************************************ 00:16:25.342 04:18:15 -- nvmf/nvmf.sh@42 -- # run_test nvmf_vfio_user_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:25.342 04:18:15 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:25.342 04:18:15 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:25.342 04:18:15 -- common/autotest_common.sh@10 -- # set +x 00:16:25.342 ************************************ 00:16:25.342 START TEST nvmf_vfio_user_fuzz 00:16:25.342 ************************************ 00:16:25.342 04:18:15 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/vfio_user_fuzz.sh --transport=tcp 00:16:25.342 * Looking for test storage... 00:16:25.342 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:25.342 04:18:15 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:25.342 04:18:15 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:25.342 04:18:15 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:25.601 04:18:16 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:25.601 04:18:16 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:25.601 04:18:16 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:25.601 04:18:16 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:25.601 04:18:16 -- scripts/common.sh@335 -- # IFS=.-: 00:16:25.601 04:18:16 -- scripts/common.sh@335 -- # read -ra ver1 00:16:25.601 04:18:16 -- scripts/common.sh@336 -- # IFS=.-: 00:16:25.601 04:18:16 -- scripts/common.sh@336 -- # read -ra ver2 00:16:25.601 04:18:16 -- scripts/common.sh@337 -- # local 'op=<' 00:16:25.601 04:18:16 -- scripts/common.sh@339 -- # ver1_l=2 00:16:25.601 04:18:16 -- scripts/common.sh@340 -- # ver2_l=1 00:16:25.601 04:18:16 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:25.601 04:18:16 -- scripts/common.sh@343 -- # case "$op" in 00:16:25.601 04:18:16 -- scripts/common.sh@344 -- # : 1 00:16:25.601 04:18:16 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:25.601 04:18:16 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:25.601 04:18:16 -- scripts/common.sh@364 -- # decimal 1 00:16:25.601 04:18:16 -- scripts/common.sh@352 -- # local d=1 00:16:25.601 04:18:16 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:25.601 04:18:16 -- scripts/common.sh@354 -- # echo 1 00:16:25.601 04:18:16 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:25.601 04:18:16 -- scripts/common.sh@365 -- # decimal 2 00:16:25.601 04:18:16 -- scripts/common.sh@352 -- # local d=2 00:16:25.601 04:18:16 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:25.601 04:18:16 -- scripts/common.sh@354 -- # echo 2 00:16:25.601 04:18:16 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:25.601 04:18:16 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:25.601 04:18:16 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:25.601 04:18:16 -- scripts/common.sh@367 -- # return 0 00:16:25.601 04:18:16 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:25.601 04:18:16 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:25.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.601 --rc genhtml_branch_coverage=1 00:16:25.601 --rc genhtml_function_coverage=1 00:16:25.601 --rc genhtml_legend=1 00:16:25.601 --rc geninfo_all_blocks=1 00:16:25.601 --rc geninfo_unexecuted_blocks=1 00:16:25.601 00:16:25.601 ' 00:16:25.601 04:18:16 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:25.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.601 --rc genhtml_branch_coverage=1 00:16:25.601 --rc genhtml_function_coverage=1 00:16:25.601 --rc genhtml_legend=1 00:16:25.601 --rc geninfo_all_blocks=1 00:16:25.601 --rc geninfo_unexecuted_blocks=1 00:16:25.601 00:16:25.601 ' 00:16:25.601 04:18:16 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:25.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.601 --rc genhtml_branch_coverage=1 00:16:25.601 --rc genhtml_function_coverage=1 00:16:25.601 --rc genhtml_legend=1 00:16:25.601 --rc geninfo_all_blocks=1 00:16:25.601 --rc geninfo_unexecuted_blocks=1 00:16:25.601 00:16:25.601 ' 00:16:25.601 04:18:16 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:25.601 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:25.601 --rc genhtml_branch_coverage=1 00:16:25.601 --rc genhtml_function_coverage=1 00:16:25.601 --rc genhtml_legend=1 00:16:25.601 --rc geninfo_all_blocks=1 00:16:25.601 --rc geninfo_unexecuted_blocks=1 00:16:25.601 00:16:25.601 ' 00:16:25.601 04:18:16 -- target/vfio_user_fuzz.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:25.601 04:18:16 -- nvmf/common.sh@7 -- # uname -s 00:16:25.601 04:18:16 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:25.601 04:18:16 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:25.601 04:18:16 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:25.601 04:18:16 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:25.601 04:18:16 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:25.601 04:18:16 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:25.601 04:18:16 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:25.601 04:18:16 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:25.601 04:18:16 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:25.601 04:18:16 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:25.601 04:18:16 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:25.601 04:18:16 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:25.601 04:18:16 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:25.601 04:18:16 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:25.601 04:18:16 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:25.602 04:18:16 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:25.602 04:18:16 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:25.602 04:18:16 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:25.602 04:18:16 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:25.602 04:18:16 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.602 04:18:16 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.602 04:18:16 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.602 04:18:16 -- paths/export.sh@5 -- # export PATH 00:16:25.602 04:18:16 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:25.602 04:18:16 -- nvmf/common.sh@46 -- # : 0 00:16:25.602 04:18:16 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:25.602 04:18:16 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:25.602 04:18:16 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:25.602 04:18:16 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:25.602 04:18:16 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:25.602 04:18:16 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:25.602 04:18:16 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:25.602 04:18:16 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@12 -- # MALLOC_BDEV_SIZE=64 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@15 -- # nqn=nqn.2021-09.io.spdk:cnode0 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@16 -- # traddr=/var/run/vfio-user 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@18 -- # export TEST_TRANSPORT=VFIOUSER 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@18 -- # TEST_TRANSPORT=VFIOUSER 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@20 -- # rm -rf /var/run/vfio-user 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@24 -- # nvmfpid=2342556 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@25 -- # echo 'Process pid: 2342556' 00:16:25.602 Process pid: 2342556 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@27 -- # trap 'killprocess $nvmfpid; exit 1' SIGINT SIGTERM EXIT 00:16:25.602 04:18:16 -- target/vfio_user_fuzz.sh@28 -- # waitforlisten 2342556 00:16:25.602 04:18:16 -- common/autotest_common.sh@829 -- # '[' -z 2342556 ']' 00:16:25.602 04:18:16 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:16:25.602 04:18:16 -- common/autotest_common.sh@834 -- # local max_retries=100 00:16:25.602 04:18:16 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:16:25.602 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:16:25.602 04:18:16 -- common/autotest_common.sh@838 -- # xtrace_disable 00:16:25.602 04:18:16 -- common/autotest_common.sh@10 -- # set +x 00:16:26.536 04:18:17 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:16:26.536 04:18:17 -- common/autotest_common.sh@862 -- # return 0 00:16:26.536 04:18:17 -- target/vfio_user_fuzz.sh@30 -- # sleep 1 00:16:27.471 04:18:18 -- target/vfio_user_fuzz.sh@32 -- # rpc_cmd nvmf_create_transport -t VFIOUSER 00:16:27.471 04:18:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.471 04:18:18 -- common/autotest_common.sh@10 -- # set +x 00:16:27.471 04:18:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.471 04:18:18 -- target/vfio_user_fuzz.sh@34 -- # mkdir -p /var/run/vfio-user 00:16:27.729 04:18:18 -- target/vfio_user_fuzz.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b malloc0 00:16:27.729 04:18:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.729 04:18:18 -- common/autotest_common.sh@10 -- # set +x 00:16:27.729 malloc0 00:16:27.729 04:18:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.729 04:18:18 -- target/vfio_user_fuzz.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2021-09.io.spdk:cnode0 -a -s spdk 00:16:27.729 04:18:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.729 04:18:18 -- common/autotest_common.sh@10 -- # set +x 00:16:27.729 04:18:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.729 04:18:18 -- target/vfio_user_fuzz.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2021-09.io.spdk:cnode0 malloc0 00:16:27.729 04:18:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.729 04:18:18 -- common/autotest_common.sh@10 -- # set +x 00:16:27.729 04:18:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.729 04:18:18 -- target/vfio_user_fuzz.sh@39 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2021-09.io.spdk:cnode0 -t VFIOUSER -a /var/run/vfio-user -s 0 00:16:27.729 04:18:18 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:27.729 04:18:18 -- common/autotest_common.sh@10 -- # set +x 00:16:27.729 04:18:18 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:27.729 04:18:18 -- target/vfio_user_fuzz.sh@41 -- # trid='trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' 00:16:27.729 04:18:18 -- target/vfio_user_fuzz.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/vfio_user_fuzz -t 30 -S 123456 -F 'trtype:VFIOUSER subnqn:nqn.2021-09.io.spdk:cnode0 traddr:/var/run/vfio-user' -N -a 00:16:59.792 Fuzzing completed. Shutting down the fuzz application 00:16:59.792 00:16:59.792 Dumping successful admin opcodes: 00:16:59.792 8, 9, 10, 24, 00:16:59.792 Dumping successful io opcodes: 00:16:59.792 0, 00:16:59.792 NS: 0x200003a1ef00 I/O qp, Total commands completed: 602477, total successful commands: 2329, random_seed: 3289598848 00:16:59.792 NS: 0x200003a1ef00 admin qp, Total commands completed: 149990, total successful commands: 1205, random_seed: 3914036544 00:16:59.792 04:18:48 -- target/vfio_user_fuzz.sh@44 -- # rpc_cmd nvmf_delete_subsystem nqn.2021-09.io.spdk:cnode0 00:16:59.792 04:18:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:16:59.792 04:18:48 -- common/autotest_common.sh@10 -- # set +x 00:16:59.792 04:18:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:16:59.792 04:18:48 -- target/vfio_user_fuzz.sh@46 -- # killprocess 2342556 00:16:59.792 04:18:48 -- common/autotest_common.sh@936 -- # '[' -z 2342556 ']' 00:16:59.792 04:18:48 -- common/autotest_common.sh@940 -- # kill -0 2342556 00:16:59.792 04:18:48 -- common/autotest_common.sh@941 -- # uname 00:16:59.792 04:18:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:16:59.792 04:18:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2342556 00:16:59.792 04:18:48 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:16:59.792 04:18:48 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:16:59.792 04:18:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2342556' 00:16:59.792 killing process with pid 2342556 00:16:59.792 04:18:48 -- common/autotest_common.sh@955 -- # kill 2342556 00:16:59.792 04:18:48 -- common/autotest_common.sh@960 -- # wait 2342556 00:16:59.792 04:18:48 -- target/vfio_user_fuzz.sh@48 -- # rm -rf /var/run/vfio-user /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_log.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/vfio_user_fuzz_tgt_output.txt 00:16:59.792 04:18:48 -- target/vfio_user_fuzz.sh@50 -- # trap - SIGINT SIGTERM EXIT 00:16:59.792 00:16:59.792 real 0m33.057s 00:16:59.792 user 0m35.479s 00:16:59.792 sys 0m27.118s 00:16:59.792 04:18:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:16:59.792 04:18:48 -- common/autotest_common.sh@10 -- # set +x 00:16:59.792 ************************************ 00:16:59.792 END TEST nvmf_vfio_user_fuzz 00:16:59.792 ************************************ 00:16:59.792 04:18:49 -- nvmf/nvmf.sh@46 -- # run_test nvmf_host_management /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:59.792 04:18:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:16:59.792 04:18:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:16:59.792 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:16:59.792 ************************************ 00:16:59.792 START TEST nvmf_host_management 00:16:59.792 ************************************ 00:16:59.792 04:18:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh --transport=tcp 00:16:59.792 * Looking for test storage... 00:16:59.792 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:16:59.792 04:18:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:16:59.792 04:18:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:16:59.792 04:18:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:16:59.792 04:18:49 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:16:59.792 04:18:49 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:16:59.792 04:18:49 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:16:59.792 04:18:49 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:16:59.792 04:18:49 -- scripts/common.sh@335 -- # IFS=.-: 00:16:59.792 04:18:49 -- scripts/common.sh@335 -- # read -ra ver1 00:16:59.792 04:18:49 -- scripts/common.sh@336 -- # IFS=.-: 00:16:59.792 04:18:49 -- scripts/common.sh@336 -- # read -ra ver2 00:16:59.792 04:18:49 -- scripts/common.sh@337 -- # local 'op=<' 00:16:59.792 04:18:49 -- scripts/common.sh@339 -- # ver1_l=2 00:16:59.792 04:18:49 -- scripts/common.sh@340 -- # ver2_l=1 00:16:59.792 04:18:49 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:16:59.792 04:18:49 -- scripts/common.sh@343 -- # case "$op" in 00:16:59.792 04:18:49 -- scripts/common.sh@344 -- # : 1 00:16:59.792 04:18:49 -- scripts/common.sh@363 -- # (( v = 0 )) 00:16:59.792 04:18:49 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:16:59.792 04:18:49 -- scripts/common.sh@364 -- # decimal 1 00:16:59.792 04:18:49 -- scripts/common.sh@352 -- # local d=1 00:16:59.792 04:18:49 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:16:59.792 04:18:49 -- scripts/common.sh@354 -- # echo 1 00:16:59.792 04:18:49 -- scripts/common.sh@364 -- # ver1[v]=1 00:16:59.792 04:18:49 -- scripts/common.sh@365 -- # decimal 2 00:16:59.792 04:18:49 -- scripts/common.sh@352 -- # local d=2 00:16:59.792 04:18:49 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:16:59.792 04:18:49 -- scripts/common.sh@354 -- # echo 2 00:16:59.792 04:18:49 -- scripts/common.sh@365 -- # ver2[v]=2 00:16:59.792 04:18:49 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:16:59.792 04:18:49 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:16:59.792 04:18:49 -- scripts/common.sh@367 -- # return 0 00:16:59.792 04:18:49 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:16:59.792 04:18:49 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:16:59.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.792 --rc genhtml_branch_coverage=1 00:16:59.792 --rc genhtml_function_coverage=1 00:16:59.792 --rc genhtml_legend=1 00:16:59.792 --rc geninfo_all_blocks=1 00:16:59.792 --rc geninfo_unexecuted_blocks=1 00:16:59.792 00:16:59.792 ' 00:16:59.792 04:18:49 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:16:59.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.792 --rc genhtml_branch_coverage=1 00:16:59.792 --rc genhtml_function_coverage=1 00:16:59.792 --rc genhtml_legend=1 00:16:59.792 --rc geninfo_all_blocks=1 00:16:59.792 --rc geninfo_unexecuted_blocks=1 00:16:59.792 00:16:59.792 ' 00:16:59.792 04:18:49 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:16:59.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.792 --rc genhtml_branch_coverage=1 00:16:59.792 --rc genhtml_function_coverage=1 00:16:59.792 --rc genhtml_legend=1 00:16:59.792 --rc geninfo_all_blocks=1 00:16:59.792 --rc geninfo_unexecuted_blocks=1 00:16:59.792 00:16:59.792 ' 00:16:59.792 04:18:49 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:16:59.792 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:16:59.792 --rc genhtml_branch_coverage=1 00:16:59.792 --rc genhtml_function_coverage=1 00:16:59.792 --rc genhtml_legend=1 00:16:59.792 --rc geninfo_all_blocks=1 00:16:59.792 --rc geninfo_unexecuted_blocks=1 00:16:59.792 00:16:59.792 ' 00:16:59.792 04:18:49 -- target/host_management.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:16:59.792 04:18:49 -- nvmf/common.sh@7 -- # uname -s 00:16:59.792 04:18:49 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:16:59.792 04:18:49 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:16:59.792 04:18:49 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:16:59.792 04:18:49 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:16:59.792 04:18:49 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:16:59.792 04:18:49 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:16:59.792 04:18:49 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:16:59.792 04:18:49 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:16:59.792 04:18:49 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:16:59.792 04:18:49 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:16:59.792 04:18:49 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:16:59.792 04:18:49 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:16:59.792 04:18:49 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:16:59.792 04:18:49 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:16:59.792 04:18:49 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:16:59.792 04:18:49 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:16:59.792 04:18:49 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:16:59.792 04:18:49 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:16:59.792 04:18:49 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:16:59.792 04:18:49 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.792 04:18:49 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.793 04:18:49 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.793 04:18:49 -- paths/export.sh@5 -- # export PATH 00:16:59.793 04:18:49 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:16:59.793 04:18:49 -- nvmf/common.sh@46 -- # : 0 00:16:59.793 04:18:49 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:16:59.793 04:18:49 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:16:59.793 04:18:49 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:16:59.793 04:18:49 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:16:59.793 04:18:49 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:16:59.793 04:18:49 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:16:59.793 04:18:49 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:16:59.793 04:18:49 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:16:59.793 04:18:49 -- target/host_management.sh@11 -- # MALLOC_BDEV_SIZE=64 00:16:59.793 04:18:49 -- target/host_management.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:16:59.793 04:18:49 -- target/host_management.sh@104 -- # nvmftestinit 00:16:59.793 04:18:49 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:16:59.793 04:18:49 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:16:59.793 04:18:49 -- nvmf/common.sh@436 -- # prepare_net_devs 00:16:59.793 04:18:49 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:16:59.793 04:18:49 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:16:59.793 04:18:49 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:16:59.793 04:18:49 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:16:59.793 04:18:49 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:16:59.793 04:18:49 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:16:59.793 04:18:49 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:16:59.793 04:18:49 -- nvmf/common.sh@284 -- # xtrace_disable 00:16:59.793 04:18:49 -- common/autotest_common.sh@10 -- # set +x 00:17:00.725 04:18:51 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:00.725 04:18:51 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:00.725 04:18:51 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:00.725 04:18:51 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:00.725 04:18:51 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:00.725 04:18:51 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:00.725 04:18:51 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:00.725 04:18:51 -- nvmf/common.sh@294 -- # net_devs=() 00:17:00.725 04:18:51 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:00.726 04:18:51 -- nvmf/common.sh@295 -- # e810=() 00:17:00.726 04:18:51 -- nvmf/common.sh@295 -- # local -ga e810 00:17:00.726 04:18:51 -- nvmf/common.sh@296 -- # x722=() 00:17:00.726 04:18:51 -- nvmf/common.sh@296 -- # local -ga x722 00:17:00.726 04:18:51 -- nvmf/common.sh@297 -- # mlx=() 00:17:00.726 04:18:51 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:00.726 04:18:51 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:00.726 04:18:51 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:00.726 04:18:51 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:00.726 04:18:51 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:00.726 04:18:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:00.726 04:18:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:00.726 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:00.726 04:18:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:00.726 04:18:51 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:00.726 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:00.726 04:18:51 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:00.726 04:18:51 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:00.726 04:18:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:00.726 04:18:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:00.726 04:18:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:00.726 04:18:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:00.726 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:00.726 04:18:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:00.726 04:18:51 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:00.726 04:18:51 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:00.726 04:18:51 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:00.726 04:18:51 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:00.726 04:18:51 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:00.726 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:00.726 04:18:51 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:00.726 04:18:51 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:00.726 04:18:51 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:00.726 04:18:51 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:00.726 04:18:51 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:00.726 04:18:51 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:00.726 04:18:51 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:00.726 04:18:51 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:00.726 04:18:51 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:00.726 04:18:51 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:00.726 04:18:51 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:00.726 04:18:51 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:00.726 04:18:51 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:00.726 04:18:51 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:00.726 04:18:51 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:00.726 04:18:51 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:00.726 04:18:51 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:00.726 04:18:51 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:00.726 04:18:51 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:00.726 04:18:51 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:00.726 04:18:51 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:00.726 04:18:51 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:00.726 04:18:51 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:00.726 04:18:51 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:00.726 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:00.726 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.311 ms 00:17:00.726 00:17:00.726 --- 10.0.0.2 ping statistics --- 00:17:00.726 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:00.726 rtt min/avg/max/mdev = 0.311/0.311/0.311/0.000 ms 00:17:00.726 04:18:51 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:00.726 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:00.726 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.077 ms 00:17:00.726 00:17:00.726 --- 10.0.0.1 ping statistics --- 00:17:00.726 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:00.726 rtt min/avg/max/mdev = 0.077/0.077/0.077/0.000 ms 00:17:00.726 04:18:51 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:00.726 04:18:51 -- nvmf/common.sh@410 -- # return 0 00:17:00.726 04:18:51 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:00.726 04:18:51 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:00.726 04:18:51 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:00.726 04:18:51 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:00.726 04:18:51 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:00.726 04:18:51 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:00.726 04:18:51 -- target/host_management.sh@106 -- # run_test nvmf_host_management nvmf_host_management 00:17:00.726 04:18:51 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:00.726 04:18:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:00.726 04:18:51 -- common/autotest_common.sh@10 -- # set +x 00:17:00.726 ************************************ 00:17:00.726 START TEST nvmf_host_management 00:17:00.726 ************************************ 00:17:00.726 04:18:51 -- common/autotest_common.sh@1114 -- # nvmf_host_management 00:17:00.726 04:18:51 -- target/host_management.sh@69 -- # starttarget 00:17:00.726 04:18:51 -- target/host_management.sh@16 -- # nvmfappstart -m 0x1E 00:17:00.726 04:18:51 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:00.726 04:18:51 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:00.726 04:18:51 -- common/autotest_common.sh@10 -- # set +x 00:17:00.726 04:18:51 -- nvmf/common.sh@469 -- # nvmfpid=2348259 00:17:00.726 04:18:51 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:17:00.726 04:18:51 -- nvmf/common.sh@470 -- # waitforlisten 2348259 00:17:00.726 04:18:51 -- common/autotest_common.sh@829 -- # '[' -z 2348259 ']' 00:17:00.726 04:18:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:00.726 04:18:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:00.726 04:18:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:00.726 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:00.726 04:18:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:00.726 04:18:51 -- common/autotest_common.sh@10 -- # set +x 00:17:00.984 [2024-11-30 04:18:51.384884] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:00.984 [2024-11-30 04:18:51.384989] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:00.984 EAL: No free 2048 kB hugepages reported on node 1 00:17:00.984 [2024-11-30 04:18:51.449694] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:17:00.984 [2024-11-30 04:18:51.536897] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:00.984 [2024-11-30 04:18:51.537072] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:00.984 [2024-11-30 04:18:51.537092] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:00.984 [2024-11-30 04:18:51.537106] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:00.984 [2024-11-30 04:18:51.537200] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:00.984 [2024-11-30 04:18:51.537225] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:17:00.984 [2024-11-30 04:18:51.537286] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:17:00.984 [2024-11-30 04:18:51.537288] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:01.916 04:18:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:01.916 04:18:52 -- common/autotest_common.sh@862 -- # return 0 00:17:01.916 04:18:52 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:01.916 04:18:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:01.916 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:17:01.916 04:18:52 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:01.916 04:18:52 -- target/host_management.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:17:01.916 04:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:01.916 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:17:01.916 [2024-11-30 04:18:52.385665] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:01.916 04:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:01.916 04:18:52 -- target/host_management.sh@20 -- # timing_enter create_subsystem 00:17:01.916 04:18:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:01.916 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:17:01.916 04:18:52 -- target/host_management.sh@22 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:01.916 04:18:52 -- target/host_management.sh@23 -- # cat 00:17:01.916 04:18:52 -- target/host_management.sh@30 -- # rpc_cmd 00:17:01.916 04:18:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:01.916 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:17:01.916 Malloc0 00:17:01.916 [2024-11-30 04:18:52.445158] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:01.916 04:18:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:01.916 04:18:52 -- target/host_management.sh@31 -- # timing_exit create_subsystems 00:17:01.916 04:18:52 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:01.916 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:17:01.916 04:18:52 -- target/host_management.sh@73 -- # perfpid=2348442 00:17:01.916 04:18:52 -- target/host_management.sh@74 -- # waitforlisten 2348442 /var/tmp/bdevperf.sock 00:17:01.916 04:18:52 -- common/autotest_common.sh@829 -- # '[' -z 2348442 ']' 00:17:01.916 04:18:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:01.916 04:18:52 -- target/host_management.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:17:01.916 04:18:52 -- target/host_management.sh@72 -- # gen_nvmf_target_json 0 00:17:01.916 04:18:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:01.916 04:18:52 -- nvmf/common.sh@520 -- # config=() 00:17:01.916 04:18:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:01.916 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:01.916 04:18:52 -- nvmf/common.sh@520 -- # local subsystem config 00:17:01.916 04:18:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:01.916 04:18:52 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:01.916 04:18:52 -- common/autotest_common.sh@10 -- # set +x 00:17:01.916 04:18:52 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:01.916 { 00:17:01.916 "params": { 00:17:01.916 "name": "Nvme$subsystem", 00:17:01.916 "trtype": "$TEST_TRANSPORT", 00:17:01.916 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:01.916 "adrfam": "ipv4", 00:17:01.916 "trsvcid": "$NVMF_PORT", 00:17:01.916 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:01.916 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:01.916 "hdgst": ${hdgst:-false}, 00:17:01.916 "ddgst": ${ddgst:-false} 00:17:01.916 }, 00:17:01.916 "method": "bdev_nvme_attach_controller" 00:17:01.916 } 00:17:01.916 EOF 00:17:01.916 )") 00:17:01.916 04:18:52 -- nvmf/common.sh@542 -- # cat 00:17:01.916 04:18:52 -- nvmf/common.sh@544 -- # jq . 00:17:01.916 04:18:52 -- nvmf/common.sh@545 -- # IFS=, 00:17:01.916 04:18:52 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:01.916 "params": { 00:17:01.916 "name": "Nvme0", 00:17:01.916 "trtype": "tcp", 00:17:01.916 "traddr": "10.0.0.2", 00:17:01.916 "adrfam": "ipv4", 00:17:01.916 "trsvcid": "4420", 00:17:01.916 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:01.916 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:01.916 "hdgst": false, 00:17:01.916 "ddgst": false 00:17:01.916 }, 00:17:01.916 "method": "bdev_nvme_attach_controller" 00:17:01.916 }' 00:17:01.916 [2024-11-30 04:18:52.522061] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:01.916 [2024-11-30 04:18:52.522153] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2348442 ] 00:17:02.174 EAL: No free 2048 kB hugepages reported on node 1 00:17:02.174 [2024-11-30 04:18:52.582585] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:02.174 [2024-11-30 04:18:52.667383] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:02.432 Running I/O for 10 seconds... 00:17:02.998 04:18:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:02.998 04:18:53 -- common/autotest_common.sh@862 -- # return 0 00:17:02.998 04:18:53 -- target/host_management.sh@75 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:17:02.998 04:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.998 04:18:53 -- common/autotest_common.sh@10 -- # set +x 00:17:02.998 04:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.998 04:18:53 -- target/host_management.sh@78 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:02.999 04:18:53 -- target/host_management.sh@80 -- # waitforio /var/tmp/bdevperf.sock Nvme0n1 00:17:02.999 04:18:53 -- target/host_management.sh@45 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:17:02.999 04:18:53 -- target/host_management.sh@49 -- # '[' -z Nvme0n1 ']' 00:17:02.999 04:18:53 -- target/host_management.sh@52 -- # local ret=1 00:17:02.999 04:18:53 -- target/host_management.sh@53 -- # local i 00:17:02.999 04:18:53 -- target/host_management.sh@54 -- # (( i = 10 )) 00:17:02.999 04:18:53 -- target/host_management.sh@54 -- # (( i != 0 )) 00:17:02.999 04:18:53 -- target/host_management.sh@55 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme0n1 00:17:02.999 04:18:53 -- target/host_management.sh@55 -- # jq -r '.bdevs[0].num_read_ops' 00:17:02.999 04:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.999 04:18:53 -- common/autotest_common.sh@10 -- # set +x 00:17:02.999 04:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:02.999 04:18:53 -- target/host_management.sh@55 -- # read_io_count=2144 00:17:02.999 04:18:53 -- target/host_management.sh@58 -- # '[' 2144 -ge 100 ']' 00:17:02.999 04:18:53 -- target/host_management.sh@59 -- # ret=0 00:17:02.999 04:18:53 -- target/host_management.sh@60 -- # break 00:17:02.999 04:18:53 -- target/host_management.sh@64 -- # return 0 00:17:02.999 04:18:53 -- target/host_management.sh@84 -- # rpc_cmd nvmf_subsystem_remove_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:02.999 04:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:02.999 04:18:53 -- common/autotest_common.sh@10 -- # set +x 00:17:02.999 [2024-11-30 04:18:53.540931] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541019] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541036] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541062] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541075] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541087] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541100] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541112] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541124] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541136] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541149] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541173] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541186] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541198] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541211] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541269] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541282] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541294] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541387] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541437] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541462] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.541487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2279f40 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.542307] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:17:02.999 [2024-11-30 04:18:53.542366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542399] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:17:02.999 [2024-11-30 04:18:53.542414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542429] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:17:02.999 [2024-11-30 04:18:53.542442] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542458] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:17:02.999 [2024-11-30 04:18:53.542473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542487] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x175a870 is same with the state(5) to be set 00:17:02.999 [2024-11-30 04:18:53.542555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:39 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542789] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542900] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:02.999 [2024-11-30 04:18:53.542932] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:02.999 [2024-11-30 04:18:53.542955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.542996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543050] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:28544 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:29056 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543437] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543565] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543601] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543698] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543859] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.543940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.543979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544242] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544349] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.000 [2024-11-30 04:18:53.544366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.000 [2024-11-30 04:18:53.544381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544446] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544643] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544659] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544743] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:17:03.001 [2024-11-30 04:18:53.544826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:17:03.001 [2024-11-30 04:18:53.544913] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1757f30 was disconnected and freed. reset controller. 00:17:03.001 04:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.001 04:18:53 -- target/host_management.sh@85 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host0 00:17:03.001 04:18:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:17:03.001 04:18:53 -- common/autotest_common.sh@10 -- # set +x 00:17:03.001 [2024-11-30 04:18:53.546079] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:17:03.001 task offset: 32128 on job bdev=Nvme0n1 fails 00:17:03.001 00:17:03.001 Latency(us) 00:17:03.001 [2024-11-30T03:18:53.632Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:03.001 [2024-11-30T03:18:53.632Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:03.001 [2024-11-30T03:18:53.632Z] Job: Nvme0n1 ended in about 0.58 seconds with error 00:17:03.001 Verification LBA range: start 0x0 length 0x400 00:17:03.001 Nvme0n1 : 0.58 3926.08 245.38 109.58 0.00 15608.51 3021.94 23010.42 00:17:03.001 [2024-11-30T03:18:53.632Z] =================================================================================================================== 00:17:03.001 [2024-11-30T03:18:53.632Z] Total : 3926.08 245.38 109.58 0.00 15608.51 3021.94 23010.42 00:17:03.001 [2024-11-30 04:18:53.547954] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:17:03.001 [2024-11-30 04:18:53.547992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x175a870 (9): Bad file descriptor 00:17:03.001 04:18:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:17:03.001 04:18:53 -- target/host_management.sh@87 -- # sleep 1 00:17:03.001 [2024-11-30 04:18:53.601242] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:17:03.934 04:18:54 -- target/host_management.sh@91 -- # kill -9 2348442 00:17:03.934 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/host_management.sh: line 91: kill: (2348442) - No such process 00:17:03.934 04:18:54 -- target/host_management.sh@91 -- # true 00:17:03.934 04:18:54 -- target/host_management.sh@97 -- # rm -f /var/tmp/spdk_cpu_lock_001 /var/tmp/spdk_cpu_lock_002 /var/tmp/spdk_cpu_lock_003 /var/tmp/spdk_cpu_lock_004 00:17:03.934 04:18:54 -- target/host_management.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:17:03.934 04:18:54 -- target/host_management.sh@100 -- # gen_nvmf_target_json 0 00:17:03.934 04:18:54 -- nvmf/common.sh@520 -- # config=() 00:17:03.934 04:18:54 -- nvmf/common.sh@520 -- # local subsystem config 00:17:03.934 04:18:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:17:03.934 04:18:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:17:03.934 { 00:17:03.934 "params": { 00:17:03.934 "name": "Nvme$subsystem", 00:17:03.934 "trtype": "$TEST_TRANSPORT", 00:17:03.934 "traddr": "$NVMF_FIRST_TARGET_IP", 00:17:03.934 "adrfam": "ipv4", 00:17:03.934 "trsvcid": "$NVMF_PORT", 00:17:03.934 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:17:03.934 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:17:03.934 "hdgst": ${hdgst:-false}, 00:17:03.934 "ddgst": ${ddgst:-false} 00:17:03.934 }, 00:17:03.934 "method": "bdev_nvme_attach_controller" 00:17:03.934 } 00:17:03.934 EOF 00:17:03.934 )") 00:17:03.934 04:18:54 -- nvmf/common.sh@542 -- # cat 00:17:03.934 04:18:54 -- nvmf/common.sh@544 -- # jq . 00:17:03.934 04:18:54 -- nvmf/common.sh@545 -- # IFS=, 00:17:03.934 04:18:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:17:03.934 "params": { 00:17:03.934 "name": "Nvme0", 00:17:03.934 "trtype": "tcp", 00:17:03.934 "traddr": "10.0.0.2", 00:17:03.934 "adrfam": "ipv4", 00:17:03.934 "trsvcid": "4420", 00:17:03.934 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:03.934 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:17:03.934 "hdgst": false, 00:17:03.934 "ddgst": false 00:17:03.934 }, 00:17:03.934 "method": "bdev_nvme_attach_controller" 00:17:03.934 }' 00:17:04.193 [2024-11-30 04:18:54.602677] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:04.193 [2024-11-30 04:18:54.602761] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2348699 ] 00:17:04.193 EAL: No free 2048 kB hugepages reported on node 1 00:17:04.193 [2024-11-30 04:18:54.664312] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:04.193 [2024-11-30 04:18:54.750930] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:04.452 Running I/O for 1 seconds... 00:17:05.823 00:17:05.823 Latency(us) 00:17:05.823 [2024-11-30T03:18:56.454Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:05.823 [2024-11-30T03:18:56.454Z] Job: Nvme0n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:17:05.823 Verification LBA range: start 0x0 length 0x400 00:17:05.823 Nvme0n1 : 1.01 4056.36 253.52 0.00 0.00 15521.25 910.22 22719.15 00:17:05.823 [2024-11-30T03:18:56.454Z] =================================================================================================================== 00:17:05.823 [2024-11-30T03:18:56.454Z] Total : 4056.36 253.52 0.00 0.00 15521.25 910.22 22719.15 00:17:05.823 04:18:56 -- target/host_management.sh@101 -- # stoptarget 00:17:05.823 04:18:56 -- target/host_management.sh@36 -- # rm -f ./local-job0-0-verify.state 00:17:05.823 04:18:56 -- target/host_management.sh@37 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:17:05.823 04:18:56 -- target/host_management.sh@38 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:17:05.823 04:18:56 -- target/host_management.sh@40 -- # nvmftestfini 00:17:05.823 04:18:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:05.823 04:18:56 -- nvmf/common.sh@116 -- # sync 00:17:05.823 04:18:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:05.823 04:18:56 -- nvmf/common.sh@119 -- # set +e 00:17:05.823 04:18:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:05.823 04:18:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:05.823 rmmod nvme_tcp 00:17:05.823 rmmod nvme_fabrics 00:17:05.823 rmmod nvme_keyring 00:17:05.823 04:18:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:05.823 04:18:56 -- nvmf/common.sh@123 -- # set -e 00:17:05.823 04:18:56 -- nvmf/common.sh@124 -- # return 0 00:17:05.823 04:18:56 -- nvmf/common.sh@477 -- # '[' -n 2348259 ']' 00:17:05.823 04:18:56 -- nvmf/common.sh@478 -- # killprocess 2348259 00:17:05.823 04:18:56 -- common/autotest_common.sh@936 -- # '[' -z 2348259 ']' 00:17:05.823 04:18:56 -- common/autotest_common.sh@940 -- # kill -0 2348259 00:17:05.823 04:18:56 -- common/autotest_common.sh@941 -- # uname 00:17:05.823 04:18:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:05.823 04:18:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2348259 00:17:05.823 04:18:56 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:05.823 04:18:56 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:05.823 04:18:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2348259' 00:17:05.823 killing process with pid 2348259 00:17:05.823 04:18:56 -- common/autotest_common.sh@955 -- # kill 2348259 00:17:05.823 04:18:56 -- common/autotest_common.sh@960 -- # wait 2348259 00:17:06.082 [2024-11-30 04:18:56.575919] app.c: 605:unclaim_cpu_cores: *ERROR*: Failed to unlink lock fd for core 1, errno: 2 00:17:06.082 04:18:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:06.082 04:18:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:06.082 04:18:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:06.082 04:18:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:06.082 04:18:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:06.082 04:18:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:06.082 04:18:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:06.082 04:18:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:08.615 04:18:58 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:08.615 00:17:08.615 real 0m7.306s 00:17:08.615 user 0m22.780s 00:17:08.615 sys 0m1.443s 00:17:08.615 04:18:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:08.615 04:18:58 -- common/autotest_common.sh@10 -- # set +x 00:17:08.615 ************************************ 00:17:08.615 END TEST nvmf_host_management 00:17:08.615 ************************************ 00:17:08.615 04:18:58 -- target/host_management.sh@108 -- # trap - SIGINT SIGTERM EXIT 00:17:08.615 00:17:08.615 real 0m9.662s 00:17:08.615 user 0m23.624s 00:17:08.615 sys 0m2.950s 00:17:08.615 04:18:58 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:08.615 04:18:58 -- common/autotest_common.sh@10 -- # set +x 00:17:08.615 ************************************ 00:17:08.615 END TEST nvmf_host_management 00:17:08.615 ************************************ 00:17:08.615 04:18:58 -- nvmf/nvmf.sh@47 -- # run_test nvmf_lvol /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:08.615 04:18:58 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:08.615 04:18:58 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:08.615 04:18:58 -- common/autotest_common.sh@10 -- # set +x 00:17:08.615 ************************************ 00:17:08.615 START TEST nvmf_lvol 00:17:08.615 ************************************ 00:17:08.615 04:18:58 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvol.sh --transport=tcp 00:17:08.615 * Looking for test storage... 00:17:08.615 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:08.615 04:18:58 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:08.615 04:18:58 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:08.615 04:18:58 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:08.615 04:18:58 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:08.615 04:18:58 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:08.615 04:18:58 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:08.615 04:18:58 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:08.615 04:18:58 -- scripts/common.sh@335 -- # IFS=.-: 00:17:08.615 04:18:58 -- scripts/common.sh@335 -- # read -ra ver1 00:17:08.615 04:18:58 -- scripts/common.sh@336 -- # IFS=.-: 00:17:08.615 04:18:58 -- scripts/common.sh@336 -- # read -ra ver2 00:17:08.615 04:18:58 -- scripts/common.sh@337 -- # local 'op=<' 00:17:08.615 04:18:58 -- scripts/common.sh@339 -- # ver1_l=2 00:17:08.615 04:18:58 -- scripts/common.sh@340 -- # ver2_l=1 00:17:08.615 04:18:58 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:08.615 04:18:58 -- scripts/common.sh@343 -- # case "$op" in 00:17:08.615 04:18:58 -- scripts/common.sh@344 -- # : 1 00:17:08.615 04:18:58 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:08.615 04:18:58 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:08.615 04:18:58 -- scripts/common.sh@364 -- # decimal 1 00:17:08.615 04:18:58 -- scripts/common.sh@352 -- # local d=1 00:17:08.615 04:18:58 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:08.615 04:18:58 -- scripts/common.sh@354 -- # echo 1 00:17:08.615 04:18:58 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:08.615 04:18:58 -- scripts/common.sh@365 -- # decimal 2 00:17:08.615 04:18:58 -- scripts/common.sh@352 -- # local d=2 00:17:08.615 04:18:58 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:08.615 04:18:58 -- scripts/common.sh@354 -- # echo 2 00:17:08.615 04:18:58 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:08.615 04:18:58 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:08.615 04:18:58 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:08.615 04:18:58 -- scripts/common.sh@367 -- # return 0 00:17:08.615 04:18:58 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:08.615 04:18:58 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:08.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.615 --rc genhtml_branch_coverage=1 00:17:08.615 --rc genhtml_function_coverage=1 00:17:08.615 --rc genhtml_legend=1 00:17:08.615 --rc geninfo_all_blocks=1 00:17:08.615 --rc geninfo_unexecuted_blocks=1 00:17:08.615 00:17:08.615 ' 00:17:08.615 04:18:58 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:08.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.615 --rc genhtml_branch_coverage=1 00:17:08.615 --rc genhtml_function_coverage=1 00:17:08.615 --rc genhtml_legend=1 00:17:08.615 --rc geninfo_all_blocks=1 00:17:08.615 --rc geninfo_unexecuted_blocks=1 00:17:08.615 00:17:08.615 ' 00:17:08.615 04:18:58 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:08.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.615 --rc genhtml_branch_coverage=1 00:17:08.615 --rc genhtml_function_coverage=1 00:17:08.615 --rc genhtml_legend=1 00:17:08.615 --rc geninfo_all_blocks=1 00:17:08.615 --rc geninfo_unexecuted_blocks=1 00:17:08.615 00:17:08.615 ' 00:17:08.615 04:18:58 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:08.615 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:08.615 --rc genhtml_branch_coverage=1 00:17:08.615 --rc genhtml_function_coverage=1 00:17:08.615 --rc genhtml_legend=1 00:17:08.615 --rc geninfo_all_blocks=1 00:17:08.615 --rc geninfo_unexecuted_blocks=1 00:17:08.615 00:17:08.615 ' 00:17:08.615 04:18:58 -- target/nvmf_lvol.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:08.615 04:18:58 -- nvmf/common.sh@7 -- # uname -s 00:17:08.615 04:18:58 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:08.615 04:18:58 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:08.615 04:18:58 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:08.615 04:18:58 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:08.615 04:18:58 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:08.615 04:18:58 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:08.615 04:18:58 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:08.615 04:18:58 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:08.615 04:18:58 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:08.615 04:18:58 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:08.615 04:18:58 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:08.615 04:18:58 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:08.615 04:18:58 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:08.615 04:18:58 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:08.615 04:18:58 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:08.615 04:18:58 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:08.615 04:18:58 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:08.615 04:18:58 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:08.615 04:18:58 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:08.615 04:18:58 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.615 04:18:58 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.615 04:18:58 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.615 04:18:58 -- paths/export.sh@5 -- # export PATH 00:17:08.615 04:18:58 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:08.615 04:18:58 -- nvmf/common.sh@46 -- # : 0 00:17:08.615 04:18:58 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:08.615 04:18:58 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:08.615 04:18:58 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:08.615 04:18:58 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:08.615 04:18:58 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:08.615 04:18:58 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:08.615 04:18:58 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:08.615 04:18:58 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:08.615 04:18:58 -- target/nvmf_lvol.sh@11 -- # MALLOC_BDEV_SIZE=64 00:17:08.616 04:18:58 -- target/nvmf_lvol.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:17:08.616 04:18:58 -- target/nvmf_lvol.sh@13 -- # LVOL_BDEV_INIT_SIZE=20 00:17:08.616 04:18:58 -- target/nvmf_lvol.sh@14 -- # LVOL_BDEV_FINAL_SIZE=30 00:17:08.616 04:18:58 -- target/nvmf_lvol.sh@16 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:08.616 04:18:58 -- target/nvmf_lvol.sh@18 -- # nvmftestinit 00:17:08.616 04:18:58 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:08.616 04:18:58 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:08.616 04:18:58 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:08.616 04:18:58 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:08.616 04:18:58 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:08.616 04:18:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:08.616 04:18:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:08.616 04:18:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:08.616 04:18:58 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:08.616 04:18:58 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:08.616 04:18:58 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:08.616 04:18:58 -- common/autotest_common.sh@10 -- # set +x 00:17:10.518 04:19:00 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:10.518 04:19:00 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:10.518 04:19:00 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:10.518 04:19:00 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:10.518 04:19:00 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:10.518 04:19:00 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:10.518 04:19:00 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:10.518 04:19:00 -- nvmf/common.sh@294 -- # net_devs=() 00:17:10.518 04:19:00 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:10.518 04:19:00 -- nvmf/common.sh@295 -- # e810=() 00:17:10.518 04:19:00 -- nvmf/common.sh@295 -- # local -ga e810 00:17:10.518 04:19:00 -- nvmf/common.sh@296 -- # x722=() 00:17:10.518 04:19:00 -- nvmf/common.sh@296 -- # local -ga x722 00:17:10.518 04:19:00 -- nvmf/common.sh@297 -- # mlx=() 00:17:10.518 04:19:00 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:10.518 04:19:00 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:10.518 04:19:00 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:10.518 04:19:00 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:10.518 04:19:00 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:10.518 04:19:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:10.518 04:19:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:10.518 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:10.518 04:19:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:10.518 04:19:00 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:10.518 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:10.518 04:19:00 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:10.518 04:19:00 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:10.518 04:19:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:10.518 04:19:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:10.518 04:19:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:10.518 04:19:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:10.518 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:10.518 04:19:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:10.518 04:19:00 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:10.518 04:19:00 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:10.518 04:19:00 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:10.518 04:19:00 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:10.518 04:19:00 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:10.518 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:10.518 04:19:00 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:10.518 04:19:00 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:10.518 04:19:00 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:10.518 04:19:00 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:10.518 04:19:00 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:10.518 04:19:00 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:10.518 04:19:00 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:10.518 04:19:00 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:10.518 04:19:00 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:10.518 04:19:00 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:10.518 04:19:00 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:10.518 04:19:00 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:10.518 04:19:00 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:10.518 04:19:00 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:10.518 04:19:00 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:10.518 04:19:00 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:10.518 04:19:00 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:10.518 04:19:00 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:10.518 04:19:01 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:10.518 04:19:01 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:10.518 04:19:01 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:10.518 04:19:01 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:10.518 04:19:01 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:10.518 04:19:01 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:10.518 04:19:01 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:10.518 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:10.518 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.233 ms 00:17:10.518 00:17:10.518 --- 10.0.0.2 ping statistics --- 00:17:10.518 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:10.518 rtt min/avg/max/mdev = 0.233/0.233/0.233/0.000 ms 00:17:10.518 04:19:01 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:10.518 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:10.518 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:17:10.518 00:17:10.518 --- 10.0.0.1 ping statistics --- 00:17:10.518 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:10.518 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:17:10.518 04:19:01 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:10.518 04:19:01 -- nvmf/common.sh@410 -- # return 0 00:17:10.518 04:19:01 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:10.518 04:19:01 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:10.518 04:19:01 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:10.518 04:19:01 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:10.518 04:19:01 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:10.518 04:19:01 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:10.518 04:19:01 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:10.518 04:19:01 -- target/nvmf_lvol.sh@19 -- # nvmfappstart -m 0x7 00:17:10.518 04:19:01 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:10.518 04:19:01 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:10.518 04:19:01 -- common/autotest_common.sh@10 -- # set +x 00:17:10.518 04:19:01 -- nvmf/common.sh@469 -- # nvmfpid=2350851 00:17:10.518 04:19:01 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x7 00:17:10.518 04:19:01 -- nvmf/common.sh@470 -- # waitforlisten 2350851 00:17:10.518 04:19:01 -- common/autotest_common.sh@829 -- # '[' -z 2350851 ']' 00:17:10.518 04:19:01 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:10.518 04:19:01 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:10.518 04:19:01 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:10.518 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:10.518 04:19:01 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:10.518 04:19:01 -- common/autotest_common.sh@10 -- # set +x 00:17:10.777 [2024-11-30 04:19:01.155912] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:10.777 [2024-11-30 04:19:01.156020] [ DPDK EAL parameters: nvmf -c 0x7 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:10.777 EAL: No free 2048 kB hugepages reported on node 1 00:17:10.777 [2024-11-30 04:19:01.224348] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:17:10.777 [2024-11-30 04:19:01.318575] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:10.777 [2024-11-30 04:19:01.318734] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:10.777 [2024-11-30 04:19:01.318754] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:10.777 [2024-11-30 04:19:01.318767] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:10.777 [2024-11-30 04:19:01.318831] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:10.777 [2024-11-30 04:19:01.318858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:17:10.777 [2024-11-30 04:19:01.318861] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:11.715 04:19:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:11.715 04:19:02 -- common/autotest_common.sh@862 -- # return 0 00:17:11.715 04:19:02 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:11.715 04:19:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:11.715 04:19:02 -- common/autotest_common.sh@10 -- # set +x 00:17:11.715 04:19:02 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:11.715 04:19:02 -- target/nvmf_lvol.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:11.973 [2024-11-30 04:19:02.411358] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:11.973 04:19:02 -- target/nvmf_lvol.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:12.230 04:19:02 -- target/nvmf_lvol.sh@24 -- # base_bdevs='Malloc0 ' 00:17:12.230 04:19:02 -- target/nvmf_lvol.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:17:12.488 04:19:02 -- target/nvmf_lvol.sh@25 -- # base_bdevs+=Malloc1 00:17:12.489 04:19:02 -- target/nvmf_lvol.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc0 Malloc1' 00:17:12.747 04:19:03 -- target/nvmf_lvol.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore raid0 lvs 00:17:13.005 04:19:03 -- target/nvmf_lvol.sh@29 -- # lvs=feafbb68-f5aa-4c78-b13b-eb36a318f8b5 00:17:13.006 04:19:03 -- target/nvmf_lvol.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u feafbb68-f5aa-4c78-b13b-eb36a318f8b5 lvol 20 00:17:13.263 04:19:03 -- target/nvmf_lvol.sh@32 -- # lvol=687656bc-3c81-4290-80e1-9f83bbadc308 00:17:13.263 04:19:03 -- target/nvmf_lvol.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:13.521 04:19:03 -- target/nvmf_lvol.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 687656bc-3c81-4290-80e1-9f83bbadc308 00:17:13.779 04:19:04 -- target/nvmf_lvol.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:14.037 [2024-11-30 04:19:04.473296] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:14.037 04:19:04 -- target/nvmf_lvol.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:14.295 04:19:04 -- target/nvmf_lvol.sh@42 -- # perf_pid=2351411 00:17:14.295 04:19:04 -- target/nvmf_lvol.sh@44 -- # sleep 1 00:17:14.295 04:19:04 -- target/nvmf_lvol.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -o 4096 -q 128 -s 512 -w randwrite -t 10 -c 0x18 00:17:14.295 EAL: No free 2048 kB hugepages reported on node 1 00:17:15.226 04:19:05 -- target/nvmf_lvol.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_snapshot 687656bc-3c81-4290-80e1-9f83bbadc308 MY_SNAPSHOT 00:17:15.483 04:19:06 -- target/nvmf_lvol.sh@47 -- # snapshot=05983c0b-07fe-4e2e-98f6-23804db9cb18 00:17:15.483 04:19:06 -- target/nvmf_lvol.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_resize 687656bc-3c81-4290-80e1-9f83bbadc308 30 00:17:15.741 04:19:06 -- target/nvmf_lvol.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_clone 05983c0b-07fe-4e2e-98f6-23804db9cb18 MY_CLONE 00:17:16.309 04:19:06 -- target/nvmf_lvol.sh@49 -- # clone=2058ece6-83ae-4e09-9461-0ce4a607e9f6 00:17:16.309 04:19:06 -- target/nvmf_lvol.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_inflate 2058ece6-83ae-4e09-9461-0ce4a607e9f6 00:17:16.876 04:19:07 -- target/nvmf_lvol.sh@53 -- # wait 2351411 00:17:25.045 Initializing NVMe Controllers 00:17:25.045 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode0 00:17:25.045 Controller IO queue size 128, less than required. 00:17:25.045 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:17:25.045 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 3 00:17:25.045 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 with lcore 4 00:17:25.045 Initialization complete. Launching workers. 00:17:25.045 ======================================================== 00:17:25.045 Latency(us) 00:17:25.045 Device Information : IOPS MiB/s Average min max 00:17:25.045 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 3: 10981.00 42.89 11662.28 2072.87 61413.84 00:17:25.045 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode0) NSID 1 from core 4: 10360.10 40.47 12357.75 2132.06 61877.42 00:17:25.045 ======================================================== 00:17:25.045 Total : 21341.10 83.36 11999.90 2072.87 61877.42 00:17:25.045 00:17:25.045 04:19:15 -- target/nvmf_lvol.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:25.045 04:19:15 -- target/nvmf_lvol.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 687656bc-3c81-4290-80e1-9f83bbadc308 00:17:25.303 04:19:15 -- target/nvmf_lvol.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u feafbb68-f5aa-4c78-b13b-eb36a318f8b5 00:17:25.561 04:19:15 -- target/nvmf_lvol.sh@60 -- # rm -f 00:17:25.561 04:19:15 -- target/nvmf_lvol.sh@62 -- # trap - SIGINT SIGTERM EXIT 00:17:25.561 04:19:15 -- target/nvmf_lvol.sh@64 -- # nvmftestfini 00:17:25.561 04:19:15 -- nvmf/common.sh@476 -- # nvmfcleanup 00:17:25.561 04:19:15 -- nvmf/common.sh@116 -- # sync 00:17:25.561 04:19:15 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:17:25.561 04:19:15 -- nvmf/common.sh@119 -- # set +e 00:17:25.561 04:19:15 -- nvmf/common.sh@120 -- # for i in {1..20} 00:17:25.561 04:19:15 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:17:25.561 rmmod nvme_tcp 00:17:25.561 rmmod nvme_fabrics 00:17:25.561 rmmod nvme_keyring 00:17:25.561 04:19:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:17:25.561 04:19:16 -- nvmf/common.sh@123 -- # set -e 00:17:25.561 04:19:16 -- nvmf/common.sh@124 -- # return 0 00:17:25.561 04:19:16 -- nvmf/common.sh@477 -- # '[' -n 2350851 ']' 00:17:25.561 04:19:16 -- nvmf/common.sh@478 -- # killprocess 2350851 00:17:25.561 04:19:16 -- common/autotest_common.sh@936 -- # '[' -z 2350851 ']' 00:17:25.561 04:19:16 -- common/autotest_common.sh@940 -- # kill -0 2350851 00:17:25.561 04:19:16 -- common/autotest_common.sh@941 -- # uname 00:17:25.561 04:19:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:25.561 04:19:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2350851 00:17:25.561 04:19:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:17:25.561 04:19:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:17:25.561 04:19:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2350851' 00:17:25.561 killing process with pid 2350851 00:17:25.561 04:19:16 -- common/autotest_common.sh@955 -- # kill 2350851 00:17:25.561 04:19:16 -- common/autotest_common.sh@960 -- # wait 2350851 00:17:25.821 04:19:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:17:25.821 04:19:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:17:25.821 04:19:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:17:25.821 04:19:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:17:25.821 04:19:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:17:25.821 04:19:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:25.821 04:19:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:25.821 04:19:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:28.357 04:19:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:17:28.357 00:17:28.357 real 0m19.717s 00:17:28.357 user 1m5.961s 00:17:28.357 sys 0m5.909s 00:17:28.357 04:19:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:28.357 04:19:18 -- common/autotest_common.sh@10 -- # set +x 00:17:28.357 ************************************ 00:17:28.357 END TEST nvmf_lvol 00:17:28.357 ************************************ 00:17:28.357 04:19:18 -- nvmf/nvmf.sh@48 -- # run_test nvmf_lvs_grow /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:28.357 04:19:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:28.357 04:19:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:28.357 04:19:18 -- common/autotest_common.sh@10 -- # set +x 00:17:28.357 ************************************ 00:17:28.357 START TEST nvmf_lvs_grow 00:17:28.357 ************************************ 00:17:28.357 04:19:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh --transport=tcp 00:17:28.357 * Looking for test storage... 00:17:28.357 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:17:28.357 04:19:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:17:28.357 04:19:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:17:28.357 04:19:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:17:28.357 04:19:18 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:17:28.357 04:19:18 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:17:28.357 04:19:18 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:17:28.357 04:19:18 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:17:28.357 04:19:18 -- scripts/common.sh@335 -- # IFS=.-: 00:17:28.357 04:19:18 -- scripts/common.sh@335 -- # read -ra ver1 00:17:28.357 04:19:18 -- scripts/common.sh@336 -- # IFS=.-: 00:17:28.357 04:19:18 -- scripts/common.sh@336 -- # read -ra ver2 00:17:28.357 04:19:18 -- scripts/common.sh@337 -- # local 'op=<' 00:17:28.357 04:19:18 -- scripts/common.sh@339 -- # ver1_l=2 00:17:28.357 04:19:18 -- scripts/common.sh@340 -- # ver2_l=1 00:17:28.357 04:19:18 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:17:28.357 04:19:18 -- scripts/common.sh@343 -- # case "$op" in 00:17:28.357 04:19:18 -- scripts/common.sh@344 -- # : 1 00:17:28.357 04:19:18 -- scripts/common.sh@363 -- # (( v = 0 )) 00:17:28.357 04:19:18 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:17:28.357 04:19:18 -- scripts/common.sh@364 -- # decimal 1 00:17:28.357 04:19:18 -- scripts/common.sh@352 -- # local d=1 00:17:28.357 04:19:18 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:17:28.357 04:19:18 -- scripts/common.sh@354 -- # echo 1 00:17:28.357 04:19:18 -- scripts/common.sh@364 -- # ver1[v]=1 00:17:28.357 04:19:18 -- scripts/common.sh@365 -- # decimal 2 00:17:28.357 04:19:18 -- scripts/common.sh@352 -- # local d=2 00:17:28.357 04:19:18 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:17:28.357 04:19:18 -- scripts/common.sh@354 -- # echo 2 00:17:28.357 04:19:18 -- scripts/common.sh@365 -- # ver2[v]=2 00:17:28.358 04:19:18 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:17:28.358 04:19:18 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:17:28.358 04:19:18 -- scripts/common.sh@367 -- # return 0 00:17:28.358 04:19:18 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:17:28.358 04:19:18 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:17:28.358 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:28.358 --rc genhtml_branch_coverage=1 00:17:28.358 --rc genhtml_function_coverage=1 00:17:28.358 --rc genhtml_legend=1 00:17:28.358 --rc geninfo_all_blocks=1 00:17:28.358 --rc geninfo_unexecuted_blocks=1 00:17:28.358 00:17:28.358 ' 00:17:28.358 04:19:18 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:17:28.358 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:28.358 --rc genhtml_branch_coverage=1 00:17:28.358 --rc genhtml_function_coverage=1 00:17:28.358 --rc genhtml_legend=1 00:17:28.358 --rc geninfo_all_blocks=1 00:17:28.358 --rc geninfo_unexecuted_blocks=1 00:17:28.358 00:17:28.358 ' 00:17:28.358 04:19:18 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:17:28.358 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:28.358 --rc genhtml_branch_coverage=1 00:17:28.358 --rc genhtml_function_coverage=1 00:17:28.358 --rc genhtml_legend=1 00:17:28.358 --rc geninfo_all_blocks=1 00:17:28.358 --rc geninfo_unexecuted_blocks=1 00:17:28.358 00:17:28.358 ' 00:17:28.358 04:19:18 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:17:28.358 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:17:28.358 --rc genhtml_branch_coverage=1 00:17:28.358 --rc genhtml_function_coverage=1 00:17:28.358 --rc genhtml_legend=1 00:17:28.358 --rc geninfo_all_blocks=1 00:17:28.358 --rc geninfo_unexecuted_blocks=1 00:17:28.358 00:17:28.358 ' 00:17:28.358 04:19:18 -- target/nvmf_lvs_grow.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:17:28.358 04:19:18 -- nvmf/common.sh@7 -- # uname -s 00:17:28.358 04:19:18 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:17:28.358 04:19:18 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:17:28.358 04:19:18 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:17:28.358 04:19:18 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:17:28.358 04:19:18 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:17:28.358 04:19:18 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:17:28.358 04:19:18 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:17:28.358 04:19:18 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:17:28.358 04:19:18 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:17:28.358 04:19:18 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:17:28.358 04:19:18 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:17:28.358 04:19:18 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:17:28.358 04:19:18 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:17:28.358 04:19:18 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:17:28.358 04:19:18 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:17:28.358 04:19:18 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:17:28.358 04:19:18 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:17:28.358 04:19:18 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:17:28.358 04:19:18 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:17:28.358 04:19:18 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.358 04:19:18 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.358 04:19:18 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.358 04:19:18 -- paths/export.sh@5 -- # export PATH 00:17:28.358 04:19:18 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:17:28.358 04:19:18 -- nvmf/common.sh@46 -- # : 0 00:17:28.358 04:19:18 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:17:28.358 04:19:18 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:17:28.358 04:19:18 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:17:28.358 04:19:18 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:17:28.358 04:19:18 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:17:28.358 04:19:18 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:17:28.358 04:19:18 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:17:28.358 04:19:18 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:17:28.358 04:19:18 -- target/nvmf_lvs_grow.sh@11 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:28.358 04:19:18 -- target/nvmf_lvs_grow.sh@12 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:17:28.358 04:19:18 -- target/nvmf_lvs_grow.sh@97 -- # nvmftestinit 00:17:28.358 04:19:18 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:17:28.358 04:19:18 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:17:28.358 04:19:18 -- nvmf/common.sh@436 -- # prepare_net_devs 00:17:28.358 04:19:18 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:17:28.358 04:19:18 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:17:28.358 04:19:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:17:28.358 04:19:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:17:28.358 04:19:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:17:28.358 04:19:18 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:17:28.358 04:19:18 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:17:28.358 04:19:18 -- nvmf/common.sh@284 -- # xtrace_disable 00:17:28.358 04:19:18 -- common/autotest_common.sh@10 -- # set +x 00:17:30.267 04:19:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:17:30.267 04:19:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:17:30.267 04:19:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:17:30.267 04:19:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:17:30.267 04:19:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:17:30.267 04:19:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:17:30.267 04:19:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:17:30.267 04:19:20 -- nvmf/common.sh@294 -- # net_devs=() 00:17:30.268 04:19:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:17:30.268 04:19:20 -- nvmf/common.sh@295 -- # e810=() 00:17:30.268 04:19:20 -- nvmf/common.sh@295 -- # local -ga e810 00:17:30.268 04:19:20 -- nvmf/common.sh@296 -- # x722=() 00:17:30.268 04:19:20 -- nvmf/common.sh@296 -- # local -ga x722 00:17:30.268 04:19:20 -- nvmf/common.sh@297 -- # mlx=() 00:17:30.268 04:19:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:17:30.268 04:19:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:17:30.268 04:19:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:17:30.268 04:19:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:17:30.268 04:19:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:17:30.268 04:19:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:30.268 04:19:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:17:30.268 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:17:30.268 04:19:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:17:30.268 04:19:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:17:30.268 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:17:30.268 04:19:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:17:30.268 04:19:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:30.268 04:19:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:30.268 04:19:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:30.268 04:19:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:30.268 04:19:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:17:30.268 Found net devices under 0000:0a:00.0: cvl_0_0 00:17:30.268 04:19:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:30.268 04:19:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:17:30.268 04:19:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:17:30.268 04:19:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:17:30.268 04:19:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:17:30.268 04:19:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:17:30.268 Found net devices under 0000:0a:00.1: cvl_0_1 00:17:30.268 04:19:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:17:30.268 04:19:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:17:30.268 04:19:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:17:30.268 04:19:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:17:30.268 04:19:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:17:30.268 04:19:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:17:30.268 04:19:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:17:30.268 04:19:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:17:30.268 04:19:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:17:30.268 04:19:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:17:30.268 04:19:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:17:30.268 04:19:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:17:30.268 04:19:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:17:30.268 04:19:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:17:30.268 04:19:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:17:30.268 04:19:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:17:30.268 04:19:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:17:30.268 04:19:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:17:30.268 04:19:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:17:30.268 04:19:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:17:30.268 04:19:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:17:30.268 04:19:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:17:30.268 04:19:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:17:30.268 04:19:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:17:30.268 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:17:30.268 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.377 ms 00:17:30.268 00:17:30.268 --- 10.0.0.2 ping statistics --- 00:17:30.268 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:30.268 rtt min/avg/max/mdev = 0.377/0.377/0.377/0.000 ms 00:17:30.268 04:19:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:17:30.268 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:17:30.268 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.163 ms 00:17:30.268 00:17:30.268 --- 10.0.0.1 ping statistics --- 00:17:30.268 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:17:30.268 rtt min/avg/max/mdev = 0.163/0.163/0.163/0.000 ms 00:17:30.268 04:19:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:17:30.268 04:19:20 -- nvmf/common.sh@410 -- # return 0 00:17:30.268 04:19:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:17:30.268 04:19:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:17:30.268 04:19:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:17:30.268 04:19:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:17:30.268 04:19:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:17:30.268 04:19:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:17:30.268 04:19:20 -- target/nvmf_lvs_grow.sh@98 -- # nvmfappstart -m 0x1 00:17:30.268 04:19:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:17:30.268 04:19:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:17:30.268 04:19:20 -- common/autotest_common.sh@10 -- # set +x 00:17:30.268 04:19:20 -- nvmf/common.sh@469 -- # nvmfpid=2354731 00:17:30.268 04:19:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:17:30.268 04:19:20 -- nvmf/common.sh@470 -- # waitforlisten 2354731 00:17:30.268 04:19:20 -- common/autotest_common.sh@829 -- # '[' -z 2354731 ']' 00:17:30.268 04:19:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:17:30.268 04:19:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:30.268 04:19:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:17:30.268 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:17:30.268 04:19:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:30.268 04:19:20 -- common/autotest_common.sh@10 -- # set +x 00:17:30.268 [2024-11-30 04:19:20.779095] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:30.268 [2024-11-30 04:19:20.779158] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:17:30.268 EAL: No free 2048 kB hugepages reported on node 1 00:17:30.268 [2024-11-30 04:19:20.844384] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:30.527 [2024-11-30 04:19:20.932443] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:17:30.527 [2024-11-30 04:19:20.932629] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:17:30.527 [2024-11-30 04:19:20.932650] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:17:30.527 [2024-11-30 04:19:20.932665] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:17:30.527 [2024-11-30 04:19:20.932695] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:17:31.459 04:19:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:31.459 04:19:21 -- common/autotest_common.sh@862 -- # return 0 00:17:31.459 04:19:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:17:31.459 04:19:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:17:31.459 04:19:21 -- common/autotest_common.sh@10 -- # set +x 00:17:31.459 04:19:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:17:31.459 04:19:21 -- target/nvmf_lvs_grow.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:17:31.459 [2024-11-30 04:19:22.073880] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:17:31.717 04:19:22 -- target/nvmf_lvs_grow.sh@101 -- # run_test lvs_grow_clean lvs_grow 00:17:31.717 04:19:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:17:31.717 04:19:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:31.717 04:19:22 -- common/autotest_common.sh@10 -- # set +x 00:17:31.717 ************************************ 00:17:31.717 START TEST lvs_grow_clean 00:17:31.717 ************************************ 00:17:31.717 04:19:22 -- common/autotest_common.sh@1114 -- # lvs_grow 00:17:31.717 04:19:22 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:31.717 04:19:22 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:31.717 04:19:22 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:31.717 04:19:22 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:31.717 04:19:22 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:31.717 04:19:22 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:31.717 04:19:22 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:31.717 04:19:22 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:31.717 04:19:22 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:31.975 04:19:22 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:31.975 04:19:22 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:32.233 04:19:22 -- target/nvmf_lvs_grow.sh@28 -- # lvs=e96448ee-5528-46eb-a516-197bf614673a 00:17:32.233 04:19:22 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e96448ee-5528-46eb-a516-197bf614673a 00:17:32.233 04:19:22 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:32.491 04:19:22 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:32.491 04:19:22 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:32.491 04:19:22 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u e96448ee-5528-46eb-a516-197bf614673a lvol 150 00:17:32.749 04:19:23 -- target/nvmf_lvs_grow.sh@33 -- # lvol=63c51ae5-a739-4b78-8247-51eeff2144b1 00:17:32.749 04:19:23 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:32.749 04:19:23 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:33.007 [2024-11-30 04:19:23.448297] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:33.007 [2024-11-30 04:19:23.448386] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:33.007 true 00:17:33.007 04:19:23 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e96448ee-5528-46eb-a516-197bf614673a 00:17:33.007 04:19:23 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:33.265 04:19:23 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:33.265 04:19:23 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:33.523 04:19:23 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 63c51ae5-a739-4b78-8247-51eeff2144b1 00:17:33.781 04:19:24 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:34.038 [2024-11-30 04:19:24.471560] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:17:34.039 04:19:24 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:34.297 04:19:24 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2355190 00:17:34.297 04:19:24 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:34.297 04:19:24 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:34.297 04:19:24 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2355190 /var/tmp/bdevperf.sock 00:17:34.297 04:19:24 -- common/autotest_common.sh@829 -- # '[' -z 2355190 ']' 00:17:34.297 04:19:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:34.297 04:19:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:34.297 04:19:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:34.297 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:34.297 04:19:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:34.297 04:19:24 -- common/autotest_common.sh@10 -- # set +x 00:17:34.297 [2024-11-30 04:19:24.783334] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:34.297 [2024-11-30 04:19:24.783403] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2355190 ] 00:17:34.297 EAL: No free 2048 kB hugepages reported on node 1 00:17:34.297 [2024-11-30 04:19:24.845799] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:34.555 [2024-11-30 04:19:24.935309] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:35.486 04:19:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:35.486 04:19:25 -- common/autotest_common.sh@862 -- # return 0 00:17:35.486 04:19:25 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:35.743 Nvme0n1 00:17:35.743 04:19:26 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:36.001 [ 00:17:36.001 { 00:17:36.001 "name": "Nvme0n1", 00:17:36.001 "aliases": [ 00:17:36.001 "63c51ae5-a739-4b78-8247-51eeff2144b1" 00:17:36.001 ], 00:17:36.001 "product_name": "NVMe disk", 00:17:36.001 "block_size": 4096, 00:17:36.001 "num_blocks": 38912, 00:17:36.001 "uuid": "63c51ae5-a739-4b78-8247-51eeff2144b1", 00:17:36.001 "assigned_rate_limits": { 00:17:36.001 "rw_ios_per_sec": 0, 00:17:36.001 "rw_mbytes_per_sec": 0, 00:17:36.001 "r_mbytes_per_sec": 0, 00:17:36.001 "w_mbytes_per_sec": 0 00:17:36.001 }, 00:17:36.001 "claimed": false, 00:17:36.001 "zoned": false, 00:17:36.001 "supported_io_types": { 00:17:36.001 "read": true, 00:17:36.001 "write": true, 00:17:36.001 "unmap": true, 00:17:36.001 "write_zeroes": true, 00:17:36.001 "flush": true, 00:17:36.001 "reset": true, 00:17:36.001 "compare": true, 00:17:36.001 "compare_and_write": true, 00:17:36.001 "abort": true, 00:17:36.001 "nvme_admin": true, 00:17:36.001 "nvme_io": true 00:17:36.001 }, 00:17:36.001 "driver_specific": { 00:17:36.001 "nvme": [ 00:17:36.001 { 00:17:36.001 "trid": { 00:17:36.001 "trtype": "TCP", 00:17:36.001 "adrfam": "IPv4", 00:17:36.001 "traddr": "10.0.0.2", 00:17:36.001 "trsvcid": "4420", 00:17:36.001 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:36.001 }, 00:17:36.001 "ctrlr_data": { 00:17:36.001 "cntlid": 1, 00:17:36.001 "vendor_id": "0x8086", 00:17:36.001 "model_number": "SPDK bdev Controller", 00:17:36.001 "serial_number": "SPDK0", 00:17:36.001 "firmware_revision": "24.01.1", 00:17:36.001 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:36.001 "oacs": { 00:17:36.002 "security": 0, 00:17:36.002 "format": 0, 00:17:36.002 "firmware": 0, 00:17:36.002 "ns_manage": 0 00:17:36.002 }, 00:17:36.002 "multi_ctrlr": true, 00:17:36.002 "ana_reporting": false 00:17:36.002 }, 00:17:36.002 "vs": { 00:17:36.002 "nvme_version": "1.3" 00:17:36.002 }, 00:17:36.002 "ns_data": { 00:17:36.002 "id": 1, 00:17:36.002 "can_share": true 00:17:36.002 } 00:17:36.002 } 00:17:36.002 ], 00:17:36.002 "mp_policy": "active_passive" 00:17:36.002 } 00:17:36.002 } 00:17:36.002 ] 00:17:36.002 04:19:26 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2355462 00:17:36.002 04:19:26 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:36.002 04:19:26 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:36.260 Running I/O for 10 seconds... 00:17:37.194 Latency(us) 00:17:37.194 [2024-11-30T03:19:27.825Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:37.194 [2024-11-30T03:19:27.825Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:37.194 Nvme0n1 : 1.00 14676.00 57.33 0.00 0.00 0.00 0.00 0.00 00:17:37.194 [2024-11-30T03:19:27.825Z] =================================================================================================================== 00:17:37.194 [2024-11-30T03:19:27.825Z] Total : 14676.00 57.33 0.00 0.00 0.00 0.00 0.00 00:17:37.194 00:17:38.128 04:19:28 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u e96448ee-5528-46eb-a516-197bf614673a 00:17:38.128 [2024-11-30T03:19:28.759Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:38.128 Nvme0n1 : 2.00 14825.00 57.91 0.00 0.00 0.00 0.00 0.00 00:17:38.128 [2024-11-30T03:19:28.759Z] =================================================================================================================== 00:17:38.128 [2024-11-30T03:19:28.759Z] Total : 14825.00 57.91 0.00 0.00 0.00 0.00 0.00 00:17:38.128 00:17:38.385 true 00:17:38.385 04:19:28 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e96448ee-5528-46eb-a516-197bf614673a 00:17:38.385 04:19:28 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:38.643 04:19:29 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:38.643 04:19:29 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:38.643 04:19:29 -- target/nvmf_lvs_grow.sh@65 -- # wait 2355462 00:17:39.209 [2024-11-30T03:19:29.840Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:39.209 Nvme0n1 : 3.00 14926.33 58.31 0.00 0.00 0.00 0.00 0.00 00:17:39.209 [2024-11-30T03:19:29.840Z] =================================================================================================================== 00:17:39.209 [2024-11-30T03:19:29.840Z] Total : 14926.33 58.31 0.00 0.00 0.00 0.00 0.00 00:17:39.209 00:17:40.142 [2024-11-30T03:19:30.773Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:40.142 Nvme0n1 : 4.00 15004.75 58.61 0.00 0.00 0.00 0.00 0.00 00:17:40.142 [2024-11-30T03:19:30.773Z] =================================================================================================================== 00:17:40.142 [2024-11-30T03:19:30.773Z] Total : 15004.75 58.61 0.00 0.00 0.00 0.00 0.00 00:17:40.142 00:17:41.516 [2024-11-30T03:19:32.147Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:41.516 Nvme0n1 : 5.00 15090.20 58.95 0.00 0.00 0.00 0.00 0.00 00:17:41.516 [2024-11-30T03:19:32.147Z] =================================================================================================================== 00:17:41.516 [2024-11-30T03:19:32.147Z] Total : 15090.20 58.95 0.00 0.00 0.00 0.00 0.00 00:17:41.516 00:17:42.450 [2024-11-30T03:19:33.081Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:42.450 Nvme0n1 : 6.00 15147.67 59.17 0.00 0.00 0.00 0.00 0.00 00:17:42.450 [2024-11-30T03:19:33.081Z] =================================================================================================================== 00:17:42.450 [2024-11-30T03:19:33.081Z] Total : 15147.67 59.17 0.00 0.00 0.00 0.00 0.00 00:17:42.450 00:17:43.385 [2024-11-30T03:19:34.016Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:43.385 Nvme0n1 : 7.00 15199.14 59.37 0.00 0.00 0.00 0.00 0.00 00:17:43.385 [2024-11-30T03:19:34.016Z] =================================================================================================================== 00:17:43.385 [2024-11-30T03:19:34.016Z] Total : 15199.14 59.37 0.00 0.00 0.00 0.00 0.00 00:17:43.385 00:17:44.319 [2024-11-30T03:19:34.950Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:44.319 Nvme0n1 : 8.00 15233.38 59.51 0.00 0.00 0.00 0.00 0.00 00:17:44.319 [2024-11-30T03:19:34.950Z] =================================================================================================================== 00:17:44.319 [2024-11-30T03:19:34.950Z] Total : 15233.38 59.51 0.00 0.00 0.00 0.00 0.00 00:17:44.319 00:17:45.255 [2024-11-30T03:19:35.886Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:45.255 Nvme0n1 : 9.00 15278.00 59.68 0.00 0.00 0.00 0.00 0.00 00:17:45.255 [2024-11-30T03:19:35.886Z] =================================================================================================================== 00:17:45.255 [2024-11-30T03:19:35.886Z] Total : 15278.00 59.68 0.00 0.00 0.00 0.00 0.00 00:17:45.255 00:17:46.189 [2024-11-30T03:19:36.820Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:46.189 Nvme0n1 : 10.00 15295.70 59.75 0.00 0.00 0.00 0.00 0.00 00:17:46.189 [2024-11-30T03:19:36.820Z] =================================================================================================================== 00:17:46.189 [2024-11-30T03:19:36.820Z] Total : 15295.70 59.75 0.00 0.00 0.00 0.00 0.00 00:17:46.189 00:17:46.189 00:17:46.189 Latency(us) 00:17:46.189 [2024-11-30T03:19:36.820Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:46.189 [2024-11-30T03:19:36.820Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:46.189 Nvme0n1 : 10.01 15298.79 59.76 0.00 0.00 8362.27 2123.85 16408.27 00:17:46.189 [2024-11-30T03:19:36.820Z] =================================================================================================================== 00:17:46.189 [2024-11-30T03:19:36.820Z] Total : 15298.79 59.76 0.00 0.00 8362.27 2123.85 16408.27 00:17:46.189 0 00:17:46.189 04:19:36 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2355190 00:17:46.189 04:19:36 -- common/autotest_common.sh@936 -- # '[' -z 2355190 ']' 00:17:46.189 04:19:36 -- common/autotest_common.sh@940 -- # kill -0 2355190 00:17:46.189 04:19:36 -- common/autotest_common.sh@941 -- # uname 00:17:46.189 04:19:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:17:46.189 04:19:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2355190 00:17:46.189 04:19:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:17:46.189 04:19:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:17:46.189 04:19:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2355190' 00:17:46.189 killing process with pid 2355190 00:17:46.189 04:19:36 -- common/autotest_common.sh@955 -- # kill 2355190 00:17:46.189 Received shutdown signal, test time was about 10.000000 seconds 00:17:46.189 00:17:46.189 Latency(us) 00:17:46.189 [2024-11-30T03:19:36.820Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:46.189 [2024-11-30T03:19:36.820Z] =================================================================================================================== 00:17:46.189 [2024-11-30T03:19:36.820Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:17:46.189 04:19:36 -- common/autotest_common.sh@960 -- # wait 2355190 00:17:46.448 04:19:37 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:17:46.706 04:19:37 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e96448ee-5528-46eb-a516-197bf614673a 00:17:46.706 04:19:37 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:17:46.964 04:19:37 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:17:46.964 04:19:37 -- target/nvmf_lvs_grow.sh@71 -- # [[ '' == \d\i\r\t\y ]] 00:17:46.965 04:19:37 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:47.223 [2024-11-30 04:19:37.782779] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:17:47.223 04:19:37 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e96448ee-5528-46eb-a516-197bf614673a 00:17:47.223 04:19:37 -- common/autotest_common.sh@650 -- # local es=0 00:17:47.223 04:19:37 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e96448ee-5528-46eb-a516-197bf614673a 00:17:47.223 04:19:37 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:47.223 04:19:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:47.223 04:19:37 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:47.223 04:19:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:47.223 04:19:37 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:47.223 04:19:37 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:17:47.223 04:19:37 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:17:47.223 04:19:37 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:17:47.223 04:19:37 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e96448ee-5528-46eb-a516-197bf614673a 00:17:47.481 request: 00:17:47.481 { 00:17:47.481 "uuid": "e96448ee-5528-46eb-a516-197bf614673a", 00:17:47.481 "method": "bdev_lvol_get_lvstores", 00:17:47.481 "req_id": 1 00:17:47.481 } 00:17:47.481 Got JSON-RPC error response 00:17:47.481 response: 00:17:47.481 { 00:17:47.481 "code": -19, 00:17:47.481 "message": "No such device" 00:17:47.481 } 00:17:47.481 04:19:38 -- common/autotest_common.sh@653 -- # es=1 00:17:47.481 04:19:38 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:17:47.481 04:19:38 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:17:47.481 04:19:38 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:17:47.481 04:19:38 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:47.739 aio_bdev 00:17:47.739 04:19:38 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev 63c51ae5-a739-4b78-8247-51eeff2144b1 00:17:47.739 04:19:38 -- common/autotest_common.sh@897 -- # local bdev_name=63c51ae5-a739-4b78-8247-51eeff2144b1 00:17:47.739 04:19:38 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:17:47.739 04:19:38 -- common/autotest_common.sh@899 -- # local i 00:17:47.739 04:19:38 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:17:47.739 04:19:38 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:17:47.739 04:19:38 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:17:47.997 04:19:38 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b 63c51ae5-a739-4b78-8247-51eeff2144b1 -t 2000 00:17:48.255 [ 00:17:48.255 { 00:17:48.255 "name": "63c51ae5-a739-4b78-8247-51eeff2144b1", 00:17:48.255 "aliases": [ 00:17:48.255 "lvs/lvol" 00:17:48.255 ], 00:17:48.255 "product_name": "Logical Volume", 00:17:48.255 "block_size": 4096, 00:17:48.255 "num_blocks": 38912, 00:17:48.255 "uuid": "63c51ae5-a739-4b78-8247-51eeff2144b1", 00:17:48.255 "assigned_rate_limits": { 00:17:48.255 "rw_ios_per_sec": 0, 00:17:48.255 "rw_mbytes_per_sec": 0, 00:17:48.255 "r_mbytes_per_sec": 0, 00:17:48.255 "w_mbytes_per_sec": 0 00:17:48.255 }, 00:17:48.255 "claimed": false, 00:17:48.255 "zoned": false, 00:17:48.255 "supported_io_types": { 00:17:48.255 "read": true, 00:17:48.255 "write": true, 00:17:48.255 "unmap": true, 00:17:48.255 "write_zeroes": true, 00:17:48.255 "flush": false, 00:17:48.255 "reset": true, 00:17:48.255 "compare": false, 00:17:48.255 "compare_and_write": false, 00:17:48.255 "abort": false, 00:17:48.255 "nvme_admin": false, 00:17:48.255 "nvme_io": false 00:17:48.255 }, 00:17:48.255 "driver_specific": { 00:17:48.255 "lvol": { 00:17:48.255 "lvol_store_uuid": "e96448ee-5528-46eb-a516-197bf614673a", 00:17:48.255 "base_bdev": "aio_bdev", 00:17:48.255 "thin_provision": false, 00:17:48.255 "snapshot": false, 00:17:48.255 "clone": false, 00:17:48.255 "esnap_clone": false 00:17:48.255 } 00:17:48.255 } 00:17:48.255 } 00:17:48.255 ] 00:17:48.255 04:19:38 -- common/autotest_common.sh@905 -- # return 0 00:17:48.255 04:19:38 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e96448ee-5528-46eb-a516-197bf614673a 00:17:48.255 04:19:38 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:17:48.514 04:19:39 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:17:48.514 04:19:39 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u e96448ee-5528-46eb-a516-197bf614673a 00:17:48.514 04:19:39 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:17:48.772 04:19:39 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:17:48.772 04:19:39 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 63c51ae5-a739-4b78-8247-51eeff2144b1 00:17:49.030 04:19:39 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u e96448ee-5528-46eb-a516-197bf614673a 00:17:49.595 04:19:39 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:17:49.595 04:19:40 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:49.595 00:17:49.595 real 0m18.106s 00:17:49.595 user 0m18.052s 00:17:49.595 sys 0m1.759s 00:17:49.595 04:19:40 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:17:49.595 04:19:40 -- common/autotest_common.sh@10 -- # set +x 00:17:49.595 ************************************ 00:17:49.595 END TEST lvs_grow_clean 00:17:49.595 ************************************ 00:17:49.854 04:19:40 -- target/nvmf_lvs_grow.sh@102 -- # run_test lvs_grow_dirty lvs_grow dirty 00:17:49.854 04:19:40 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:17:49.854 04:19:40 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:17:49.854 04:19:40 -- common/autotest_common.sh@10 -- # set +x 00:17:49.854 ************************************ 00:17:49.854 START TEST lvs_grow_dirty 00:17:49.854 ************************************ 00:17:49.854 04:19:40 -- common/autotest_common.sh@1114 -- # lvs_grow dirty 00:17:49.854 04:19:40 -- target/nvmf_lvs_grow.sh@15 -- # local aio_bdev lvs lvol 00:17:49.854 04:19:40 -- target/nvmf_lvs_grow.sh@16 -- # local data_clusters free_clusters 00:17:49.854 04:19:40 -- target/nvmf_lvs_grow.sh@17 -- # local bdevperf_pid run_test_pid 00:17:49.854 04:19:40 -- target/nvmf_lvs_grow.sh@18 -- # local aio_init_size_mb=200 00:17:49.854 04:19:40 -- target/nvmf_lvs_grow.sh@19 -- # local aio_final_size_mb=400 00:17:49.854 04:19:40 -- target/nvmf_lvs_grow.sh@20 -- # local lvol_bdev_size_mb=150 00:17:49.854 04:19:40 -- target/nvmf_lvs_grow.sh@23 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:49.854 04:19:40 -- target/nvmf_lvs_grow.sh@24 -- # truncate -s 200M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:49.854 04:19:40 -- target/nvmf_lvs_grow.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:17:50.112 04:19:40 -- target/nvmf_lvs_grow.sh@25 -- # aio_bdev=aio_bdev 00:17:50.112 04:19:40 -- target/nvmf_lvs_grow.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --cluster-sz 4194304 --md-pages-per-cluster-ratio 300 aio_bdev lvs 00:17:50.370 04:19:40 -- target/nvmf_lvs_grow.sh@28 -- # lvs=d56bbe20-7092-4b2c-a765-deaa57da331c 00:17:50.370 04:19:40 -- target/nvmf_lvs_grow.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:17:50.370 04:19:40 -- target/nvmf_lvs_grow.sh@29 -- # jq -r '.[0].total_data_clusters' 00:17:50.628 04:19:41 -- target/nvmf_lvs_grow.sh@29 -- # data_clusters=49 00:17:50.628 04:19:41 -- target/nvmf_lvs_grow.sh@30 -- # (( data_clusters == 49 )) 00:17:50.628 04:19:41 -- target/nvmf_lvs_grow.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u d56bbe20-7092-4b2c-a765-deaa57da331c lvol 150 00:17:50.886 04:19:41 -- target/nvmf_lvs_grow.sh@33 -- # lvol=a7d7021a-6218-43b6-860d-9af89c6ee2b1 00:17:50.886 04:19:41 -- target/nvmf_lvs_grow.sh@36 -- # truncate -s 400M /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:17:50.886 04:19:41 -- target/nvmf_lvs_grow.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_rescan aio_bdev 00:17:51.144 [2024-11-30 04:19:41.525286] bdev_aio.c: 959:bdev_aio_rescan: *NOTICE*: AIO device is resized: bdev name /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev, old block count 51200, new block count 102400 00:17:51.144 [2024-11-30 04:19:41.525360] vbdev_lvol.c: 165:vbdev_lvs_base_bdev_event_cb: *NOTICE*: Unsupported bdev event: type 1 00:17:51.144 true 00:17:51.144 04:19:41 -- target/nvmf_lvs_grow.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:17:51.144 04:19:41 -- target/nvmf_lvs_grow.sh@38 -- # jq -r '.[0].total_data_clusters' 00:17:51.403 04:19:41 -- target/nvmf_lvs_grow.sh@38 -- # (( data_clusters == 49 )) 00:17:51.403 04:19:41 -- target/nvmf_lvs_grow.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a -s SPDK0 00:17:51.662 04:19:42 -- target/nvmf_lvs_grow.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 a7d7021a-6218-43b6-860d-9af89c6ee2b1 00:17:51.920 04:19:42 -- target/nvmf_lvs_grow.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:17:52.178 04:19:42 -- target/nvmf_lvs_grow.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:17:52.178 04:19:42 -- target/nvmf_lvs_grow.sh@48 -- # bdevperf_pid=2357424 00:17:52.178 04:19:42 -- target/nvmf_lvs_grow.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock -m 0x2 -o 4096 -q 128 -w randwrite -t 10 -S 1 -z 00:17:52.178 04:19:42 -- target/nvmf_lvs_grow.sh@49 -- # trap 'killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:17:52.178 04:19:42 -- target/nvmf_lvs_grow.sh@50 -- # waitforlisten 2357424 /var/tmp/bdevperf.sock 00:17:52.178 04:19:42 -- common/autotest_common.sh@829 -- # '[' -z 2357424 ']' 00:17:52.178 04:19:42 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:17:52.178 04:19:42 -- common/autotest_common.sh@834 -- # local max_retries=100 00:17:52.178 04:19:42 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:17:52.178 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:17:52.178 04:19:42 -- common/autotest_common.sh@838 -- # xtrace_disable 00:17:52.178 04:19:42 -- common/autotest_common.sh@10 -- # set +x 00:17:52.436 [2024-11-30 04:19:42.842682] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:17:52.436 [2024-11-30 04:19:42.842753] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2357424 ] 00:17:52.436 EAL: No free 2048 kB hugepages reported on node 1 00:17:52.436 [2024-11-30 04:19:42.907134] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:17:52.436 [2024-11-30 04:19:42.996253] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:17:53.370 04:19:43 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:17:53.370 04:19:43 -- common/autotest_common.sh@862 -- # return 0 00:17:53.370 04:19:43 -- target/nvmf_lvs_grow.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b Nvme0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode0 00:17:53.943 Nvme0n1 00:17:53.943 04:19:44 -- target/nvmf_lvs_grow.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_get_bdevs -b Nvme0n1 -t 3000 00:17:54.275 [ 00:17:54.275 { 00:17:54.275 "name": "Nvme0n1", 00:17:54.275 "aliases": [ 00:17:54.275 "a7d7021a-6218-43b6-860d-9af89c6ee2b1" 00:17:54.275 ], 00:17:54.275 "product_name": "NVMe disk", 00:17:54.275 "block_size": 4096, 00:17:54.275 "num_blocks": 38912, 00:17:54.275 "uuid": "a7d7021a-6218-43b6-860d-9af89c6ee2b1", 00:17:54.276 "assigned_rate_limits": { 00:17:54.276 "rw_ios_per_sec": 0, 00:17:54.276 "rw_mbytes_per_sec": 0, 00:17:54.276 "r_mbytes_per_sec": 0, 00:17:54.276 "w_mbytes_per_sec": 0 00:17:54.276 }, 00:17:54.276 "claimed": false, 00:17:54.276 "zoned": false, 00:17:54.276 "supported_io_types": { 00:17:54.276 "read": true, 00:17:54.276 "write": true, 00:17:54.276 "unmap": true, 00:17:54.276 "write_zeroes": true, 00:17:54.276 "flush": true, 00:17:54.276 "reset": true, 00:17:54.276 "compare": true, 00:17:54.276 "compare_and_write": true, 00:17:54.276 "abort": true, 00:17:54.276 "nvme_admin": true, 00:17:54.276 "nvme_io": true 00:17:54.276 }, 00:17:54.276 "driver_specific": { 00:17:54.276 "nvme": [ 00:17:54.276 { 00:17:54.276 "trid": { 00:17:54.276 "trtype": "TCP", 00:17:54.276 "adrfam": "IPv4", 00:17:54.276 "traddr": "10.0.0.2", 00:17:54.276 "trsvcid": "4420", 00:17:54.276 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:17:54.276 }, 00:17:54.276 "ctrlr_data": { 00:17:54.276 "cntlid": 1, 00:17:54.276 "vendor_id": "0x8086", 00:17:54.276 "model_number": "SPDK bdev Controller", 00:17:54.276 "serial_number": "SPDK0", 00:17:54.276 "firmware_revision": "24.01.1", 00:17:54.276 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:17:54.276 "oacs": { 00:17:54.276 "security": 0, 00:17:54.276 "format": 0, 00:17:54.276 "firmware": 0, 00:17:54.276 "ns_manage": 0 00:17:54.276 }, 00:17:54.276 "multi_ctrlr": true, 00:17:54.276 "ana_reporting": false 00:17:54.276 }, 00:17:54.276 "vs": { 00:17:54.276 "nvme_version": "1.3" 00:17:54.276 }, 00:17:54.276 "ns_data": { 00:17:54.276 "id": 1, 00:17:54.276 "can_share": true 00:17:54.276 } 00:17:54.276 } 00:17:54.276 ], 00:17:54.276 "mp_policy": "active_passive" 00:17:54.276 } 00:17:54.276 } 00:17:54.276 ] 00:17:54.276 04:19:44 -- target/nvmf_lvs_grow.sh@56 -- # run_test_pid=2357703 00:17:54.276 04:19:44 -- target/nvmf_lvs_grow.sh@57 -- # sleep 2 00:17:54.276 04:19:44 -- target/nvmf_lvs_grow.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:17:54.276 Running I/O for 10 seconds... 00:17:55.239 Latency(us) 00:17:55.239 [2024-11-30T03:19:45.870Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:17:55.239 [2024-11-30T03:19:45.870Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:55.239 Nvme0n1 : 1.00 14713.00 57.47 0.00 0.00 0.00 0.00 0.00 00:17:55.239 [2024-11-30T03:19:45.870Z] =================================================================================================================== 00:17:55.239 [2024-11-30T03:19:45.870Z] Total : 14713.00 57.47 0.00 0.00 0.00 0.00 0.00 00:17:55.239 00:17:56.172 04:19:46 -- target/nvmf_lvs_grow.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_grow_lvstore -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:17:56.172 [2024-11-30T03:19:46.803Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:56.172 Nvme0n1 : 2.00 14854.50 58.03 0.00 0.00 0.00 0.00 0.00 00:17:56.172 [2024-11-30T03:19:46.803Z] =================================================================================================================== 00:17:56.172 [2024-11-30T03:19:46.803Z] Total : 14854.50 58.03 0.00 0.00 0.00 0.00 0.00 00:17:56.172 00:17:56.430 true 00:17:56.430 04:19:46 -- target/nvmf_lvs_grow.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:17:56.430 04:19:46 -- target/nvmf_lvs_grow.sh@61 -- # jq -r '.[0].total_data_clusters' 00:17:56.688 04:19:47 -- target/nvmf_lvs_grow.sh@61 -- # data_clusters=99 00:17:56.688 04:19:47 -- target/nvmf_lvs_grow.sh@62 -- # (( data_clusters == 99 )) 00:17:56.688 04:19:47 -- target/nvmf_lvs_grow.sh@65 -- # wait 2357703 00:17:57.254 [2024-11-30T03:19:47.885Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:57.255 Nvme0n1 : 3.00 14963.33 58.45 0.00 0.00 0.00 0.00 0.00 00:17:57.255 [2024-11-30T03:19:47.886Z] =================================================================================================================== 00:17:57.255 [2024-11-30T03:19:47.886Z] Total : 14963.33 58.45 0.00 0.00 0.00 0.00 0.00 00:17:57.255 00:17:58.190 [2024-11-30T03:19:48.821Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:58.190 Nvme0n1 : 4.00 15065.75 58.85 0.00 0.00 0.00 0.00 0.00 00:17:58.190 [2024-11-30T03:19:48.821Z] =================================================================================================================== 00:17:58.190 [2024-11-30T03:19:48.821Z] Total : 15065.75 58.85 0.00 0.00 0.00 0.00 0.00 00:17:58.190 00:17:59.125 [2024-11-30T03:19:49.756Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:17:59.125 Nvme0n1 : 5.00 15117.00 59.05 0.00 0.00 0.00 0.00 0.00 00:17:59.125 [2024-11-30T03:19:49.756Z] =================================================================================================================== 00:17:59.125 [2024-11-30T03:19:49.756Z] Total : 15117.00 59.05 0.00 0.00 0.00 0.00 0.00 00:17:59.125 00:18:00.498 [2024-11-30T03:19:51.129Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:00.498 Nvme0n1 : 6.00 15137.50 59.13 0.00 0.00 0.00 0.00 0.00 00:18:00.498 [2024-11-30T03:19:51.129Z] =================================================================================================================== 00:18:00.498 [2024-11-30T03:19:51.129Z] Total : 15137.50 59.13 0.00 0.00 0.00 0.00 0.00 00:18:00.498 00:18:01.431 [2024-11-30T03:19:52.062Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:01.431 Nvme0n1 : 7.00 15019.71 58.67 0.00 0.00 0.00 0.00 0.00 00:18:01.431 [2024-11-30T03:19:52.062Z] =================================================================================================================== 00:18:01.431 [2024-11-30T03:19:52.062Z] Total : 15019.71 58.67 0.00 0.00 0.00 0.00 0.00 00:18:01.431 00:18:02.364 [2024-11-30T03:19:52.995Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:02.364 Nvme0n1 : 8.00 14939.25 58.36 0.00 0.00 0.00 0.00 0.00 00:18:02.364 [2024-11-30T03:19:52.995Z] =================================================================================================================== 00:18:02.364 [2024-11-30T03:19:52.995Z] Total : 14939.25 58.36 0.00 0.00 0.00 0.00 0.00 00:18:02.364 00:18:03.298 [2024-11-30T03:19:53.929Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:03.298 Nvme0n1 : 9.00 14867.78 58.08 0.00 0.00 0.00 0.00 0.00 00:18:03.298 [2024-11-30T03:19:53.929Z] =================================================================================================================== 00:18:03.298 [2024-11-30T03:19:53.929Z] Total : 14867.78 58.08 0.00 0.00 0.00 0.00 0.00 00:18:03.298 00:18:04.229 [2024-11-30T03:19:54.860Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.229 Nvme0n1 : 10.00 14813.80 57.87 0.00 0.00 0.00 0.00 0.00 00:18:04.229 [2024-11-30T03:19:54.860Z] =================================================================================================================== 00:18:04.229 [2024-11-30T03:19:54.860Z] Total : 14813.80 57.87 0.00 0.00 0.00 0.00 0.00 00:18:04.229 00:18:04.229 00:18:04.229 Latency(us) 00:18:04.229 [2024-11-30T03:19:54.860Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:04.229 [2024-11-30T03:19:54.860Z] Job: Nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:18:04.229 Nvme0n1 : 10.01 14813.46 57.87 0.00 0.00 8632.82 2949.12 18350.08 00:18:04.229 [2024-11-30T03:19:54.860Z] =================================================================================================================== 00:18:04.229 [2024-11-30T03:19:54.860Z] Total : 14813.46 57.87 0.00 0.00 8632.82 2949.12 18350.08 00:18:04.229 0 00:18:04.229 04:19:54 -- target/nvmf_lvs_grow.sh@66 -- # killprocess 2357424 00:18:04.229 04:19:54 -- common/autotest_common.sh@936 -- # '[' -z 2357424 ']' 00:18:04.229 04:19:54 -- common/autotest_common.sh@940 -- # kill -0 2357424 00:18:04.229 04:19:54 -- common/autotest_common.sh@941 -- # uname 00:18:04.229 04:19:54 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:04.229 04:19:54 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2357424 00:18:04.230 04:19:54 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:04.230 04:19:54 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:04.230 04:19:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2357424' 00:18:04.230 killing process with pid 2357424 00:18:04.230 04:19:54 -- common/autotest_common.sh@955 -- # kill 2357424 00:18:04.230 Received shutdown signal, test time was about 10.000000 seconds 00:18:04.230 00:18:04.230 Latency(us) 00:18:04.230 [2024-11-30T03:19:54.861Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:04.230 [2024-11-30T03:19:54.861Z] =================================================================================================================== 00:18:04.230 [2024-11-30T03:19:54.861Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:04.230 04:19:54 -- common/autotest_common.sh@960 -- # wait 2357424 00:18:04.486 04:19:55 -- target/nvmf_lvs_grow.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:18:04.742 04:19:55 -- target/nvmf_lvs_grow.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:18:04.742 04:19:55 -- target/nvmf_lvs_grow.sh@69 -- # jq -r '.[0].free_clusters' 00:18:05.000 04:19:55 -- target/nvmf_lvs_grow.sh@69 -- # free_clusters=61 00:18:05.000 04:19:55 -- target/nvmf_lvs_grow.sh@71 -- # [[ dirty == \d\i\r\t\y ]] 00:18:05.000 04:19:55 -- target/nvmf_lvs_grow.sh@73 -- # kill -9 2354731 00:18:05.000 04:19:55 -- target/nvmf_lvs_grow.sh@74 -- # wait 2354731 00:18:05.000 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nvmf_lvs_grow.sh: line 74: 2354731 Killed "${NVMF_APP[@]}" "$@" 00:18:05.000 04:19:55 -- target/nvmf_lvs_grow.sh@74 -- # true 00:18:05.000 04:19:55 -- target/nvmf_lvs_grow.sh@75 -- # nvmfappstart -m 0x1 00:18:05.000 04:19:55 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:05.000 04:19:55 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:05.000 04:19:55 -- common/autotest_common.sh@10 -- # set +x 00:18:05.000 04:19:55 -- nvmf/common.sh@469 -- # nvmfpid=2358941 00:18:05.000 04:19:55 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:18:05.000 04:19:55 -- nvmf/common.sh@470 -- # waitforlisten 2358941 00:18:05.000 04:19:55 -- common/autotest_common.sh@829 -- # '[' -z 2358941 ']' 00:18:05.000 04:19:55 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:05.000 04:19:55 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:05.000 04:19:55 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:05.000 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:05.000 04:19:55 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:05.000 04:19:55 -- common/autotest_common.sh@10 -- # set +x 00:18:05.258 [2024-11-30 04:19:55.660637] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:05.258 [2024-11-30 04:19:55.660727] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:05.258 EAL: No free 2048 kB hugepages reported on node 1 00:18:05.258 [2024-11-30 04:19:55.728157] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:05.258 [2024-11-30 04:19:55.813098] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:05.258 [2024-11-30 04:19:55.813257] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:05.258 [2024-11-30 04:19:55.813274] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:05.258 [2024-11-30 04:19:55.813287] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:05.258 [2024-11-30 04:19:55.813319] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:06.190 04:19:56 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:06.190 04:19:56 -- common/autotest_common.sh@862 -- # return 0 00:18:06.190 04:19:56 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:06.190 04:19:56 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:06.190 04:19:56 -- common/autotest_common.sh@10 -- # set +x 00:18:06.190 04:19:56 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:06.190 04:19:56 -- target/nvmf_lvs_grow.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:06.448 [2024-11-30 04:19:56.934291] blobstore.c:4642:bs_recover: *NOTICE*: Performing recovery on blobstore 00:18:06.448 [2024-11-30 04:19:56.934440] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x0 00:18:06.448 [2024-11-30 04:19:56.934500] blobstore.c:4589:bs_load_replay_md_cpl: *NOTICE*: Recover: blob 0x1 00:18:06.448 04:19:56 -- target/nvmf_lvs_grow.sh@76 -- # aio_bdev=aio_bdev 00:18:06.448 04:19:56 -- target/nvmf_lvs_grow.sh@77 -- # waitforbdev a7d7021a-6218-43b6-860d-9af89c6ee2b1 00:18:06.448 04:19:56 -- common/autotest_common.sh@897 -- # local bdev_name=a7d7021a-6218-43b6-860d-9af89c6ee2b1 00:18:06.448 04:19:56 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:06.448 04:19:56 -- common/autotest_common.sh@899 -- # local i 00:18:06.448 04:19:56 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:06.448 04:19:56 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:06.448 04:19:56 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:06.707 04:19:57 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a7d7021a-6218-43b6-860d-9af89c6ee2b1 -t 2000 00:18:06.965 [ 00:18:06.965 { 00:18:06.965 "name": "a7d7021a-6218-43b6-860d-9af89c6ee2b1", 00:18:06.965 "aliases": [ 00:18:06.965 "lvs/lvol" 00:18:06.965 ], 00:18:06.965 "product_name": "Logical Volume", 00:18:06.965 "block_size": 4096, 00:18:06.965 "num_blocks": 38912, 00:18:06.965 "uuid": "a7d7021a-6218-43b6-860d-9af89c6ee2b1", 00:18:06.965 "assigned_rate_limits": { 00:18:06.965 "rw_ios_per_sec": 0, 00:18:06.965 "rw_mbytes_per_sec": 0, 00:18:06.965 "r_mbytes_per_sec": 0, 00:18:06.965 "w_mbytes_per_sec": 0 00:18:06.965 }, 00:18:06.965 "claimed": false, 00:18:06.965 "zoned": false, 00:18:06.965 "supported_io_types": { 00:18:06.965 "read": true, 00:18:06.965 "write": true, 00:18:06.965 "unmap": true, 00:18:06.965 "write_zeroes": true, 00:18:06.965 "flush": false, 00:18:06.965 "reset": true, 00:18:06.965 "compare": false, 00:18:06.965 "compare_and_write": false, 00:18:06.965 "abort": false, 00:18:06.965 "nvme_admin": false, 00:18:06.965 "nvme_io": false 00:18:06.965 }, 00:18:06.965 "driver_specific": { 00:18:06.965 "lvol": { 00:18:06.965 "lvol_store_uuid": "d56bbe20-7092-4b2c-a765-deaa57da331c", 00:18:06.965 "base_bdev": "aio_bdev", 00:18:06.965 "thin_provision": false, 00:18:06.965 "snapshot": false, 00:18:06.965 "clone": false, 00:18:06.965 "esnap_clone": false 00:18:06.965 } 00:18:06.965 } 00:18:06.965 } 00:18:06.965 ] 00:18:06.965 04:19:57 -- common/autotest_common.sh@905 -- # return 0 00:18:06.965 04:19:57 -- target/nvmf_lvs_grow.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:18:06.965 04:19:57 -- target/nvmf_lvs_grow.sh@78 -- # jq -r '.[0].free_clusters' 00:18:07.223 04:19:57 -- target/nvmf_lvs_grow.sh@78 -- # (( free_clusters == 61 )) 00:18:07.223 04:19:57 -- target/nvmf_lvs_grow.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:18:07.223 04:19:57 -- target/nvmf_lvs_grow.sh@79 -- # jq -r '.[0].total_data_clusters' 00:18:07.481 04:19:57 -- target/nvmf_lvs_grow.sh@79 -- # (( data_clusters == 99 )) 00:18:07.481 04:19:57 -- target/nvmf_lvs_grow.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:07.739 [2024-11-30 04:19:58.199298] vbdev_lvol.c: 150:vbdev_lvs_hotremove_cb: *NOTICE*: bdev aio_bdev being removed: closing lvstore lvs 00:18:07.740 04:19:58 -- target/nvmf_lvs_grow.sh@84 -- # NOT /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:18:07.740 04:19:58 -- common/autotest_common.sh@650 -- # local es=0 00:18:07.740 04:19:58 -- common/autotest_common.sh@652 -- # valid_exec_arg /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:18:07.740 04:19:58 -- common/autotest_common.sh@638 -- # local arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:07.740 04:19:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:07.740 04:19:58 -- common/autotest_common.sh@642 -- # type -t /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:07.740 04:19:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:07.740 04:19:58 -- common/autotest_common.sh@644 -- # type -P /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:07.740 04:19:58 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:18:07.740 04:19:58 -- common/autotest_common.sh@644 -- # arg=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:07.740 04:19:58 -- common/autotest_common.sh@644 -- # [[ -x /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py ]] 00:18:07.740 04:19:58 -- common/autotest_common.sh@653 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:18:07.998 request: 00:18:07.998 { 00:18:07.998 "uuid": "d56bbe20-7092-4b2c-a765-deaa57da331c", 00:18:07.998 "method": "bdev_lvol_get_lvstores", 00:18:07.998 "req_id": 1 00:18:07.998 } 00:18:07.998 Got JSON-RPC error response 00:18:07.998 response: 00:18:07.998 { 00:18:07.998 "code": -19, 00:18:07.998 "message": "No such device" 00:18:07.998 } 00:18:07.998 04:19:58 -- common/autotest_common.sh@653 -- # es=1 00:18:07.998 04:19:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:18:07.998 04:19:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:18:07.998 04:19:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:18:07.998 04:19:58 -- target/nvmf_lvs_grow.sh@85 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_create /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev aio_bdev 4096 00:18:08.256 aio_bdev 00:18:08.256 04:19:58 -- target/nvmf_lvs_grow.sh@86 -- # waitforbdev a7d7021a-6218-43b6-860d-9af89c6ee2b1 00:18:08.256 04:19:58 -- common/autotest_common.sh@897 -- # local bdev_name=a7d7021a-6218-43b6-860d-9af89c6ee2b1 00:18:08.256 04:19:58 -- common/autotest_common.sh@898 -- # local bdev_timeout= 00:18:08.256 04:19:58 -- common/autotest_common.sh@899 -- # local i 00:18:08.256 04:19:58 -- common/autotest_common.sh@900 -- # [[ -z '' ]] 00:18:08.257 04:19:58 -- common/autotest_common.sh@900 -- # bdev_timeout=2000 00:18:08.257 04:19:58 -- common/autotest_common.sh@902 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_wait_for_examine 00:18:08.515 04:19:58 -- common/autotest_common.sh@904 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_get_bdevs -b a7d7021a-6218-43b6-860d-9af89c6ee2b1 -t 2000 00:18:08.772 [ 00:18:08.772 { 00:18:08.772 "name": "a7d7021a-6218-43b6-860d-9af89c6ee2b1", 00:18:08.772 "aliases": [ 00:18:08.772 "lvs/lvol" 00:18:08.772 ], 00:18:08.772 "product_name": "Logical Volume", 00:18:08.772 "block_size": 4096, 00:18:08.772 "num_blocks": 38912, 00:18:08.772 "uuid": "a7d7021a-6218-43b6-860d-9af89c6ee2b1", 00:18:08.772 "assigned_rate_limits": { 00:18:08.772 "rw_ios_per_sec": 0, 00:18:08.772 "rw_mbytes_per_sec": 0, 00:18:08.772 "r_mbytes_per_sec": 0, 00:18:08.772 "w_mbytes_per_sec": 0 00:18:08.772 }, 00:18:08.772 "claimed": false, 00:18:08.772 "zoned": false, 00:18:08.772 "supported_io_types": { 00:18:08.772 "read": true, 00:18:08.772 "write": true, 00:18:08.772 "unmap": true, 00:18:08.772 "write_zeroes": true, 00:18:08.772 "flush": false, 00:18:08.772 "reset": true, 00:18:08.772 "compare": false, 00:18:08.772 "compare_and_write": false, 00:18:08.772 "abort": false, 00:18:08.772 "nvme_admin": false, 00:18:08.772 "nvme_io": false 00:18:08.772 }, 00:18:08.772 "driver_specific": { 00:18:08.772 "lvol": { 00:18:08.772 "lvol_store_uuid": "d56bbe20-7092-4b2c-a765-deaa57da331c", 00:18:08.772 "base_bdev": "aio_bdev", 00:18:08.772 "thin_provision": false, 00:18:08.772 "snapshot": false, 00:18:08.772 "clone": false, 00:18:08.772 "esnap_clone": false 00:18:08.773 } 00:18:08.773 } 00:18:08.773 } 00:18:08.773 ] 00:18:08.773 04:19:59 -- common/autotest_common.sh@905 -- # return 0 00:18:08.773 04:19:59 -- target/nvmf_lvs_grow.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:18:08.773 04:19:59 -- target/nvmf_lvs_grow.sh@87 -- # jq -r '.[0].free_clusters' 00:18:09.030 04:19:59 -- target/nvmf_lvs_grow.sh@87 -- # (( free_clusters == 61 )) 00:18:09.030 04:19:59 -- target/nvmf_lvs_grow.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:18:09.030 04:19:59 -- target/nvmf_lvs_grow.sh@88 -- # jq -r '.[0].total_data_clusters' 00:18:09.288 04:19:59 -- target/nvmf_lvs_grow.sh@88 -- # (( data_clusters == 99 )) 00:18:09.288 04:19:59 -- target/nvmf_lvs_grow.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete a7d7021a-6218-43b6-860d-9af89c6ee2b1 00:18:09.546 04:20:00 -- target/nvmf_lvs_grow.sh@92 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -u d56bbe20-7092-4b2c-a765-deaa57da331c 00:18:09.804 04:20:00 -- target/nvmf_lvs_grow.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_aio_delete aio_bdev 00:18:10.062 04:20:00 -- target/nvmf_lvs_grow.sh@94 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/aio_bdev 00:18:10.062 00:18:10.062 real 0m20.368s 00:18:10.062 user 0m50.470s 00:18:10.062 sys 0m5.081s 00:18:10.062 04:20:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:10.062 04:20:00 -- common/autotest_common.sh@10 -- # set +x 00:18:10.062 ************************************ 00:18:10.062 END TEST lvs_grow_dirty 00:18:10.062 ************************************ 00:18:10.062 04:20:00 -- target/nvmf_lvs_grow.sh@1 -- # process_shm --id 0 00:18:10.062 04:20:00 -- common/autotest_common.sh@806 -- # type=--id 00:18:10.062 04:20:00 -- common/autotest_common.sh@807 -- # id=0 00:18:10.062 04:20:00 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:18:10.062 04:20:00 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:18:10.062 04:20:00 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:18:10.062 04:20:00 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:18:10.062 04:20:00 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:18:10.062 04:20:00 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:18:10.062 nvmf_trace.0 00:18:10.062 04:20:00 -- common/autotest_common.sh@821 -- # return 0 00:18:10.062 04:20:00 -- target/nvmf_lvs_grow.sh@1 -- # nvmftestfini 00:18:10.062 04:20:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:10.062 04:20:00 -- nvmf/common.sh@116 -- # sync 00:18:10.062 04:20:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:10.062 04:20:00 -- nvmf/common.sh@119 -- # set +e 00:18:10.062 04:20:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:10.062 04:20:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:10.062 rmmod nvme_tcp 00:18:10.062 rmmod nvme_fabrics 00:18:10.320 rmmod nvme_keyring 00:18:10.320 04:20:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:10.320 04:20:00 -- nvmf/common.sh@123 -- # set -e 00:18:10.320 04:20:00 -- nvmf/common.sh@124 -- # return 0 00:18:10.320 04:20:00 -- nvmf/common.sh@477 -- # '[' -n 2358941 ']' 00:18:10.320 04:20:00 -- nvmf/common.sh@478 -- # killprocess 2358941 00:18:10.320 04:20:00 -- common/autotest_common.sh@936 -- # '[' -z 2358941 ']' 00:18:10.320 04:20:00 -- common/autotest_common.sh@940 -- # kill -0 2358941 00:18:10.320 04:20:00 -- common/autotest_common.sh@941 -- # uname 00:18:10.320 04:20:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:10.320 04:20:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2358941 00:18:10.320 04:20:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:10.320 04:20:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:10.320 04:20:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2358941' 00:18:10.320 killing process with pid 2358941 00:18:10.320 04:20:00 -- common/autotest_common.sh@955 -- # kill 2358941 00:18:10.320 04:20:00 -- common/autotest_common.sh@960 -- # wait 2358941 00:18:10.579 04:20:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:10.579 04:20:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:10.579 04:20:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:10.579 04:20:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:10.579 04:20:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:10.579 04:20:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:10.579 04:20:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:10.579 04:20:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:12.480 04:20:03 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:12.480 00:18:12.480 real 0m44.594s 00:18:12.480 user 1m15.266s 00:18:12.480 sys 0m8.748s 00:18:12.480 04:20:03 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:12.480 04:20:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.480 ************************************ 00:18:12.480 END TEST nvmf_lvs_grow 00:18:12.480 ************************************ 00:18:12.480 04:20:03 -- nvmf/nvmf.sh@49 -- # run_test nvmf_bdev_io_wait /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:12.480 04:20:03 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:12.480 04:20:03 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:12.480 04:20:03 -- common/autotest_common.sh@10 -- # set +x 00:18:12.480 ************************************ 00:18:12.480 START TEST nvmf_bdev_io_wait 00:18:12.480 ************************************ 00:18:12.480 04:20:03 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdev_io_wait.sh --transport=tcp 00:18:12.480 * Looking for test storage... 00:18:12.480 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:12.480 04:20:03 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:12.480 04:20:03 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:12.480 04:20:03 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:12.738 04:20:03 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:12.738 04:20:03 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:12.738 04:20:03 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:12.738 04:20:03 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:12.738 04:20:03 -- scripts/common.sh@335 -- # IFS=.-: 00:18:12.738 04:20:03 -- scripts/common.sh@335 -- # read -ra ver1 00:18:12.738 04:20:03 -- scripts/common.sh@336 -- # IFS=.-: 00:18:12.738 04:20:03 -- scripts/common.sh@336 -- # read -ra ver2 00:18:12.738 04:20:03 -- scripts/common.sh@337 -- # local 'op=<' 00:18:12.738 04:20:03 -- scripts/common.sh@339 -- # ver1_l=2 00:18:12.738 04:20:03 -- scripts/common.sh@340 -- # ver2_l=1 00:18:12.738 04:20:03 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:12.738 04:20:03 -- scripts/common.sh@343 -- # case "$op" in 00:18:12.738 04:20:03 -- scripts/common.sh@344 -- # : 1 00:18:12.738 04:20:03 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:12.738 04:20:03 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:12.738 04:20:03 -- scripts/common.sh@364 -- # decimal 1 00:18:12.738 04:20:03 -- scripts/common.sh@352 -- # local d=1 00:18:12.738 04:20:03 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:12.738 04:20:03 -- scripts/common.sh@354 -- # echo 1 00:18:12.738 04:20:03 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:12.738 04:20:03 -- scripts/common.sh@365 -- # decimal 2 00:18:12.738 04:20:03 -- scripts/common.sh@352 -- # local d=2 00:18:12.738 04:20:03 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:12.738 04:20:03 -- scripts/common.sh@354 -- # echo 2 00:18:12.738 04:20:03 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:12.738 04:20:03 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:12.738 04:20:03 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:12.738 04:20:03 -- scripts/common.sh@367 -- # return 0 00:18:12.738 04:20:03 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:12.738 04:20:03 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:12.738 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:12.738 --rc genhtml_branch_coverage=1 00:18:12.738 --rc genhtml_function_coverage=1 00:18:12.738 --rc genhtml_legend=1 00:18:12.738 --rc geninfo_all_blocks=1 00:18:12.738 --rc geninfo_unexecuted_blocks=1 00:18:12.738 00:18:12.738 ' 00:18:12.738 04:20:03 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:12.738 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:12.738 --rc genhtml_branch_coverage=1 00:18:12.738 --rc genhtml_function_coverage=1 00:18:12.738 --rc genhtml_legend=1 00:18:12.738 --rc geninfo_all_blocks=1 00:18:12.738 --rc geninfo_unexecuted_blocks=1 00:18:12.738 00:18:12.738 ' 00:18:12.738 04:20:03 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:12.738 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:12.738 --rc genhtml_branch_coverage=1 00:18:12.738 --rc genhtml_function_coverage=1 00:18:12.738 --rc genhtml_legend=1 00:18:12.738 --rc geninfo_all_blocks=1 00:18:12.738 --rc geninfo_unexecuted_blocks=1 00:18:12.738 00:18:12.738 ' 00:18:12.738 04:20:03 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:12.738 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:12.738 --rc genhtml_branch_coverage=1 00:18:12.738 --rc genhtml_function_coverage=1 00:18:12.738 --rc genhtml_legend=1 00:18:12.738 --rc geninfo_all_blocks=1 00:18:12.738 --rc geninfo_unexecuted_blocks=1 00:18:12.738 00:18:12.738 ' 00:18:12.738 04:20:03 -- target/bdev_io_wait.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:12.738 04:20:03 -- nvmf/common.sh@7 -- # uname -s 00:18:12.738 04:20:03 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:12.738 04:20:03 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:12.738 04:20:03 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:12.738 04:20:03 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:12.738 04:20:03 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:12.738 04:20:03 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:12.738 04:20:03 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:12.738 04:20:03 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:12.738 04:20:03 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:12.738 04:20:03 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:12.738 04:20:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:12.738 04:20:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:12.738 04:20:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:12.738 04:20:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:12.738 04:20:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:12.738 04:20:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:12.738 04:20:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:12.738 04:20:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:12.738 04:20:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:12.738 04:20:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.738 04:20:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.738 04:20:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.738 04:20:03 -- paths/export.sh@5 -- # export PATH 00:18:12.739 04:20:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:12.739 04:20:03 -- nvmf/common.sh@46 -- # : 0 00:18:12.739 04:20:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:12.739 04:20:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:12.739 04:20:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:12.739 04:20:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:12.739 04:20:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:12.739 04:20:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:12.739 04:20:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:12.739 04:20:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:12.739 04:20:03 -- target/bdev_io_wait.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:12.739 04:20:03 -- target/bdev_io_wait.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:12.739 04:20:03 -- target/bdev_io_wait.sh@14 -- # nvmftestinit 00:18:12.739 04:20:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:12.739 04:20:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:12.739 04:20:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:12.739 04:20:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:12.739 04:20:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:12.739 04:20:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:12.739 04:20:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:12.739 04:20:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:12.739 04:20:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:12.739 04:20:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:12.739 04:20:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:12.739 04:20:03 -- common/autotest_common.sh@10 -- # set +x 00:18:14.636 04:20:05 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:14.636 04:20:05 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:14.636 04:20:05 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:14.636 04:20:05 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:14.636 04:20:05 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:14.636 04:20:05 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:14.637 04:20:05 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:14.637 04:20:05 -- nvmf/common.sh@294 -- # net_devs=() 00:18:14.637 04:20:05 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:14.637 04:20:05 -- nvmf/common.sh@295 -- # e810=() 00:18:14.637 04:20:05 -- nvmf/common.sh@295 -- # local -ga e810 00:18:14.637 04:20:05 -- nvmf/common.sh@296 -- # x722=() 00:18:14.637 04:20:05 -- nvmf/common.sh@296 -- # local -ga x722 00:18:14.637 04:20:05 -- nvmf/common.sh@297 -- # mlx=() 00:18:14.637 04:20:05 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:14.637 04:20:05 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:14.637 04:20:05 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:14.637 04:20:05 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:14.637 04:20:05 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:14.637 04:20:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:14.637 04:20:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:14.637 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:14.637 04:20:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:14.637 04:20:05 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:14.637 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:14.637 04:20:05 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:14.637 04:20:05 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:14.637 04:20:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:14.637 04:20:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:14.637 04:20:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:14.637 04:20:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:14.637 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:14.637 04:20:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:14.637 04:20:05 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:14.637 04:20:05 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:14.637 04:20:05 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:14.637 04:20:05 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:14.637 04:20:05 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:14.637 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:14.637 04:20:05 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:14.637 04:20:05 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:14.637 04:20:05 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:14.637 04:20:05 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:14.637 04:20:05 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:14.637 04:20:05 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:14.637 04:20:05 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:14.637 04:20:05 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:14.637 04:20:05 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:14.637 04:20:05 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:14.637 04:20:05 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:14.637 04:20:05 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:14.637 04:20:05 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:14.637 04:20:05 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:14.637 04:20:05 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:14.637 04:20:05 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:14.637 04:20:05 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:14.637 04:20:05 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:14.637 04:20:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:14.637 04:20:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:14.637 04:20:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:14.637 04:20:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:14.894 04:20:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:14.894 04:20:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:14.894 04:20:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:14.894 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:14.894 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.208 ms 00:18:14.894 00:18:14.894 --- 10.0.0.2 ping statistics --- 00:18:14.894 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:14.894 rtt min/avg/max/mdev = 0.208/0.208/0.208/0.000 ms 00:18:14.894 04:20:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:14.894 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:14.894 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.098 ms 00:18:14.894 00:18:14.894 --- 10.0.0.1 ping statistics --- 00:18:14.894 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:14.894 rtt min/avg/max/mdev = 0.098/0.098/0.098/0.000 ms 00:18:14.894 04:20:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:14.894 04:20:05 -- nvmf/common.sh@410 -- # return 0 00:18:14.894 04:20:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:14.894 04:20:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:14.894 04:20:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:14.894 04:20:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:14.894 04:20:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:14.894 04:20:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:14.894 04:20:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:14.894 04:20:05 -- target/bdev_io_wait.sh@15 -- # nvmfappstart -m 0xF --wait-for-rpc 00:18:14.894 04:20:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:14.894 04:20:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:14.894 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:18:14.894 04:20:05 -- nvmf/common.sh@469 -- # nvmfpid=2361630 00:18:14.894 04:20:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:18:14.894 04:20:05 -- nvmf/common.sh@470 -- # waitforlisten 2361630 00:18:14.894 04:20:05 -- common/autotest_common.sh@829 -- # '[' -z 2361630 ']' 00:18:14.894 04:20:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:14.895 04:20:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:14.895 04:20:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:14.895 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:14.895 04:20:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:14.895 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:18:14.895 [2024-11-30 04:20:05.388295] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:14.895 [2024-11-30 04:20:05.388392] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:14.895 EAL: No free 2048 kB hugepages reported on node 1 00:18:14.895 [2024-11-30 04:20:05.458461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:18:15.153 [2024-11-30 04:20:05.549745] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:15.153 [2024-11-30 04:20:05.549927] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:15.153 [2024-11-30 04:20:05.549950] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:15.153 [2024-11-30 04:20:05.549985] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:15.153 [2024-11-30 04:20:05.550052] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:15.153 [2024-11-30 04:20:05.550110] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:18:15.153 [2024-11-30 04:20:05.550228] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:18:15.153 [2024-11-30 04:20:05.550231] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:15.153 04:20:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:15.153 04:20:05 -- common/autotest_common.sh@862 -- # return 0 00:18:15.153 04:20:05 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:15.153 04:20:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:15.153 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:18:15.153 04:20:05 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:15.153 04:20:05 -- target/bdev_io_wait.sh@18 -- # rpc_cmd bdev_set_options -p 5 -c 1 00:18:15.153 04:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:15.153 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:18:15.153 04:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:15.153 04:20:05 -- target/bdev_io_wait.sh@19 -- # rpc_cmd framework_start_init 00:18:15.153 04:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:15.153 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:18:15.153 04:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:15.153 04:20:05 -- target/bdev_io_wait.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:15.153 04:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:15.153 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:18:15.153 [2024-11-30 04:20:05.703074] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:15.153 04:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:15.153 04:20:05 -- target/bdev_io_wait.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:15.154 04:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:15.154 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:18:15.154 Malloc0 00:18:15.154 04:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:15.154 04:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:15.154 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:18:15.154 04:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:15.154 04:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:15.154 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:18:15.154 04:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:15.154 04:20:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:15.154 04:20:05 -- common/autotest_common.sh@10 -- # set +x 00:18:15.154 [2024-11-30 04:20:05.765751] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:15.154 04:20:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@28 -- # WRITE_PID=2361653 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x10 -i 1 --json /dev/fd/63 -q 128 -o 4096 -w write -t 1 -s 256 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@27 -- # gen_nvmf_target_json 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@30 -- # READ_PID=2361655 00:18:15.154 04:20:05 -- nvmf/common.sh@520 -- # config=() 00:18:15.154 04:20:05 -- nvmf/common.sh@520 -- # local subsystem config 00:18:15.154 04:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:15.154 04:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:15.154 { 00:18:15.154 "params": { 00:18:15.154 "name": "Nvme$subsystem", 00:18:15.154 "trtype": "$TEST_TRANSPORT", 00:18:15.154 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:15.154 "adrfam": "ipv4", 00:18:15.154 "trsvcid": "$NVMF_PORT", 00:18:15.154 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:15.154 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:15.154 "hdgst": ${hdgst:-false}, 00:18:15.154 "ddgst": ${ddgst:-false} 00:18:15.154 }, 00:18:15.154 "method": "bdev_nvme_attach_controller" 00:18:15.154 } 00:18:15.154 EOF 00:18:15.154 )") 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x20 -i 2 --json /dev/fd/63 -q 128 -o 4096 -w read -t 1 -s 256 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@29 -- # gen_nvmf_target_json 00:18:15.154 04:20:05 -- nvmf/common.sh@520 -- # config=() 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@32 -- # FLUSH_PID=2361657 00:18:15.154 04:20:05 -- nvmf/common.sh@520 -- # local subsystem config 00:18:15.154 04:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:15.154 04:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:15.154 { 00:18:15.154 "params": { 00:18:15.154 "name": "Nvme$subsystem", 00:18:15.154 "trtype": "$TEST_TRANSPORT", 00:18:15.154 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:15.154 "adrfam": "ipv4", 00:18:15.154 "trsvcid": "$NVMF_PORT", 00:18:15.154 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:15.154 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:15.154 "hdgst": ${hdgst:-false}, 00:18:15.154 "ddgst": ${ddgst:-false} 00:18:15.154 }, 00:18:15.154 "method": "bdev_nvme_attach_controller" 00:18:15.154 } 00:18:15.154 EOF 00:18:15.154 )") 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x40 -i 3 --json /dev/fd/63 -q 128 -o 4096 -w flush -t 1 -s 256 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@31 -- # gen_nvmf_target_json 00:18:15.154 04:20:05 -- nvmf/common.sh@542 -- # cat 00:18:15.154 04:20:05 -- nvmf/common.sh@520 -- # config=() 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@34 -- # UNMAP_PID=2361660 00:18:15.154 04:20:05 -- nvmf/common.sh@520 -- # local subsystem config 00:18:15.154 04:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@35 -- # sync 00:18:15.154 04:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:15.154 { 00:18:15.154 "params": { 00:18:15.154 "name": "Nvme$subsystem", 00:18:15.154 "trtype": "$TEST_TRANSPORT", 00:18:15.154 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:15.154 "adrfam": "ipv4", 00:18:15.154 "trsvcid": "$NVMF_PORT", 00:18:15.154 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:15.154 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:15.154 "hdgst": ${hdgst:-false}, 00:18:15.154 "ddgst": ${ddgst:-false} 00:18:15.154 }, 00:18:15.154 "method": "bdev_nvme_attach_controller" 00:18:15.154 } 00:18:15.154 EOF 00:18:15.154 )") 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x80 -i 4 --json /dev/fd/63 -q 128 -o 4096 -w unmap -t 1 -s 256 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@33 -- # gen_nvmf_target_json 00:18:15.154 04:20:05 -- nvmf/common.sh@542 -- # cat 00:18:15.154 04:20:05 -- nvmf/common.sh@520 -- # config=() 00:18:15.154 04:20:05 -- nvmf/common.sh@520 -- # local subsystem config 00:18:15.154 04:20:05 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:15.154 04:20:05 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:15.154 { 00:18:15.154 "params": { 00:18:15.154 "name": "Nvme$subsystem", 00:18:15.154 "trtype": "$TEST_TRANSPORT", 00:18:15.154 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:15.154 "adrfam": "ipv4", 00:18:15.154 "trsvcid": "$NVMF_PORT", 00:18:15.154 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:15.154 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:15.154 "hdgst": ${hdgst:-false}, 00:18:15.154 "ddgst": ${ddgst:-false} 00:18:15.154 }, 00:18:15.154 "method": "bdev_nvme_attach_controller" 00:18:15.154 } 00:18:15.154 EOF 00:18:15.154 )") 00:18:15.154 04:20:05 -- nvmf/common.sh@542 -- # cat 00:18:15.154 04:20:05 -- nvmf/common.sh@544 -- # jq . 00:18:15.154 04:20:05 -- nvmf/common.sh@542 -- # cat 00:18:15.154 04:20:05 -- target/bdev_io_wait.sh@37 -- # wait 2361653 00:18:15.154 04:20:05 -- nvmf/common.sh@544 -- # jq . 00:18:15.154 04:20:05 -- nvmf/common.sh@545 -- # IFS=, 00:18:15.154 04:20:05 -- nvmf/common.sh@544 -- # jq . 00:18:15.154 04:20:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:15.154 "params": { 00:18:15.154 "name": "Nvme1", 00:18:15.154 "trtype": "tcp", 00:18:15.154 "traddr": "10.0.0.2", 00:18:15.154 "adrfam": "ipv4", 00:18:15.154 "trsvcid": "4420", 00:18:15.154 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:15.154 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:15.154 "hdgst": false, 00:18:15.154 "ddgst": false 00:18:15.154 }, 00:18:15.154 "method": "bdev_nvme_attach_controller" 00:18:15.154 }' 00:18:15.154 04:20:05 -- nvmf/common.sh@544 -- # jq . 00:18:15.154 04:20:05 -- nvmf/common.sh@545 -- # IFS=, 00:18:15.154 04:20:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:15.154 "params": { 00:18:15.154 "name": "Nvme1", 00:18:15.154 "trtype": "tcp", 00:18:15.154 "traddr": "10.0.0.2", 00:18:15.154 "adrfam": "ipv4", 00:18:15.154 "trsvcid": "4420", 00:18:15.154 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:15.154 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:15.154 "hdgst": false, 00:18:15.154 "ddgst": false 00:18:15.154 }, 00:18:15.154 "method": "bdev_nvme_attach_controller" 00:18:15.154 }' 00:18:15.154 04:20:05 -- nvmf/common.sh@545 -- # IFS=, 00:18:15.154 04:20:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:15.154 "params": { 00:18:15.154 "name": "Nvme1", 00:18:15.154 "trtype": "tcp", 00:18:15.154 "traddr": "10.0.0.2", 00:18:15.154 "adrfam": "ipv4", 00:18:15.154 "trsvcid": "4420", 00:18:15.154 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:15.154 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:15.154 "hdgst": false, 00:18:15.154 "ddgst": false 00:18:15.154 }, 00:18:15.154 "method": "bdev_nvme_attach_controller" 00:18:15.154 }' 00:18:15.154 04:20:05 -- nvmf/common.sh@545 -- # IFS=, 00:18:15.154 04:20:05 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:15.154 "params": { 00:18:15.154 "name": "Nvme1", 00:18:15.154 "trtype": "tcp", 00:18:15.154 "traddr": "10.0.0.2", 00:18:15.154 "adrfam": "ipv4", 00:18:15.154 "trsvcid": "4420", 00:18:15.154 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:15.154 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:15.154 "hdgst": false, 00:18:15.154 "ddgst": false 00:18:15.154 }, 00:18:15.154 "method": "bdev_nvme_attach_controller" 00:18:15.154 }' 00:18:15.413 [2024-11-30 04:20:05.812500] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:15.413 [2024-11-30 04:20:05.812500] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:15.413 [2024-11-30 04:20:05.812500] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:15.413 [2024-11-30 04:20:05.812594] [ DPDK EAL parameters: bdevperf -c 0x40 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-30 04:20:05.812595] [ DPDK EAL parameters: bdevperf -c 0x20 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib[2024-11-30 04:20:05.812595] [ DPDK EAL parameters: bdevperf -c 0x10 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk3 --proc-type=auto ] 00:18:15.413 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk2 --proc-type=auto ] 00:18:15.413 .cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:18:15.413 [2024-11-30 04:20:05.813492] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:15.413 [2024-11-30 04:20:05.813562] [ DPDK EAL parameters: bdevperf -c 0x80 -m 256 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk4 --proc-type=auto ] 00:18:15.413 EAL: No free 2048 kB hugepages reported on node 1 00:18:15.413 EAL: No free 2048 kB hugepages reported on node 1 00:18:15.413 [2024-11-30 04:20:05.993447] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:15.671 EAL: No free 2048 kB hugepages reported on node 1 00:18:15.671 [2024-11-30 04:20:06.065681] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:18:15.671 [2024-11-30 04:20:06.092487] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:15.671 EAL: No free 2048 kB hugepages reported on node 1 00:18:15.671 [2024-11-30 04:20:06.165625] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:18:15.671 [2024-11-30 04:20:06.192785] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:15.671 [2024-11-30 04:20:06.264933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:18:15.671 [2024-11-30 04:20:06.267177] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:15.929 [2024-11-30 04:20:06.332933] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:18:15.929 Running I/O for 1 seconds... 00:18:15.929 Running I/O for 1 seconds... 00:18:15.929 Running I/O for 1 seconds... 00:18:15.929 Running I/O for 1 seconds... 00:18:16.864 00:18:16.864 Latency(us) 00:18:16.864 [2024-11-30T03:20:07.495Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.864 [2024-11-30T03:20:07.495Z] Job: Nvme1n1 (Core Mask 0x20, workload: read, depth: 128, IO size: 4096) 00:18:16.864 Nvme1n1 : 1.01 10008.00 39.09 0.00 0.00 12741.60 6796.33 20194.80 00:18:16.864 [2024-11-30T03:20:07.495Z] =================================================================================================================== 00:18:16.864 [2024-11-30T03:20:07.495Z] Total : 10008.00 39.09 0.00 0.00 12741.60 6796.33 20194.80 00:18:16.864 00:18:16.864 Latency(us) 00:18:16.864 [2024-11-30T03:20:07.495Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.864 [2024-11-30T03:20:07.495Z] Job: Nvme1n1 (Core Mask 0x10, workload: write, depth: 128, IO size: 4096) 00:18:16.864 Nvme1n1 : 1.02 5400.55 21.10 0.00 0.00 23557.79 9660.49 34564.17 00:18:16.864 [2024-11-30T03:20:07.495Z] =================================================================================================================== 00:18:16.864 [2024-11-30T03:20:07.495Z] Total : 5400.55 21.10 0.00 0.00 23557.79 9660.49 34564.17 00:18:16.864 00:18:16.864 Latency(us) 00:18:16.864 [2024-11-30T03:20:07.495Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:16.864 [2024-11-30T03:20:07.495Z] Job: Nvme1n1 (Core Mask 0x40, workload: flush, depth: 128, IO size: 4096) 00:18:16.864 Nvme1n1 : 1.00 198421.73 775.08 0.00 0.00 642.72 276.10 1122.61 00:18:16.864 [2024-11-30T03:20:07.495Z] =================================================================================================================== 00:18:16.864 [2024-11-30T03:20:07.495Z] Total : 198421.73 775.08 0.00 0.00 642.72 276.10 1122.61 00:18:17.122 00:18:17.122 Latency(us) 00:18:17.122 [2024-11-30T03:20:07.753Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:17.122 [2024-11-30T03:20:07.753Z] Job: Nvme1n1 (Core Mask 0x80, workload: unmap, depth: 128, IO size: 4096) 00:18:17.122 Nvme1n1 : 1.01 5469.31 21.36 0.00 0.00 23326.38 6116.69 44855.75 00:18:17.122 [2024-11-30T03:20:07.753Z] =================================================================================================================== 00:18:17.122 [2024-11-30T03:20:07.753Z] Total : 5469.31 21.36 0.00 0.00 23326.38 6116.69 44855.75 00:18:17.380 04:20:07 -- target/bdev_io_wait.sh@38 -- # wait 2361655 00:18:17.380 04:20:07 -- target/bdev_io_wait.sh@39 -- # wait 2361657 00:18:17.380 04:20:07 -- target/bdev_io_wait.sh@40 -- # wait 2361660 00:18:17.380 04:20:07 -- target/bdev_io_wait.sh@42 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:18:17.380 04:20:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:17.380 04:20:07 -- common/autotest_common.sh@10 -- # set +x 00:18:17.380 04:20:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:17.380 04:20:07 -- target/bdev_io_wait.sh@44 -- # trap - SIGINT SIGTERM EXIT 00:18:17.380 04:20:07 -- target/bdev_io_wait.sh@46 -- # nvmftestfini 00:18:17.380 04:20:07 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:17.380 04:20:07 -- nvmf/common.sh@116 -- # sync 00:18:17.380 04:20:07 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:17.380 04:20:07 -- nvmf/common.sh@119 -- # set +e 00:18:17.380 04:20:07 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:17.380 04:20:07 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:17.380 rmmod nvme_tcp 00:18:17.380 rmmod nvme_fabrics 00:18:17.380 rmmod nvme_keyring 00:18:17.380 04:20:07 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:17.380 04:20:07 -- nvmf/common.sh@123 -- # set -e 00:18:17.380 04:20:07 -- nvmf/common.sh@124 -- # return 0 00:18:17.380 04:20:07 -- nvmf/common.sh@477 -- # '[' -n 2361630 ']' 00:18:17.380 04:20:07 -- nvmf/common.sh@478 -- # killprocess 2361630 00:18:17.380 04:20:07 -- common/autotest_common.sh@936 -- # '[' -z 2361630 ']' 00:18:17.380 04:20:07 -- common/autotest_common.sh@940 -- # kill -0 2361630 00:18:17.380 04:20:07 -- common/autotest_common.sh@941 -- # uname 00:18:17.380 04:20:07 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:17.380 04:20:07 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2361630 00:18:17.380 04:20:07 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:17.381 04:20:07 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:17.381 04:20:07 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2361630' 00:18:17.381 killing process with pid 2361630 00:18:17.381 04:20:07 -- common/autotest_common.sh@955 -- # kill 2361630 00:18:17.381 04:20:07 -- common/autotest_common.sh@960 -- # wait 2361630 00:18:17.639 04:20:08 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:17.639 04:20:08 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:17.639 04:20:08 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:17.639 04:20:08 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:17.639 04:20:08 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:17.639 04:20:08 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:17.639 04:20:08 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:17.639 04:20:08 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:20.174 04:20:10 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:20.174 00:18:20.174 real 0m7.121s 00:18:20.174 user 0m15.658s 00:18:20.174 sys 0m3.588s 00:18:20.174 04:20:10 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:20.174 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:18:20.174 ************************************ 00:18:20.174 END TEST nvmf_bdev_io_wait 00:18:20.174 ************************************ 00:18:20.174 04:20:10 -- nvmf/nvmf.sh@50 -- # run_test nvmf_queue_depth /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:20.174 04:20:10 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:20.174 04:20:10 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:20.174 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:18:20.174 ************************************ 00:18:20.174 START TEST nvmf_queue_depth 00:18:20.174 ************************************ 00:18:20.174 04:20:10 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/queue_depth.sh --transport=tcp 00:18:20.174 * Looking for test storage... 00:18:20.174 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:20.174 04:20:10 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:20.174 04:20:10 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:20.174 04:20:10 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:20.174 04:20:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:20.174 04:20:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:20.174 04:20:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:20.174 04:20:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:20.174 04:20:10 -- scripts/common.sh@335 -- # IFS=.-: 00:18:20.174 04:20:10 -- scripts/common.sh@335 -- # read -ra ver1 00:18:20.174 04:20:10 -- scripts/common.sh@336 -- # IFS=.-: 00:18:20.174 04:20:10 -- scripts/common.sh@336 -- # read -ra ver2 00:18:20.174 04:20:10 -- scripts/common.sh@337 -- # local 'op=<' 00:18:20.174 04:20:10 -- scripts/common.sh@339 -- # ver1_l=2 00:18:20.174 04:20:10 -- scripts/common.sh@340 -- # ver2_l=1 00:18:20.174 04:20:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:20.174 04:20:10 -- scripts/common.sh@343 -- # case "$op" in 00:18:20.174 04:20:10 -- scripts/common.sh@344 -- # : 1 00:18:20.174 04:20:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:20.174 04:20:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:20.174 04:20:10 -- scripts/common.sh@364 -- # decimal 1 00:18:20.174 04:20:10 -- scripts/common.sh@352 -- # local d=1 00:18:20.174 04:20:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:20.174 04:20:10 -- scripts/common.sh@354 -- # echo 1 00:18:20.174 04:20:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:20.174 04:20:10 -- scripts/common.sh@365 -- # decimal 2 00:18:20.174 04:20:10 -- scripts/common.sh@352 -- # local d=2 00:18:20.174 04:20:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:20.174 04:20:10 -- scripts/common.sh@354 -- # echo 2 00:18:20.174 04:20:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:20.174 04:20:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:20.174 04:20:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:20.174 04:20:10 -- scripts/common.sh@367 -- # return 0 00:18:20.174 04:20:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:20.175 04:20:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:20.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:20.175 --rc genhtml_branch_coverage=1 00:18:20.175 --rc genhtml_function_coverage=1 00:18:20.175 --rc genhtml_legend=1 00:18:20.175 --rc geninfo_all_blocks=1 00:18:20.175 --rc geninfo_unexecuted_blocks=1 00:18:20.175 00:18:20.175 ' 00:18:20.175 04:20:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:20.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:20.175 --rc genhtml_branch_coverage=1 00:18:20.175 --rc genhtml_function_coverage=1 00:18:20.175 --rc genhtml_legend=1 00:18:20.175 --rc geninfo_all_blocks=1 00:18:20.175 --rc geninfo_unexecuted_blocks=1 00:18:20.175 00:18:20.175 ' 00:18:20.175 04:20:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:20.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:20.175 --rc genhtml_branch_coverage=1 00:18:20.175 --rc genhtml_function_coverage=1 00:18:20.175 --rc genhtml_legend=1 00:18:20.175 --rc geninfo_all_blocks=1 00:18:20.175 --rc geninfo_unexecuted_blocks=1 00:18:20.175 00:18:20.175 ' 00:18:20.175 04:20:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:20.175 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:20.175 --rc genhtml_branch_coverage=1 00:18:20.175 --rc genhtml_function_coverage=1 00:18:20.175 --rc genhtml_legend=1 00:18:20.175 --rc geninfo_all_blocks=1 00:18:20.175 --rc geninfo_unexecuted_blocks=1 00:18:20.175 00:18:20.175 ' 00:18:20.175 04:20:10 -- target/queue_depth.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:20.175 04:20:10 -- nvmf/common.sh@7 -- # uname -s 00:18:20.175 04:20:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:20.175 04:20:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:20.175 04:20:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:20.175 04:20:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:20.175 04:20:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:20.175 04:20:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:20.175 04:20:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:20.175 04:20:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:20.175 04:20:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:20.175 04:20:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:20.175 04:20:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:20.175 04:20:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:20.175 04:20:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:20.175 04:20:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:20.175 04:20:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:20.175 04:20:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:20.175 04:20:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:20.175 04:20:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:20.175 04:20:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:20.175 04:20:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.175 04:20:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.175 04:20:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.175 04:20:10 -- paths/export.sh@5 -- # export PATH 00:18:20.175 04:20:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:20.175 04:20:10 -- nvmf/common.sh@46 -- # : 0 00:18:20.175 04:20:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:20.175 04:20:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:20.175 04:20:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:20.175 04:20:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:20.175 04:20:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:20.175 04:20:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:20.175 04:20:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:20.175 04:20:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:20.175 04:20:10 -- target/queue_depth.sh@14 -- # MALLOC_BDEV_SIZE=64 00:18:20.175 04:20:10 -- target/queue_depth.sh@15 -- # MALLOC_BLOCK_SIZE=512 00:18:20.175 04:20:10 -- target/queue_depth.sh@17 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:18:20.175 04:20:10 -- target/queue_depth.sh@19 -- # nvmftestinit 00:18:20.175 04:20:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:20.175 04:20:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:20.175 04:20:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:20.175 04:20:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:20.175 04:20:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:20.175 04:20:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:20.175 04:20:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:20.175 04:20:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:20.175 04:20:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:20.175 04:20:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:20.175 04:20:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:20.175 04:20:10 -- common/autotest_common.sh@10 -- # set +x 00:18:22.073 04:20:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:22.073 04:20:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:22.073 04:20:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:22.073 04:20:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:22.073 04:20:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:22.073 04:20:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:22.073 04:20:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:22.073 04:20:12 -- nvmf/common.sh@294 -- # net_devs=() 00:18:22.073 04:20:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:22.073 04:20:12 -- nvmf/common.sh@295 -- # e810=() 00:18:22.073 04:20:12 -- nvmf/common.sh@295 -- # local -ga e810 00:18:22.073 04:20:12 -- nvmf/common.sh@296 -- # x722=() 00:18:22.074 04:20:12 -- nvmf/common.sh@296 -- # local -ga x722 00:18:22.074 04:20:12 -- nvmf/common.sh@297 -- # mlx=() 00:18:22.074 04:20:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:22.074 04:20:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:22.074 04:20:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:22.074 04:20:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:22.074 04:20:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:22.074 04:20:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:22.074 04:20:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:22.074 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:22.074 04:20:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:22.074 04:20:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:22.074 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:22.074 04:20:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:22.074 04:20:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:22.074 04:20:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:22.074 04:20:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:22.074 04:20:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:22.074 04:20:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:22.074 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:22.074 04:20:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:22.074 04:20:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:22.074 04:20:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:22.074 04:20:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:22.074 04:20:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:22.074 04:20:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:22.074 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:22.074 04:20:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:22.074 04:20:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:22.074 04:20:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:22.074 04:20:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:22.074 04:20:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:22.074 04:20:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:22.074 04:20:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:22.074 04:20:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:22.074 04:20:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:22.074 04:20:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:22.074 04:20:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:22.074 04:20:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:22.074 04:20:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:22.074 04:20:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:22.074 04:20:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:22.074 04:20:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:22.074 04:20:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:22.074 04:20:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:22.074 04:20:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:22.074 04:20:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:22.074 04:20:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:22.074 04:20:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:22.074 04:20:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:22.074 04:20:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:22.074 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:22.074 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.284 ms 00:18:22.074 00:18:22.074 --- 10.0.0.2 ping statistics --- 00:18:22.074 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:22.074 rtt min/avg/max/mdev = 0.284/0.284/0.284/0.000 ms 00:18:22.074 04:20:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:22.074 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:22.074 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.104 ms 00:18:22.074 00:18:22.074 --- 10.0.0.1 ping statistics --- 00:18:22.074 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:22.074 rtt min/avg/max/mdev = 0.104/0.104/0.104/0.000 ms 00:18:22.074 04:20:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:22.074 04:20:12 -- nvmf/common.sh@410 -- # return 0 00:18:22.074 04:20:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:22.074 04:20:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:22.074 04:20:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:22.074 04:20:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:22.074 04:20:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:22.074 04:20:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:22.074 04:20:12 -- target/queue_depth.sh@21 -- # nvmfappstart -m 0x2 00:18:22.074 04:20:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:22.074 04:20:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:22.074 04:20:12 -- common/autotest_common.sh@10 -- # set +x 00:18:22.074 04:20:12 -- nvmf/common.sh@469 -- # nvmfpid=2363902 00:18:22.074 04:20:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:22.074 04:20:12 -- nvmf/common.sh@470 -- # waitforlisten 2363902 00:18:22.074 04:20:12 -- common/autotest_common.sh@829 -- # '[' -z 2363902 ']' 00:18:22.074 04:20:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:22.074 04:20:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:22.074 04:20:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:22.074 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:22.074 04:20:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:22.074 04:20:12 -- common/autotest_common.sh@10 -- # set +x 00:18:22.074 [2024-11-30 04:20:12.449853] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:22.074 [2024-11-30 04:20:12.449935] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:22.074 EAL: No free 2048 kB hugepages reported on node 1 00:18:22.074 [2024-11-30 04:20:12.513398] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:22.074 [2024-11-30 04:20:12.595546] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:22.074 [2024-11-30 04:20:12.595702] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:22.074 [2024-11-30 04:20:12.595718] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:22.074 [2024-11-30 04:20:12.595731] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:22.074 [2024-11-30 04:20:12.595764] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:23.009 04:20:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:23.009 04:20:13 -- common/autotest_common.sh@862 -- # return 0 00:18:23.009 04:20:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:23.009 04:20:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:23.009 04:20:13 -- common/autotest_common.sh@10 -- # set +x 00:18:23.009 04:20:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:23.009 04:20:13 -- target/queue_depth.sh@23 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:18:23.009 04:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:23.009 04:20:13 -- common/autotest_common.sh@10 -- # set +x 00:18:23.009 [2024-11-30 04:20:13.489059] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:23.009 04:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:23.009 04:20:13 -- target/queue_depth.sh@24 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:18:23.009 04:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:23.009 04:20:13 -- common/autotest_common.sh@10 -- # set +x 00:18:23.009 Malloc0 00:18:23.009 04:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:23.009 04:20:13 -- target/queue_depth.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:18:23.009 04:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:23.009 04:20:13 -- common/autotest_common.sh@10 -- # set +x 00:18:23.009 04:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:23.009 04:20:13 -- target/queue_depth.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:18:23.009 04:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:23.009 04:20:13 -- common/autotest_common.sh@10 -- # set +x 00:18:23.009 04:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:23.009 04:20:13 -- target/queue_depth.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:23.009 04:20:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:23.009 04:20:13 -- common/autotest_common.sh@10 -- # set +x 00:18:23.009 [2024-11-30 04:20:13.549655] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:23.009 04:20:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:23.009 04:20:13 -- target/queue_depth.sh@30 -- # bdevperf_pid=2364056 00:18:23.009 04:20:13 -- target/queue_depth.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 1024 -o 4096 -w verify -t 10 00:18:23.009 04:20:13 -- target/queue_depth.sh@32 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:18:23.009 04:20:13 -- target/queue_depth.sh@33 -- # waitforlisten 2364056 /var/tmp/bdevperf.sock 00:18:23.009 04:20:13 -- common/autotest_common.sh@829 -- # '[' -z 2364056 ']' 00:18:23.009 04:20:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:18:23.009 04:20:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:23.009 04:20:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:18:23.009 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:18:23.009 04:20:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:23.009 04:20:13 -- common/autotest_common.sh@10 -- # set +x 00:18:23.009 [2024-11-30 04:20:13.594384] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:23.009 [2024-11-30 04:20:13.594445] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2364056 ] 00:18:23.009 EAL: No free 2048 kB hugepages reported on node 1 00:18:23.268 [2024-11-30 04:20:13.656159] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:23.268 [2024-11-30 04:20:13.744649] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:24.201 04:20:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:24.201 04:20:14 -- common/autotest_common.sh@862 -- # return 0 00:18:24.201 04:20:14 -- target/queue_depth.sh@34 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:18:24.202 04:20:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:24.202 04:20:14 -- common/autotest_common.sh@10 -- # set +x 00:18:24.460 NVMe0n1 00:18:24.460 04:20:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:24.460 04:20:14 -- target/queue_depth.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:18:24.460 Running I/O for 10 seconds... 00:18:34.532 00:18:34.532 Latency(us) 00:18:34.532 [2024-11-30T03:20:25.163Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:34.532 [2024-11-30T03:20:25.163Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 1024, IO size: 4096) 00:18:34.532 Verification LBA range: start 0x0 length 0x4000 00:18:34.532 NVMe0n1 : 10.07 12516.56 48.89 0.00 0.00 81492.31 14951.92 62526.20 00:18:34.532 [2024-11-30T03:20:25.163Z] =================================================================================================================== 00:18:34.532 [2024-11-30T03:20:25.163Z] Total : 12516.56 48.89 0.00 0.00 81492.31 14951.92 62526.20 00:18:34.532 0 00:18:34.532 04:20:25 -- target/queue_depth.sh@39 -- # killprocess 2364056 00:18:34.532 04:20:25 -- common/autotest_common.sh@936 -- # '[' -z 2364056 ']' 00:18:34.532 04:20:25 -- common/autotest_common.sh@940 -- # kill -0 2364056 00:18:34.532 04:20:25 -- common/autotest_common.sh@941 -- # uname 00:18:34.532 04:20:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:34.532 04:20:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2364056 00:18:34.533 04:20:25 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:18:34.533 04:20:25 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:18:34.533 04:20:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2364056' 00:18:34.533 killing process with pid 2364056 00:18:34.533 04:20:25 -- common/autotest_common.sh@955 -- # kill 2364056 00:18:34.533 Received shutdown signal, test time was about 10.000000 seconds 00:18:34.533 00:18:34.533 Latency(us) 00:18:34.533 [2024-11-30T03:20:25.164Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:34.533 [2024-11-30T03:20:25.164Z] =================================================================================================================== 00:18:34.533 [2024-11-30T03:20:25.164Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:18:34.533 04:20:25 -- common/autotest_common.sh@960 -- # wait 2364056 00:18:34.791 04:20:25 -- target/queue_depth.sh@41 -- # trap - SIGINT SIGTERM EXIT 00:18:34.791 04:20:25 -- target/queue_depth.sh@43 -- # nvmftestfini 00:18:34.791 04:20:25 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:34.791 04:20:25 -- nvmf/common.sh@116 -- # sync 00:18:34.791 04:20:25 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:34.791 04:20:25 -- nvmf/common.sh@119 -- # set +e 00:18:34.791 04:20:25 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:34.791 04:20:25 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:34.791 rmmod nvme_tcp 00:18:34.791 rmmod nvme_fabrics 00:18:34.791 rmmod nvme_keyring 00:18:35.050 04:20:25 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:35.050 04:20:25 -- nvmf/common.sh@123 -- # set -e 00:18:35.050 04:20:25 -- nvmf/common.sh@124 -- # return 0 00:18:35.050 04:20:25 -- nvmf/common.sh@477 -- # '[' -n 2363902 ']' 00:18:35.050 04:20:25 -- nvmf/common.sh@478 -- # killprocess 2363902 00:18:35.050 04:20:25 -- common/autotest_common.sh@936 -- # '[' -z 2363902 ']' 00:18:35.050 04:20:25 -- common/autotest_common.sh@940 -- # kill -0 2363902 00:18:35.050 04:20:25 -- common/autotest_common.sh@941 -- # uname 00:18:35.050 04:20:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:18:35.050 04:20:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2363902 00:18:35.050 04:20:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:18:35.050 04:20:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:18:35.050 04:20:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2363902' 00:18:35.050 killing process with pid 2363902 00:18:35.050 04:20:25 -- common/autotest_common.sh@955 -- # kill 2363902 00:18:35.050 04:20:25 -- common/autotest_common.sh@960 -- # wait 2363902 00:18:35.309 04:20:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:35.309 04:20:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:35.309 04:20:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:35.309 04:20:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:35.309 04:20:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:35.309 04:20:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:35.309 04:20:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:35.309 04:20:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:37.209 04:20:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:37.209 00:18:37.209 real 0m17.584s 00:18:37.209 user 0m25.534s 00:18:37.209 sys 0m3.107s 00:18:37.209 04:20:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:37.209 04:20:27 -- common/autotest_common.sh@10 -- # set +x 00:18:37.209 ************************************ 00:18:37.209 END TEST nvmf_queue_depth 00:18:37.209 ************************************ 00:18:37.209 04:20:27 -- nvmf/nvmf.sh@51 -- # run_test nvmf_multipath /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:37.209 04:20:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:37.209 04:20:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:37.209 04:20:27 -- common/autotest_common.sh@10 -- # set +x 00:18:37.209 ************************************ 00:18:37.209 START TEST nvmf_multipath 00:18:37.209 ************************************ 00:18:37.209 04:20:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multipath.sh --transport=tcp 00:18:37.468 * Looking for test storage... 00:18:37.468 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:37.468 04:20:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:37.468 04:20:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:37.468 04:20:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:37.468 04:20:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:37.468 04:20:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:37.468 04:20:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:37.468 04:20:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:37.468 04:20:27 -- scripts/common.sh@335 -- # IFS=.-: 00:18:37.468 04:20:27 -- scripts/common.sh@335 -- # read -ra ver1 00:18:37.468 04:20:27 -- scripts/common.sh@336 -- # IFS=.-: 00:18:37.468 04:20:27 -- scripts/common.sh@336 -- # read -ra ver2 00:18:37.468 04:20:27 -- scripts/common.sh@337 -- # local 'op=<' 00:18:37.468 04:20:27 -- scripts/common.sh@339 -- # ver1_l=2 00:18:37.468 04:20:27 -- scripts/common.sh@340 -- # ver2_l=1 00:18:37.468 04:20:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:37.468 04:20:27 -- scripts/common.sh@343 -- # case "$op" in 00:18:37.468 04:20:27 -- scripts/common.sh@344 -- # : 1 00:18:37.468 04:20:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:37.468 04:20:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:37.468 04:20:27 -- scripts/common.sh@364 -- # decimal 1 00:18:37.468 04:20:27 -- scripts/common.sh@352 -- # local d=1 00:18:37.468 04:20:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:37.468 04:20:27 -- scripts/common.sh@354 -- # echo 1 00:18:37.468 04:20:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:37.468 04:20:27 -- scripts/common.sh@365 -- # decimal 2 00:18:37.468 04:20:27 -- scripts/common.sh@352 -- # local d=2 00:18:37.468 04:20:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:37.468 04:20:27 -- scripts/common.sh@354 -- # echo 2 00:18:37.468 04:20:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:37.468 04:20:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:37.468 04:20:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:37.468 04:20:27 -- scripts/common.sh@367 -- # return 0 00:18:37.468 04:20:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:37.468 04:20:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:37.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.468 --rc genhtml_branch_coverage=1 00:18:37.468 --rc genhtml_function_coverage=1 00:18:37.468 --rc genhtml_legend=1 00:18:37.468 --rc geninfo_all_blocks=1 00:18:37.468 --rc geninfo_unexecuted_blocks=1 00:18:37.468 00:18:37.468 ' 00:18:37.468 04:20:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:37.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.468 --rc genhtml_branch_coverage=1 00:18:37.468 --rc genhtml_function_coverage=1 00:18:37.468 --rc genhtml_legend=1 00:18:37.468 --rc geninfo_all_blocks=1 00:18:37.468 --rc geninfo_unexecuted_blocks=1 00:18:37.468 00:18:37.468 ' 00:18:37.468 04:20:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:37.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.468 --rc genhtml_branch_coverage=1 00:18:37.468 --rc genhtml_function_coverage=1 00:18:37.468 --rc genhtml_legend=1 00:18:37.468 --rc geninfo_all_blocks=1 00:18:37.468 --rc geninfo_unexecuted_blocks=1 00:18:37.468 00:18:37.468 ' 00:18:37.468 04:20:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:37.468 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:37.468 --rc genhtml_branch_coverage=1 00:18:37.468 --rc genhtml_function_coverage=1 00:18:37.468 --rc genhtml_legend=1 00:18:37.468 --rc geninfo_all_blocks=1 00:18:37.468 --rc geninfo_unexecuted_blocks=1 00:18:37.468 00:18:37.468 ' 00:18:37.468 04:20:27 -- target/multipath.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:37.468 04:20:27 -- nvmf/common.sh@7 -- # uname -s 00:18:37.468 04:20:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:37.468 04:20:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:37.468 04:20:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:37.468 04:20:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:37.468 04:20:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:37.468 04:20:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:37.468 04:20:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:37.468 04:20:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:37.468 04:20:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:37.468 04:20:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:37.468 04:20:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:37.468 04:20:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:37.468 04:20:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:37.468 04:20:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:37.468 04:20:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:37.468 04:20:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:37.468 04:20:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:37.468 04:20:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:37.468 04:20:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:37.469 04:20:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.469 04:20:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.469 04:20:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.469 04:20:27 -- paths/export.sh@5 -- # export PATH 00:18:37.469 04:20:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:37.469 04:20:27 -- nvmf/common.sh@46 -- # : 0 00:18:37.469 04:20:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:37.469 04:20:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:37.469 04:20:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:37.469 04:20:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:37.469 04:20:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:37.469 04:20:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:37.469 04:20:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:37.469 04:20:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:37.469 04:20:27 -- target/multipath.sh@11 -- # MALLOC_BDEV_SIZE=64 00:18:37.469 04:20:27 -- target/multipath.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:18:37.469 04:20:27 -- target/multipath.sh@13 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:18:37.469 04:20:27 -- target/multipath.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:18:37.469 04:20:27 -- target/multipath.sh@43 -- # nvmftestinit 00:18:37.469 04:20:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:37.469 04:20:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:37.469 04:20:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:37.469 04:20:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:37.469 04:20:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:37.469 04:20:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:37.469 04:20:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:37.469 04:20:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:37.469 04:20:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:37.469 04:20:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:37.469 04:20:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:37.469 04:20:27 -- common/autotest_common.sh@10 -- # set +x 00:18:40.001 04:20:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:40.001 04:20:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:40.001 04:20:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:40.001 04:20:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:40.001 04:20:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:40.001 04:20:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:40.001 04:20:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:40.001 04:20:30 -- nvmf/common.sh@294 -- # net_devs=() 00:18:40.001 04:20:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:40.001 04:20:30 -- nvmf/common.sh@295 -- # e810=() 00:18:40.001 04:20:30 -- nvmf/common.sh@295 -- # local -ga e810 00:18:40.001 04:20:30 -- nvmf/common.sh@296 -- # x722=() 00:18:40.001 04:20:30 -- nvmf/common.sh@296 -- # local -ga x722 00:18:40.001 04:20:30 -- nvmf/common.sh@297 -- # mlx=() 00:18:40.001 04:20:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:40.001 04:20:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:40.001 04:20:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:40.001 04:20:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:40.001 04:20:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:40.001 04:20:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:40.001 04:20:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:40.001 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:40.001 04:20:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:40.001 04:20:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:40.001 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:40.001 04:20:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:40.001 04:20:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:40.001 04:20:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:40.001 04:20:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:40.001 04:20:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:40.001 04:20:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:40.001 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:40.001 04:20:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:40.001 04:20:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:40.001 04:20:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:40.001 04:20:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:40.001 04:20:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:40.001 04:20:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:40.001 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:40.001 04:20:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:40.001 04:20:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:40.001 04:20:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:40.001 04:20:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:40.001 04:20:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:40.001 04:20:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:40.001 04:20:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:40.001 04:20:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:40.001 04:20:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:40.001 04:20:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:40.001 04:20:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:40.001 04:20:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:40.001 04:20:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:40.001 04:20:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:40.001 04:20:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:40.001 04:20:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:40.001 04:20:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:40.001 04:20:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:40.001 04:20:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:40.001 04:20:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:40.001 04:20:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:40.001 04:20:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:40.001 04:20:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:40.001 04:20:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:40.001 04:20:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:40.001 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:40.001 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.160 ms 00:18:40.001 00:18:40.002 --- 10.0.0.2 ping statistics --- 00:18:40.002 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:40.002 rtt min/avg/max/mdev = 0.160/0.160/0.160/0.000 ms 00:18:40.002 04:20:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:40.002 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:40.002 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.048 ms 00:18:40.002 00:18:40.002 --- 10.0.0.1 ping statistics --- 00:18:40.002 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:40.002 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:18:40.002 04:20:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:40.002 04:20:30 -- nvmf/common.sh@410 -- # return 0 00:18:40.002 04:20:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:40.002 04:20:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:40.002 04:20:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:40.002 04:20:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:40.002 04:20:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:40.002 04:20:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:40.002 04:20:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:40.002 04:20:30 -- target/multipath.sh@45 -- # '[' -z ']' 00:18:40.002 04:20:30 -- target/multipath.sh@46 -- # echo 'only one NIC for nvmf test' 00:18:40.002 only one NIC for nvmf test 00:18:40.002 04:20:30 -- target/multipath.sh@47 -- # nvmftestfini 00:18:40.002 04:20:30 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:40.002 04:20:30 -- nvmf/common.sh@116 -- # sync 00:18:40.002 04:20:30 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:40.002 04:20:30 -- nvmf/common.sh@119 -- # set +e 00:18:40.002 04:20:30 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:40.002 04:20:30 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:40.002 rmmod nvme_tcp 00:18:40.002 rmmod nvme_fabrics 00:18:40.002 rmmod nvme_keyring 00:18:40.002 04:20:30 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:40.002 04:20:30 -- nvmf/common.sh@123 -- # set -e 00:18:40.002 04:20:30 -- nvmf/common.sh@124 -- # return 0 00:18:40.002 04:20:30 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:40.002 04:20:30 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:40.002 04:20:30 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:40.002 04:20:30 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:40.002 04:20:30 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:40.002 04:20:30 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:40.002 04:20:30 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:40.002 04:20:30 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:40.002 04:20:30 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.905 04:20:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:41.905 04:20:32 -- target/multipath.sh@48 -- # exit 0 00:18:41.905 04:20:32 -- target/multipath.sh@1 -- # nvmftestfini 00:18:41.905 04:20:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:18:41.905 04:20:32 -- nvmf/common.sh@116 -- # sync 00:18:41.905 04:20:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:18:41.905 04:20:32 -- nvmf/common.sh@119 -- # set +e 00:18:41.905 04:20:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:18:41.905 04:20:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:18:41.905 04:20:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:18:41.905 04:20:32 -- nvmf/common.sh@123 -- # set -e 00:18:41.905 04:20:32 -- nvmf/common.sh@124 -- # return 0 00:18:41.905 04:20:32 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:18:41.905 04:20:32 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:18:41.905 04:20:32 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:18:41.905 04:20:32 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:18:41.905 04:20:32 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:18:41.905 04:20:32 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:18:41.905 04:20:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:41.905 04:20:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:41.905 04:20:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:41.905 04:20:32 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:18:41.905 00:18:41.905 real 0m4.645s 00:18:41.905 user 0m0.915s 00:18:41.905 sys 0m1.609s 00:18:41.905 04:20:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:18:41.905 04:20:32 -- common/autotest_common.sh@10 -- # set +x 00:18:41.905 ************************************ 00:18:41.905 END TEST nvmf_multipath 00:18:41.905 ************************************ 00:18:41.905 04:20:32 -- nvmf/nvmf.sh@52 -- # run_test nvmf_zcopy /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:41.905 04:20:32 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:18:41.905 04:20:32 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:18:41.905 04:20:32 -- common/autotest_common.sh@10 -- # set +x 00:18:41.905 ************************************ 00:18:41.905 START TEST nvmf_zcopy 00:18:41.905 ************************************ 00:18:41.905 04:20:32 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh --transport=tcp 00:18:42.163 * Looking for test storage... 00:18:42.163 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:18:42.163 04:20:32 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:18:42.163 04:20:32 -- common/autotest_common.sh@1690 -- # lcov --version 00:18:42.163 04:20:32 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:18:42.163 04:20:32 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:18:42.163 04:20:32 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:18:42.163 04:20:32 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:18:42.163 04:20:32 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:18:42.163 04:20:32 -- scripts/common.sh@335 -- # IFS=.-: 00:18:42.163 04:20:32 -- scripts/common.sh@335 -- # read -ra ver1 00:18:42.163 04:20:32 -- scripts/common.sh@336 -- # IFS=.-: 00:18:42.163 04:20:32 -- scripts/common.sh@336 -- # read -ra ver2 00:18:42.163 04:20:32 -- scripts/common.sh@337 -- # local 'op=<' 00:18:42.163 04:20:32 -- scripts/common.sh@339 -- # ver1_l=2 00:18:42.163 04:20:32 -- scripts/common.sh@340 -- # ver2_l=1 00:18:42.163 04:20:32 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:18:42.163 04:20:32 -- scripts/common.sh@343 -- # case "$op" in 00:18:42.163 04:20:32 -- scripts/common.sh@344 -- # : 1 00:18:42.163 04:20:32 -- scripts/common.sh@363 -- # (( v = 0 )) 00:18:42.163 04:20:32 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:18:42.163 04:20:32 -- scripts/common.sh@364 -- # decimal 1 00:18:42.163 04:20:32 -- scripts/common.sh@352 -- # local d=1 00:18:42.163 04:20:32 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:18:42.163 04:20:32 -- scripts/common.sh@354 -- # echo 1 00:18:42.163 04:20:32 -- scripts/common.sh@364 -- # ver1[v]=1 00:18:42.163 04:20:32 -- scripts/common.sh@365 -- # decimal 2 00:18:42.163 04:20:32 -- scripts/common.sh@352 -- # local d=2 00:18:42.163 04:20:32 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:18:42.163 04:20:32 -- scripts/common.sh@354 -- # echo 2 00:18:42.163 04:20:32 -- scripts/common.sh@365 -- # ver2[v]=2 00:18:42.163 04:20:32 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:18:42.163 04:20:32 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:18:42.163 04:20:32 -- scripts/common.sh@367 -- # return 0 00:18:42.163 04:20:32 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:18:42.163 04:20:32 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:18:42.163 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.163 --rc genhtml_branch_coverage=1 00:18:42.164 --rc genhtml_function_coverage=1 00:18:42.164 --rc genhtml_legend=1 00:18:42.164 --rc geninfo_all_blocks=1 00:18:42.164 --rc geninfo_unexecuted_blocks=1 00:18:42.164 00:18:42.164 ' 00:18:42.164 04:20:32 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:18:42.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.164 --rc genhtml_branch_coverage=1 00:18:42.164 --rc genhtml_function_coverage=1 00:18:42.164 --rc genhtml_legend=1 00:18:42.164 --rc geninfo_all_blocks=1 00:18:42.164 --rc geninfo_unexecuted_blocks=1 00:18:42.164 00:18:42.164 ' 00:18:42.164 04:20:32 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:18:42.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.164 --rc genhtml_branch_coverage=1 00:18:42.164 --rc genhtml_function_coverage=1 00:18:42.164 --rc genhtml_legend=1 00:18:42.164 --rc geninfo_all_blocks=1 00:18:42.164 --rc geninfo_unexecuted_blocks=1 00:18:42.164 00:18:42.164 ' 00:18:42.164 04:20:32 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:18:42.164 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:18:42.164 --rc genhtml_branch_coverage=1 00:18:42.164 --rc genhtml_function_coverage=1 00:18:42.164 --rc genhtml_legend=1 00:18:42.164 --rc geninfo_all_blocks=1 00:18:42.164 --rc geninfo_unexecuted_blocks=1 00:18:42.164 00:18:42.164 ' 00:18:42.164 04:20:32 -- target/zcopy.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:18:42.164 04:20:32 -- nvmf/common.sh@7 -- # uname -s 00:18:42.164 04:20:32 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:18:42.164 04:20:32 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:18:42.164 04:20:32 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:18:42.164 04:20:32 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:18:42.164 04:20:32 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:18:42.164 04:20:32 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:18:42.164 04:20:32 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:18:42.164 04:20:32 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:18:42.164 04:20:32 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:18:42.164 04:20:32 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:18:42.164 04:20:32 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:18:42.164 04:20:32 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:18:42.164 04:20:32 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:18:42.164 04:20:32 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:18:42.164 04:20:32 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:18:42.164 04:20:32 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:18:42.164 04:20:32 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:18:42.164 04:20:32 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:18:42.164 04:20:32 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:18:42.164 04:20:32 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.164 04:20:32 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.164 04:20:32 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.164 04:20:32 -- paths/export.sh@5 -- # export PATH 00:18:42.164 04:20:32 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:18:42.164 04:20:32 -- nvmf/common.sh@46 -- # : 0 00:18:42.164 04:20:32 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:18:42.164 04:20:32 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:18:42.164 04:20:32 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:18:42.164 04:20:32 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:18:42.164 04:20:32 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:18:42.164 04:20:32 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:18:42.164 04:20:32 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:18:42.164 04:20:32 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:18:42.164 04:20:32 -- target/zcopy.sh@12 -- # nvmftestinit 00:18:42.164 04:20:32 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:18:42.164 04:20:32 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:18:42.164 04:20:32 -- nvmf/common.sh@436 -- # prepare_net_devs 00:18:42.164 04:20:32 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:18:42.164 04:20:32 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:18:42.164 04:20:32 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:18:42.164 04:20:32 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:18:42.164 04:20:32 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:18:42.164 04:20:32 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:18:42.164 04:20:32 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:18:42.164 04:20:32 -- nvmf/common.sh@284 -- # xtrace_disable 00:18:42.164 04:20:32 -- common/autotest_common.sh@10 -- # set +x 00:18:44.695 04:20:34 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:18:44.695 04:20:34 -- nvmf/common.sh@290 -- # pci_devs=() 00:18:44.695 04:20:34 -- nvmf/common.sh@290 -- # local -a pci_devs 00:18:44.695 04:20:34 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:18:44.695 04:20:34 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:18:44.695 04:20:34 -- nvmf/common.sh@292 -- # pci_drivers=() 00:18:44.695 04:20:34 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:18:44.695 04:20:34 -- nvmf/common.sh@294 -- # net_devs=() 00:18:44.695 04:20:34 -- nvmf/common.sh@294 -- # local -ga net_devs 00:18:44.695 04:20:34 -- nvmf/common.sh@295 -- # e810=() 00:18:44.695 04:20:34 -- nvmf/common.sh@295 -- # local -ga e810 00:18:44.695 04:20:34 -- nvmf/common.sh@296 -- # x722=() 00:18:44.695 04:20:34 -- nvmf/common.sh@296 -- # local -ga x722 00:18:44.695 04:20:34 -- nvmf/common.sh@297 -- # mlx=() 00:18:44.695 04:20:34 -- nvmf/common.sh@297 -- # local -ga mlx 00:18:44.695 04:20:34 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:18:44.695 04:20:34 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:18:44.695 04:20:34 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:18:44.695 04:20:34 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:18:44.695 04:20:34 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:18:44.695 04:20:34 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:18:44.695 04:20:34 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:18:44.695 04:20:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:44.695 04:20:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:18:44.695 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:18:44.695 04:20:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:44.695 04:20:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:44.695 04:20:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:44.695 04:20:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:44.695 04:20:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:44.695 04:20:34 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:18:44.695 04:20:34 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:18:44.695 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:18:44.695 04:20:34 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:18:44.695 04:20:34 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:18:44.696 04:20:34 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:18:44.696 04:20:34 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:18:44.696 04:20:34 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:18:44.696 04:20:34 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:18:44.696 04:20:34 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:18:44.696 04:20:34 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:18:44.696 04:20:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:44.696 04:20:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:44.696 04:20:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:44.696 04:20:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:44.696 04:20:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:18:44.696 Found net devices under 0000:0a:00.0: cvl_0_0 00:18:44.696 04:20:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:44.696 04:20:34 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:18:44.696 04:20:34 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:18:44.696 04:20:34 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:18:44.696 04:20:34 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:18:44.696 04:20:34 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:18:44.696 Found net devices under 0000:0a:00.1: cvl_0_1 00:18:44.696 04:20:34 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:18:44.696 04:20:34 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:18:44.696 04:20:34 -- nvmf/common.sh@402 -- # is_hw=yes 00:18:44.696 04:20:34 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:18:44.696 04:20:34 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:18:44.696 04:20:34 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:18:44.696 04:20:34 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:18:44.696 04:20:34 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:18:44.696 04:20:34 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:18:44.696 04:20:34 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:18:44.696 04:20:34 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:18:44.696 04:20:34 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:18:44.696 04:20:34 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:18:44.696 04:20:34 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:18:44.696 04:20:34 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:18:44.696 04:20:34 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:18:44.696 04:20:34 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:18:44.696 04:20:34 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:18:44.696 04:20:34 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:18:44.696 04:20:34 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:18:44.696 04:20:34 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:18:44.696 04:20:34 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:18:44.696 04:20:34 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:18:44.696 04:20:34 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:18:44.696 04:20:34 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:18:44.696 04:20:34 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:18:44.696 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:18:44.696 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.419 ms 00:18:44.696 00:18:44.696 --- 10.0.0.2 ping statistics --- 00:18:44.696 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:44.696 rtt min/avg/max/mdev = 0.419/0.419/0.419/0.000 ms 00:18:44.696 04:20:34 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:18:44.696 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:18:44.696 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.177 ms 00:18:44.696 00:18:44.696 --- 10.0.0.1 ping statistics --- 00:18:44.696 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:18:44.696 rtt min/avg/max/mdev = 0.177/0.177/0.177/0.000 ms 00:18:44.696 04:20:34 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:18:44.696 04:20:34 -- nvmf/common.sh@410 -- # return 0 00:18:44.696 04:20:34 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:18:44.696 04:20:34 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:18:44.696 04:20:34 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:18:44.696 04:20:34 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:18:44.696 04:20:34 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:18:44.696 04:20:34 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:18:44.696 04:20:34 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:18:44.696 04:20:34 -- target/zcopy.sh@13 -- # nvmfappstart -m 0x2 00:18:44.696 04:20:34 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:18:44.696 04:20:34 -- common/autotest_common.sh@722 -- # xtrace_disable 00:18:44.696 04:20:34 -- common/autotest_common.sh@10 -- # set +x 00:18:44.696 04:20:34 -- nvmf/common.sh@469 -- # nvmfpid=2369446 00:18:44.696 04:20:34 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:18:44.696 04:20:34 -- nvmf/common.sh@470 -- # waitforlisten 2369446 00:18:44.696 04:20:34 -- common/autotest_common.sh@829 -- # '[' -z 2369446 ']' 00:18:44.696 04:20:34 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:18:44.696 04:20:34 -- common/autotest_common.sh@834 -- # local max_retries=100 00:18:44.696 04:20:34 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:18:44.696 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:18:44.696 04:20:34 -- common/autotest_common.sh@838 -- # xtrace_disable 00:18:44.696 04:20:34 -- common/autotest_common.sh@10 -- # set +x 00:18:44.696 [2024-11-30 04:20:34.956045] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:44.696 [2024-11-30 04:20:34.956132] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:18:44.696 EAL: No free 2048 kB hugepages reported on node 1 00:18:44.696 [2024-11-30 04:20:35.030430] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:44.696 [2024-11-30 04:20:35.121086] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:18:44.696 [2024-11-30 04:20:35.121267] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:18:44.696 [2024-11-30 04:20:35.121286] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:18:44.696 [2024-11-30 04:20:35.121301] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:18:44.696 [2024-11-30 04:20:35.121340] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:18:45.628 04:20:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:18:45.628 04:20:35 -- common/autotest_common.sh@862 -- # return 0 00:18:45.628 04:20:35 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:18:45.628 04:20:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:18:45.628 04:20:35 -- common/autotest_common.sh@10 -- # set +x 00:18:45.628 04:20:35 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:18:45.628 04:20:35 -- target/zcopy.sh@15 -- # '[' tcp '!=' tcp ']' 00:18:45.629 04:20:35 -- target/zcopy.sh@22 -- # rpc_cmd nvmf_create_transport -t tcp -o -c 0 --zcopy 00:18:45.629 04:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.629 04:20:35 -- common/autotest_common.sh@10 -- # set +x 00:18:45.629 [2024-11-30 04:20:35.969397] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:18:45.629 04:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.629 04:20:35 -- target/zcopy.sh@24 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 10 00:18:45.629 04:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.629 04:20:35 -- common/autotest_common.sh@10 -- # set +x 00:18:45.629 04:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.629 04:20:35 -- target/zcopy.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:18:45.629 04:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.629 04:20:35 -- common/autotest_common.sh@10 -- # set +x 00:18:45.629 [2024-11-30 04:20:35.985630] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:18:45.629 04:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.629 04:20:35 -- target/zcopy.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:18:45.629 04:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.629 04:20:35 -- common/autotest_common.sh@10 -- # set +x 00:18:45.629 04:20:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.629 04:20:35 -- target/zcopy.sh@29 -- # rpc_cmd bdev_malloc_create 32 4096 -b malloc0 00:18:45.629 04:20:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.629 04:20:35 -- common/autotest_common.sh@10 -- # set +x 00:18:45.629 malloc0 00:18:45.629 04:20:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.629 04:20:36 -- target/zcopy.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:18:45.629 04:20:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:18:45.629 04:20:36 -- common/autotest_common.sh@10 -- # set +x 00:18:45.629 04:20:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:18:45.629 04:20:36 -- target/zcopy.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -t 10 -q 128 -w verify -o 8192 00:18:45.629 04:20:36 -- target/zcopy.sh@33 -- # gen_nvmf_target_json 00:18:45.629 04:20:36 -- nvmf/common.sh@520 -- # config=() 00:18:45.629 04:20:36 -- nvmf/common.sh@520 -- # local subsystem config 00:18:45.629 04:20:36 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:45.629 04:20:36 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:45.629 { 00:18:45.629 "params": { 00:18:45.629 "name": "Nvme$subsystem", 00:18:45.629 "trtype": "$TEST_TRANSPORT", 00:18:45.629 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:45.629 "adrfam": "ipv4", 00:18:45.629 "trsvcid": "$NVMF_PORT", 00:18:45.629 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:45.629 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:45.629 "hdgst": ${hdgst:-false}, 00:18:45.629 "ddgst": ${ddgst:-false} 00:18:45.629 }, 00:18:45.629 "method": "bdev_nvme_attach_controller" 00:18:45.629 } 00:18:45.629 EOF 00:18:45.629 )") 00:18:45.629 04:20:36 -- nvmf/common.sh@542 -- # cat 00:18:45.629 04:20:36 -- nvmf/common.sh@544 -- # jq . 00:18:45.629 04:20:36 -- nvmf/common.sh@545 -- # IFS=, 00:18:45.629 04:20:36 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:45.629 "params": { 00:18:45.629 "name": "Nvme1", 00:18:45.629 "trtype": "tcp", 00:18:45.629 "traddr": "10.0.0.2", 00:18:45.629 "adrfam": "ipv4", 00:18:45.629 "trsvcid": "4420", 00:18:45.629 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:45.629 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:45.629 "hdgst": false, 00:18:45.629 "ddgst": false 00:18:45.629 }, 00:18:45.629 "method": "bdev_nvme_attach_controller" 00:18:45.629 }' 00:18:45.629 [2024-11-30 04:20:36.066633] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:45.629 [2024-11-30 04:20:36.066723] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2369601 ] 00:18:45.629 EAL: No free 2048 kB hugepages reported on node 1 00:18:45.629 [2024-11-30 04:20:36.129932] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:45.629 [2024-11-30 04:20:36.222654] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:45.887 Running I/O for 10 seconds... 00:18:55.858 00:18:55.858 Latency(us) 00:18:55.858 [2024-11-30T03:20:46.489Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:18:55.858 [2024-11-30T03:20:46.489Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 8192) 00:18:55.858 Verification LBA range: start 0x0 length 0x1000 00:18:55.858 Nvme1n1 : 10.01 8529.64 66.64 0.00 0.00 14970.90 1262.17 22719.15 00:18:55.858 [2024-11-30T03:20:46.489Z] =================================================================================================================== 00:18:55.858 [2024-11-30T03:20:46.489Z] Total : 8529.64 66.64 0.00 0.00 14970.90 1262.17 22719.15 00:18:56.116 04:20:46 -- target/zcopy.sh@39 -- # perfpid=2370836 00:18:56.116 04:20:46 -- target/zcopy.sh@41 -- # xtrace_disable 00:18:56.116 04:20:46 -- common/autotest_common.sh@10 -- # set +x 00:18:56.116 04:20:46 -- target/zcopy.sh@37 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -t 5 -q 128 -w randrw -M 50 -o 8192 00:18:56.116 04:20:46 -- target/zcopy.sh@37 -- # gen_nvmf_target_json 00:18:56.116 04:20:46 -- nvmf/common.sh@520 -- # config=() 00:18:56.116 04:20:46 -- nvmf/common.sh@520 -- # local subsystem config 00:18:56.116 04:20:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:18:56.116 04:20:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:18:56.116 { 00:18:56.116 "params": { 00:18:56.116 "name": "Nvme$subsystem", 00:18:56.116 "trtype": "$TEST_TRANSPORT", 00:18:56.116 "traddr": "$NVMF_FIRST_TARGET_IP", 00:18:56.116 "adrfam": "ipv4", 00:18:56.116 "trsvcid": "$NVMF_PORT", 00:18:56.116 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:18:56.116 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:18:56.116 "hdgst": ${hdgst:-false}, 00:18:56.116 "ddgst": ${ddgst:-false} 00:18:56.116 }, 00:18:56.116 "method": "bdev_nvme_attach_controller" 00:18:56.116 } 00:18:56.116 EOF 00:18:56.116 )") 00:18:56.116 04:20:46 -- nvmf/common.sh@542 -- # cat 00:18:56.116 04:20:46 -- nvmf/common.sh@544 -- # jq . 00:18:56.116 [2024-11-30 04:20:46.671208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.116 [2024-11-30 04:20:46.671254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.116 04:20:46 -- nvmf/common.sh@545 -- # IFS=, 00:18:56.116 04:20:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:18:56.116 "params": { 00:18:56.116 "name": "Nvme1", 00:18:56.116 "trtype": "tcp", 00:18:56.116 "traddr": "10.0.0.2", 00:18:56.116 "adrfam": "ipv4", 00:18:56.116 "trsvcid": "4420", 00:18:56.116 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:18:56.116 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:18:56.116 "hdgst": false, 00:18:56.116 "ddgst": false 00:18:56.116 }, 00:18:56.116 "method": "bdev_nvme_attach_controller" 00:18:56.116 }' 00:18:56.116 [2024-11-30 04:20:46.679171] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.116 [2024-11-30 04:20:46.679198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.116 [2024-11-30 04:20:46.687192] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.116 [2024-11-30 04:20:46.687218] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.116 [2024-11-30 04:20:46.695215] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.116 [2024-11-30 04:20:46.695239] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.116 [2024-11-30 04:20:46.703228] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.116 [2024-11-30 04:20:46.703257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.116 [2024-11-30 04:20:46.707579] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:18:56.116 [2024-11-30 04:20:46.707654] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2370836 ] 00:18:56.116 [2024-11-30 04:20:46.711280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.116 [2024-11-30 04:20:46.711306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.116 [2024-11-30 04:20:46.719296] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.116 [2024-11-30 04:20:46.719322] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.116 [2024-11-30 04:20:46.727324] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.116 [2024-11-30 04:20:46.727348] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.116 [2024-11-30 04:20:46.735341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.116 [2024-11-30 04:20:46.735362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.116 EAL: No free 2048 kB hugepages reported on node 1 00:18:56.116 [2024-11-30 04:20:46.743363] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.116 [2024-11-30 04:20:46.743392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.374 [2024-11-30 04:20:46.751391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.374 [2024-11-30 04:20:46.751422] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.374 [2024-11-30 04:20:46.759407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.374 [2024-11-30 04:20:46.759434] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.374 [2024-11-30 04:20:46.767428] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.374 [2024-11-30 04:20:46.767454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.374 [2024-11-30 04:20:46.775450] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.374 [2024-11-30 04:20:46.775476] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.374 [2024-11-30 04:20:46.777884] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:18:56.374 [2024-11-30 04:20:46.783475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.374 [2024-11-30 04:20:46.783502] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.791524] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.791564] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.799517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.799542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.807538] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.807563] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.815560] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.815587] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.823583] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.823610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.831626] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.831662] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.839644] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.839680] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.847658] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.847684] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.855673] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.855699] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.863695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.863720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.870017] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:18:56.375 [2024-11-30 04:20:46.871719] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.871744] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.879742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.879774] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.887789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.887823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.895812] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.895849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.903834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.903872] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.911860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.911899] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.919883] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.919923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.927906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.927946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.935924] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.935969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.943928] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.943966] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.951980] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.952039] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.960030] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.960063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.968029] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.968052] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.976040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.976063] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.984143] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.984170] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:46.992136] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:46.992160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.375 [2024-11-30 04:20:47.000175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.375 [2024-11-30 04:20:47.000200] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.008210] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.008254] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.016220] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.016264] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.024276] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.024306] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.032285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.032324] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.040307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.040334] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.048338] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.048369] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 Running I/O for 5 seconds... 00:18:56.632 [2024-11-30 04:20:47.056368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.056396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.069049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.069079] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.081942] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.081999] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.095466] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.095499] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.108819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.108852] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.122204] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.122233] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.136381] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.136413] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.149411] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.149443] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.162464] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.162498] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.176139] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.632 [2024-11-30 04:20:47.176168] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.632 [2024-11-30 04:20:47.189426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.633 [2024-11-30 04:20:47.189458] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.633 [2024-11-30 04:20:47.202999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.633 [2024-11-30 04:20:47.203029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.633 [2024-11-30 04:20:47.216811] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.633 [2024-11-30 04:20:47.216842] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.633 [2024-11-30 04:20:47.229886] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.633 [2024-11-30 04:20:47.229917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.633 [2024-11-30 04:20:47.243330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.633 [2024-11-30 04:20:47.243362] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.633 [2024-11-30 04:20:47.257084] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.633 [2024-11-30 04:20:47.257113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.270708] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.270752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.284639] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.284671] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.297832] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.297864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.311347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.311379] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.324862] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.324894] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.337940] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.337981] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.350906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.350937] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.364038] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.364067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.376782] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.376813] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.390147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.390176] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.403674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.403705] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.417589] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.417621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.431754] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.431785] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.445679] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.445710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.458836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.458868] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.471916] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.471948] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.485008] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.485040] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.498913] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.498945] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:56.890 [2024-11-30 04:20:47.512181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:56.890 [2024-11-30 04:20:47.512210] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.526074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.526103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.539264] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.539296] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.553002] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.553030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.566059] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.566088] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.579732] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.579763] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.593604] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.593636] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.607019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.607047] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.620449] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.620481] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.634417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.634450] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.647608] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.647640] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.661897] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.661928] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.675333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.675365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.689333] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.689365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.702620] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.702652] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.715829] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.715863] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.729725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.729757] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.743414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.743445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.756929] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.756969] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.148 [2024-11-30 04:20:47.770208] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.148 [2024-11-30 04:20:47.770257] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.784700] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.784733] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.798619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.798651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.812548] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.812580] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.825816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.825848] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.839066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.839094] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.851926] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.851967] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.865391] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.865423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.878126] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.878155] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.891101] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.891128] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.904299] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.904331] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.917475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.917505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.930860] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.930891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.943609] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.943641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.957632] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.957664] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.970581] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.970614] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.984833] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.984865] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:47.998203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:47.998234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:48.012360] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:48.012391] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.406 [2024-11-30 04:20:48.026361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.406 [2024-11-30 04:20:48.026399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.040166] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.040195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.054283] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.054325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.068088] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.068117] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.081764] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.081796] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.094682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.094713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.108367] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.108398] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.121475] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.121505] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.135014] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.135042] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.148284] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.148329] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.161440] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.161470] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.175184] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.175213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.188580] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.188611] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.202149] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.202177] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.215373] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.215405] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.228967] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.228997] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.242102] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.242130] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.255158] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.255186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.268512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.268543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.665 [2024-11-30 04:20:48.282358] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.665 [2024-11-30 04:20:48.282403] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.295983] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.296026] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.309307] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.309339] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.322574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.322605] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.336244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.336275] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.349738] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.349769] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.362755] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.362786] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.376198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.376225] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.389887] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.389917] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.403614] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.403645] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.416999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.417030] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.430164] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.430195] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.443828] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.443858] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.457569] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.457599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.470779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.470810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.484410] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.484442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.498173] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.498205] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.511834] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.511864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.524871] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.524903] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.538290] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.538340] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:57.924 [2024-11-30 04:20:48.552209] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:57.924 [2024-11-30 04:20:48.552240] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.566116] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.566148] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.579523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.579554] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.592659] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.592690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.606155] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.606186] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.619063] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.619093] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.632244] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.632274] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.645562] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.645592] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.658594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.658625] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.672709] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.672740] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.686075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.686106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.699181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.699211] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.712236] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.712277] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.724945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.183 [2024-11-30 04:20:48.724986] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.183 [2024-11-30 04:20:48.738123] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.184 [2024-11-30 04:20:48.738154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.184 [2024-11-30 04:20:48.751099] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.184 [2024-11-30 04:20:48.751129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.184 [2024-11-30 04:20:48.764955] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.184 [2024-11-30 04:20:48.764996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.184 [2024-11-30 04:20:48.778409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.184 [2024-11-30 04:20:48.778440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.184 [2024-11-30 04:20:48.791537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.184 [2024-11-30 04:20:48.791583] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.184 [2024-11-30 04:20:48.804682] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.184 [2024-11-30 04:20:48.804713] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.442 [2024-11-30 04:20:48.818616] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.442 [2024-11-30 04:20:48.818647] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.442 [2024-11-30 04:20:48.832001] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.442 [2024-11-30 04:20:48.832036] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.442 [2024-11-30 04:20:48.845596] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.442 [2024-11-30 04:20:48.845626] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.859406] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.859437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.873180] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.873212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.886423] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.886454] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.900207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.900238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.913335] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.913365] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.926100] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.926131] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.939818] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.939849] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.953310] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.953341] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.967207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.967238] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.980785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.980816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:48.994452] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:48.994483] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:49.008376] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:49.008408] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:49.021803] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:49.021833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:49.035182] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:49.035213] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:49.049017] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:49.049067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.443 [2024-11-30 04:20:49.062587] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.443 [2024-11-30 04:20:49.062618] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.702 [2024-11-30 04:20:49.076393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.702 [2024-11-30 04:20:49.076425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.702 [2024-11-30 04:20:49.090375] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.702 [2024-11-30 04:20:49.090407] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.702 [2024-11-30 04:20:49.103910] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.702 [2024-11-30 04:20:49.103941] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.702 [2024-11-30 04:20:49.116921] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.702 [2024-11-30 04:20:49.116953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.702 [2024-11-30 04:20:49.130392] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.702 [2024-11-30 04:20:49.130423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.143720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.143752] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.157349] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.157380] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.171150] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.171182] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.184147] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.184178] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.197742] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.197773] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.210941] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.210983] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.224465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.224495] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.237728] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.237759] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.251432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.251463] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.265591] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.265622] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.279106] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.279136] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.292122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.292152] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.305813] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.305860] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.319207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.319237] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.703 [2024-11-30 04:20:49.332992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.703 [2024-11-30 04:20:49.333025] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.347199] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.347230] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.360175] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.360212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.374083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.374115] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.388280] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.388310] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.401198] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.401229] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.414856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.414886] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.428601] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.428631] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.442119] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.442150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.455789] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.455820] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.469380] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.469411] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.482704] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.482734] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.496523] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.496553] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.509686] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.509717] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.523519] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.523549] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.536611] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.536641] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.550040] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.550071] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.563144] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.563175] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.576661] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.962 [2024-11-30 04:20:49.576692] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:58.962 [2024-11-30 04:20:49.589906] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:58.963 [2024-11-30 04:20:49.589936] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.603347] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.603378] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.616795] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.616825] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.630527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.630557] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.643791] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.643821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.657357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.657388] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.670898] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.670929] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.684412] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.684442] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.698181] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.698212] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.711393] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.711423] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.724992] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.725023] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.738288] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.738318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.751418] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.751449] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.764826] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.764856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.777665] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.777695] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.791120] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.791150] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.805168] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.805198] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.818989] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.819019] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.832361] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.832392] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.224 [2024-11-30 04:20:49.845547] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.224 [2024-11-30 04:20:49.845578] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.482 [2024-11-30 04:20:49.859372] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.482 [2024-11-30 04:20:49.859404] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.482 [2024-11-30 04:20:49.873365] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.482 [2024-11-30 04:20:49.873396] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.482 [2024-11-30 04:20:49.887097] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.482 [2024-11-30 04:20:49.887129] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.482 [2024-11-30 04:20:49.901044] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.482 [2024-11-30 04:20:49.901074] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.482 [2024-11-30 04:20:49.915189] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.482 [2024-11-30 04:20:49.915220] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.482 [2024-11-30 04:20:49.928892] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.482 [2024-11-30 04:20:49.928923] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.482 [2024-11-30 04:20:49.941695] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.482 [2024-11-30 04:20:49.941726] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.482 [2024-11-30 04:20:49.955430] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.482 [2024-11-30 04:20:49.955461] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.482 [2024-11-30 04:20:49.968893] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:49.968924] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.483 [2024-11-30 04:20:49.981866] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:49.981896] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.483 [2024-11-30 04:20:49.995512] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:49.995543] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.483 [2024-11-30 04:20:50.008858] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:50.008892] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.483 [2024-11-30 04:20:50.023241] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:50.023290] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.483 [2024-11-30 04:20:50.036746] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:50.036784] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.483 [2024-11-30 04:20:50.050471] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:50.050503] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.483 [2024-11-30 04:20:50.063667] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:50.063698] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.483 [2024-11-30 04:20:50.077202] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:50.077232] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.483 [2024-11-30 04:20:50.090947] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:50.090988] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.483 [2024-11-30 04:20:50.105285] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.483 [2024-11-30 04:20:50.105316] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.119383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.119415] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.132836] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.132867] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.146481] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.146512] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.159779] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.159810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.173035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.173066] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.186298] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.186328] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.199570] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.199600] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.213672] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.213703] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.227316] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.227347] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.241332] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.241363] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.255238] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.255269] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.268790] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.268821] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.282207] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.282248] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.295780] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.295811] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.309036] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.309067] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.322368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.322414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.336047] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.336077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.349266] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.349297] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.741 [2024-11-30 04:20:50.362634] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.741 [2024-11-30 04:20:50.362665] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.999 [2024-11-30 04:20:50.376864] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.999 [2024-11-30 04:20:50.376895] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.999 [2024-11-30 04:20:50.390651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.999 [2024-11-30 04:20:50.390682] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.999 [2024-11-30 04:20:50.404351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.999 [2024-11-30 04:20:50.404381] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.999 [2024-11-30 04:20:50.417870] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.999 [2024-11-30 04:20:50.417901] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.999 [2024-11-30 04:20:50.431356] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.999 [2024-11-30 04:20:50.431387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.999 [2024-11-30 04:20:50.445379] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.999 [2024-11-30 04:20:50.445409] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.999 [2024-11-30 04:20:50.459357] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.999 [2024-11-30 04:20:50.459387] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.999 [2024-11-30 04:20:50.473083] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.999 [2024-11-30 04:20:50.473113] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.999 [2024-11-30 04:20:50.486623] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.999 [2024-11-30 04:20:50.486654] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:18:59.999 [2024-11-30 04:20:50.500109] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:18:59.999 [2024-11-30 04:20:50.500140] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.000 [2024-11-30 04:20:50.513305] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.000 [2024-11-30 04:20:50.513337] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.000 [2024-11-30 04:20:50.526619] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.000 [2024-11-30 04:20:50.526650] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.000 [2024-11-30 04:20:50.540690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.000 [2024-11-30 04:20:50.540720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.000 [2024-11-30 04:20:50.554802] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.000 [2024-11-30 04:20:50.554833] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.000 [2024-11-30 04:20:50.568018] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.000 [2024-11-30 04:20:50.568048] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.000 [2024-11-30 04:20:50.581628] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.000 [2024-11-30 04:20:50.581674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.000 [2024-11-30 04:20:50.595022] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.000 [2024-11-30 04:20:50.595053] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.000 [2024-11-30 04:20:50.609281] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.000 [2024-11-30 04:20:50.609313] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.000 [2024-11-30 04:20:50.622330] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.000 [2024-11-30 04:20:50.622361] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.636537] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.636568] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.650073] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.650103] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.664051] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.664081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.677383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.677414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.691295] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.691326] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.704808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.704840] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.718915] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.718946] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.733127] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.733159] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.746396] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.746427] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.760054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.760085] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.773214] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.258 [2024-11-30 04:20:50.773244] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.258 [2024-11-30 04:20:50.786409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.259 [2024-11-30 04:20:50.786440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.259 [2024-11-30 04:20:50.799563] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.259 [2024-11-30 04:20:50.799593] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.259 [2024-11-30 04:20:50.812969] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.259 [2024-11-30 04:20:50.813000] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.259 [2024-11-30 04:20:50.826535] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.259 [2024-11-30 04:20:50.826565] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.259 [2024-11-30 04:20:50.839801] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.259 [2024-11-30 04:20:50.839847] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.259 [2024-11-30 04:20:50.853201] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.259 [2024-11-30 04:20:50.853231] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.259 [2024-11-30 04:20:50.866131] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.259 [2024-11-30 04:20:50.866160] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.259 [2024-11-30 04:20:50.879223] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.259 [2024-11-30 04:20:50.879253] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:50.893095] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:50.893126] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:50.907074] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:50.907104] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:50.919879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:50.919908] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:50.933478] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:50.933509] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:50.947465] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:50.947496] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:50.960819] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:50.960851] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:50.974432] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:50.974462] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:50.987517] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:50.987547] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.000424] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.000455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.014287] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.014318] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.027696] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.027727] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.040937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.040979] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.054274] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.054304] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.067409] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.067440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.081050] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.081081] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.094966] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.095013] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.108190] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.108222] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.122785] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.122816] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.517 [2024-11-30 04:20:51.136075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.517 [2024-11-30 04:20:51.136107] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.150643] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.150674] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.163654] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.163686] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.176922] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.176953] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.189838] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.189869] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.203680] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.203710] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.216793] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.216823] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.230045] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.230077] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.243110] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.243141] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.256407] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.256437] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.269066] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.269096] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.281748] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.281778] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.294816] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.294846] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.308394] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.308425] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.321385] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.321416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.335203] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.335234] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.349025] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.349069] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.362200] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.362242] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.376075] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.376106] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.389669] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.389700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:00.776 [2024-11-30 04:20:51.403436] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:00.776 [2024-11-30 04:20:51.403466] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.417293] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.417325] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.430005] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.430035] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.443408] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.443440] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.456122] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.456154] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.469655] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.469685] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.482485] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.482516] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.495861] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.495891] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.509272] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.509303] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.522506] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.522537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.536232] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.536265] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.549427] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.549457] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.562839] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.562870] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.576211] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.576241] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.589895] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.589926] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.602720] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.602751] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.616507] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.616537] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.629574] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.629604] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.643371] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.643401] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.035 [2024-11-30 04:20:51.656477] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.035 [2024-11-30 04:20:51.656507] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.670417] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.670447] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.684019] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.684050] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.696879] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.696910] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.709927] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.709965] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.723594] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.723624] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.737351] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.737382] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.751213] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.751243] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.764888] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.764919] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.778368] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.778399] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.792568] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.792599] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.805808] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.805838] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.819301] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.819332] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.832725] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.832756] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.846258] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.846288] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.860174] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.860204] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.873731] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.873762] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.887400] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.887432] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.900383] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.900414] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.294 [2024-11-30 04:20:51.913998] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.294 [2024-11-30 04:20:51.914029] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:51.927505] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:51.927545] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:51.940579] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:51.940610] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:51.954414] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:51.954445] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:51.966850] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:51.966881] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:51.980527] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:51.980558] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:51.993768] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:51.993798] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.007650] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.007681] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.021156] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.021187] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.034341] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.034371] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.047386] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.047416] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.059649] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.059679] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.072847] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.072877] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.080653] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.080683] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 00:19:01.552 Latency(us) 00:19:01.552 [2024-11-30T03:20:52.183Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:19:01.552 [2024-11-30T03:20:52.183Z] Job: Nvme1n1 (Core Mask 0x1, workload: randrw, percentage: 50, depth: 128, IO size: 8192) 00:19:01.552 Nvme1n1 : 5.01 9421.63 73.61 0.00 0.00 13564.51 5873.97 24272.59 00:19:01.552 [2024-11-30T03:20:52.183Z] =================================================================================================================== 00:19:01.552 [2024-11-30T03:20:52.183Z] Total : 9421.63 73.61 0.00 0.00 13564.51 5873.97 24272.59 00:19:01.552 [2024-11-30 04:20:52.088426] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.088455] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.096446] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.096475] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.104501] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.104542] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.112539] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.112586] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.120556] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.120603] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.128575] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.128621] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.136602] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.136651] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.144640] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.144690] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.152651] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.152700] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.160674] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.160720] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.168690] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.168737] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.552 [2024-11-30 04:20:52.176714] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.552 [2024-11-30 04:20:52.176764] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.184757] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.184810] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.192776] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.192830] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.200784] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.200829] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.208806] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.208856] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.216821] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.216890] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.224844] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.224887] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.232837] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.232864] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.240856] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.240884] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.248918] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.248975] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.256937] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.257001] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.264945] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.264996] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.272939] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.272972] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.280999] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.281038] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.289035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.289078] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.297054] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.297099] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.305035] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.305059] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.313049] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.313073] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 [2024-11-30 04:20:52.321087] subsystem.c:1793:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Requested NSID 1 already in use 00:19:01.810 [2024-11-30 04:20:52.321122] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:01.810 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/zcopy.sh: line 42: kill: (2370836) - No such process 00:19:01.810 04:20:52 -- target/zcopy.sh@49 -- # wait 2370836 00:19:01.810 04:20:52 -- target/zcopy.sh@52 -- # rpc_cmd nvmf_subsystem_remove_ns nqn.2016-06.io.spdk:cnode1 1 00:19:01.810 04:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:01.810 04:20:52 -- common/autotest_common.sh@10 -- # set +x 00:19:01.810 04:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:01.810 04:20:52 -- target/zcopy.sh@53 -- # rpc_cmd bdev_delay_create -b malloc0 -d delay0 -r 1000000 -t 1000000 -w 1000000 -n 1000000 00:19:01.810 04:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:01.810 04:20:52 -- common/autotest_common.sh@10 -- # set +x 00:19:01.810 delay0 00:19:01.810 04:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:01.810 04:20:52 -- target/zcopy.sh@54 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 delay0 -n 1 00:19:01.810 04:20:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:01.810 04:20:52 -- common/autotest_common.sh@10 -- # set +x 00:19:01.810 04:20:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:01.810 04:20:52 -- target/zcopy.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -c 0x1 -t 5 -q 64 -w randrw -M 50 -l warning -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 ns:1' 00:19:01.810 EAL: No free 2048 kB hugepages reported on node 1 00:19:01.810 [2024-11-30 04:20:52.399379] nvme_fabric.c: 295:nvme_fabric_discover_probe: *WARNING*: Skipping unsupported current discovery service or discovery service referral 00:19:08.362 Initializing NVMe Controllers 00:19:08.362 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:19:08.362 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:19:08.362 Initialization complete. Launching workers. 00:19:08.362 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 I/O completed: 320, failed: 91 00:19:08.362 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) abort submitted 378, failed to submit 33 00:19:08.362 success 200, unsuccess 178, failed 0 00:19:08.362 04:20:58 -- target/zcopy.sh@59 -- # trap - SIGINT SIGTERM EXIT 00:19:08.362 04:20:58 -- target/zcopy.sh@60 -- # nvmftestfini 00:19:08.362 04:20:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:08.362 04:20:58 -- nvmf/common.sh@116 -- # sync 00:19:08.362 04:20:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:08.362 04:20:58 -- nvmf/common.sh@119 -- # set +e 00:19:08.362 04:20:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:08.362 04:20:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:08.362 rmmod nvme_tcp 00:19:08.362 rmmod nvme_fabrics 00:19:08.362 rmmod nvme_keyring 00:19:08.362 04:20:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:08.362 04:20:58 -- nvmf/common.sh@123 -- # set -e 00:19:08.362 04:20:58 -- nvmf/common.sh@124 -- # return 0 00:19:08.362 04:20:58 -- nvmf/common.sh@477 -- # '[' -n 2369446 ']' 00:19:08.362 04:20:58 -- nvmf/common.sh@478 -- # killprocess 2369446 00:19:08.362 04:20:58 -- common/autotest_common.sh@936 -- # '[' -z 2369446 ']' 00:19:08.362 04:20:58 -- common/autotest_common.sh@940 -- # kill -0 2369446 00:19:08.362 04:20:58 -- common/autotest_common.sh@941 -- # uname 00:19:08.362 04:20:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:08.362 04:20:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2369446 00:19:08.362 04:20:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:19:08.362 04:20:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:19:08.362 04:20:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2369446' 00:19:08.362 killing process with pid 2369446 00:19:08.362 04:20:58 -- common/autotest_common.sh@955 -- # kill 2369446 00:19:08.362 04:20:58 -- common/autotest_common.sh@960 -- # wait 2369446 00:19:08.362 04:20:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:08.362 04:20:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:08.362 04:20:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:08.362 04:20:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:08.362 04:20:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:08.362 04:20:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:08.362 04:20:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:08.362 04:20:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:10.898 04:21:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:10.898 00:19:10.898 real 0m28.502s 00:19:10.898 user 0m40.790s 00:19:10.898 sys 0m8.791s 00:19:10.898 04:21:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:10.898 04:21:00 -- common/autotest_common.sh@10 -- # set +x 00:19:10.898 ************************************ 00:19:10.898 END TEST nvmf_zcopy 00:19:10.898 ************************************ 00:19:10.898 04:21:01 -- nvmf/nvmf.sh@53 -- # run_test nvmf_nmic /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:10.898 04:21:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:10.898 04:21:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:10.898 04:21:01 -- common/autotest_common.sh@10 -- # set +x 00:19:10.898 ************************************ 00:19:10.898 START TEST nvmf_nmic 00:19:10.898 ************************************ 00:19:10.898 04:21:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/nmic.sh --transport=tcp 00:19:10.898 * Looking for test storage... 00:19:10.898 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:10.898 04:21:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:10.898 04:21:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:10.898 04:21:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:10.898 04:21:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:10.898 04:21:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:10.898 04:21:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:10.898 04:21:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:10.898 04:21:01 -- scripts/common.sh@335 -- # IFS=.-: 00:19:10.898 04:21:01 -- scripts/common.sh@335 -- # read -ra ver1 00:19:10.898 04:21:01 -- scripts/common.sh@336 -- # IFS=.-: 00:19:10.898 04:21:01 -- scripts/common.sh@336 -- # read -ra ver2 00:19:10.898 04:21:01 -- scripts/common.sh@337 -- # local 'op=<' 00:19:10.898 04:21:01 -- scripts/common.sh@339 -- # ver1_l=2 00:19:10.898 04:21:01 -- scripts/common.sh@340 -- # ver2_l=1 00:19:10.898 04:21:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:10.898 04:21:01 -- scripts/common.sh@343 -- # case "$op" in 00:19:10.898 04:21:01 -- scripts/common.sh@344 -- # : 1 00:19:10.898 04:21:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:10.898 04:21:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:10.898 04:21:01 -- scripts/common.sh@364 -- # decimal 1 00:19:10.898 04:21:01 -- scripts/common.sh@352 -- # local d=1 00:19:10.898 04:21:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:10.898 04:21:01 -- scripts/common.sh@354 -- # echo 1 00:19:10.898 04:21:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:10.898 04:21:01 -- scripts/common.sh@365 -- # decimal 2 00:19:10.898 04:21:01 -- scripts/common.sh@352 -- # local d=2 00:19:10.898 04:21:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:10.898 04:21:01 -- scripts/common.sh@354 -- # echo 2 00:19:10.898 04:21:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:10.898 04:21:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:10.898 04:21:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:10.898 04:21:01 -- scripts/common.sh@367 -- # return 0 00:19:10.898 04:21:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:10.898 04:21:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:10.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:10.898 --rc genhtml_branch_coverage=1 00:19:10.898 --rc genhtml_function_coverage=1 00:19:10.898 --rc genhtml_legend=1 00:19:10.898 --rc geninfo_all_blocks=1 00:19:10.898 --rc geninfo_unexecuted_blocks=1 00:19:10.898 00:19:10.898 ' 00:19:10.898 04:21:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:10.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:10.898 --rc genhtml_branch_coverage=1 00:19:10.898 --rc genhtml_function_coverage=1 00:19:10.898 --rc genhtml_legend=1 00:19:10.898 --rc geninfo_all_blocks=1 00:19:10.898 --rc geninfo_unexecuted_blocks=1 00:19:10.898 00:19:10.898 ' 00:19:10.898 04:21:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:10.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:10.898 --rc genhtml_branch_coverage=1 00:19:10.898 --rc genhtml_function_coverage=1 00:19:10.898 --rc genhtml_legend=1 00:19:10.898 --rc geninfo_all_blocks=1 00:19:10.898 --rc geninfo_unexecuted_blocks=1 00:19:10.898 00:19:10.898 ' 00:19:10.898 04:21:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:10.898 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:10.898 --rc genhtml_branch_coverage=1 00:19:10.898 --rc genhtml_function_coverage=1 00:19:10.898 --rc genhtml_legend=1 00:19:10.898 --rc geninfo_all_blocks=1 00:19:10.898 --rc geninfo_unexecuted_blocks=1 00:19:10.898 00:19:10.898 ' 00:19:10.898 04:21:01 -- target/nmic.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:10.898 04:21:01 -- nvmf/common.sh@7 -- # uname -s 00:19:10.898 04:21:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:10.898 04:21:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:10.898 04:21:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:10.898 04:21:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:10.898 04:21:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:10.898 04:21:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:10.898 04:21:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:10.898 04:21:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:10.898 04:21:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:10.898 04:21:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:10.898 04:21:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:10.898 04:21:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:10.898 04:21:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:10.898 04:21:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:10.898 04:21:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:10.898 04:21:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:10.898 04:21:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:10.898 04:21:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:10.898 04:21:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:10.898 04:21:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.898 04:21:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.898 04:21:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.898 04:21:01 -- paths/export.sh@5 -- # export PATH 00:19:10.898 04:21:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:10.898 04:21:01 -- nvmf/common.sh@46 -- # : 0 00:19:10.898 04:21:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:10.898 04:21:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:10.899 04:21:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:10.899 04:21:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:10.899 04:21:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:10.899 04:21:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:10.899 04:21:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:10.899 04:21:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:10.899 04:21:01 -- target/nmic.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:10.899 04:21:01 -- target/nmic.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:10.899 04:21:01 -- target/nmic.sh@14 -- # nvmftestinit 00:19:10.899 04:21:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:10.899 04:21:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:10.899 04:21:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:10.899 04:21:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:10.899 04:21:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:10.899 04:21:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:10.899 04:21:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:10.899 04:21:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:10.899 04:21:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:10.899 04:21:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:10.899 04:21:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:10.899 04:21:01 -- common/autotest_common.sh@10 -- # set +x 00:19:12.801 04:21:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:12.801 04:21:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:12.802 04:21:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:12.802 04:21:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:12.802 04:21:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:12.802 04:21:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:12.802 04:21:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:12.802 04:21:03 -- nvmf/common.sh@294 -- # net_devs=() 00:19:12.802 04:21:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:12.802 04:21:03 -- nvmf/common.sh@295 -- # e810=() 00:19:12.802 04:21:03 -- nvmf/common.sh@295 -- # local -ga e810 00:19:12.802 04:21:03 -- nvmf/common.sh@296 -- # x722=() 00:19:12.802 04:21:03 -- nvmf/common.sh@296 -- # local -ga x722 00:19:12.802 04:21:03 -- nvmf/common.sh@297 -- # mlx=() 00:19:12.802 04:21:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:12.802 04:21:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:12.802 04:21:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:12.802 04:21:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:12.802 04:21:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:12.802 04:21:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:12.802 04:21:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:12.802 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:12.802 04:21:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:12.802 04:21:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:12.802 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:12.802 04:21:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:12.802 04:21:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:12.802 04:21:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:12.802 04:21:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:12.802 04:21:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:12.802 04:21:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:12.802 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:12.802 04:21:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:12.802 04:21:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:12.802 04:21:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:12.802 04:21:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:12.802 04:21:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:12.802 04:21:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:12.802 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:12.802 04:21:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:12.802 04:21:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:12.802 04:21:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:12.802 04:21:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:12.802 04:21:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:12.802 04:21:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:12.802 04:21:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:12.802 04:21:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:12.802 04:21:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:12.802 04:21:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:12.802 04:21:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:12.802 04:21:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:12.802 04:21:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:12.802 04:21:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:12.802 04:21:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:12.802 04:21:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:12.802 04:21:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:12.802 04:21:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:12.802 04:21:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:12.802 04:21:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:12.802 04:21:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:12.802 04:21:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:12.802 04:21:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:12.802 04:21:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:12.802 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:12.802 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.203 ms 00:19:12.802 00:19:12.802 --- 10.0.0.2 ping statistics --- 00:19:12.802 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:12.802 rtt min/avg/max/mdev = 0.203/0.203/0.203/0.000 ms 00:19:12.802 04:21:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:12.802 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:12.802 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:19:12.802 00:19:12.802 --- 10.0.0.1 ping statistics --- 00:19:12.802 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:12.802 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:19:12.802 04:21:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:12.802 04:21:03 -- nvmf/common.sh@410 -- # return 0 00:19:12.802 04:21:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:12.802 04:21:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:12.802 04:21:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:12.802 04:21:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:12.802 04:21:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:12.802 04:21:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:12.802 04:21:03 -- target/nmic.sh@15 -- # nvmfappstart -m 0xF 00:19:12.802 04:21:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:12.802 04:21:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:12.802 04:21:03 -- common/autotest_common.sh@10 -- # set +x 00:19:12.802 04:21:03 -- nvmf/common.sh@469 -- # nvmfpid=2374377 00:19:12.802 04:21:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:12.802 04:21:03 -- nvmf/common.sh@470 -- # waitforlisten 2374377 00:19:12.802 04:21:03 -- common/autotest_common.sh@829 -- # '[' -z 2374377 ']' 00:19:12.803 04:21:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:12.803 04:21:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:12.803 04:21:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:12.803 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:12.803 04:21:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:12.803 04:21:03 -- common/autotest_common.sh@10 -- # set +x 00:19:13.061 [2024-11-30 04:21:03.472989] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:13.061 [2024-11-30 04:21:03.473078] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:13.061 EAL: No free 2048 kB hugepages reported on node 1 00:19:13.061 [2024-11-30 04:21:03.543833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:13.061 [2024-11-30 04:21:03.638631] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:13.061 [2024-11-30 04:21:03.638800] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:13.061 [2024-11-30 04:21:03.638820] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:13.061 [2024-11-30 04:21:03.638834] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:13.061 [2024-11-30 04:21:03.638910] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:13.061 [2024-11-30 04:21:03.638975] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:13.061 [2024-11-30 04:21:03.639029] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:13.061 [2024-11-30 04:21:03.639032] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:13.994 04:21:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:13.994 04:21:04 -- common/autotest_common.sh@862 -- # return 0 00:19:13.994 04:21:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:13.994 04:21:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:13.994 04:21:04 -- common/autotest_common.sh@10 -- # set +x 00:19:13.994 04:21:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:13.994 04:21:04 -- target/nmic.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:13.994 04:21:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.994 04:21:04 -- common/autotest_common.sh@10 -- # set +x 00:19:13.994 [2024-11-30 04:21:04.452577] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:13.994 04:21:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.994 04:21:04 -- target/nmic.sh@20 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:13.994 04:21:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.994 04:21:04 -- common/autotest_common.sh@10 -- # set +x 00:19:13.994 Malloc0 00:19:13.994 04:21:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.994 04:21:04 -- target/nmic.sh@21 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:13.994 04:21:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.994 04:21:04 -- common/autotest_common.sh@10 -- # set +x 00:19:13.994 04:21:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.994 04:21:04 -- target/nmic.sh@22 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:13.994 04:21:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.994 04:21:04 -- common/autotest_common.sh@10 -- # set +x 00:19:13.994 04:21:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.994 04:21:04 -- target/nmic.sh@23 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:13.994 04:21:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.994 04:21:04 -- common/autotest_common.sh@10 -- # set +x 00:19:13.994 [2024-11-30 04:21:04.506026] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:13.994 04:21:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.994 04:21:04 -- target/nmic.sh@25 -- # echo 'test case1: single bdev can'\''t be used in multiple subsystems' 00:19:13.994 test case1: single bdev can't be used in multiple subsystems 00:19:13.995 04:21:04 -- target/nmic.sh@26 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:19:13.995 04:21:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.995 04:21:04 -- common/autotest_common.sh@10 -- # set +x 00:19:13.995 04:21:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.995 04:21:04 -- target/nmic.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:19:13.995 04:21:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.995 04:21:04 -- common/autotest_common.sh@10 -- # set +x 00:19:13.995 04:21:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.995 04:21:04 -- target/nmic.sh@28 -- # nmic_status=0 00:19:13.995 04:21:04 -- target/nmic.sh@29 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc0 00:19:13.995 04:21:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.995 04:21:04 -- common/autotest_common.sh@10 -- # set +x 00:19:13.995 [2024-11-30 04:21:04.529818] bdev.c:7940:bdev_open: *ERROR*: bdev Malloc0 already claimed: type exclusive_write by module NVMe-oF Target 00:19:13.995 [2024-11-30 04:21:04.529847] subsystem.c:1819:spdk_nvmf_subsystem_add_ns_ext: *ERROR*: Subsystem nqn.2016-06.io.spdk:cnode2: bdev Malloc0 cannot be opened, error=-1 00:19:13.995 [2024-11-30 04:21:04.529878] nvmf_rpc.c:1513:nvmf_rpc_ns_paused: *ERROR*: Unable to add namespace 00:19:13.995 request: 00:19:13.995 { 00:19:13.995 "nqn": "nqn.2016-06.io.spdk:cnode2", 00:19:13.995 "namespace": { 00:19:13.995 "bdev_name": "Malloc0" 00:19:13.995 }, 00:19:13.995 "method": "nvmf_subsystem_add_ns", 00:19:13.995 "req_id": 1 00:19:13.995 } 00:19:13.995 Got JSON-RPC error response 00:19:13.995 response: 00:19:13.995 { 00:19:13.995 "code": -32602, 00:19:13.995 "message": "Invalid parameters" 00:19:13.995 } 00:19:13.995 04:21:04 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:19:13.995 04:21:04 -- target/nmic.sh@29 -- # nmic_status=1 00:19:13.995 04:21:04 -- target/nmic.sh@31 -- # '[' 1 -eq 0 ']' 00:19:13.995 04:21:04 -- target/nmic.sh@36 -- # echo ' Adding namespace failed - expected result.' 00:19:13.995 Adding namespace failed - expected result. 00:19:13.995 04:21:04 -- target/nmic.sh@39 -- # echo 'test case2: host connect to nvmf target in multiple paths' 00:19:13.995 test case2: host connect to nvmf target in multiple paths 00:19:13.995 04:21:04 -- target/nmic.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:19:13.995 04:21:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:13.995 04:21:04 -- common/autotest_common.sh@10 -- # set +x 00:19:13.995 [2024-11-30 04:21:04.537964] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:19:13.995 04:21:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:13.995 04:21:04 -- target/nmic.sh@41 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:14.561 04:21:05 -- target/nmic.sh@42 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4421 00:19:15.492 04:21:05 -- target/nmic.sh@44 -- # waitforserial SPDKISFASTANDAWESOME 00:19:15.492 04:21:05 -- common/autotest_common.sh@1187 -- # local i=0 00:19:15.492 04:21:05 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:15.492 04:21:05 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:19:15.492 04:21:05 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:17.437 04:21:07 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:17.437 04:21:07 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:17.437 04:21:07 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:17.437 04:21:07 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:19:17.437 04:21:07 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:17.437 04:21:07 -- common/autotest_common.sh@1197 -- # return 0 00:19:17.437 04:21:07 -- target/nmic.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:17.437 [global] 00:19:17.437 thread=1 00:19:17.437 invalidate=1 00:19:17.437 rw=write 00:19:17.437 time_based=1 00:19:17.437 runtime=1 00:19:17.437 ioengine=libaio 00:19:17.437 direct=1 00:19:17.437 bs=4096 00:19:17.437 iodepth=1 00:19:17.437 norandommap=0 00:19:17.437 numjobs=1 00:19:17.437 00:19:17.437 verify_dump=1 00:19:17.437 verify_backlog=512 00:19:17.437 verify_state_save=0 00:19:17.437 do_verify=1 00:19:17.437 verify=crc32c-intel 00:19:17.437 [job0] 00:19:17.437 filename=/dev/nvme0n1 00:19:17.437 Could not set queue depth (nvme0n1) 00:19:17.437 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:17.437 fio-3.35 00:19:17.437 Starting 1 thread 00:19:18.861 00:19:18.861 job0: (groupid=0, jobs=1): err= 0: pid=2375401: Sat Nov 30 04:21:09 2024 00:19:18.861 read: IOPS=991, BW=3965KiB/s (4061kB/s)(4136KiB/1043msec) 00:19:18.861 slat (nsec): min=4190, max=31857, avg=6172.36, stdev=2254.57 00:19:18.861 clat (usec): min=177, max=42971, avg=630.98, stdev=4012.21 00:19:18.861 lat (usec): min=183, max=42987, avg=637.16, stdev=4012.90 00:19:18.861 clat percentiles (usec): 00:19:18.861 | 1.00th=[ 184], 5.00th=[ 190], 10.00th=[ 194], 20.00th=[ 200], 00:19:18.861 | 30.00th=[ 206], 40.00th=[ 210], 50.00th=[ 219], 60.00th=[ 229], 00:19:18.861 | 70.00th=[ 258], 80.00th=[ 273], 90.00th=[ 289], 95.00th=[ 314], 00:19:18.861 | 99.00th=[ 791], 99.50th=[41157], 99.90th=[41157], 99.95th=[42730], 00:19:18.861 | 99.99th=[42730] 00:19:18.861 write: IOPS=1472, BW=5891KiB/s (6032kB/s)(6144KiB/1043msec); 0 zone resets 00:19:18.861 slat (usec): min=6, max=40731, avg=53.67, stdev=1270.84 00:19:18.861 clat (usec): min=130, max=926, avg=192.80, stdev=73.59 00:19:18.861 lat (usec): min=138, max=40922, avg=246.48, stdev=1273.22 00:19:18.861 clat percentiles (usec): 00:19:18.861 | 1.00th=[ 135], 5.00th=[ 139], 10.00th=[ 143], 20.00th=[ 147], 00:19:18.861 | 30.00th=[ 151], 40.00th=[ 155], 50.00th=[ 165], 60.00th=[ 188], 00:19:18.861 | 70.00th=[ 241], 80.00th=[ 245], 90.00th=[ 247], 95.00th=[ 251], 00:19:18.861 | 99.00th=[ 627], 99.50th=[ 709], 99.90th=[ 848], 99.95th=[ 930], 00:19:18.861 | 99.99th=[ 930] 00:19:18.861 bw ( KiB/s): min= 4096, max= 8192, per=100.00%, avg=6144.00, stdev=2896.31, samples=2 00:19:18.861 iops : min= 1024, max= 2048, avg=1536.00, stdev=724.08, samples=2 00:19:18.861 lat (usec) : 250=83.23%, 500=15.56%, 750=0.58%, 1000=0.23% 00:19:18.861 lat (msec) : 50=0.39% 00:19:18.861 cpu : usr=1.73%, sys=1.54%, ctx=2573, majf=0, minf=1 00:19:18.861 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:18.861 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.861 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:18.861 issued rwts: total=1034,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:18.861 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:18.861 00:19:18.861 Run status group 0 (all jobs): 00:19:18.861 READ: bw=3965KiB/s (4061kB/s), 3965KiB/s-3965KiB/s (4061kB/s-4061kB/s), io=4136KiB (4235kB), run=1043-1043msec 00:19:18.861 WRITE: bw=5891KiB/s (6032kB/s), 5891KiB/s-5891KiB/s (6032kB/s-6032kB/s), io=6144KiB (6291kB), run=1043-1043msec 00:19:18.861 00:19:18.861 Disk stats (read/write): 00:19:18.861 nvme0n1: ios=1059/1536, merge=0/0, ticks=1468/282, in_queue=1750, util=99.80% 00:19:18.861 04:21:09 -- target/nmic.sh@48 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:18.861 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 2 controller(s) 00:19:18.861 04:21:09 -- target/nmic.sh@49 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:18.861 04:21:09 -- common/autotest_common.sh@1208 -- # local i=0 00:19:18.861 04:21:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:18.861 04:21:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:18.861 04:21:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:18.861 04:21:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:18.861 04:21:09 -- common/autotest_common.sh@1220 -- # return 0 00:19:18.861 04:21:09 -- target/nmic.sh@51 -- # trap - SIGINT SIGTERM EXIT 00:19:18.861 04:21:09 -- target/nmic.sh@53 -- # nvmftestfini 00:19:18.861 04:21:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:18.861 04:21:09 -- nvmf/common.sh@116 -- # sync 00:19:18.861 04:21:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:18.861 04:21:09 -- nvmf/common.sh@119 -- # set +e 00:19:18.861 04:21:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:18.861 04:21:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:18.861 rmmod nvme_tcp 00:19:18.861 rmmod nvme_fabrics 00:19:18.861 rmmod nvme_keyring 00:19:18.861 04:21:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:18.861 04:21:09 -- nvmf/common.sh@123 -- # set -e 00:19:18.861 04:21:09 -- nvmf/common.sh@124 -- # return 0 00:19:18.861 04:21:09 -- nvmf/common.sh@477 -- # '[' -n 2374377 ']' 00:19:18.861 04:21:09 -- nvmf/common.sh@478 -- # killprocess 2374377 00:19:18.861 04:21:09 -- common/autotest_common.sh@936 -- # '[' -z 2374377 ']' 00:19:18.861 04:21:09 -- common/autotest_common.sh@940 -- # kill -0 2374377 00:19:18.861 04:21:09 -- common/autotest_common.sh@941 -- # uname 00:19:18.861 04:21:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:18.861 04:21:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2374377 00:19:19.119 04:21:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:19.119 04:21:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:19.119 04:21:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2374377' 00:19:19.119 killing process with pid 2374377 00:19:19.119 04:21:09 -- common/autotest_common.sh@955 -- # kill 2374377 00:19:19.119 04:21:09 -- common/autotest_common.sh@960 -- # wait 2374377 00:19:19.378 04:21:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:19.378 04:21:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:19.378 04:21:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:19.378 04:21:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:19.378 04:21:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:19.378 04:21:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:19.378 04:21:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:19.378 04:21:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:21.281 04:21:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:21.281 00:19:21.281 real 0m10.777s 00:19:21.281 user 0m25.434s 00:19:21.281 sys 0m2.520s 00:19:21.281 04:21:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:21.281 04:21:11 -- common/autotest_common.sh@10 -- # set +x 00:19:21.281 ************************************ 00:19:21.281 END TEST nvmf_nmic 00:19:21.281 ************************************ 00:19:21.281 04:21:11 -- nvmf/nvmf.sh@54 -- # run_test nvmf_fio_target /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:21.281 04:21:11 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:21.281 04:21:11 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:21.281 04:21:11 -- common/autotest_common.sh@10 -- # set +x 00:19:21.281 ************************************ 00:19:21.281 START TEST nvmf_fio_target 00:19:21.281 ************************************ 00:19:21.281 04:21:11 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fio.sh --transport=tcp 00:19:21.281 * Looking for test storage... 00:19:21.281 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:21.281 04:21:11 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:21.281 04:21:11 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:21.281 04:21:11 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:21.541 04:21:11 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:21.541 04:21:11 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:21.541 04:21:11 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:21.541 04:21:11 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:21.541 04:21:11 -- scripts/common.sh@335 -- # IFS=.-: 00:19:21.541 04:21:11 -- scripts/common.sh@335 -- # read -ra ver1 00:19:21.541 04:21:11 -- scripts/common.sh@336 -- # IFS=.-: 00:19:21.541 04:21:11 -- scripts/common.sh@336 -- # read -ra ver2 00:19:21.541 04:21:11 -- scripts/common.sh@337 -- # local 'op=<' 00:19:21.541 04:21:11 -- scripts/common.sh@339 -- # ver1_l=2 00:19:21.541 04:21:11 -- scripts/common.sh@340 -- # ver2_l=1 00:19:21.541 04:21:11 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:21.541 04:21:11 -- scripts/common.sh@343 -- # case "$op" in 00:19:21.541 04:21:11 -- scripts/common.sh@344 -- # : 1 00:19:21.541 04:21:11 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:21.541 04:21:11 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:21.541 04:21:11 -- scripts/common.sh@364 -- # decimal 1 00:19:21.541 04:21:11 -- scripts/common.sh@352 -- # local d=1 00:19:21.541 04:21:11 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:21.541 04:21:11 -- scripts/common.sh@354 -- # echo 1 00:19:21.541 04:21:11 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:21.541 04:21:11 -- scripts/common.sh@365 -- # decimal 2 00:19:21.541 04:21:11 -- scripts/common.sh@352 -- # local d=2 00:19:21.541 04:21:11 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:21.541 04:21:11 -- scripts/common.sh@354 -- # echo 2 00:19:21.541 04:21:11 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:21.541 04:21:11 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:21.541 04:21:11 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:21.541 04:21:11 -- scripts/common.sh@367 -- # return 0 00:19:21.541 04:21:11 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:21.541 04:21:11 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:21.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.541 --rc genhtml_branch_coverage=1 00:19:21.541 --rc genhtml_function_coverage=1 00:19:21.541 --rc genhtml_legend=1 00:19:21.541 --rc geninfo_all_blocks=1 00:19:21.541 --rc geninfo_unexecuted_blocks=1 00:19:21.541 00:19:21.541 ' 00:19:21.541 04:21:11 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:21.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.541 --rc genhtml_branch_coverage=1 00:19:21.541 --rc genhtml_function_coverage=1 00:19:21.541 --rc genhtml_legend=1 00:19:21.541 --rc geninfo_all_blocks=1 00:19:21.541 --rc geninfo_unexecuted_blocks=1 00:19:21.541 00:19:21.541 ' 00:19:21.541 04:21:11 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:21.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.541 --rc genhtml_branch_coverage=1 00:19:21.541 --rc genhtml_function_coverage=1 00:19:21.541 --rc genhtml_legend=1 00:19:21.541 --rc geninfo_all_blocks=1 00:19:21.541 --rc geninfo_unexecuted_blocks=1 00:19:21.541 00:19:21.541 ' 00:19:21.541 04:21:11 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:21.541 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:21.541 --rc genhtml_branch_coverage=1 00:19:21.541 --rc genhtml_function_coverage=1 00:19:21.541 --rc genhtml_legend=1 00:19:21.541 --rc geninfo_all_blocks=1 00:19:21.541 --rc geninfo_unexecuted_blocks=1 00:19:21.541 00:19:21.541 ' 00:19:21.541 04:21:11 -- target/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:21.541 04:21:11 -- nvmf/common.sh@7 -- # uname -s 00:19:21.541 04:21:11 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:21.541 04:21:11 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:21.541 04:21:11 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:21.541 04:21:11 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:21.541 04:21:11 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:21.541 04:21:11 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:21.541 04:21:11 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:21.541 04:21:11 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:21.541 04:21:11 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:21.541 04:21:11 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:21.541 04:21:11 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:21.541 04:21:11 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:21.541 04:21:11 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:21.541 04:21:11 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:21.541 04:21:11 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:21.541 04:21:11 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:21.541 04:21:11 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:21.541 04:21:11 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:21.541 04:21:11 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:21.541 04:21:11 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.541 04:21:11 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.541 04:21:11 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.541 04:21:11 -- paths/export.sh@5 -- # export PATH 00:19:21.541 04:21:11 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:21.541 04:21:11 -- nvmf/common.sh@46 -- # : 0 00:19:21.541 04:21:11 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:21.541 04:21:11 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:21.541 04:21:11 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:21.542 04:21:11 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:21.542 04:21:11 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:21.542 04:21:11 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:21.542 04:21:11 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:21.542 04:21:11 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:21.542 04:21:11 -- target/fio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:21.542 04:21:11 -- target/fio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:21.542 04:21:11 -- target/fio.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:19:21.542 04:21:11 -- target/fio.sh@16 -- # nvmftestinit 00:19:21.542 04:21:11 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:21.542 04:21:11 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:21.542 04:21:11 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:21.542 04:21:11 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:21.542 04:21:11 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:21.542 04:21:11 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:21.542 04:21:11 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:21.542 04:21:11 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:21.542 04:21:11 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:21.542 04:21:11 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:21.542 04:21:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:21.542 04:21:11 -- common/autotest_common.sh@10 -- # set +x 00:19:23.443 04:21:14 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:23.443 04:21:14 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:23.443 04:21:14 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:23.443 04:21:14 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:23.443 04:21:14 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:23.443 04:21:14 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:23.443 04:21:14 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:23.443 04:21:14 -- nvmf/common.sh@294 -- # net_devs=() 00:19:23.443 04:21:14 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:23.443 04:21:14 -- nvmf/common.sh@295 -- # e810=() 00:19:23.443 04:21:14 -- nvmf/common.sh@295 -- # local -ga e810 00:19:23.443 04:21:14 -- nvmf/common.sh@296 -- # x722=() 00:19:23.443 04:21:14 -- nvmf/common.sh@296 -- # local -ga x722 00:19:23.443 04:21:14 -- nvmf/common.sh@297 -- # mlx=() 00:19:23.443 04:21:14 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:23.443 04:21:14 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:23.443 04:21:14 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:23.443 04:21:14 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:23.443 04:21:14 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:23.443 04:21:14 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:23.443 04:21:14 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:23.443 04:21:14 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:23.443 04:21:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:23.443 04:21:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:23.443 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:23.443 04:21:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:23.443 04:21:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:23.443 04:21:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:23.444 04:21:14 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:23.444 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:23.444 04:21:14 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:23.444 04:21:14 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:23.444 04:21:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:23.444 04:21:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:23.444 04:21:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:23.444 04:21:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:23.444 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:23.444 04:21:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:23.444 04:21:14 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:23.444 04:21:14 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:23.444 04:21:14 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:23.444 04:21:14 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:23.444 04:21:14 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:23.444 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:23.444 04:21:14 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:23.444 04:21:14 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:23.444 04:21:14 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:23.444 04:21:14 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:23.444 04:21:14 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:23.444 04:21:14 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:23.444 04:21:14 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:23.444 04:21:14 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:23.444 04:21:14 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:23.444 04:21:14 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:23.444 04:21:14 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:23.444 04:21:14 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:23.444 04:21:14 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:23.444 04:21:14 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:23.444 04:21:14 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:23.444 04:21:14 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:23.444 04:21:14 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:23.444 04:21:14 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:23.702 04:21:14 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:23.702 04:21:14 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:23.702 04:21:14 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:23.702 04:21:14 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:23.702 04:21:14 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:23.702 04:21:14 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:23.702 04:21:14 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:23.702 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:23.702 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.191 ms 00:19:23.702 00:19:23.702 --- 10.0.0.2 ping statistics --- 00:19:23.702 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:23.702 rtt min/avg/max/mdev = 0.191/0.191/0.191/0.000 ms 00:19:23.702 04:21:14 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:23.702 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:23.702 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.181 ms 00:19:23.702 00:19:23.702 --- 10.0.0.1 ping statistics --- 00:19:23.702 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:23.702 rtt min/avg/max/mdev = 0.181/0.181/0.181/0.000 ms 00:19:23.702 04:21:14 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:23.702 04:21:14 -- nvmf/common.sh@410 -- # return 0 00:19:23.702 04:21:14 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:23.702 04:21:14 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:23.702 04:21:14 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:23.702 04:21:14 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:23.702 04:21:14 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:23.702 04:21:14 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:23.702 04:21:14 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:23.702 04:21:14 -- target/fio.sh@17 -- # nvmfappstart -m 0xF 00:19:23.702 04:21:14 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:23.702 04:21:14 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:23.702 04:21:14 -- common/autotest_common.sh@10 -- # set +x 00:19:23.702 04:21:14 -- nvmf/common.sh@469 -- # nvmfpid=2377767 00:19:23.702 04:21:14 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:19:23.702 04:21:14 -- nvmf/common.sh@470 -- # waitforlisten 2377767 00:19:23.702 04:21:14 -- common/autotest_common.sh@829 -- # '[' -z 2377767 ']' 00:19:23.702 04:21:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:23.702 04:21:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:23.702 04:21:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:23.702 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:23.702 04:21:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:23.702 04:21:14 -- common/autotest_common.sh@10 -- # set +x 00:19:23.960 [2024-11-30 04:21:14.353506] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:23.960 [2024-11-30 04:21:14.353588] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:23.960 EAL: No free 2048 kB hugepages reported on node 1 00:19:23.960 [2024-11-30 04:21:14.421070] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:23.960 [2024-11-30 04:21:14.509105] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:23.960 [2024-11-30 04:21:14.509261] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:23.960 [2024-11-30 04:21:14.509279] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:23.960 [2024-11-30 04:21:14.509292] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:23.960 [2024-11-30 04:21:14.509344] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:23.960 [2024-11-30 04:21:14.509407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:23.960 [2024-11-30 04:21:14.509474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:23.960 [2024-11-30 04:21:14.509476] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:24.892 04:21:15 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:24.892 04:21:15 -- common/autotest_common.sh@862 -- # return 0 00:19:24.892 04:21:15 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:24.892 04:21:15 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:24.892 04:21:15 -- common/autotest_common.sh@10 -- # set +x 00:19:24.892 04:21:15 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:24.892 04:21:15 -- target/fio.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:19:25.149 [2024-11-30 04:21:15.631626] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:25.149 04:21:15 -- target/fio.sh@21 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:25.407 04:21:15 -- target/fio.sh@21 -- # malloc_bdevs='Malloc0 ' 00:19:25.407 04:21:15 -- target/fio.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:25.665 04:21:16 -- target/fio.sh@22 -- # malloc_bdevs+=Malloc1 00:19:25.665 04:21:16 -- target/fio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:25.923 04:21:16 -- target/fio.sh@24 -- # raid_malloc_bdevs='Malloc2 ' 00:19:25.923 04:21:16 -- target/fio.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:26.182 04:21:16 -- target/fio.sh@25 -- # raid_malloc_bdevs+=Malloc3 00:19:26.182 04:21:16 -- target/fio.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n raid0 -z 64 -r 0 -b 'Malloc2 Malloc3' 00:19:26.438 04:21:17 -- target/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:26.695 04:21:17 -- target/fio.sh@29 -- # concat_malloc_bdevs='Malloc4 ' 00:19:26.695 04:21:17 -- target/fio.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:26.952 04:21:17 -- target/fio.sh@30 -- # concat_malloc_bdevs+='Malloc5 ' 00:19:26.952 04:21:17 -- target/fio.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:19:27.210 04:21:17 -- target/fio.sh@31 -- # concat_malloc_bdevs+=Malloc6 00:19:27.210 04:21:17 -- target/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_create -n concat0 -r concat -z 64 -b 'Malloc4 Malloc5 Malloc6' 00:19:27.468 04:21:18 -- target/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:19:27.726 04:21:18 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:27.726 04:21:18 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:27.984 04:21:18 -- target/fio.sh@35 -- # for malloc_bdev in $malloc_bdevs 00:19:27.984 04:21:18 -- target/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:19:28.241 04:21:18 -- target/fio.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:28.499 [2024-11-30 04:21:19.043182] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:28.499 04:21:19 -- target/fio.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 raid0 00:19:28.756 04:21:19 -- target/fio.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 concat0 00:19:29.014 04:21:19 -- target/fio.sh@46 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:19:29.948 04:21:20 -- target/fio.sh@48 -- # waitforserial SPDKISFASTANDAWESOME 4 00:19:29.948 04:21:20 -- common/autotest_common.sh@1187 -- # local i=0 00:19:29.948 04:21:20 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:19:29.948 04:21:20 -- common/autotest_common.sh@1189 -- # [[ -n 4 ]] 00:19:29.948 04:21:20 -- common/autotest_common.sh@1190 -- # nvme_device_counter=4 00:19:29.948 04:21:20 -- common/autotest_common.sh@1194 -- # sleep 2 00:19:31.848 04:21:22 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:19:31.848 04:21:22 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:19:31.848 04:21:22 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:19:31.848 04:21:22 -- common/autotest_common.sh@1196 -- # nvme_devices=4 00:19:31.848 04:21:22 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:19:31.848 04:21:22 -- common/autotest_common.sh@1197 -- # return 0 00:19:31.848 04:21:22 -- target/fio.sh@50 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 1 -v 00:19:31.848 [global] 00:19:31.848 thread=1 00:19:31.848 invalidate=1 00:19:31.848 rw=write 00:19:31.848 time_based=1 00:19:31.848 runtime=1 00:19:31.848 ioengine=libaio 00:19:31.848 direct=1 00:19:31.848 bs=4096 00:19:31.848 iodepth=1 00:19:31.848 norandommap=0 00:19:31.848 numjobs=1 00:19:31.848 00:19:31.848 verify_dump=1 00:19:31.848 verify_backlog=512 00:19:31.848 verify_state_save=0 00:19:31.848 do_verify=1 00:19:31.848 verify=crc32c-intel 00:19:31.848 [job0] 00:19:31.848 filename=/dev/nvme0n1 00:19:31.848 [job1] 00:19:31.848 filename=/dev/nvme0n2 00:19:31.848 [job2] 00:19:31.848 filename=/dev/nvme0n3 00:19:31.848 [job3] 00:19:31.848 filename=/dev/nvme0n4 00:19:31.848 Could not set queue depth (nvme0n1) 00:19:31.848 Could not set queue depth (nvme0n2) 00:19:31.848 Could not set queue depth (nvme0n3) 00:19:31.848 Could not set queue depth (nvme0n4) 00:19:32.106 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.106 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.106 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.106 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:32.106 fio-3.35 00:19:32.106 Starting 4 threads 00:19:33.479 00:19:33.479 job0: (groupid=0, jobs=1): err= 0: pid=2378880: Sat Nov 30 04:21:23 2024 00:19:33.479 read: IOPS=21, BW=87.1KiB/s (89.2kB/s)(88.0KiB/1010msec) 00:19:33.479 slat (nsec): min=15490, max=43484, avg=27449.50, stdev=9354.60 00:19:33.479 clat (usec): min=373, max=42108, avg=39284.02, stdev=8701.10 00:19:33.479 lat (usec): min=408, max=42128, avg=39311.47, stdev=8699.35 00:19:33.479 clat percentiles (usec): 00:19:33.479 | 1.00th=[ 375], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:19:33.479 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:33.479 | 70.00th=[41157], 80.00th=[41157], 90.00th=[42206], 95.00th=[42206], 00:19:33.479 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:19:33.479 | 99.99th=[42206] 00:19:33.479 write: IOPS=506, BW=2028KiB/s (2076kB/s)(2048KiB/1010msec); 0 zone resets 00:19:33.479 slat (nsec): min=8408, max=60207, avg=22050.58, stdev=8270.41 00:19:33.479 clat (usec): min=153, max=653, avg=255.42, stdev=61.78 00:19:33.479 lat (usec): min=163, max=672, avg=277.47, stdev=61.43 00:19:33.479 clat percentiles (usec): 00:19:33.479 | 1.00th=[ 172], 5.00th=[ 188], 10.00th=[ 194], 20.00th=[ 202], 00:19:33.479 | 30.00th=[ 210], 40.00th=[ 227], 50.00th=[ 241], 60.00th=[ 260], 00:19:33.479 | 70.00th=[ 281], 80.00th=[ 302], 90.00th=[ 338], 95.00th=[ 379], 00:19:33.479 | 99.00th=[ 437], 99.50th=[ 449], 99.90th=[ 652], 99.95th=[ 652], 00:19:33.479 | 99.99th=[ 652] 00:19:33.479 bw ( KiB/s): min= 4096, max= 4096, per=34.03%, avg=4096.00, stdev= 0.00, samples=1 00:19:33.479 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:33.479 lat (usec) : 250=52.25%, 500=43.63%, 750=0.19% 00:19:33.479 lat (msec) : 50=3.93% 00:19:33.479 cpu : usr=0.89%, sys=1.39%, ctx=535, majf=0, minf=1 00:19:33.479 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:33.479 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.479 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.479 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:33.479 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:33.479 job1: (groupid=0, jobs=1): err= 0: pid=2378881: Sat Nov 30 04:21:23 2024 00:19:33.479 read: IOPS=1104, BW=4420KiB/s (4526kB/s)(4424KiB/1001msec) 00:19:33.479 slat (nsec): min=7132, max=48762, avg=12108.77, stdev=5379.97 00:19:33.479 clat (usec): min=184, max=41033, avg=567.00, stdev=3655.32 00:19:33.479 lat (usec): min=192, max=41050, avg=579.11, stdev=3656.67 00:19:33.479 clat percentiles (usec): 00:19:33.479 | 1.00th=[ 190], 5.00th=[ 196], 10.00th=[ 202], 20.00th=[ 215], 00:19:33.479 | 30.00th=[ 225], 40.00th=[ 233], 50.00th=[ 237], 60.00th=[ 243], 00:19:33.479 | 70.00th=[ 249], 80.00th=[ 255], 90.00th=[ 269], 95.00th=[ 277], 00:19:33.479 | 99.00th=[ 322], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:33.479 | 99.99th=[41157] 00:19:33.479 write: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec); 0 zone resets 00:19:33.479 slat (nsec): min=8158, max=69510, avg=20896.44, stdev=6650.97 00:19:33.479 clat (usec): min=136, max=673, avg=205.23, stdev=61.00 00:19:33.479 lat (usec): min=146, max=685, avg=226.12, stdev=61.19 00:19:33.479 clat percentiles (usec): 00:19:33.479 | 1.00th=[ 145], 5.00th=[ 159], 10.00th=[ 167], 20.00th=[ 172], 00:19:33.479 | 30.00th=[ 176], 40.00th=[ 178], 50.00th=[ 182], 60.00th=[ 190], 00:19:33.479 | 70.00th=[ 204], 80.00th=[ 227], 90.00th=[ 269], 95.00th=[ 343], 00:19:33.479 | 99.00th=[ 461], 99.50th=[ 490], 99.90th=[ 529], 99.95th=[ 676], 00:19:33.479 | 99.99th=[ 676] 00:19:33.479 bw ( KiB/s): min= 4096, max= 4096, per=34.03%, avg=4096.00, stdev= 0.00, samples=1 00:19:33.479 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:33.479 lat (usec) : 250=80.73%, 500=18.77%, 750=0.15% 00:19:33.479 lat (msec) : 50=0.34% 00:19:33.479 cpu : usr=3.40%, sys=5.80%, ctx=2644, majf=0, minf=1 00:19:33.479 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:33.479 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.479 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.479 issued rwts: total=1106,1536,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:33.479 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:33.479 job2: (groupid=0, jobs=1): err= 0: pid=2378882: Sat Nov 30 04:21:23 2024 00:19:33.479 read: IOPS=21, BW=86.2KiB/s (88.3kB/s)(88.0KiB/1021msec) 00:19:33.479 slat (nsec): min=16107, max=37067, avg=25643.77, stdev=9266.80 00:19:33.479 clat (usec): min=40876, max=43994, avg=41093.96, stdev=649.34 00:19:33.479 lat (usec): min=40913, max=44014, avg=41119.60, stdev=647.84 00:19:33.479 clat percentiles (usec): 00:19:33.479 | 1.00th=[40633], 5.00th=[40633], 10.00th=[40633], 20.00th=[41157], 00:19:33.479 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:33.479 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:33.479 | 99.00th=[43779], 99.50th=[43779], 99.90th=[43779], 99.95th=[43779], 00:19:33.479 | 99.99th=[43779] 00:19:33.479 write: IOPS=501, BW=2006KiB/s (2054kB/s)(2048KiB/1021msec); 0 zone resets 00:19:33.479 slat (nsec): min=7998, max=60575, avg=18800.32, stdev=8366.46 00:19:33.479 clat (usec): min=156, max=655, avg=203.50, stdev=40.70 00:19:33.479 lat (usec): min=165, max=668, avg=222.30, stdev=43.31 00:19:33.479 clat percentiles (usec): 00:19:33.479 | 1.00th=[ 159], 5.00th=[ 167], 10.00th=[ 174], 20.00th=[ 182], 00:19:33.479 | 30.00th=[ 190], 40.00th=[ 196], 50.00th=[ 200], 60.00th=[ 204], 00:19:33.479 | 70.00th=[ 208], 80.00th=[ 217], 90.00th=[ 225], 95.00th=[ 235], 00:19:33.479 | 99.00th=[ 355], 99.50th=[ 396], 99.90th=[ 660], 99.95th=[ 660], 00:19:33.479 | 99.99th=[ 660] 00:19:33.479 bw ( KiB/s): min= 4096, max= 4096, per=34.03%, avg=4096.00, stdev= 0.00, samples=1 00:19:33.479 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:33.479 lat (usec) : 250=92.70%, 500=2.81%, 750=0.37% 00:19:33.479 lat (msec) : 50=4.12% 00:19:33.479 cpu : usr=0.20%, sys=1.67%, ctx=535, majf=0, minf=1 00:19:33.479 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:33.479 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.479 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.479 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:33.479 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:33.480 job3: (groupid=0, jobs=1): err= 0: pid=2378883: Sat Nov 30 04:21:23 2024 00:19:33.480 read: IOPS=365, BW=1461KiB/s (1496kB/s)(1484KiB/1016msec) 00:19:33.480 slat (nsec): min=8102, max=37004, avg=12825.09, stdev=6092.04 00:19:33.480 clat (usec): min=204, max=41120, avg=2322.39, stdev=8981.15 00:19:33.480 lat (usec): min=213, max=41142, avg=2335.21, stdev=8984.58 00:19:33.480 clat percentiles (usec): 00:19:33.480 | 1.00th=[ 210], 5.00th=[ 215], 10.00th=[ 219], 20.00th=[ 223], 00:19:33.480 | 30.00th=[ 227], 40.00th=[ 231], 50.00th=[ 237], 60.00th=[ 241], 00:19:33.480 | 70.00th=[ 247], 80.00th=[ 255], 90.00th=[ 273], 95.00th=[40109], 00:19:33.480 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:33.480 | 99.99th=[41157] 00:19:33.480 write: IOPS=503, BW=2016KiB/s (2064kB/s)(2048KiB/1016msec); 0 zone resets 00:19:33.480 slat (nsec): min=7037, max=54130, avg=21012.24, stdev=7816.33 00:19:33.480 clat (usec): min=171, max=643, avg=262.57, stdev=79.22 00:19:33.480 lat (usec): min=185, max=656, avg=283.58, stdev=79.03 00:19:33.480 clat percentiles (usec): 00:19:33.480 | 1.00th=[ 182], 5.00th=[ 192], 10.00th=[ 198], 20.00th=[ 206], 00:19:33.480 | 30.00th=[ 215], 40.00th=[ 223], 50.00th=[ 233], 60.00th=[ 241], 00:19:33.480 | 70.00th=[ 262], 80.00th=[ 310], 90.00th=[ 400], 95.00th=[ 445], 00:19:33.480 | 99.00th=[ 494], 99.50th=[ 515], 99.90th=[ 644], 99.95th=[ 644], 00:19:33.480 | 99.99th=[ 644] 00:19:33.480 bw ( KiB/s): min= 4096, max= 4096, per=34.03%, avg=4096.00, stdev= 0.00, samples=1 00:19:33.480 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:33.480 lat (usec) : 250=68.86%, 500=28.31%, 750=0.68% 00:19:33.480 lat (msec) : 50=2.15% 00:19:33.480 cpu : usr=0.99%, sys=1.77%, ctx=884, majf=0, minf=1 00:19:33.480 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:33.480 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.480 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:33.480 issued rwts: total=371,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:33.480 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:33.480 00:19:33.480 Run status group 0 (all jobs): 00:19:33.480 READ: bw=5959KiB/s (6102kB/s), 86.2KiB/s-4420KiB/s (88.3kB/s-4526kB/s), io=6084KiB (6230kB), run=1001-1021msec 00:19:33.480 WRITE: bw=11.8MiB/s (12.3MB/s), 2006KiB/s-6138KiB/s (2054kB/s-6285kB/s), io=12.0MiB (12.6MB), run=1001-1021msec 00:19:33.480 00:19:33.480 Disk stats (read/write): 00:19:33.480 nvme0n1: ios=68/512, merge=0/0, ticks=851/127, in_queue=978, util=85.97% 00:19:33.480 nvme0n2: ios=962/1024, merge=0/0, ticks=1490/211, in_queue=1701, util=89.94% 00:19:33.480 nvme0n3: ios=41/512, merge=0/0, ticks=1640/102, in_queue=1742, util=93.54% 00:19:33.480 nvme0n4: ios=431/512, merge=0/0, ticks=819/131, in_queue=950, util=95.49% 00:19:33.480 04:21:23 -- target/fio.sh@51 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t randwrite -r 1 -v 00:19:33.480 [global] 00:19:33.480 thread=1 00:19:33.480 invalidate=1 00:19:33.480 rw=randwrite 00:19:33.480 time_based=1 00:19:33.480 runtime=1 00:19:33.480 ioengine=libaio 00:19:33.480 direct=1 00:19:33.480 bs=4096 00:19:33.480 iodepth=1 00:19:33.480 norandommap=0 00:19:33.480 numjobs=1 00:19:33.480 00:19:33.480 verify_dump=1 00:19:33.480 verify_backlog=512 00:19:33.480 verify_state_save=0 00:19:33.480 do_verify=1 00:19:33.480 verify=crc32c-intel 00:19:33.480 [job0] 00:19:33.480 filename=/dev/nvme0n1 00:19:33.480 [job1] 00:19:33.480 filename=/dev/nvme0n2 00:19:33.480 [job2] 00:19:33.480 filename=/dev/nvme0n3 00:19:33.480 [job3] 00:19:33.480 filename=/dev/nvme0n4 00:19:33.480 Could not set queue depth (nvme0n1) 00:19:33.480 Could not set queue depth (nvme0n2) 00:19:33.480 Could not set queue depth (nvme0n3) 00:19:33.480 Could not set queue depth (nvme0n4) 00:19:33.480 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:33.480 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:33.480 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:33.480 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:33.480 fio-3.35 00:19:33.480 Starting 4 threads 00:19:34.851 00:19:34.851 job0: (groupid=0, jobs=1): err= 0: pid=2379111: Sat Nov 30 04:21:25 2024 00:19:34.851 read: IOPS=928, BW=3712KiB/s (3801kB/s)(3716KiB/1001msec) 00:19:34.851 slat (nsec): min=4754, max=73807, avg=24579.80, stdev=12556.23 00:19:34.851 clat (usec): min=194, max=41086, avg=808.78, stdev=4193.22 00:19:34.851 lat (usec): min=201, max=41104, avg=833.36, stdev=4193.03 00:19:34.851 clat percentiles (usec): 00:19:34.851 | 1.00th=[ 221], 5.00th=[ 258], 10.00th=[ 277], 20.00th=[ 297], 00:19:34.851 | 30.00th=[ 314], 40.00th=[ 330], 50.00th=[ 363], 60.00th=[ 388], 00:19:34.851 | 70.00th=[ 424], 80.00th=[ 453], 90.00th=[ 490], 95.00th=[ 537], 00:19:34.851 | 99.00th=[40633], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:34.851 | 99.99th=[41157] 00:19:34.851 write: IOPS=1022, BW=4092KiB/s (4190kB/s)(4096KiB/1001msec); 0 zone resets 00:19:34.851 slat (nsec): min=6345, max=43293, avg=12621.41, stdev=4985.94 00:19:34.851 clat (usec): min=138, max=258, avg=194.41, stdev=26.44 00:19:34.851 lat (usec): min=154, max=278, avg=207.04, stdev=23.83 00:19:34.851 clat percentiles (usec): 00:19:34.851 | 1.00th=[ 143], 5.00th=[ 151], 10.00th=[ 155], 20.00th=[ 165], 00:19:34.851 | 30.00th=[ 178], 40.00th=[ 190], 50.00th=[ 202], 60.00th=[ 208], 00:19:34.851 | 70.00th=[ 212], 80.00th=[ 219], 90.00th=[ 225], 95.00th=[ 233], 00:19:34.851 | 99.00th=[ 243], 99.50th=[ 243], 99.90th=[ 253], 99.95th=[ 260], 00:19:34.851 | 99.99th=[ 260] 00:19:34.851 bw ( KiB/s): min= 4096, max= 4096, per=28.44%, avg=4096.00, stdev= 0.00, samples=1 00:19:34.851 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:34.851 lat (usec) : 250=54.48%, 500=41.63%, 750=3.38% 00:19:34.851 lat (msec) : 50=0.51% 00:19:34.851 cpu : usr=2.00%, sys=3.50%, ctx=1955, majf=0, minf=1 00:19:34.851 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:34.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:34.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:34.851 issued rwts: total=929,1024,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:34.851 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:34.851 job1: (groupid=0, jobs=1): err= 0: pid=2379118: Sat Nov 30 04:21:25 2024 00:19:34.851 read: IOPS=1534, BW=6138KiB/s (6285kB/s)(6144KiB/1001msec) 00:19:34.851 slat (nsec): min=5451, max=70423, avg=12269.62, stdev=6016.21 00:19:34.851 clat (usec): min=175, max=41346, avg=352.94, stdev=1050.49 00:19:34.851 lat (usec): min=184, max=41355, avg=365.21, stdev=1050.61 00:19:34.851 clat percentiles (usec): 00:19:34.851 | 1.00th=[ 192], 5.00th=[ 241], 10.00th=[ 249], 20.00th=[ 265], 00:19:34.851 | 30.00th=[ 277], 40.00th=[ 285], 50.00th=[ 302], 60.00th=[ 318], 00:19:34.851 | 70.00th=[ 343], 80.00th=[ 383], 90.00th=[ 457], 95.00th=[ 498], 00:19:34.851 | 99.00th=[ 570], 99.50th=[ 603], 99.90th=[ 1631], 99.95th=[41157], 00:19:34.851 | 99.99th=[41157] 00:19:34.851 write: IOPS=1673, BW=6693KiB/s (6854kB/s)(6700KiB/1001msec); 0 zone resets 00:19:34.851 slat (nsec): min=6217, max=58008, avg=17916.65, stdev=7995.76 00:19:34.851 clat (usec): min=128, max=474, avg=235.45, stdev=43.97 00:19:34.851 lat (usec): min=138, max=490, avg=253.36, stdev=45.14 00:19:34.851 clat percentiles (usec): 00:19:34.851 | 1.00th=[ 172], 5.00th=[ 188], 10.00th=[ 196], 20.00th=[ 204], 00:19:34.851 | 30.00th=[ 212], 40.00th=[ 221], 50.00th=[ 227], 60.00th=[ 237], 00:19:34.851 | 70.00th=[ 245], 80.00th=[ 251], 90.00th=[ 289], 95.00th=[ 326], 00:19:34.851 | 99.00th=[ 412], 99.50th=[ 424], 99.90th=[ 461], 99.95th=[ 474], 00:19:34.851 | 99.99th=[ 474] 00:19:34.851 bw ( KiB/s): min= 8192, max= 8192, per=56.88%, avg=8192.00, stdev= 0.00, samples=1 00:19:34.851 iops : min= 2048, max= 2048, avg=2048.00, stdev= 0.00, samples=1 00:19:34.851 lat (usec) : 250=46.59%, 500=51.07%, 750=2.24% 00:19:34.851 lat (msec) : 2=0.06%, 50=0.03% 00:19:34.851 cpu : usr=4.70%, sys=5.50%, ctx=3211, majf=0, minf=1 00:19:34.851 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:34.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:34.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:34.851 issued rwts: total=1536,1675,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:34.851 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:34.851 job2: (groupid=0, jobs=1): err= 0: pid=2379119: Sat Nov 30 04:21:25 2024 00:19:34.851 read: IOPS=214, BW=859KiB/s (879kB/s)(888KiB/1034msec) 00:19:34.851 slat (nsec): min=5580, max=54584, avg=8186.51, stdev=6740.74 00:19:34.851 clat (usec): min=174, max=41054, avg=4051.70, stdev=11961.32 00:19:34.851 lat (usec): min=181, max=41072, avg=4059.89, stdev=11967.04 00:19:34.851 clat percentiles (usec): 00:19:34.851 | 1.00th=[ 176], 5.00th=[ 180], 10.00th=[ 184], 20.00th=[ 188], 00:19:34.851 | 30.00th=[ 190], 40.00th=[ 192], 50.00th=[ 194], 60.00th=[ 198], 00:19:34.851 | 70.00th=[ 202], 80.00th=[ 206], 90.00th=[ 233], 95.00th=[41157], 00:19:34.851 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:34.851 | 99.99th=[41157] 00:19:34.851 write: IOPS=495, BW=1981KiB/s (2028kB/s)(2048KiB/1034msec); 0 zone resets 00:19:34.851 slat (nsec): min=5891, max=49399, avg=9517.30, stdev=5553.56 00:19:34.851 clat (usec): min=138, max=485, avg=246.14, stdev=49.02 00:19:34.851 lat (usec): min=149, max=492, avg=255.66, stdev=49.49 00:19:34.851 clat percentiles (usec): 00:19:34.851 | 1.00th=[ 167], 5.00th=[ 180], 10.00th=[ 186], 20.00th=[ 229], 00:19:34.851 | 30.00th=[ 239], 40.00th=[ 241], 50.00th=[ 245], 60.00th=[ 247], 00:19:34.851 | 70.00th=[ 249], 80.00th=[ 255], 90.00th=[ 273], 95.00th=[ 383], 00:19:34.851 | 99.00th=[ 429], 99.50th=[ 437], 99.90th=[ 486], 99.95th=[ 486], 00:19:34.851 | 99.99th=[ 486] 00:19:34.851 bw ( KiB/s): min= 4096, max= 4096, per=28.44%, avg=4096.00, stdev= 0.00, samples=1 00:19:34.851 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:34.851 lat (usec) : 250=81.06%, 500=16.08% 00:19:34.851 lat (msec) : 50=2.86% 00:19:34.851 cpu : usr=0.39%, sys=0.58%, ctx=734, majf=0, minf=2 00:19:34.851 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:34.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:34.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:34.851 issued rwts: total=222,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:34.851 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:34.851 job3: (groupid=0, jobs=1): err= 0: pid=2379120: Sat Nov 30 04:21:25 2024 00:19:34.851 read: IOPS=21, BW=86.6KiB/s (88.7kB/s)(88.0KiB/1016msec) 00:19:34.851 slat (nsec): min=13337, max=35263, avg=25814.91, stdev=9092.71 00:19:34.851 clat (usec): min=40549, max=41024, avg=40947.59, stdev=93.88 00:19:34.851 lat (usec): min=40564, max=41042, avg=40973.40, stdev=94.93 00:19:34.851 clat percentiles (usec): 00:19:34.851 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:19:34.851 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:34.851 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:34.851 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:34.851 | 99.99th=[41157] 00:19:34.851 write: IOPS=503, BW=2016KiB/s (2064kB/s)(2048KiB/1016msec); 0 zone resets 00:19:34.851 slat (nsec): min=5882, max=29793, avg=8122.09, stdev=3258.76 00:19:34.851 clat (usec): min=159, max=261, avg=213.29, stdev=13.84 00:19:34.851 lat (usec): min=168, max=268, avg=221.42, stdev=13.44 00:19:34.851 clat percentiles (usec): 00:19:34.851 | 1.00th=[ 167], 5.00th=[ 192], 10.00th=[ 200], 20.00th=[ 204], 00:19:34.851 | 30.00th=[ 208], 40.00th=[ 212], 50.00th=[ 215], 60.00th=[ 217], 00:19:34.851 | 70.00th=[ 219], 80.00th=[ 223], 90.00th=[ 231], 95.00th=[ 237], 00:19:34.851 | 99.00th=[ 245], 99.50th=[ 249], 99.90th=[ 262], 99.95th=[ 262], 00:19:34.851 | 99.99th=[ 262] 00:19:34.851 bw ( KiB/s): min= 4096, max= 4096, per=28.44%, avg=4096.00, stdev= 0.00, samples=1 00:19:34.851 iops : min= 1024, max= 1024, avg=1024.00, stdev= 0.00, samples=1 00:19:34.851 lat (usec) : 250=95.51%, 500=0.37% 00:19:34.851 lat (msec) : 50=4.12% 00:19:34.851 cpu : usr=0.30%, sys=0.30%, ctx=534, majf=0, minf=1 00:19:34.851 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:34.851 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:34.851 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:34.851 issued rwts: total=22,512,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:34.851 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:34.851 00:19:34.851 Run status group 0 (all jobs): 00:19:34.851 READ: bw=10.2MiB/s (10.7MB/s), 86.6KiB/s-6138KiB/s (88.7kB/s-6285kB/s), io=10.6MiB (11.1MB), run=1001-1034msec 00:19:34.851 WRITE: bw=14.1MiB/s (14.7MB/s), 1981KiB/s-6693KiB/s (2028kB/s-6854kB/s), io=14.5MiB (15.2MB), run=1001-1034msec 00:19:34.852 00:19:34.852 Disk stats (read/write): 00:19:34.852 nvme0n1: ios=615/1024, merge=0/0, ticks=1529/191, in_queue=1720, util=96.79% 00:19:34.852 nvme0n2: ios=1353/1536, merge=0/0, ticks=460/345, in_queue=805, util=87.92% 00:19:34.852 nvme0n3: ios=274/512, merge=0/0, ticks=771/120, in_queue=891, util=90.51% 00:19:34.852 nvme0n4: ios=44/512, merge=0/0, ticks=969/104, in_queue=1073, util=93.48% 00:19:34.852 04:21:25 -- target/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t write -r 1 -v 00:19:34.852 [global] 00:19:34.852 thread=1 00:19:34.852 invalidate=1 00:19:34.852 rw=write 00:19:34.852 time_based=1 00:19:34.852 runtime=1 00:19:34.852 ioengine=libaio 00:19:34.852 direct=1 00:19:34.852 bs=4096 00:19:34.852 iodepth=128 00:19:34.852 norandommap=0 00:19:34.852 numjobs=1 00:19:34.852 00:19:34.852 verify_dump=1 00:19:34.852 verify_backlog=512 00:19:34.852 verify_state_save=0 00:19:34.852 do_verify=1 00:19:34.852 verify=crc32c-intel 00:19:34.852 [job0] 00:19:34.852 filename=/dev/nvme0n1 00:19:34.852 [job1] 00:19:34.852 filename=/dev/nvme0n2 00:19:34.852 [job2] 00:19:34.852 filename=/dev/nvme0n3 00:19:34.852 [job3] 00:19:34.852 filename=/dev/nvme0n4 00:19:34.852 Could not set queue depth (nvme0n1) 00:19:34.852 Could not set queue depth (nvme0n2) 00:19:34.852 Could not set queue depth (nvme0n3) 00:19:34.852 Could not set queue depth (nvme0n4) 00:19:34.852 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:34.852 job1: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:34.852 job2: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:34.852 job3: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:34.852 fio-3.35 00:19:34.852 Starting 4 threads 00:19:36.228 00:19:36.228 job0: (groupid=0, jobs=1): err= 0: pid=2379385: Sat Nov 30 04:21:26 2024 00:19:36.228 read: IOPS=5320, BW=20.8MiB/s (21.8MB/s)(20.8MiB/1002msec) 00:19:36.228 slat (usec): min=2, max=3599, avg=83.73, stdev=441.05 00:19:36.228 clat (usec): min=593, max=15108, avg=11131.90, stdev=1216.21 00:19:36.228 lat (usec): min=3175, max=16229, avg=11215.64, stdev=1247.77 00:19:36.228 clat percentiles (usec): 00:19:36.228 | 1.00th=[ 6849], 5.00th=[ 8979], 10.00th=[10028], 20.00th=[10683], 00:19:36.228 | 30.00th=[10945], 40.00th=[11076], 50.00th=[11207], 60.00th=[11338], 00:19:36.228 | 70.00th=[11600], 80.00th=[11731], 90.00th=[12125], 95.00th=[12649], 00:19:36.228 | 99.00th=[13960], 99.50th=[14222], 99.90th=[14615], 99.95th=[14877], 00:19:36.228 | 99.99th=[15139] 00:19:36.228 write: IOPS=5620, BW=22.0MiB/s (23.0MB/s)(22.0MiB/1002msec); 0 zone resets 00:19:36.228 slat (usec): min=3, max=24848, avg=88.77, stdev=608.84 00:19:36.228 clat (usec): min=740, max=48329, avg=12033.12, stdev=3947.99 00:19:36.228 lat (usec): min=810, max=48333, avg=12121.89, stdev=3976.35 00:19:36.228 clat percentiles (usec): 00:19:36.228 | 1.00th=[ 7832], 5.00th=[ 8586], 10.00th=[ 9241], 20.00th=[10814], 00:19:36.228 | 30.00th=[11207], 40.00th=[11600], 50.00th=[11731], 60.00th=[11994], 00:19:36.228 | 70.00th=[12125], 80.00th=[12256], 90.00th=[12780], 95.00th=[14222], 00:19:36.228 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:36.228 | 99.99th=[48497] 00:19:36.228 bw ( KiB/s): min=22528, max=22528, per=29.63%, avg=22528.00, stdev= 0.00, samples=1 00:19:36.228 iops : min= 5632, max= 5632, avg=5632.00, stdev= 0.00, samples=1 00:19:36.228 lat (usec) : 750=0.02% 00:19:36.228 lat (msec) : 4=0.38%, 10=11.90%, 20=85.96%, 50=1.73% 00:19:36.228 cpu : usr=7.49%, sys=9.59%, ctx=402, majf=0, minf=1 00:19:36.228 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.3%, >=64=99.4% 00:19:36.228 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.228 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:36.228 issued rwts: total=5331,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.228 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:36.228 job1: (groupid=0, jobs=1): err= 0: pid=2379404: Sat Nov 30 04:21:26 2024 00:19:36.228 read: IOPS=4063, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1008msec) 00:19:36.228 slat (usec): min=2, max=11828, avg=111.86, stdev=722.08 00:19:36.228 clat (usec): min=4505, max=43937, avg=14576.17, stdev=5779.24 00:19:36.228 lat (usec): min=4974, max=43952, avg=14688.03, stdev=5824.66 00:19:36.228 clat percentiles (usec): 00:19:36.228 | 1.00th=[ 5800], 5.00th=[ 8979], 10.00th=[ 9896], 20.00th=[11076], 00:19:36.228 | 30.00th=[11338], 40.00th=[12125], 50.00th=[12780], 60.00th=[13566], 00:19:36.228 | 70.00th=[14877], 80.00th=[17171], 90.00th=[21103], 95.00th=[29230], 00:19:36.228 | 99.00th=[37487], 99.50th=[38011], 99.90th=[38011], 99.95th=[39060], 00:19:36.228 | 99.99th=[43779] 00:19:36.228 write: IOPS=4418, BW=17.3MiB/s (18.1MB/s)(17.4MiB/1008msec); 0 zone resets 00:19:36.228 slat (usec): min=3, max=16083, avg=114.05, stdev=704.09 00:19:36.228 clat (usec): min=1465, max=37816, avg=15084.89, stdev=5482.05 00:19:36.228 lat (usec): min=3903, max=37821, avg=15198.94, stdev=5544.04 00:19:36.228 clat percentiles (usec): 00:19:36.229 | 1.00th=[ 4752], 5.00th=[ 6390], 10.00th=[ 9241], 20.00th=[12518], 00:19:36.229 | 30.00th=[12780], 40.00th=[13042], 50.00th=[13435], 60.00th=[14222], 00:19:36.229 | 70.00th=[15664], 80.00th=[19268], 90.00th=[24511], 95.00th=[26084], 00:19:36.229 | 99.00th=[32637], 99.50th=[32900], 99.90th=[34866], 99.95th=[35914], 00:19:36.229 | 99.99th=[38011] 00:19:36.229 bw ( KiB/s): min=15568, max=19040, per=22.76%, avg=17304.00, stdev=2455.07, samples=2 00:19:36.229 iops : min= 3892, max= 4760, avg=4326.00, stdev=613.77, samples=2 00:19:36.229 lat (msec) : 2=0.01%, 4=0.02%, 10=11.16%, 20=71.38%, 50=17.43% 00:19:36.229 cpu : usr=4.67%, sys=7.65%, ctx=468, majf=0, minf=1 00:19:36.229 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:36.229 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.229 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:36.229 issued rwts: total=4096,4454,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.229 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:36.229 job2: (groupid=0, jobs=1): err= 0: pid=2379436: Sat Nov 30 04:21:26 2024 00:19:36.229 read: IOPS=4510, BW=17.6MiB/s (18.5MB/s)(18.5MiB/1049msec) 00:19:36.229 slat (usec): min=2, max=29430, avg=106.17, stdev=863.16 00:19:36.229 clat (usec): min=4002, max=72507, avg=14894.73, stdev=9828.99 00:19:36.229 lat (usec): min=4007, max=72517, avg=15000.91, stdev=9857.53 00:19:36.229 clat percentiles (usec): 00:19:36.229 | 1.00th=[ 5735], 5.00th=[ 9765], 10.00th=[10683], 20.00th=[11469], 00:19:36.229 | 30.00th=[11994], 40.00th=[12387], 50.00th=[12649], 60.00th=[12780], 00:19:36.229 | 70.00th=[13173], 80.00th=[15795], 90.00th=[19530], 95.00th=[22938], 00:19:36.229 | 99.00th=[71828], 99.50th=[71828], 99.90th=[72877], 99.95th=[72877], 00:19:36.229 | 99.99th=[72877] 00:19:36.229 write: IOPS=4880, BW=19.1MiB/s (20.0MB/s)(20.0MiB/1049msec); 0 zone resets 00:19:36.229 slat (usec): min=3, max=20028, avg=83.00, stdev=611.20 00:19:36.229 clat (usec): min=819, max=72560, avg=12221.13, stdev=4195.78 00:19:36.229 lat (usec): min=835, max=90332, avg=12304.13, stdev=4282.62 00:19:36.229 clat percentiles (usec): 00:19:36.229 | 1.00th=[ 2802], 5.00th=[ 5211], 10.00th=[ 6849], 20.00th=[ 8717], 00:19:36.229 | 30.00th=[10945], 40.00th=[12518], 50.00th=[13042], 60.00th=[13304], 00:19:36.229 | 70.00th=[13566], 80.00th=[13829], 90.00th=[14877], 95.00th=[20055], 00:19:36.229 | 99.00th=[22414], 99.50th=[24249], 99.90th=[28705], 99.95th=[72877], 00:19:36.229 | 99.99th=[72877] 00:19:36.229 bw ( KiB/s): min=20448, max=20480, per=26.92%, avg=20464.00, stdev=22.63, samples=2 00:19:36.229 iops : min= 5112, max= 5120, avg=5116.00, stdev= 5.66, samples=2 00:19:36.229 lat (usec) : 1000=0.06% 00:19:36.229 lat (msec) : 2=0.22%, 4=0.79%, 10=13.87%, 20=78.19%, 50=5.59% 00:19:36.229 lat (msec) : 100=1.28% 00:19:36.229 cpu : usr=3.34%, sys=6.11%, ctx=504, majf=0, minf=1 00:19:36.229 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.4% 00:19:36.229 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.229 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:36.229 issued rwts: total=4732,5120,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.229 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:36.229 job3: (groupid=0, jobs=1): err= 0: pid=2379447: Sat Nov 30 04:21:26 2024 00:19:36.229 read: IOPS=4585, BW=17.9MiB/s (18.8MB/s)(18.0MiB/1005msec) 00:19:36.229 slat (usec): min=3, max=8417, avg=108.70, stdev=666.05 00:19:36.229 clat (usec): min=7473, max=28970, avg=13427.13, stdev=3161.17 00:19:36.229 lat (usec): min=7488, max=28983, avg=13535.82, stdev=3210.30 00:19:36.229 clat percentiles (usec): 00:19:36.229 | 1.00th=[ 8160], 5.00th=[10028], 10.00th=[11469], 20.00th=[11863], 00:19:36.229 | 30.00th=[11994], 40.00th=[12125], 50.00th=[12256], 60.00th=[12387], 00:19:36.229 | 70.00th=[13042], 80.00th=[15008], 90.00th=[17433], 95.00th=[20579], 00:19:36.229 | 99.00th=[24249], 99.50th=[25822], 99.90th=[28181], 99.95th=[28181], 00:19:36.229 | 99.99th=[28967] 00:19:36.229 write: IOPS=4708, BW=18.4MiB/s (19.3MB/s)(18.5MiB/1005msec); 0 zone resets 00:19:36.229 slat (usec): min=4, max=8661, avg=96.32, stdev=498.84 00:19:36.229 clat (usec): min=533, max=27361, avg=13815.67, stdev=2637.31 00:19:36.229 lat (usec): min=4963, max=27389, avg=13911.99, stdev=2670.59 00:19:36.229 clat percentiles (usec): 00:19:36.229 | 1.00th=[ 5866], 5.00th=[10290], 10.00th=[12256], 20.00th=[12780], 00:19:36.229 | 30.00th=[13042], 40.00th=[13173], 50.00th=[13304], 60.00th=[13566], 00:19:36.229 | 70.00th=[13829], 80.00th=[14877], 90.00th=[16712], 95.00th=[17695], 00:19:36.229 | 99.00th=[23725], 99.50th=[25822], 99.90th=[27395], 99.95th=[27395], 00:19:36.229 | 99.99th=[27395] 00:19:36.229 bw ( KiB/s): min=18168, max=18736, per=24.27%, avg=18452.00, stdev=401.64, samples=2 00:19:36.229 iops : min= 4542, max= 4684, avg=4613.00, stdev=100.41, samples=2 00:19:36.229 lat (usec) : 750=0.01% 00:19:36.229 lat (msec) : 10=4.72%, 20=90.55%, 50=4.72% 00:19:36.229 cpu : usr=6.18%, sys=9.56%, ctx=512, majf=0, minf=1 00:19:36.229 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:19:36.229 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:36.229 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:36.229 issued rwts: total=4608,4732,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:36.229 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:36.229 00:19:36.229 Run status group 0 (all jobs): 00:19:36.229 READ: bw=69.9MiB/s (73.3MB/s), 15.9MiB/s-20.8MiB/s (16.6MB/s-21.8MB/s), io=73.3MiB (76.9MB), run=1002-1049msec 00:19:36.229 WRITE: bw=74.2MiB/s (77.9MB/s), 17.3MiB/s-22.0MiB/s (18.1MB/s-23.0MB/s), io=77.9MiB (81.7MB), run=1002-1049msec 00:19:36.229 00:19:36.229 Disk stats (read/write): 00:19:36.229 nvme0n1: ios=4658/4617, merge=0/0, ticks=16145/19676, in_queue=35821, util=86.87% 00:19:36.229 nvme0n2: ios=3613/3606, merge=0/0, ticks=32708/28781, in_queue=61489, util=92.68% 00:19:36.229 nvme0n3: ios=4147/4322, merge=0/0, ticks=54000/50007, in_queue=104007, util=98.96% 00:19:36.229 nvme0n4: ios=3766/4096, merge=0/0, ticks=24487/26193, in_queue=50680, util=98.84% 00:19:36.229 04:21:26 -- target/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 128 -t randwrite -r 1 -v 00:19:36.229 [global] 00:19:36.229 thread=1 00:19:36.229 invalidate=1 00:19:36.229 rw=randwrite 00:19:36.229 time_based=1 00:19:36.229 runtime=1 00:19:36.229 ioengine=libaio 00:19:36.229 direct=1 00:19:36.229 bs=4096 00:19:36.229 iodepth=128 00:19:36.229 norandommap=0 00:19:36.229 numjobs=1 00:19:36.229 00:19:36.229 verify_dump=1 00:19:36.229 verify_backlog=512 00:19:36.229 verify_state_save=0 00:19:36.229 do_verify=1 00:19:36.229 verify=crc32c-intel 00:19:36.229 [job0] 00:19:36.229 filename=/dev/nvme0n1 00:19:36.229 [job1] 00:19:36.229 filename=/dev/nvme0n2 00:19:36.229 [job2] 00:19:36.229 filename=/dev/nvme0n3 00:19:36.229 [job3] 00:19:36.229 filename=/dev/nvme0n4 00:19:36.229 Could not set queue depth (nvme0n1) 00:19:36.229 Could not set queue depth (nvme0n2) 00:19:36.229 Could not set queue depth (nvme0n3) 00:19:36.229 Could not set queue depth (nvme0n4) 00:19:36.487 job0: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:36.487 job1: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:36.487 job2: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:36.487 job3: (g=0): rw=randwrite, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=128 00:19:36.487 fio-3.35 00:19:36.487 Starting 4 threads 00:19:37.862 00:19:37.862 job0: (groupid=0, jobs=1): err= 0: pid=2379707: Sat Nov 30 04:21:28 2024 00:19:37.862 read: IOPS=3569, BW=13.9MiB/s (14.6MB/s)(14.0MiB/1004msec) 00:19:37.862 slat (usec): min=2, max=17951, avg=122.41, stdev=841.21 00:19:37.862 clat (usec): min=6240, max=48943, avg=15214.89, stdev=7423.88 00:19:37.862 lat (usec): min=6247, max=48981, avg=15337.30, stdev=7482.77 00:19:37.862 clat percentiles (usec): 00:19:37.862 | 1.00th=[ 6325], 5.00th=[ 8848], 10.00th=[ 9634], 20.00th=[10028], 00:19:37.862 | 30.00th=[10945], 40.00th=[11600], 50.00th=[12125], 60.00th=[12911], 00:19:37.862 | 70.00th=[15926], 80.00th=[20055], 90.00th=[27132], 95.00th=[33424], 00:19:37.862 | 99.00th=[38536], 99.50th=[38536], 99.90th=[43779], 99.95th=[43779], 00:19:37.862 | 99.99th=[49021] 00:19:37.862 write: IOPS=3880, BW=15.2MiB/s (15.9MB/s)(15.2MiB/1004msec); 0 zone resets 00:19:37.862 slat (usec): min=3, max=30388, avg=131.55, stdev=948.10 00:19:37.862 clat (usec): min=321, max=61500, avg=18652.96, stdev=10840.20 00:19:37.862 lat (usec): min=2427, max=61507, avg=18784.51, stdev=10902.39 00:19:37.862 clat percentiles (usec): 00:19:37.862 | 1.00th=[ 2900], 5.00th=[ 8455], 10.00th=[10290], 20.00th=[11207], 00:19:37.862 | 30.00th=[12125], 40.00th=[12649], 50.00th=[14484], 60.00th=[17695], 00:19:37.862 | 70.00th=[21627], 80.00th=[22938], 90.00th=[33817], 95.00th=[41157], 00:19:37.862 | 99.00th=[58983], 99.50th=[60031], 99.90th=[61604], 99.95th=[61604], 00:19:37.862 | 99.99th=[61604] 00:19:37.862 bw ( KiB/s): min=12288, max=17856, per=21.98%, avg=15072.00, stdev=3937.17, samples=2 00:19:37.862 iops : min= 3072, max= 4464, avg=3768.00, stdev=984.29, samples=2 00:19:37.862 lat (usec) : 500=0.01% 00:19:37.862 lat (msec) : 4=0.70%, 10=12.35%, 20=57.66%, 50=27.82%, 100=1.46% 00:19:37.862 cpu : usr=4.59%, sys=7.18%, ctx=395, majf=0, minf=1 00:19:37.862 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:37.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.862 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:37.862 issued rwts: total=3584,3896,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.862 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:37.862 job1: (groupid=0, jobs=1): err= 0: pid=2379708: Sat Nov 30 04:21:28 2024 00:19:37.862 read: IOPS=4344, BW=17.0MiB/s (17.8MB/s)(17.0MiB/1001msec) 00:19:37.862 slat (usec): min=2, max=11991, avg=98.62, stdev=610.80 00:19:37.862 clat (usec): min=787, max=34429, avg=12997.04, stdev=5108.83 00:19:37.862 lat (usec): min=1463, max=34441, avg=13095.66, stdev=5157.57 00:19:37.862 clat percentiles (usec): 00:19:37.862 | 1.00th=[ 2245], 5.00th=[ 5669], 10.00th=[ 7963], 20.00th=[ 9896], 00:19:37.862 | 30.00th=[10290], 40.00th=[10945], 50.00th=[12256], 60.00th=[13435], 00:19:37.862 | 70.00th=[14222], 80.00th=[16712], 90.00th=[18744], 95.00th=[22676], 00:19:37.862 | 99.00th=[29492], 99.50th=[31065], 99.90th=[34341], 99.95th=[34341], 00:19:37.862 | 99.99th=[34341] 00:19:37.862 write: IOPS=4603, BW=18.0MiB/s (18.9MB/s)(18.0MiB/1001msec); 0 zone resets 00:19:37.862 slat (usec): min=4, max=11331, avg=108.24, stdev=655.69 00:19:37.862 clat (usec): min=594, max=49414, avg=15280.69, stdev=7647.73 00:19:37.862 lat (usec): min=666, max=49438, avg=15388.93, stdev=7713.51 00:19:37.862 clat percentiles (usec): 00:19:37.862 | 1.00th=[ 3884], 5.00th=[ 7111], 10.00th=[ 9372], 20.00th=[10683], 00:19:37.862 | 30.00th=[10945], 40.00th=[11600], 50.00th=[12125], 60.00th=[13435], 00:19:37.862 | 70.00th=[16581], 80.00th=[21627], 90.00th=[25822], 95.00th=[28705], 00:19:37.862 | 99.00th=[43254], 99.50th=[45876], 99.90th=[49546], 99.95th=[49546], 00:19:37.862 | 99.99th=[49546] 00:19:37.862 bw ( KiB/s): min=16384, max=16384, per=23.89%, avg=16384.00, stdev= 0.00, samples=1 00:19:37.862 iops : min= 4096, max= 4096, avg=4096.00, stdev= 0.00, samples=1 00:19:37.862 lat (usec) : 750=0.01%, 1000=0.10% 00:19:37.862 lat (msec) : 2=0.40%, 4=1.27%, 10=16.60%, 20=65.61%, 50=16.00% 00:19:37.862 cpu : usr=6.20%, sys=8.10%, ctx=391, majf=0, minf=1 00:19:37.862 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:37.862 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.862 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:37.862 issued rwts: total=4349,4608,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.862 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:37.862 job2: (groupid=0, jobs=1): err= 0: pid=2379709: Sat Nov 30 04:21:28 2024 00:19:37.862 read: IOPS=4043, BW=15.8MiB/s (16.6MB/s)(16.0MiB/1013msec) 00:19:37.862 slat (usec): min=2, max=12476, avg=114.24, stdev=797.02 00:19:37.862 clat (usec): min=2635, max=45239, avg=15102.02, stdev=5997.08 00:19:37.862 lat (usec): min=4107, max=45270, avg=15216.26, stdev=6052.02 00:19:37.862 clat percentiles (usec): 00:19:37.862 | 1.00th=[ 4948], 5.00th=[ 9372], 10.00th=[ 9765], 20.00th=[10683], 00:19:37.862 | 30.00th=[11207], 40.00th=[11731], 50.00th=[13173], 60.00th=[15795], 00:19:37.862 | 70.00th=[16581], 80.00th=[19006], 90.00th=[22938], 95.00th=[26870], 00:19:37.862 | 99.00th=[36963], 99.50th=[39584], 99.90th=[39584], 99.95th=[39584], 00:19:37.862 | 99.99th=[45351] 00:19:37.862 write: IOPS=4538, BW=17.7MiB/s (18.6MB/s)(18.0MiB/1013msec); 0 zone resets 00:19:37.862 slat (usec): min=2, max=13092, avg=97.63, stdev=712.55 00:19:37.862 clat (usec): min=639, max=50566, avg=14529.61, stdev=8185.47 00:19:37.862 lat (usec): min=645, max=50589, avg=14627.24, stdev=8253.93 00:19:37.862 clat percentiles (usec): 00:19:37.862 | 1.00th=[ 4228], 5.00th=[ 6849], 10.00th=[ 8455], 20.00th=[10421], 00:19:37.863 | 30.00th=[11207], 40.00th=[11863], 50.00th=[12256], 60.00th=[12518], 00:19:37.863 | 70.00th=[13042], 80.00th=[16319], 90.00th=[25560], 95.00th=[35390], 00:19:37.863 | 99.00th=[44827], 99.50th=[45351], 99.90th=[50594], 99.95th=[50594], 00:19:37.863 | 99.99th=[50594] 00:19:37.863 bw ( KiB/s): min=17848, max=17920, per=26.08%, avg=17884.00, stdev=50.91, samples=2 00:19:37.863 iops : min= 4462, max= 4480, avg=4471.00, stdev=12.73, samples=2 00:19:37.863 lat (usec) : 750=0.02% 00:19:37.863 lat (msec) : 4=0.39%, 10=15.56%, 20=69.30%, 50=14.55%, 100=0.17% 00:19:37.863 cpu : usr=3.06%, sys=6.32%, ctx=358, majf=0, minf=2 00:19:37.863 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:19:37.863 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.863 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:37.863 issued rwts: total=4096,4598,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.863 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:37.863 job3: (groupid=0, jobs=1): err= 0: pid=2379711: Sat Nov 30 04:21:28 2024 00:19:37.863 read: IOPS=4059, BW=15.9MiB/s (16.6MB/s)(16.0MiB/1009msec) 00:19:37.863 slat (usec): min=2, max=21343, avg=98.24, stdev=747.65 00:19:37.863 clat (usec): min=1941, max=52231, avg=13900.37, stdev=4528.03 00:19:37.863 lat (usec): min=4497, max=52235, avg=13998.61, stdev=4580.73 00:19:37.863 clat percentiles (usec): 00:19:37.863 | 1.00th=[ 5276], 5.00th=[ 7242], 10.00th=[ 9765], 20.00th=[11469], 00:19:37.863 | 30.00th=[11731], 40.00th=[11994], 50.00th=[12780], 60.00th=[13829], 00:19:37.863 | 70.00th=[15270], 80.00th=[15926], 90.00th=[19268], 95.00th=[22676], 00:19:37.863 | 99.00th=[26870], 99.50th=[29230], 99.90th=[52167], 99.95th=[52167], 00:19:37.863 | 99.99th=[52167] 00:19:37.863 write: IOPS=4224, BW=16.5MiB/s (17.3MB/s)(16.7MiB/1009msec); 0 zone resets 00:19:37.863 slat (usec): min=3, max=17977, avg=112.95, stdev=920.88 00:19:37.863 clat (usec): min=3180, max=72999, avg=16633.42, stdev=8677.37 00:19:37.863 lat (usec): min=3188, max=73007, avg=16746.37, stdev=8744.89 00:19:37.863 clat percentiles (usec): 00:19:37.863 | 1.00th=[ 4621], 5.00th=[ 7111], 10.00th=[ 8160], 20.00th=[11863], 00:19:37.863 | 30.00th=[12256], 40.00th=[12780], 50.00th=[13042], 60.00th=[14222], 00:19:37.863 | 70.00th=[19792], 80.00th=[22414], 90.00th=[29230], 95.00th=[32900], 00:19:37.863 | 99.00th=[40633], 99.50th=[54789], 99.90th=[69731], 99.95th=[69731], 00:19:37.863 | 99.99th=[72877] 00:19:37.863 bw ( KiB/s): min=16056, max=17032, per=24.13%, avg=16544.00, stdev=690.14, samples=2 00:19:37.863 iops : min= 4014, max= 4258, avg=4136.00, stdev=172.53, samples=2 00:19:37.863 lat (msec) : 2=0.01%, 4=0.26%, 10=13.33%, 20=66.80%, 50=19.19% 00:19:37.863 lat (msec) : 100=0.41% 00:19:37.863 cpu : usr=4.46%, sys=8.43%, ctx=317, majf=0, minf=1 00:19:37.863 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:19:37.863 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:37.863 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:19:37.863 issued rwts: total=4096,4263,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:37.863 latency : target=0, window=0, percentile=100.00%, depth=128 00:19:37.863 00:19:37.863 Run status group 0 (all jobs): 00:19:37.863 READ: bw=62.2MiB/s (65.2MB/s), 13.9MiB/s-17.0MiB/s (14.6MB/s-17.8MB/s), io=63.0MiB (66.0MB), run=1001-1013msec 00:19:37.863 WRITE: bw=67.0MiB/s (70.2MB/s), 15.2MiB/s-18.0MiB/s (15.9MB/s-18.9MB/s), io=67.8MiB (71.1MB), run=1001-1013msec 00:19:37.863 00:19:37.863 Disk stats (read/write): 00:19:37.863 nvme0n1: ios=2765/3072, merge=0/0, ticks=24561/32198, in_queue=56759, util=89.98% 00:19:37.863 nvme0n2: ios=3627/3619, merge=0/0, ticks=33091/42066, in_queue=75157, util=96.95% 00:19:37.863 nvme0n3: ios=3772/4096, merge=0/0, ticks=43116/43839, in_queue=86955, util=90.62% 00:19:37.863 nvme0n4: ios=3611/3668, merge=0/0, ticks=33162/38076, in_queue=71238, util=97.79% 00:19:37.863 04:21:28 -- target/fio.sh@55 -- # sync 00:19:37.863 04:21:28 -- target/fio.sh@59 -- # fio_pid=2379855 00:19:37.863 04:21:28 -- target/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t read -r 10 00:19:37.863 04:21:28 -- target/fio.sh@61 -- # sleep 3 00:19:37.863 [global] 00:19:37.863 thread=1 00:19:37.863 invalidate=1 00:19:37.863 rw=read 00:19:37.863 time_based=1 00:19:37.863 runtime=10 00:19:37.863 ioengine=libaio 00:19:37.863 direct=1 00:19:37.863 bs=4096 00:19:37.863 iodepth=1 00:19:37.863 norandommap=1 00:19:37.863 numjobs=1 00:19:37.863 00:19:37.863 [job0] 00:19:37.863 filename=/dev/nvme0n1 00:19:37.863 [job1] 00:19:37.863 filename=/dev/nvme0n2 00:19:37.863 [job2] 00:19:37.863 filename=/dev/nvme0n3 00:19:37.863 [job3] 00:19:37.863 filename=/dev/nvme0n4 00:19:37.863 Could not set queue depth (nvme0n1) 00:19:37.863 Could not set queue depth (nvme0n2) 00:19:37.863 Could not set queue depth (nvme0n3) 00:19:37.863 Could not set queue depth (nvme0n4) 00:19:37.863 job0: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.863 job1: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.863 job2: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.863 job3: (g=0): rw=read, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:19:37.863 fio-3.35 00:19:37.863 Starting 4 threads 00:19:41.141 04:21:31 -- target/fio.sh@63 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete concat0 00:19:41.141 04:21:31 -- target/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_raid_delete raid0 00:19:41.141 fio: io_u error on file /dev/nvme0n4: Operation not supported: read offset=299008, buflen=4096 00:19:41.141 fio: pid=2379950, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:41.141 04:21:31 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:41.141 04:21:31 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc0 00:19:41.141 fio: io_u error on file /dev/nvme0n3: Operation not supported: read offset=22016000, buflen=4096 00:19:41.141 fio: pid=2379949, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:41.398 04:21:31 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:41.398 04:21:31 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc1 00:19:41.398 fio: io_u error on file /dev/nvme0n1: Operation not supported: read offset=32174080, buflen=4096 00:19:41.398 fio: pid=2379947, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:41.656 04:21:32 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:41.656 04:21:32 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc2 00:19:41.656 fio: io_u error on file /dev/nvme0n2: Operation not supported: read offset=26673152, buflen=4096 00:19:41.656 fio: pid=2379948, err=95/file:io_u.c:1889, func=io_u error, error=Operation not supported 00:19:41.914 00:19:41.914 job0: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2379947: Sat Nov 30 04:21:32 2024 00:19:41.914 read: IOPS=2259, BW=9037KiB/s (9253kB/s)(30.7MiB/3477msec) 00:19:41.914 slat (usec): min=3, max=29662, avg=15.93, stdev=419.92 00:19:41.914 clat (usec): min=168, max=41292, avg=421.96, stdev=2976.92 00:19:41.914 lat (usec): min=172, max=57963, avg=437.89, stdev=3035.98 00:19:41.914 clat percentiles (usec): 00:19:41.914 | 1.00th=[ 178], 5.00th=[ 184], 10.00th=[ 186], 20.00th=[ 190], 00:19:41.914 | 30.00th=[ 194], 40.00th=[ 196], 50.00th=[ 198], 60.00th=[ 202], 00:19:41.914 | 70.00th=[ 204], 80.00th=[ 208], 90.00th=[ 215], 95.00th=[ 223], 00:19:41.914 | 99.00th=[ 400], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:41.914 | 99.99th=[41157] 00:19:41.914 bw ( KiB/s): min= 96, max=18520, per=43.81%, avg=9300.00, stdev=7557.52, samples=6 00:19:41.914 iops : min= 24, max= 4630, avg=2325.00, stdev=1889.38, samples=6 00:19:41.914 lat (usec) : 250=97.29%, 500=2.09%, 750=0.03%, 1000=0.01% 00:19:41.914 lat (msec) : 2=0.01%, 10=0.03%, 50=0.53% 00:19:41.914 cpu : usr=0.75%, sys=2.24%, ctx=7859, majf=0, minf=2 00:19:41.914 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:41.914 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.914 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.914 issued rwts: total=7856,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.914 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:41.914 job1: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2379948: Sat Nov 30 04:21:32 2024 00:19:41.914 read: IOPS=1744, BW=6976KiB/s (7143kB/s)(25.4MiB/3734msec) 00:19:41.914 slat (usec): min=5, max=14676, avg=17.34, stdev=291.63 00:19:41.914 clat (usec): min=192, max=43457, avg=549.79, stdev=3360.11 00:19:41.914 lat (usec): min=199, max=43469, avg=566.29, stdev=3372.22 00:19:41.914 clat percentiles (usec): 00:19:41.914 | 1.00th=[ 223], 5.00th=[ 235], 10.00th=[ 239], 20.00th=[ 245], 00:19:41.914 | 30.00th=[ 251], 40.00th=[ 255], 50.00th=[ 260], 60.00th=[ 265], 00:19:41.914 | 70.00th=[ 277], 80.00th=[ 285], 90.00th=[ 293], 95.00th=[ 306], 00:19:41.914 | 99.00th=[ 562], 99.50th=[40633], 99.90th=[41157], 99.95th=[42206], 00:19:41.914 | 99.99th=[43254] 00:19:41.914 bw ( KiB/s): min= 184, max=14560, per=34.03%, avg=7224.14, stdev=6962.22, samples=7 00:19:41.914 iops : min= 46, max= 3640, avg=1806.00, stdev=1740.55, samples=7 00:19:41.914 lat (usec) : 250=29.57%, 500=69.29%, 750=0.21%, 1000=0.15% 00:19:41.914 lat (msec) : 2=0.05%, 50=0.71% 00:19:41.914 cpu : usr=0.99%, sys=2.81%, ctx=6520, majf=0, minf=1 00:19:41.914 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:41.914 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.914 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.914 issued rwts: total=6513,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.914 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:41.914 job2: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2379949: Sat Nov 30 04:21:32 2024 00:19:41.914 read: IOPS=1683, BW=6733KiB/s (6895kB/s)(21.0MiB/3193msec) 00:19:41.914 slat (nsec): min=6752, max=59108, avg=13279.14, stdev=5355.82 00:19:41.914 clat (usec): min=194, max=41480, avg=572.78, stdev=3493.46 00:19:41.914 lat (usec): min=201, max=41494, avg=586.06, stdev=3493.81 00:19:41.914 clat percentiles (usec): 00:19:41.914 | 1.00th=[ 208], 5.00th=[ 219], 10.00th=[ 227], 20.00th=[ 241], 00:19:41.914 | 30.00th=[ 251], 40.00th=[ 262], 50.00th=[ 269], 60.00th=[ 273], 00:19:41.914 | 70.00th=[ 281], 80.00th=[ 285], 90.00th=[ 302], 95.00th=[ 347], 00:19:41.914 | 99.00th=[ 562], 99.50th=[40633], 99.90th=[41681], 99.95th=[41681], 00:19:41.914 | 99.99th=[41681] 00:19:41.914 bw ( KiB/s): min= 176, max=14528, per=33.70%, avg=7154.67, stdev=7526.22, samples=6 00:19:41.914 iops : min= 44, max= 3632, avg=1788.67, stdev=1881.56, samples=6 00:19:41.914 lat (usec) : 250=27.81%, 500=70.26%, 750=1.13%, 1000=0.04% 00:19:41.914 lat (msec) : 50=0.74% 00:19:41.914 cpu : usr=1.50%, sys=3.51%, ctx=5376, majf=0, minf=2 00:19:41.914 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:41.914 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.914 complete : 0=0.1%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.914 issued rwts: total=5376,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.914 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:41.914 job3: (groupid=0, jobs=1): err=95 (file:io_u.c:1889, func=io_u error, error=Operation not supported): pid=2379950: Sat Nov 30 04:21:32 2024 00:19:41.914 read: IOPS=25, BW=99.5KiB/s (102kB/s)(292KiB/2934msec) 00:19:41.914 slat (nsec): min=12801, max=46512, avg=22374.12, stdev=9027.97 00:19:41.914 clat (usec): min=494, max=41075, avg=39851.43, stdev=6649.03 00:19:41.914 lat (usec): min=540, max=41091, avg=39873.87, stdev=6647.33 00:19:41.914 clat percentiles (usec): 00:19:41.914 | 1.00th=[ 494], 5.00th=[40633], 10.00th=[41157], 20.00th=[41157], 00:19:41.914 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:19:41.915 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:19:41.915 | 99.00th=[41157], 99.50th=[41157], 99.90th=[41157], 99.95th=[41157], 00:19:41.915 | 99.99th=[41157] 00:19:41.915 bw ( KiB/s): min= 96, max= 112, per=0.47%, avg=100.80, stdev= 7.16, samples=5 00:19:41.915 iops : min= 24, max= 28, avg=25.20, stdev= 1.79, samples=5 00:19:41.915 lat (usec) : 500=1.35%, 750=1.35% 00:19:41.915 lat (msec) : 50=95.95% 00:19:41.915 cpu : usr=0.07%, sys=0.00%, ctx=74, majf=0, minf=1 00:19:41.915 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:19:41.915 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.915 complete : 0=1.3%, 4=98.7%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:19:41.915 issued rwts: total=74,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:19:41.915 latency : target=0, window=0, percentile=100.00%, depth=1 00:19:41.915 00:19:41.915 Run status group 0 (all jobs): 00:19:41.915 READ: bw=20.7MiB/s (21.7MB/s), 99.5KiB/s-9037KiB/s (102kB/s-9253kB/s), io=77.4MiB (81.2MB), run=2934-3734msec 00:19:41.915 00:19:41.915 Disk stats (read/write): 00:19:41.915 nvme0n1: ios=7852/0, merge=0/0, ticks=3141/0, in_queue=3141, util=94.19% 00:19:41.915 nvme0n2: ios=6546/0, merge=0/0, ticks=4123/0, in_queue=4123, util=98.42% 00:19:41.915 nvme0n3: ios=5372/0, merge=0/0, ticks=2939/0, in_queue=2939, util=96.76% 00:19:41.915 nvme0n4: ios=71/0, merge=0/0, ticks=2829/0, in_queue=2829, util=96.71% 00:19:41.915 04:21:32 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:41.915 04:21:32 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc3 00:19:42.173 04:21:32 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:42.173 04:21:32 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc4 00:19:42.432 04:21:33 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:42.432 04:21:33 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc5 00:19:42.690 04:21:33 -- target/fio.sh@65 -- # for malloc_bdev in $malloc_bdevs $raid_malloc_bdevs $concat_malloc_bdevs 00:19:42.690 04:21:33 -- target/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_delete Malloc6 00:19:42.948 04:21:33 -- target/fio.sh@69 -- # fio_status=0 00:19:42.948 04:21:33 -- target/fio.sh@70 -- # wait 2379855 00:19:42.948 04:21:33 -- target/fio.sh@70 -- # fio_status=4 00:19:42.948 04:21:33 -- target/fio.sh@72 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:19:43.206 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:19:43.206 04:21:33 -- target/fio.sh@73 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:19:43.206 04:21:33 -- common/autotest_common.sh@1208 -- # local i=0 00:19:43.206 04:21:33 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:19:43.206 04:21:33 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:43.206 04:21:33 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:19:43.206 04:21:33 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:19:43.206 04:21:33 -- common/autotest_common.sh@1220 -- # return 0 00:19:43.206 04:21:33 -- target/fio.sh@75 -- # '[' 4 -eq 0 ']' 00:19:43.206 04:21:33 -- target/fio.sh@80 -- # echo 'nvmf hotplug test: fio failed as expected' 00:19:43.206 nvmf hotplug test: fio failed as expected 00:19:43.206 04:21:33 -- target/fio.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:43.464 04:21:33 -- target/fio.sh@85 -- # rm -f ./local-job0-0-verify.state 00:19:43.464 04:21:33 -- target/fio.sh@86 -- # rm -f ./local-job1-1-verify.state 00:19:43.464 04:21:33 -- target/fio.sh@87 -- # rm -f ./local-job2-2-verify.state 00:19:43.464 04:21:33 -- target/fio.sh@89 -- # trap - SIGINT SIGTERM EXIT 00:19:43.464 04:21:33 -- target/fio.sh@91 -- # nvmftestfini 00:19:43.464 04:21:33 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:43.464 04:21:33 -- nvmf/common.sh@116 -- # sync 00:19:43.464 04:21:33 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:43.464 04:21:33 -- nvmf/common.sh@119 -- # set +e 00:19:43.464 04:21:33 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:43.464 04:21:33 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:43.464 rmmod nvme_tcp 00:19:43.464 rmmod nvme_fabrics 00:19:43.464 rmmod nvme_keyring 00:19:43.464 04:21:34 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:43.464 04:21:34 -- nvmf/common.sh@123 -- # set -e 00:19:43.464 04:21:34 -- nvmf/common.sh@124 -- # return 0 00:19:43.464 04:21:34 -- nvmf/common.sh@477 -- # '[' -n 2377767 ']' 00:19:43.464 04:21:34 -- nvmf/common.sh@478 -- # killprocess 2377767 00:19:43.464 04:21:34 -- common/autotest_common.sh@936 -- # '[' -z 2377767 ']' 00:19:43.464 04:21:34 -- common/autotest_common.sh@940 -- # kill -0 2377767 00:19:43.464 04:21:34 -- common/autotest_common.sh@941 -- # uname 00:19:43.464 04:21:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:43.464 04:21:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2377767 00:19:43.464 04:21:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:19:43.464 04:21:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:19:43.464 04:21:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2377767' 00:19:43.464 killing process with pid 2377767 00:19:43.464 04:21:34 -- common/autotest_common.sh@955 -- # kill 2377767 00:19:43.464 04:21:34 -- common/autotest_common.sh@960 -- # wait 2377767 00:19:43.724 04:21:34 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:43.724 04:21:34 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:43.724 04:21:34 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:43.724 04:21:34 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:43.724 04:21:34 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:43.724 04:21:34 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:43.724 04:21:34 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:43.724 04:21:34 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:46.267 04:21:36 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:46.267 00:19:46.267 real 0m24.517s 00:19:46.267 user 1m25.819s 00:19:46.267 sys 0m6.908s 00:19:46.268 04:21:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:46.268 04:21:36 -- common/autotest_common.sh@10 -- # set +x 00:19:46.268 ************************************ 00:19:46.268 END TEST nvmf_fio_target 00:19:46.268 ************************************ 00:19:46.268 04:21:36 -- nvmf/nvmf.sh@55 -- # run_test nvmf_bdevio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:46.268 04:21:36 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:19:46.268 04:21:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:46.268 04:21:36 -- common/autotest_common.sh@10 -- # set +x 00:19:46.268 ************************************ 00:19:46.268 START TEST nvmf_bdevio 00:19:46.268 ************************************ 00:19:46.268 04:21:36 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp 00:19:46.268 * Looking for test storage... 00:19:46.268 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:46.268 04:21:36 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:46.268 04:21:36 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:46.268 04:21:36 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:46.268 04:21:36 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:46.268 04:21:36 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:46.268 04:21:36 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:46.268 04:21:36 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:46.268 04:21:36 -- scripts/common.sh@335 -- # IFS=.-: 00:19:46.268 04:21:36 -- scripts/common.sh@335 -- # read -ra ver1 00:19:46.268 04:21:36 -- scripts/common.sh@336 -- # IFS=.-: 00:19:46.268 04:21:36 -- scripts/common.sh@336 -- # read -ra ver2 00:19:46.268 04:21:36 -- scripts/common.sh@337 -- # local 'op=<' 00:19:46.268 04:21:36 -- scripts/common.sh@339 -- # ver1_l=2 00:19:46.268 04:21:36 -- scripts/common.sh@340 -- # ver2_l=1 00:19:46.268 04:21:36 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:46.268 04:21:36 -- scripts/common.sh@343 -- # case "$op" in 00:19:46.268 04:21:36 -- scripts/common.sh@344 -- # : 1 00:19:46.268 04:21:36 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:46.268 04:21:36 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:46.268 04:21:36 -- scripts/common.sh@364 -- # decimal 1 00:19:46.268 04:21:36 -- scripts/common.sh@352 -- # local d=1 00:19:46.268 04:21:36 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:46.268 04:21:36 -- scripts/common.sh@354 -- # echo 1 00:19:46.268 04:21:36 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:46.268 04:21:36 -- scripts/common.sh@365 -- # decimal 2 00:19:46.268 04:21:36 -- scripts/common.sh@352 -- # local d=2 00:19:46.268 04:21:36 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:46.268 04:21:36 -- scripts/common.sh@354 -- # echo 2 00:19:46.268 04:21:36 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:46.268 04:21:36 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:46.268 04:21:36 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:46.268 04:21:36 -- scripts/common.sh@367 -- # return 0 00:19:46.268 04:21:36 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:46.268 04:21:36 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:46.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:46.268 --rc genhtml_branch_coverage=1 00:19:46.268 --rc genhtml_function_coverage=1 00:19:46.268 --rc genhtml_legend=1 00:19:46.268 --rc geninfo_all_blocks=1 00:19:46.268 --rc geninfo_unexecuted_blocks=1 00:19:46.268 00:19:46.268 ' 00:19:46.268 04:21:36 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:46.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:46.268 --rc genhtml_branch_coverage=1 00:19:46.268 --rc genhtml_function_coverage=1 00:19:46.268 --rc genhtml_legend=1 00:19:46.268 --rc geninfo_all_blocks=1 00:19:46.268 --rc geninfo_unexecuted_blocks=1 00:19:46.268 00:19:46.268 ' 00:19:46.268 04:21:36 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:46.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:46.268 --rc genhtml_branch_coverage=1 00:19:46.268 --rc genhtml_function_coverage=1 00:19:46.268 --rc genhtml_legend=1 00:19:46.268 --rc geninfo_all_blocks=1 00:19:46.268 --rc geninfo_unexecuted_blocks=1 00:19:46.268 00:19:46.268 ' 00:19:46.268 04:21:36 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:46.268 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:46.268 --rc genhtml_branch_coverage=1 00:19:46.268 --rc genhtml_function_coverage=1 00:19:46.268 --rc genhtml_legend=1 00:19:46.268 --rc geninfo_all_blocks=1 00:19:46.268 --rc geninfo_unexecuted_blocks=1 00:19:46.268 00:19:46.268 ' 00:19:46.268 04:21:36 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:46.268 04:21:36 -- nvmf/common.sh@7 -- # uname -s 00:19:46.268 04:21:36 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:46.268 04:21:36 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:46.268 04:21:36 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:46.268 04:21:36 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:46.268 04:21:36 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:46.268 04:21:36 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:46.268 04:21:36 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:46.268 04:21:36 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:46.268 04:21:36 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:46.268 04:21:36 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:46.268 04:21:36 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:46.268 04:21:36 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:46.268 04:21:36 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:46.268 04:21:36 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:46.268 04:21:36 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:46.268 04:21:36 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:46.268 04:21:36 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:46.268 04:21:36 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:46.268 04:21:36 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:46.269 04:21:36 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:46.269 04:21:36 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:46.269 04:21:36 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:46.269 04:21:36 -- paths/export.sh@5 -- # export PATH 00:19:46.269 04:21:36 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:46.269 04:21:36 -- nvmf/common.sh@46 -- # : 0 00:19:46.269 04:21:36 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:46.269 04:21:36 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:46.269 04:21:36 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:46.269 04:21:36 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:46.269 04:21:36 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:46.269 04:21:36 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:46.269 04:21:36 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:46.269 04:21:36 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:46.269 04:21:36 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:46.269 04:21:36 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:46.269 04:21:36 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:46.269 04:21:36 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:46.269 04:21:36 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:46.269 04:21:36 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:46.269 04:21:36 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:46.269 04:21:36 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:46.269 04:21:36 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:46.269 04:21:36 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:46.269 04:21:36 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:46.269 04:21:36 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:46.269 04:21:36 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:46.269 04:21:36 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:46.269 04:21:36 -- common/autotest_common.sh@10 -- # set +x 00:19:48.171 04:21:38 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:48.171 04:21:38 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:48.171 04:21:38 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:48.171 04:21:38 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:48.171 04:21:38 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:48.171 04:21:38 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:48.171 04:21:38 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:48.171 04:21:38 -- nvmf/common.sh@294 -- # net_devs=() 00:19:48.171 04:21:38 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:48.171 04:21:38 -- nvmf/common.sh@295 -- # e810=() 00:19:48.171 04:21:38 -- nvmf/common.sh@295 -- # local -ga e810 00:19:48.171 04:21:38 -- nvmf/common.sh@296 -- # x722=() 00:19:48.171 04:21:38 -- nvmf/common.sh@296 -- # local -ga x722 00:19:48.171 04:21:38 -- nvmf/common.sh@297 -- # mlx=() 00:19:48.171 04:21:38 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:48.171 04:21:38 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:48.171 04:21:38 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:48.171 04:21:38 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:48.171 04:21:38 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:48.171 04:21:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:48.171 04:21:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:48.171 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:48.171 04:21:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:48.171 04:21:38 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:48.171 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:48.171 04:21:38 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:48.171 04:21:38 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:48.171 04:21:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:48.171 04:21:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:48.171 04:21:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:48.171 04:21:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:48.171 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:48.171 04:21:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:48.171 04:21:38 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:48.171 04:21:38 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:48.171 04:21:38 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:48.171 04:21:38 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:48.171 04:21:38 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:48.171 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:48.171 04:21:38 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:48.171 04:21:38 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:48.171 04:21:38 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:48.171 04:21:38 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:48.171 04:21:38 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:48.171 04:21:38 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:48.171 04:21:38 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:48.171 04:21:38 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:48.171 04:21:38 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:48.171 04:21:38 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:48.171 04:21:38 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:48.171 04:21:38 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:48.171 04:21:38 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:48.171 04:21:38 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:48.171 04:21:38 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:48.171 04:21:38 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:48.171 04:21:38 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:48.171 04:21:38 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:48.171 04:21:38 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:48.171 04:21:38 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:48.172 04:21:38 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:48.172 04:21:38 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:48.172 04:21:38 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:48.172 04:21:38 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:48.172 04:21:38 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:48.172 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:48.172 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.380 ms 00:19:48.172 00:19:48.172 --- 10.0.0.2 ping statistics --- 00:19:48.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:48.172 rtt min/avg/max/mdev = 0.380/0.380/0.380/0.000 ms 00:19:48.172 04:21:38 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:48.172 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:48.172 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.172 ms 00:19:48.172 00:19:48.172 --- 10.0.0.1 ping statistics --- 00:19:48.172 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:48.172 rtt min/avg/max/mdev = 0.172/0.172/0.172/0.000 ms 00:19:48.172 04:21:38 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:48.172 04:21:38 -- nvmf/common.sh@410 -- # return 0 00:19:48.172 04:21:38 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:48.172 04:21:38 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:48.172 04:21:38 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:48.172 04:21:38 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:48.172 04:21:38 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:48.172 04:21:38 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:48.172 04:21:38 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:48.172 04:21:38 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:48.172 04:21:38 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:48.172 04:21:38 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:48.172 04:21:38 -- common/autotest_common.sh@10 -- # set +x 00:19:48.172 04:21:38 -- nvmf/common.sh@469 -- # nvmfpid=2382602 00:19:48.172 04:21:38 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x78 00:19:48.172 04:21:38 -- nvmf/common.sh@470 -- # waitforlisten 2382602 00:19:48.172 04:21:38 -- common/autotest_common.sh@829 -- # '[' -z 2382602 ']' 00:19:48.172 04:21:38 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:48.172 04:21:38 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:48.172 04:21:38 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:48.172 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:48.172 04:21:38 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:48.172 04:21:38 -- common/autotest_common.sh@10 -- # set +x 00:19:48.172 [2024-11-30 04:21:38.722591] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:48.172 [2024-11-30 04:21:38.722684] [ DPDK EAL parameters: nvmf -c 0x78 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:19:48.172 EAL: No free 2048 kB hugepages reported on node 1 00:19:48.172 [2024-11-30 04:21:38.798377] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:48.429 [2024-11-30 04:21:38.896983] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:48.429 [2024-11-30 04:21:38.897151] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:48.429 [2024-11-30 04:21:38.897171] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:48.429 [2024-11-30 04:21:38.897185] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:48.429 [2024-11-30 04:21:38.897277] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:48.429 [2024-11-30 04:21:38.897331] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:48.429 [2024-11-30 04:21:38.897385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:48.429 [2024-11-30 04:21:38.897389] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:49.359 04:21:39 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:49.359 04:21:39 -- common/autotest_common.sh@862 -- # return 0 00:19:49.359 04:21:39 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:49.359 04:21:39 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:49.359 04:21:39 -- common/autotest_common.sh@10 -- # set +x 00:19:49.359 04:21:39 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:49.359 04:21:39 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:49.359 04:21:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:49.359 04:21:39 -- common/autotest_common.sh@10 -- # set +x 00:19:49.359 [2024-11-30 04:21:39.751554] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:49.359 04:21:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:49.359 04:21:39 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:49.359 04:21:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:49.359 04:21:39 -- common/autotest_common.sh@10 -- # set +x 00:19:49.359 Malloc0 00:19:49.359 04:21:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:49.359 04:21:39 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:49.359 04:21:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:49.360 04:21:39 -- common/autotest_common.sh@10 -- # set +x 00:19:49.360 04:21:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:49.360 04:21:39 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:49.360 04:21:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:49.360 04:21:39 -- common/autotest_common.sh@10 -- # set +x 00:19:49.360 04:21:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:49.360 04:21:39 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:49.360 04:21:39 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:49.360 04:21:39 -- common/autotest_common.sh@10 -- # set +x 00:19:49.360 [2024-11-30 04:21:39.802434] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:49.360 04:21:39 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:49.360 04:21:39 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 00:19:49.360 04:21:39 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:49.360 04:21:39 -- nvmf/common.sh@520 -- # config=() 00:19:49.360 04:21:39 -- nvmf/common.sh@520 -- # local subsystem config 00:19:49.360 04:21:39 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:49.360 04:21:39 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:49.360 { 00:19:49.360 "params": { 00:19:49.360 "name": "Nvme$subsystem", 00:19:49.360 "trtype": "$TEST_TRANSPORT", 00:19:49.360 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:49.360 "adrfam": "ipv4", 00:19:49.360 "trsvcid": "$NVMF_PORT", 00:19:49.360 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:49.360 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:49.360 "hdgst": ${hdgst:-false}, 00:19:49.360 "ddgst": ${ddgst:-false} 00:19:49.360 }, 00:19:49.360 "method": "bdev_nvme_attach_controller" 00:19:49.360 } 00:19:49.360 EOF 00:19:49.360 )") 00:19:49.360 04:21:39 -- nvmf/common.sh@542 -- # cat 00:19:49.360 04:21:39 -- nvmf/common.sh@544 -- # jq . 00:19:49.360 04:21:39 -- nvmf/common.sh@545 -- # IFS=, 00:19:49.360 04:21:39 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:49.360 "params": { 00:19:49.360 "name": "Nvme1", 00:19:49.360 "trtype": "tcp", 00:19:49.360 "traddr": "10.0.0.2", 00:19:49.360 "adrfam": "ipv4", 00:19:49.360 "trsvcid": "4420", 00:19:49.360 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:49.360 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:49.360 "hdgst": false, 00:19:49.360 "ddgst": false 00:19:49.360 }, 00:19:49.360 "method": "bdev_nvme_attach_controller" 00:19:49.360 }' 00:19:49.360 [2024-11-30 04:21:39.843383] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:49.360 [2024-11-30 04:21:39.843468] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2382761 ] 00:19:49.360 EAL: No free 2048 kB hugepages reported on node 1 00:19:49.360 [2024-11-30 04:21:39.904005] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:49.617 [2024-11-30 04:21:39.995153] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:49.617 [2024-11-30 04:21:39.995206] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:49.617 [2024-11-30 04:21:39.995209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:49.617 [2024-11-30 04:21:40.217173] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:49.617 [2024-11-30 04:21:40.217226] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:49.617 I/O targets: 00:19:49.617 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:49.617 00:19:49.617 00:19:49.617 CUnit - A unit testing framework for C - Version 2.1-3 00:19:49.617 http://cunit.sourceforge.net/ 00:19:49.617 00:19:49.617 00:19:49.617 Suite: bdevio tests on: Nvme1n1 00:19:49.875 Test: blockdev write read block ...passed 00:19:49.875 Test: blockdev write zeroes read block ...passed 00:19:49.875 Test: blockdev write zeroes read no split ...passed 00:19:49.875 Test: blockdev write zeroes read split ...passed 00:19:49.875 Test: blockdev write zeroes read split partial ...passed 00:19:49.875 Test: blockdev reset ...[2024-11-30 04:21:40.369704] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:49.876 [2024-11-30 04:21:40.369806] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1995670 (9): Bad file descriptor 00:19:49.876 [2024-11-30 04:21:40.384122] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:49.876 passed 00:19:49.876 Test: blockdev write read 8 blocks ...passed 00:19:49.876 Test: blockdev write read size > 128k ...passed 00:19:49.876 Test: blockdev write read invalid size ...passed 00:19:49.876 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:49.876 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:49.876 Test: blockdev write read max offset ...passed 00:19:50.133 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:50.133 Test: blockdev writev readv 8 blocks ...passed 00:19:50.133 Test: blockdev writev readv 30 x 1block ...passed 00:19:50.133 Test: blockdev writev readv block ...passed 00:19:50.133 Test: blockdev writev readv size > 128k ...passed 00:19:50.133 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:50.133 Test: blockdev comparev and writev ...[2024-11-30 04:21:40.636007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:50.133 [2024-11-30 04:21:40.636043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:50.133 [2024-11-30 04:21:40.636066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:50.133 [2024-11-30 04:21:40.636083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:50.133 [2024-11-30 04:21:40.636401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:50.133 [2024-11-30 04:21:40.636427] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:50.133 [2024-11-30 04:21:40.636449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:50.133 [2024-11-30 04:21:40.636465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:50.133 [2024-11-30 04:21:40.636774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:50.133 [2024-11-30 04:21:40.636798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:50.133 [2024-11-30 04:21:40.636819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:50.133 [2024-11-30 04:21:40.636835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:50.133 [2024-11-30 04:21:40.637150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:50.133 [2024-11-30 04:21:40.637175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:50.133 [2024-11-30 04:21:40.637197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:50.134 [2024-11-30 04:21:40.637222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:50.134 passed 00:19:50.134 Test: blockdev nvme passthru rw ...passed 00:19:50.134 Test: blockdev nvme passthru vendor specific ...[2024-11-30 04:21:40.719209] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:50.134 [2024-11-30 04:21:40.719238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:50.134 [2024-11-30 04:21:40.719392] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:50.134 [2024-11-30 04:21:40.719415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:50.134 [2024-11-30 04:21:40.719567] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:50.134 [2024-11-30 04:21:40.719590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:50.134 [2024-11-30 04:21:40.719735] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:50.134 [2024-11-30 04:21:40.719758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:50.134 passed 00:19:50.134 Test: blockdev nvme admin passthru ...passed 00:19:50.392 Test: blockdev copy ...passed 00:19:50.392 00:19:50.392 Run Summary: Type Total Ran Passed Failed Inactive 00:19:50.392 suites 1 1 n/a 0 0 00:19:50.392 tests 23 23 23 0 0 00:19:50.392 asserts 152 152 152 0 n/a 00:19:50.392 00:19:50.392 Elapsed time = 1.105 seconds 00:19:50.392 04:21:40 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:50.392 04:21:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:50.392 04:21:40 -- common/autotest_common.sh@10 -- # set +x 00:19:50.392 04:21:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:50.392 04:21:40 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:50.392 04:21:40 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:50.392 04:21:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:50.392 04:21:40 -- nvmf/common.sh@116 -- # sync 00:19:50.392 04:21:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:50.392 04:21:40 -- nvmf/common.sh@119 -- # set +e 00:19:50.392 04:21:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:50.392 04:21:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:50.392 rmmod nvme_tcp 00:19:50.392 rmmod nvme_fabrics 00:19:50.392 rmmod nvme_keyring 00:19:50.392 04:21:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:50.392 04:21:41 -- nvmf/common.sh@123 -- # set -e 00:19:50.392 04:21:41 -- nvmf/common.sh@124 -- # return 0 00:19:50.392 04:21:41 -- nvmf/common.sh@477 -- # '[' -n 2382602 ']' 00:19:50.392 04:21:41 -- nvmf/common.sh@478 -- # killprocess 2382602 00:19:50.392 04:21:41 -- common/autotest_common.sh@936 -- # '[' -z 2382602 ']' 00:19:50.392 04:21:41 -- common/autotest_common.sh@940 -- # kill -0 2382602 00:19:50.392 04:21:41 -- common/autotest_common.sh@941 -- # uname 00:19:50.392 04:21:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:50.392 04:21:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2382602 00:19:50.649 04:21:41 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:50.650 04:21:41 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:50.650 04:21:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2382602' 00:19:50.650 killing process with pid 2382602 00:19:50.650 04:21:41 -- common/autotest_common.sh@955 -- # kill 2382602 00:19:50.650 04:21:41 -- common/autotest_common.sh@960 -- # wait 2382602 00:19:50.908 04:21:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:50.908 04:21:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:50.908 04:21:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:50.908 04:21:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:50.908 04:21:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:50.908 04:21:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:50.908 04:21:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:50.908 04:21:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:52.862 04:21:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:19:52.862 00:19:52.862 real 0m6.961s 00:19:52.862 user 0m12.681s 00:19:52.862 sys 0m2.108s 00:19:52.862 04:21:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:19:52.862 04:21:43 -- common/autotest_common.sh@10 -- # set +x 00:19:52.862 ************************************ 00:19:52.862 END TEST nvmf_bdevio 00:19:52.862 ************************************ 00:19:52.862 04:21:43 -- nvmf/nvmf.sh@57 -- # '[' tcp = tcp ']' 00:19:52.862 04:21:43 -- nvmf/nvmf.sh@58 -- # run_test nvmf_bdevio_no_huge /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:52.862 04:21:43 -- common/autotest_common.sh@1087 -- # '[' 4 -le 1 ']' 00:19:52.862 04:21:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:19:52.862 04:21:43 -- common/autotest_common.sh@10 -- # set +x 00:19:52.862 ************************************ 00:19:52.862 START TEST nvmf_bdevio_no_huge 00:19:52.862 ************************************ 00:19:52.862 04:21:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevio.sh --transport=tcp --no-hugepages 00:19:52.862 * Looking for test storage... 00:19:52.862 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:19:52.862 04:21:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:19:52.862 04:21:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:19:52.862 04:21:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:19:53.145 04:21:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:19:53.145 04:21:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:19:53.145 04:21:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:19:53.145 04:21:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:19:53.145 04:21:43 -- scripts/common.sh@335 -- # IFS=.-: 00:19:53.145 04:21:43 -- scripts/common.sh@335 -- # read -ra ver1 00:19:53.145 04:21:43 -- scripts/common.sh@336 -- # IFS=.-: 00:19:53.145 04:21:43 -- scripts/common.sh@336 -- # read -ra ver2 00:19:53.145 04:21:43 -- scripts/common.sh@337 -- # local 'op=<' 00:19:53.145 04:21:43 -- scripts/common.sh@339 -- # ver1_l=2 00:19:53.145 04:21:43 -- scripts/common.sh@340 -- # ver2_l=1 00:19:53.145 04:21:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:19:53.145 04:21:43 -- scripts/common.sh@343 -- # case "$op" in 00:19:53.145 04:21:43 -- scripts/common.sh@344 -- # : 1 00:19:53.145 04:21:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:19:53.145 04:21:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:19:53.145 04:21:43 -- scripts/common.sh@364 -- # decimal 1 00:19:53.145 04:21:43 -- scripts/common.sh@352 -- # local d=1 00:19:53.145 04:21:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:19:53.145 04:21:43 -- scripts/common.sh@354 -- # echo 1 00:19:53.145 04:21:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:19:53.145 04:21:43 -- scripts/common.sh@365 -- # decimal 2 00:19:53.145 04:21:43 -- scripts/common.sh@352 -- # local d=2 00:19:53.145 04:21:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:19:53.145 04:21:43 -- scripts/common.sh@354 -- # echo 2 00:19:53.145 04:21:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:19:53.145 04:21:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:19:53.145 04:21:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:19:53.145 04:21:43 -- scripts/common.sh@367 -- # return 0 00:19:53.145 04:21:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:19:53.145 04:21:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:19:53.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:53.145 --rc genhtml_branch_coverage=1 00:19:53.145 --rc genhtml_function_coverage=1 00:19:53.145 --rc genhtml_legend=1 00:19:53.145 --rc geninfo_all_blocks=1 00:19:53.145 --rc geninfo_unexecuted_blocks=1 00:19:53.145 00:19:53.145 ' 00:19:53.145 04:21:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:19:53.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:53.145 --rc genhtml_branch_coverage=1 00:19:53.145 --rc genhtml_function_coverage=1 00:19:53.145 --rc genhtml_legend=1 00:19:53.145 --rc geninfo_all_blocks=1 00:19:53.145 --rc geninfo_unexecuted_blocks=1 00:19:53.145 00:19:53.145 ' 00:19:53.145 04:21:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:19:53.145 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:53.145 --rc genhtml_branch_coverage=1 00:19:53.146 --rc genhtml_function_coverage=1 00:19:53.146 --rc genhtml_legend=1 00:19:53.146 --rc geninfo_all_blocks=1 00:19:53.146 --rc geninfo_unexecuted_blocks=1 00:19:53.146 00:19:53.146 ' 00:19:53.146 04:21:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:19:53.146 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:19:53.146 --rc genhtml_branch_coverage=1 00:19:53.146 --rc genhtml_function_coverage=1 00:19:53.146 --rc genhtml_legend=1 00:19:53.146 --rc geninfo_all_blocks=1 00:19:53.146 --rc geninfo_unexecuted_blocks=1 00:19:53.146 00:19:53.146 ' 00:19:53.146 04:21:43 -- target/bdevio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:19:53.146 04:21:43 -- nvmf/common.sh@7 -- # uname -s 00:19:53.146 04:21:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:19:53.146 04:21:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:19:53.146 04:21:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:19:53.146 04:21:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:19:53.146 04:21:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:19:53.146 04:21:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:19:53.146 04:21:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:19:53.146 04:21:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:19:53.146 04:21:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:19:53.146 04:21:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:19:53.146 04:21:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:19:53.146 04:21:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:19:53.146 04:21:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:19:53.146 04:21:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:19:53.146 04:21:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:19:53.146 04:21:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:19:53.146 04:21:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:19:53.146 04:21:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:19:53.146 04:21:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:19:53.146 04:21:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:53.146 04:21:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:53.146 04:21:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:53.146 04:21:43 -- paths/export.sh@5 -- # export PATH 00:19:53.146 04:21:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:19:53.146 04:21:43 -- nvmf/common.sh@46 -- # : 0 00:19:53.146 04:21:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:19:53.146 04:21:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:19:53.146 04:21:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:19:53.146 04:21:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:19:53.146 04:21:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:19:53.146 04:21:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:19:53.146 04:21:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:19:53.146 04:21:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:19:53.146 04:21:43 -- target/bdevio.sh@11 -- # MALLOC_BDEV_SIZE=64 00:19:53.146 04:21:43 -- target/bdevio.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:19:53.146 04:21:43 -- target/bdevio.sh@14 -- # nvmftestinit 00:19:53.146 04:21:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:19:53.146 04:21:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:19:53.146 04:21:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:19:53.146 04:21:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:19:53.146 04:21:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:19:53.146 04:21:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:53.146 04:21:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:53.146 04:21:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:19:53.146 04:21:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:19:53.146 04:21:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:19:53.146 04:21:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:19:53.146 04:21:43 -- common/autotest_common.sh@10 -- # set +x 00:19:55.046 04:21:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:19:55.046 04:21:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:19:55.046 04:21:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:19:55.046 04:21:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:19:55.046 04:21:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:19:55.046 04:21:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:19:55.046 04:21:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:19:55.046 04:21:45 -- nvmf/common.sh@294 -- # net_devs=() 00:19:55.046 04:21:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:19:55.046 04:21:45 -- nvmf/common.sh@295 -- # e810=() 00:19:55.046 04:21:45 -- nvmf/common.sh@295 -- # local -ga e810 00:19:55.046 04:21:45 -- nvmf/common.sh@296 -- # x722=() 00:19:55.046 04:21:45 -- nvmf/common.sh@296 -- # local -ga x722 00:19:55.046 04:21:45 -- nvmf/common.sh@297 -- # mlx=() 00:19:55.046 04:21:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:19:55.046 04:21:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:19:55.046 04:21:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:19:55.046 04:21:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:19:55.046 04:21:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:19:55.046 04:21:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:55.046 04:21:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:19:55.046 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:19:55.046 04:21:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:19:55.046 04:21:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:19:55.046 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:19:55.046 04:21:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:19:55.046 04:21:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:55.046 04:21:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:55.046 04:21:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:55.046 04:21:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:55.046 04:21:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:19:55.046 Found net devices under 0000:0a:00.0: cvl_0_0 00:19:55.046 04:21:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:55.046 04:21:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:19:55.046 04:21:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:19:55.046 04:21:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:19:55.046 04:21:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:19:55.046 04:21:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:19:55.046 Found net devices under 0000:0a:00.1: cvl_0_1 00:19:55.046 04:21:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:19:55.046 04:21:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:19:55.046 04:21:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:19:55.046 04:21:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:19:55.046 04:21:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:19:55.046 04:21:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:19:55.046 04:21:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:19:55.046 04:21:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:19:55.046 04:21:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:19:55.046 04:21:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:19:55.046 04:21:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:19:55.046 04:21:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:19:55.046 04:21:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:19:55.046 04:21:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:19:55.046 04:21:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:19:55.046 04:21:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:19:55.046 04:21:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:19:55.046 04:21:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:19:55.046 04:21:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:19:55.046 04:21:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:19:55.046 04:21:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:19:55.046 04:21:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:19:55.046 04:21:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:19:55.046 04:21:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:19:55.046 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:19:55.046 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.339 ms 00:19:55.046 00:19:55.046 --- 10.0.0.2 ping statistics --- 00:19:55.046 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:55.046 rtt min/avg/max/mdev = 0.339/0.339/0.339/0.000 ms 00:19:55.046 04:21:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:19:55.046 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:19:55.046 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.120 ms 00:19:55.046 00:19:55.046 --- 10.0.0.1 ping statistics --- 00:19:55.046 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:19:55.046 rtt min/avg/max/mdev = 0.120/0.120/0.120/0.000 ms 00:19:55.046 04:21:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:19:55.046 04:21:45 -- nvmf/common.sh@410 -- # return 0 00:19:55.046 04:21:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:19:55.046 04:21:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:19:55.046 04:21:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:19:55.046 04:21:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:19:55.046 04:21:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:19:55.046 04:21:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:19:55.304 04:21:45 -- target/bdevio.sh@16 -- # nvmfappstart -m 0x78 00:19:55.304 04:21:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:19:55.304 04:21:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:19:55.304 04:21:45 -- common/autotest_common.sh@10 -- # set +x 00:19:55.304 04:21:45 -- nvmf/common.sh@469 -- # nvmfpid=2384857 00:19:55.304 04:21:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --no-huge -s 1024 -m 0x78 00:19:55.304 04:21:45 -- nvmf/common.sh@470 -- # waitforlisten 2384857 00:19:55.304 04:21:45 -- common/autotest_common.sh@829 -- # '[' -z 2384857 ']' 00:19:55.304 04:21:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:19:55.304 04:21:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:19:55.304 04:21:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:19:55.304 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:19:55.304 04:21:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:19:55.304 04:21:45 -- common/autotest_common.sh@10 -- # set +x 00:19:55.304 [2024-11-30 04:21:45.720900] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:55.304 [2024-11-30 04:21:45.721002] [ DPDK EAL parameters: nvmf -c 0x78 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk0 --proc-type=auto ] 00:19:55.304 [2024-11-30 04:21:45.788519] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:19:55.304 [2024-11-30 04:21:45.869566] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:19:55.305 [2024-11-30 04:21:45.869730] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:19:55.305 [2024-11-30 04:21:45.869749] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:19:55.305 [2024-11-30 04:21:45.869762] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:19:55.305 [2024-11-30 04:21:45.869836] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:19:55.305 [2024-11-30 04:21:45.869944] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:19:55.305 [2024-11-30 04:21:45.870002] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:19:55.305 [2024-11-30 04:21:45.870007] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:19:56.238 04:21:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:19:56.238 04:21:46 -- common/autotest_common.sh@862 -- # return 0 00:19:56.238 04:21:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:19:56.238 04:21:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:19:56.238 04:21:46 -- common/autotest_common.sh@10 -- # set +x 00:19:56.238 04:21:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:19:56.238 04:21:46 -- target/bdevio.sh@18 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:19:56.238 04:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:56.238 04:21:46 -- common/autotest_common.sh@10 -- # set +x 00:19:56.238 [2024-11-30 04:21:46.773370] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:19:56.238 04:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:56.238 04:21:46 -- target/bdevio.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:19:56.238 04:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:56.238 04:21:46 -- common/autotest_common.sh@10 -- # set +x 00:19:56.238 Malloc0 00:19:56.238 04:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:56.238 04:21:46 -- target/bdevio.sh@20 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:19:56.238 04:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:56.238 04:21:46 -- common/autotest_common.sh@10 -- # set +x 00:19:56.238 04:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:56.238 04:21:46 -- target/bdevio.sh@21 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:19:56.238 04:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:56.238 04:21:46 -- common/autotest_common.sh@10 -- # set +x 00:19:56.238 04:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:56.238 04:21:46 -- target/bdevio.sh@22 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:19:56.238 04:21:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:56.238 04:21:46 -- common/autotest_common.sh@10 -- # set +x 00:19:56.238 [2024-11-30 04:21:46.811827] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:19:56.238 04:21:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:56.238 04:21:46 -- target/bdevio.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/bdev/bdevio/bdevio --json /dev/fd/62 --no-huge -s 1024 00:19:56.238 04:21:46 -- target/bdevio.sh@24 -- # gen_nvmf_target_json 00:19:56.238 04:21:46 -- nvmf/common.sh@520 -- # config=() 00:19:56.238 04:21:46 -- nvmf/common.sh@520 -- # local subsystem config 00:19:56.238 04:21:46 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:19:56.238 04:21:46 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:19:56.238 { 00:19:56.238 "params": { 00:19:56.238 "name": "Nvme$subsystem", 00:19:56.238 "trtype": "$TEST_TRANSPORT", 00:19:56.238 "traddr": "$NVMF_FIRST_TARGET_IP", 00:19:56.238 "adrfam": "ipv4", 00:19:56.238 "trsvcid": "$NVMF_PORT", 00:19:56.238 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:19:56.238 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:19:56.238 "hdgst": ${hdgst:-false}, 00:19:56.238 "ddgst": ${ddgst:-false} 00:19:56.238 }, 00:19:56.238 "method": "bdev_nvme_attach_controller" 00:19:56.238 } 00:19:56.238 EOF 00:19:56.238 )") 00:19:56.238 04:21:46 -- nvmf/common.sh@542 -- # cat 00:19:56.238 04:21:46 -- nvmf/common.sh@544 -- # jq . 00:19:56.238 04:21:46 -- nvmf/common.sh@545 -- # IFS=, 00:19:56.238 04:21:46 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:19:56.238 "params": { 00:19:56.238 "name": "Nvme1", 00:19:56.238 "trtype": "tcp", 00:19:56.238 "traddr": "10.0.0.2", 00:19:56.238 "adrfam": "ipv4", 00:19:56.238 "trsvcid": "4420", 00:19:56.238 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:19:56.238 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:19:56.238 "hdgst": false, 00:19:56.238 "ddgst": false 00:19:56.238 }, 00:19:56.238 "method": "bdev_nvme_attach_controller" 00:19:56.238 }' 00:19:56.238 [2024-11-30 04:21:46.857172] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:19:56.238 [2024-11-30 04:21:46.857255] [ DPDK EAL parameters: bdevio --no-shconf -c 0x7 -m 1024 --no-huge --iova-mode=va --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --file-prefix=spdk_pid2385016 ] 00:19:56.496 [2024-11-30 04:21:46.916508] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:19:56.496 [2024-11-30 04:21:47.003542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:19:56.496 [2024-11-30 04:21:47.003594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:19:56.496 [2024-11-30 04:21:47.003597] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:19:56.754 [2024-11-30 04:21:47.196292] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:19:56.754 [2024-11-30 04:21:47.196341] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:19:56.754 I/O targets: 00:19:56.754 Nvme1n1: 131072 blocks of 512 bytes (64 MiB) 00:19:56.754 00:19:56.754 00:19:56.754 CUnit - A unit testing framework for C - Version 2.1-3 00:19:56.754 http://cunit.sourceforge.net/ 00:19:56.754 00:19:56.754 00:19:56.754 Suite: bdevio tests on: Nvme1n1 00:19:56.754 Test: blockdev write read block ...passed 00:19:56.754 Test: blockdev write zeroes read block ...passed 00:19:56.754 Test: blockdev write zeroes read no split ...passed 00:19:56.754 Test: blockdev write zeroes read split ...passed 00:19:56.754 Test: blockdev write zeroes read split partial ...passed 00:19:56.754 Test: blockdev reset ...[2024-11-30 04:21:47.357055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:19:56.754 [2024-11-30 04:21:47.357162] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xd6d150 (9): Bad file descriptor 00:19:56.754 [2024-11-30 04:21:47.375572] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:19:56.754 passed 00:19:57.012 Test: blockdev write read 8 blocks ...passed 00:19:57.012 Test: blockdev write read size > 128k ...passed 00:19:57.012 Test: blockdev write read invalid size ...passed 00:19:57.012 Test: blockdev write read offset + nbytes == size of blockdev ...passed 00:19:57.012 Test: blockdev write read offset + nbytes > size of blockdev ...passed 00:19:57.012 Test: blockdev write read max offset ...passed 00:19:57.012 Test: blockdev write read 2 blocks on overlapped address offset ...passed 00:19:57.012 Test: blockdev writev readv 8 blocks ...passed 00:19:57.012 Test: blockdev writev readv 30 x 1block ...passed 00:19:57.270 Test: blockdev writev readv block ...passed 00:19:57.270 Test: blockdev writev readv size > 128k ...passed 00:19:57.270 Test: blockdev writev readv size > 128k in two iovs ...passed 00:19:57.270 Test: blockdev comparev and writev ...[2024-11-30 04:21:47.713038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:57.270 [2024-11-30 04:21:47.713075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:19:57.270 [2024-11-30 04:21:47.713100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:57.270 [2024-11-30 04:21:47.713118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0022 p:0 m:0 dnr:0 00:19:57.271 [2024-11-30 04:21:47.713463] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:57.271 [2024-11-30 04:21:47.713488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0023 p:0 m:0 dnr:0 00:19:57.271 [2024-11-30 04:21:47.713511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:57.271 [2024-11-30 04:21:47.713528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0024 p:0 m:0 dnr:0 00:19:57.271 [2024-11-30 04:21:47.713863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:57.271 [2024-11-30 04:21:47.713888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:0 cdw0:0 sqhd:0025 p:0 m:0 dnr:0 00:19:57.271 [2024-11-30 04:21:47.713910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:57.271 [2024-11-30 04:21:47.713927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:1 cdw0:0 sqhd:0026 p:0 m:0 dnr:0 00:19:57.271 [2024-11-30 04:21:47.714253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: COMPARE sqid:1 cid:1 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:57.271 [2024-11-30 04:21:47.714278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMPARE FAILURE (02/85) qid:1 cid:1 cdw0:0 sqhd:0027 p:0 m:0 dnr:0 00:19:57.271 [2024-11-30 04:21:47.714299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:0 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x200 00:19:57.271 [2024-11-30 04:21:47.714316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - FAILED FUSED (00/09) qid:1 cid:0 cdw0:0 sqhd:0028 p:0 m:0 dnr:0 00:19:57.271 passed 00:19:57.271 Test: blockdev nvme passthru rw ...passed 00:19:57.271 Test: blockdev nvme passthru vendor specific ...[2024-11-30 04:21:47.798238] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:57.271 [2024-11-30 04:21:47.798265] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002c p:0 m:0 dnr:0 00:19:57.271 [2024-11-30 04:21:47.798413] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:57.271 [2024-11-30 04:21:47.798436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002d p:0 m:0 dnr:0 00:19:57.271 [2024-11-30 04:21:47.798579] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:57.271 [2024-11-30 04:21:47.798602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002e p:0 m:0 dnr:0 00:19:57.271 [2024-11-30 04:21:47.798748] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:1 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:19:57.271 [2024-11-30 04:21:47.798770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: INVALID OPCODE (00/01) qid:1 cid:0 cdw0:0 sqhd:002f p:0 m:0 dnr:0 00:19:57.271 passed 00:19:57.271 Test: blockdev nvme admin passthru ...passed 00:19:57.271 Test: blockdev copy ...passed 00:19:57.271 00:19:57.271 Run Summary: Type Total Ran Passed Failed Inactive 00:19:57.271 suites 1 1 n/a 0 0 00:19:57.271 tests 23 23 23 0 0 00:19:57.271 asserts 152 152 152 0 n/a 00:19:57.271 00:19:57.271 Elapsed time = 1.327 seconds 00:19:57.838 04:21:48 -- target/bdevio.sh@26 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:19:57.838 04:21:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:19:57.838 04:21:48 -- common/autotest_common.sh@10 -- # set +x 00:19:57.838 04:21:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:19:57.838 04:21:48 -- target/bdevio.sh@28 -- # trap - SIGINT SIGTERM EXIT 00:19:57.838 04:21:48 -- target/bdevio.sh@30 -- # nvmftestfini 00:19:57.838 04:21:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:19:57.838 04:21:48 -- nvmf/common.sh@116 -- # sync 00:19:57.838 04:21:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:19:57.838 04:21:48 -- nvmf/common.sh@119 -- # set +e 00:19:57.838 04:21:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:19:57.838 04:21:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:19:57.838 rmmod nvme_tcp 00:19:57.838 rmmod nvme_fabrics 00:19:57.838 rmmod nvme_keyring 00:19:57.838 04:21:48 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:19:57.838 04:21:48 -- nvmf/common.sh@123 -- # set -e 00:19:57.838 04:21:48 -- nvmf/common.sh@124 -- # return 0 00:19:57.838 04:21:48 -- nvmf/common.sh@477 -- # '[' -n 2384857 ']' 00:19:57.838 04:21:48 -- nvmf/common.sh@478 -- # killprocess 2384857 00:19:57.838 04:21:48 -- common/autotest_common.sh@936 -- # '[' -z 2384857 ']' 00:19:57.838 04:21:48 -- common/autotest_common.sh@940 -- # kill -0 2384857 00:19:57.838 04:21:48 -- common/autotest_common.sh@941 -- # uname 00:19:57.838 04:21:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:19:57.838 04:21:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2384857 00:19:57.838 04:21:48 -- common/autotest_common.sh@942 -- # process_name=reactor_3 00:19:57.838 04:21:48 -- common/autotest_common.sh@946 -- # '[' reactor_3 = sudo ']' 00:19:57.838 04:21:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2384857' 00:19:57.838 killing process with pid 2384857 00:19:57.838 04:21:48 -- common/autotest_common.sh@955 -- # kill 2384857 00:19:57.838 04:21:48 -- common/autotest_common.sh@960 -- # wait 2384857 00:19:58.096 04:21:48 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:19:58.096 04:21:48 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:19:58.096 04:21:48 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:19:58.096 04:21:48 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:19:58.096 04:21:48 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:19:58.096 04:21:48 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:19:58.096 04:21:48 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:19:58.096 04:21:48 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:00.630 04:21:50 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:20:00.630 00:20:00.630 real 0m7.381s 00:20:00.630 user 0m14.221s 00:20:00.630 sys 0m2.614s 00:20:00.630 04:21:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:20:00.630 04:21:50 -- common/autotest_common.sh@10 -- # set +x 00:20:00.630 ************************************ 00:20:00.630 END TEST nvmf_bdevio_no_huge 00:20:00.630 ************************************ 00:20:00.630 04:21:50 -- nvmf/nvmf.sh@59 -- # run_test nvmf_tls /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:00.630 04:21:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:20:00.630 04:21:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:20:00.630 04:21:50 -- common/autotest_common.sh@10 -- # set +x 00:20:00.630 ************************************ 00:20:00.630 START TEST nvmf_tls 00:20:00.630 ************************************ 00:20:00.630 04:21:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/tls.sh --transport=tcp 00:20:00.630 * Looking for test storage... 00:20:00.630 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:20:00.630 04:21:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:20:00.630 04:21:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:20:00.630 04:21:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:20:00.630 04:21:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:20:00.630 04:21:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:20:00.630 04:21:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:20:00.630 04:21:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:20:00.630 04:21:50 -- scripts/common.sh@335 -- # IFS=.-: 00:20:00.630 04:21:50 -- scripts/common.sh@335 -- # read -ra ver1 00:20:00.630 04:21:50 -- scripts/common.sh@336 -- # IFS=.-: 00:20:00.630 04:21:50 -- scripts/common.sh@336 -- # read -ra ver2 00:20:00.630 04:21:50 -- scripts/common.sh@337 -- # local 'op=<' 00:20:00.630 04:21:50 -- scripts/common.sh@339 -- # ver1_l=2 00:20:00.630 04:21:50 -- scripts/common.sh@340 -- # ver2_l=1 00:20:00.630 04:21:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:20:00.630 04:21:50 -- scripts/common.sh@343 -- # case "$op" in 00:20:00.630 04:21:50 -- scripts/common.sh@344 -- # : 1 00:20:00.630 04:21:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:20:00.630 04:21:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:20:00.630 04:21:50 -- scripts/common.sh@364 -- # decimal 1 00:20:00.630 04:21:50 -- scripts/common.sh@352 -- # local d=1 00:20:00.630 04:21:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:20:00.630 04:21:50 -- scripts/common.sh@354 -- # echo 1 00:20:00.630 04:21:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:20:00.630 04:21:50 -- scripts/common.sh@365 -- # decimal 2 00:20:00.630 04:21:50 -- scripts/common.sh@352 -- # local d=2 00:20:00.630 04:21:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:20:00.630 04:21:50 -- scripts/common.sh@354 -- # echo 2 00:20:00.630 04:21:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:20:00.630 04:21:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:20:00.630 04:21:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:20:00.630 04:21:50 -- scripts/common.sh@367 -- # return 0 00:20:00.630 04:21:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:20:00.630 04:21:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:20:00.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:00.630 --rc genhtml_branch_coverage=1 00:20:00.630 --rc genhtml_function_coverage=1 00:20:00.630 --rc genhtml_legend=1 00:20:00.630 --rc geninfo_all_blocks=1 00:20:00.630 --rc geninfo_unexecuted_blocks=1 00:20:00.630 00:20:00.630 ' 00:20:00.630 04:21:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:20:00.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:00.630 --rc genhtml_branch_coverage=1 00:20:00.630 --rc genhtml_function_coverage=1 00:20:00.630 --rc genhtml_legend=1 00:20:00.630 --rc geninfo_all_blocks=1 00:20:00.630 --rc geninfo_unexecuted_blocks=1 00:20:00.630 00:20:00.630 ' 00:20:00.630 04:21:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:20:00.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:00.630 --rc genhtml_branch_coverage=1 00:20:00.630 --rc genhtml_function_coverage=1 00:20:00.630 --rc genhtml_legend=1 00:20:00.630 --rc geninfo_all_blocks=1 00:20:00.630 --rc geninfo_unexecuted_blocks=1 00:20:00.630 00:20:00.630 ' 00:20:00.630 04:21:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:20:00.630 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:20:00.630 --rc genhtml_branch_coverage=1 00:20:00.630 --rc genhtml_function_coverage=1 00:20:00.630 --rc genhtml_legend=1 00:20:00.630 --rc geninfo_all_blocks=1 00:20:00.630 --rc geninfo_unexecuted_blocks=1 00:20:00.630 00:20:00.630 ' 00:20:00.630 04:21:50 -- target/tls.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:20:00.630 04:21:50 -- nvmf/common.sh@7 -- # uname -s 00:20:00.630 04:21:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:20:00.630 04:21:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:20:00.630 04:21:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:20:00.630 04:21:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:20:00.630 04:21:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:20:00.630 04:21:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:20:00.630 04:21:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:20:00.630 04:21:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:20:00.630 04:21:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:20:00.630 04:21:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:20:00.630 04:21:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:20:00.630 04:21:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:20:00.630 04:21:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:20:00.630 04:21:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:20:00.630 04:21:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:20:00.631 04:21:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:20:00.631 04:21:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:20:00.631 04:21:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:20:00.631 04:21:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:20:00.631 04:21:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:00.631 04:21:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:00.631 04:21:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:00.631 04:21:50 -- paths/export.sh@5 -- # export PATH 00:20:00.631 04:21:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:20:00.631 04:21:50 -- nvmf/common.sh@46 -- # : 0 00:20:00.631 04:21:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:20:00.631 04:21:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:20:00.631 04:21:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:20:00.631 04:21:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:20:00.631 04:21:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:20:00.631 04:21:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:20:00.631 04:21:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:20:00.631 04:21:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:20:00.631 04:21:50 -- target/tls.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:20:00.631 04:21:50 -- target/tls.sh@71 -- # nvmftestinit 00:20:00.631 04:21:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:20:00.631 04:21:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:20:00.631 04:21:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:20:00.631 04:21:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:20:00.631 04:21:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:20:00.631 04:21:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:20:00.631 04:21:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:20:00.631 04:21:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:20:00.631 04:21:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:20:00.631 04:21:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:20:00.631 04:21:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:20:00.631 04:21:50 -- common/autotest_common.sh@10 -- # set +x 00:20:02.532 04:21:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:20:02.533 04:21:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:20:02.533 04:21:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:20:02.533 04:21:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:20:02.533 04:21:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:20:02.533 04:21:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:20:02.533 04:21:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:20:02.533 04:21:52 -- nvmf/common.sh@294 -- # net_devs=() 00:20:02.533 04:21:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:20:02.533 04:21:52 -- nvmf/common.sh@295 -- # e810=() 00:20:02.533 04:21:52 -- nvmf/common.sh@295 -- # local -ga e810 00:20:02.533 04:21:52 -- nvmf/common.sh@296 -- # x722=() 00:20:02.533 04:21:52 -- nvmf/common.sh@296 -- # local -ga x722 00:20:02.533 04:21:52 -- nvmf/common.sh@297 -- # mlx=() 00:20:02.533 04:21:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:20:02.533 04:21:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:20:02.533 04:21:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:20:02.533 04:21:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:20:02.533 04:21:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:20:02.533 04:21:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:02.533 04:21:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:20:02.533 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:20:02.533 04:21:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:20:02.533 04:21:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:20:02.533 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:20:02.533 04:21:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:20:02.533 04:21:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:02.533 04:21:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:02.533 04:21:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:02.533 04:21:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:02.533 04:21:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:20:02.533 Found net devices under 0000:0a:00.0: cvl_0_0 00:20:02.533 04:21:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:02.533 04:21:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:20:02.533 04:21:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:20:02.533 04:21:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:20:02.533 04:21:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:20:02.533 04:21:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:20:02.533 Found net devices under 0000:0a:00.1: cvl_0_1 00:20:02.533 04:21:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:20:02.533 04:21:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:20:02.533 04:21:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:20:02.533 04:21:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:20:02.533 04:21:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:20:02.533 04:21:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:20:02.533 04:21:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:20:02.533 04:21:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:20:02.533 04:21:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:20:02.533 04:21:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:20:02.533 04:21:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:20:02.533 04:21:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:20:02.533 04:21:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:20:02.533 04:21:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:20:02.533 04:21:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:20:02.533 04:21:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:20:02.533 04:21:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:20:02.533 04:21:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:20:02.533 04:21:53 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:20:02.533 04:21:53 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:20:02.533 04:21:53 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:20:02.533 04:21:53 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:20:02.533 04:21:53 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:20:02.533 04:21:53 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:20:02.533 04:21:53 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:20:02.533 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:20:02.533 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.337 ms 00:20:02.533 00:20:02.533 --- 10.0.0.2 ping statistics --- 00:20:02.533 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:02.533 rtt min/avg/max/mdev = 0.337/0.337/0.337/0.000 ms 00:20:02.533 04:21:53 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:20:02.533 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:20:02.533 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.118 ms 00:20:02.533 00:20:02.533 --- 10.0.0.1 ping statistics --- 00:20:02.533 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:20:02.533 rtt min/avg/max/mdev = 0.118/0.118/0.118/0.000 ms 00:20:02.533 04:21:53 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:20:02.533 04:21:53 -- nvmf/common.sh@410 -- # return 0 00:20:02.533 04:21:53 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:20:02.533 04:21:53 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:20:02.533 04:21:53 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:20:02.533 04:21:53 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:20:02.533 04:21:53 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:20:02.533 04:21:53 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:20:02.533 04:21:53 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:20:02.533 04:21:53 -- target/tls.sh@72 -- # nvmfappstart -m 0x2 --wait-for-rpc 00:20:02.533 04:21:53 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:02.533 04:21:53 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:02.533 04:21:53 -- common/autotest_common.sh@10 -- # set +x 00:20:02.533 04:21:53 -- nvmf/common.sh@469 -- # nvmfpid=2387228 00:20:02.533 04:21:53 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 --wait-for-rpc 00:20:02.533 04:21:53 -- nvmf/common.sh@470 -- # waitforlisten 2387228 00:20:02.533 04:21:53 -- common/autotest_common.sh@829 -- # '[' -z 2387228 ']' 00:20:02.533 04:21:53 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:02.533 04:21:53 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:02.533 04:21:53 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:02.533 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:02.533 04:21:53 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:02.533 04:21:53 -- common/autotest_common.sh@10 -- # set +x 00:20:02.533 [2024-11-30 04:21:53.143028] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:02.533 [2024-11-30 04:21:53.143093] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:02.791 EAL: No free 2048 kB hugepages reported on node 1 00:20:02.791 [2024-11-30 04:21:53.211780] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:02.791 [2024-11-30 04:21:53.300761] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:02.791 [2024-11-30 04:21:53.300932] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:02.791 [2024-11-30 04:21:53.300971] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:02.791 [2024-11-30 04:21:53.300988] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:02.791 [2024-11-30 04:21:53.301018] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:02.791 04:21:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:02.791 04:21:53 -- common/autotest_common.sh@862 -- # return 0 00:20:02.791 04:21:53 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:02.791 04:21:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:02.791 04:21:53 -- common/autotest_common.sh@10 -- # set +x 00:20:02.791 04:21:53 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:02.791 04:21:53 -- target/tls.sh@74 -- # '[' tcp '!=' tcp ']' 00:20:02.791 04:21:53 -- target/tls.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_set_default_impl -i ssl 00:20:03.049 true 00:20:03.049 04:21:53 -- target/tls.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:03.049 04:21:53 -- target/tls.sh@82 -- # jq -r .tls_version 00:20:03.308 04:21:53 -- target/tls.sh@82 -- # version=0 00:20:03.308 04:21:53 -- target/tls.sh@83 -- # [[ 0 != \0 ]] 00:20:03.308 04:21:53 -- target/tls.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:03.566 04:21:54 -- target/tls.sh@90 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:03.566 04:21:54 -- target/tls.sh@90 -- # jq -r .tls_version 00:20:03.850 04:21:54 -- target/tls.sh@90 -- # version=13 00:20:03.850 04:21:54 -- target/tls.sh@91 -- # [[ 13 != \1\3 ]] 00:20:03.850 04:21:54 -- target/tls.sh@97 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 7 00:20:04.108 04:21:54 -- target/tls.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:04.108 04:21:54 -- target/tls.sh@98 -- # jq -r .tls_version 00:20:04.366 04:21:54 -- target/tls.sh@98 -- # version=7 00:20:04.366 04:21:54 -- target/tls.sh@99 -- # [[ 7 != \7 ]] 00:20:04.366 04:21:54 -- target/tls.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:04.366 04:21:54 -- target/tls.sh@105 -- # jq -r .enable_ktls 00:20:04.636 04:21:55 -- target/tls.sh@105 -- # ktls=false 00:20:04.637 04:21:55 -- target/tls.sh@106 -- # [[ false != \f\a\l\s\e ]] 00:20:04.637 04:21:55 -- target/tls.sh@112 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --enable-ktls 00:20:04.903 04:21:55 -- target/tls.sh@113 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:04.903 04:21:55 -- target/tls.sh@113 -- # jq -r .enable_ktls 00:20:05.159 04:21:55 -- target/tls.sh@113 -- # ktls=true 00:20:05.159 04:21:55 -- target/tls.sh@114 -- # [[ true != \t\r\u\e ]] 00:20:05.159 04:21:55 -- target/tls.sh@120 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --disable-ktls 00:20:05.415 04:21:55 -- target/tls.sh@121 -- # jq -r .enable_ktls 00:20:05.415 04:21:55 -- target/tls.sh@121 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_get_options -i ssl 00:20:05.673 04:21:56 -- target/tls.sh@121 -- # ktls=false 00:20:05.673 04:21:56 -- target/tls.sh@122 -- # [[ false != \f\a\l\s\e ]] 00:20:05.673 04:21:56 -- target/tls.sh@127 -- # format_interchange_psk 00112233445566778899aabbccddeeff 00:20:05.673 04:21:56 -- target/tls.sh@49 -- # local key hash crc 00:20:05.673 04:21:56 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff 00:20:05.673 04:21:56 -- target/tls.sh@51 -- # hash=01 00:20:05.673 04:21:56 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff 00:20:05.673 04:21:56 -- target/tls.sh@52 -- # gzip -1 -c 00:20:05.673 04:21:56 -- target/tls.sh@52 -- # tail -c8 00:20:05.673 04:21:56 -- target/tls.sh@52 -- # head -c 4 00:20:05.673 04:21:56 -- target/tls.sh@52 -- # crc='p$H�' 00:20:05.673 04:21:56 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:05.673 04:21:56 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeffp$H�' 00:20:05.673 04:21:56 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:05.673 04:21:56 -- target/tls.sh@127 -- # key=NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:05.673 04:21:56 -- target/tls.sh@128 -- # format_interchange_psk ffeeddccbbaa99887766554433221100 00:20:05.673 04:21:56 -- target/tls.sh@49 -- # local key hash crc 00:20:05.673 04:21:56 -- target/tls.sh@51 -- # key=ffeeddccbbaa99887766554433221100 00:20:05.673 04:21:56 -- target/tls.sh@51 -- # hash=01 00:20:05.673 04:21:56 -- target/tls.sh@52 -- # echo -n ffeeddccbbaa99887766554433221100 00:20:05.673 04:21:56 -- target/tls.sh@52 -- # gzip -1 -c 00:20:05.673 04:21:56 -- target/tls.sh@52 -- # tail -c8 00:20:05.673 04:21:56 -- target/tls.sh@52 -- # head -c 4 00:20:05.673 04:21:56 -- target/tls.sh@52 -- # crc=$'_\006o\330' 00:20:05.673 04:21:56 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:05.673 04:21:56 -- target/tls.sh@54 -- # echo -n $'ffeeddccbbaa99887766554433221100_\006o\330' 00:20:05.673 04:21:56 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:05.673 04:21:56 -- target/tls.sh@128 -- # key_2=NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:05.673 04:21:56 -- target/tls.sh@130 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:05.673 04:21:56 -- target/tls.sh@131 -- # key_2_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:05.673 04:21:56 -- target/tls.sh@133 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:20:05.673 04:21:56 -- target/tls.sh@134 -- # echo -n NVMeTLSkey-1:01:ZmZlZWRkY2NiYmFhOTk4ODc3NjY1NTQ0MzMyMjExMDBfBm/Y: 00:20:05.673 04:21:56 -- target/tls.sh@136 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:05.673 04:21:56 -- target/tls.sh@137 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:05.673 04:21:56 -- target/tls.sh@139 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py sock_impl_set_options -i ssl --tls-version 13 00:20:05.931 04:21:56 -- target/tls.sh@140 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_start_init 00:20:06.497 04:21:56 -- target/tls.sh@142 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:06.497 04:21:56 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:06.497 04:21:56 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:06.755 [2024-11-30 04:21:57.167435] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:06.755 04:21:57 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:07.013 04:21:57 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:07.271 [2024-11-30 04:21:57.761053] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:07.271 [2024-11-30 04:21:57.761333] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:07.272 04:21:57 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:07.530 malloc0 00:20:07.530 04:21:58 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:07.787 04:21:58 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:08.045 04:21:58 -- target/tls.sh@146 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -S ssl -q 64 -o 4096 -w randrw -M 30 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 hostnqn:nqn.2016-06.io.spdk:host1' --psk-path /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:08.046 EAL: No free 2048 kB hugepages reported on node 1 00:20:20.243 Initializing NVMe Controllers 00:20:20.243 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:20:20.243 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:20:20.243 Initialization complete. Launching workers. 00:20:20.243 ======================================================== 00:20:20.243 Latency(us) 00:20:20.243 Device Information : IOPS MiB/s Average min max 00:20:20.243 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7751.15 30.28 8259.43 1015.12 11716.93 00:20:20.243 ======================================================== 00:20:20.243 Total : 7751.15 30.28 8259.43 1015.12 11716.93 00:20:20.243 00:20:20.243 04:22:08 -- target/tls.sh@152 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:20.243 04:22:08 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:20.243 04:22:08 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:20.243 04:22:08 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:20.243 04:22:08 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:20.243 04:22:08 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:20.243 04:22:08 -- target/tls.sh@28 -- # bdevperf_pid=2389195 00:20:20.243 04:22:08 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:20.243 04:22:08 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:20.243 04:22:08 -- target/tls.sh@31 -- # waitforlisten 2389195 /var/tmp/bdevperf.sock 00:20:20.243 04:22:08 -- common/autotest_common.sh@829 -- # '[' -z 2389195 ']' 00:20:20.243 04:22:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:20.243 04:22:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:20.244 04:22:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:20.244 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:20.244 04:22:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:20.244 04:22:08 -- common/autotest_common.sh@10 -- # set +x 00:20:20.244 [2024-11-30 04:22:08.737692] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:20.244 [2024-11-30 04:22:08.737783] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2389195 ] 00:20:20.244 EAL: No free 2048 kB hugepages reported on node 1 00:20:20.244 [2024-11-30 04:22:08.794860] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:20.244 [2024-11-30 04:22:08.875598] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:20.244 04:22:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:20.244 04:22:09 -- common/autotest_common.sh@862 -- # return 0 00:20:20.244 04:22:09 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:20.244 [2024-11-30 04:22:09.938636] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:20.244 TLSTESTn1 00:20:20.244 04:22:10 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:20.244 Running I/O for 10 seconds... 00:20:30.205 00:20:30.205 Latency(us) 00:20:30.205 [2024-11-30T03:22:20.836Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:30.205 [2024-11-30T03:22:20.836Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:30.205 Verification LBA range: start 0x0 length 0x2000 00:20:30.205 TLSTESTn1 : 10.01 4495.56 17.56 0.00 0.00 28434.28 4708.88 44661.57 00:20:30.205 [2024-11-30T03:22:20.836Z] =================================================================================================================== 00:20:30.205 [2024-11-30T03:22:20.836Z] Total : 4495.56 17.56 0.00 0.00 28434.28 4708.88 44661.57 00:20:30.205 0 00:20:30.205 04:22:20 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:30.205 04:22:20 -- target/tls.sh@45 -- # killprocess 2389195 00:20:30.205 04:22:20 -- common/autotest_common.sh@936 -- # '[' -z 2389195 ']' 00:20:30.205 04:22:20 -- common/autotest_common.sh@940 -- # kill -0 2389195 00:20:30.205 04:22:20 -- common/autotest_common.sh@941 -- # uname 00:20:30.205 04:22:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:30.205 04:22:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2389195 00:20:30.205 04:22:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:30.205 04:22:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:30.205 04:22:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2389195' 00:20:30.205 killing process with pid 2389195 00:20:30.205 04:22:20 -- common/autotest_common.sh@955 -- # kill 2389195 00:20:30.205 Received shutdown signal, test time was about 10.000000 seconds 00:20:30.205 00:20:30.205 Latency(us) 00:20:30.205 [2024-11-30T03:22:20.836Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:30.205 [2024-11-30T03:22:20.836Z] =================================================================================================================== 00:20:30.205 [2024-11-30T03:22:20.836Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:30.205 04:22:20 -- common/autotest_common.sh@960 -- # wait 2389195 00:20:30.205 04:22:20 -- target/tls.sh@155 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:30.205 04:22:20 -- common/autotest_common.sh@650 -- # local es=0 00:20:30.205 04:22:20 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:30.205 04:22:20 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:30.205 04:22:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:30.205 04:22:20 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:30.206 04:22:20 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:30.206 04:22:20 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:30.206 04:22:20 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:30.206 04:22:20 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:30.206 04:22:20 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:30.206 04:22:20 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt' 00:20:30.206 04:22:20 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:30.206 04:22:20 -- target/tls.sh@28 -- # bdevperf_pid=2390559 00:20:30.206 04:22:20 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:30.206 04:22:20 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:30.206 04:22:20 -- target/tls.sh@31 -- # waitforlisten 2390559 /var/tmp/bdevperf.sock 00:20:30.206 04:22:20 -- common/autotest_common.sh@829 -- # '[' -z 2390559 ']' 00:20:30.206 04:22:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:30.206 04:22:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:30.206 04:22:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:30.206 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:30.206 04:22:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:30.206 04:22:20 -- common/autotest_common.sh@10 -- # set +x 00:20:30.206 [2024-11-30 04:22:20.506225] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:30.206 [2024-11-30 04:22:20.506321] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2390559 ] 00:20:30.206 EAL: No free 2048 kB hugepages reported on node 1 00:20:30.206 [2024-11-30 04:22:20.564372] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:30.206 [2024-11-30 04:22:20.643183] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:31.138 04:22:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:31.138 04:22:21 -- common/autotest_common.sh@862 -- # return 0 00:20:31.138 04:22:21 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt 00:20:31.138 [2024-11-30 04:22:21.681677] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:31.138 [2024-11-30 04:22:21.686908] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:31.139 [2024-11-30 04:22:21.687415] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1577cf0 (107): Transport endpoint is not connected 00:20:31.139 [2024-11-30 04:22:21.688390] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1577cf0 (9): Bad file descriptor 00:20:31.139 [2024-11-30 04:22:21.689388] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:31.139 [2024-11-30 04:22:21.689408] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:31.139 [2024-11-30 04:22:21.689420] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:31.139 request: 00:20:31.139 { 00:20:31.139 "name": "TLSTEST", 00:20:31.139 "trtype": "tcp", 00:20:31.139 "traddr": "10.0.0.2", 00:20:31.139 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:31.139 "adrfam": "ipv4", 00:20:31.139 "trsvcid": "4420", 00:20:31.139 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:31.139 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt", 00:20:31.139 "method": "bdev_nvme_attach_controller", 00:20:31.139 "req_id": 1 00:20:31.139 } 00:20:31.139 Got JSON-RPC error response 00:20:31.139 response: 00:20:31.139 { 00:20:31.139 "code": -32602, 00:20:31.139 "message": "Invalid parameters" 00:20:31.139 } 00:20:31.139 04:22:21 -- target/tls.sh@36 -- # killprocess 2390559 00:20:31.139 04:22:21 -- common/autotest_common.sh@936 -- # '[' -z 2390559 ']' 00:20:31.139 04:22:21 -- common/autotest_common.sh@940 -- # kill -0 2390559 00:20:31.139 04:22:21 -- common/autotest_common.sh@941 -- # uname 00:20:31.139 04:22:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:31.139 04:22:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2390559 00:20:31.139 04:22:21 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:31.139 04:22:21 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:31.139 04:22:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2390559' 00:20:31.139 killing process with pid 2390559 00:20:31.139 04:22:21 -- common/autotest_common.sh@955 -- # kill 2390559 00:20:31.139 Received shutdown signal, test time was about 10.000000 seconds 00:20:31.139 00:20:31.139 Latency(us) 00:20:31.139 [2024-11-30T03:22:21.770Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:31.139 [2024-11-30T03:22:21.770Z] =================================================================================================================== 00:20:31.139 [2024-11-30T03:22:21.770Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:31.139 04:22:21 -- common/autotest_common.sh@960 -- # wait 2390559 00:20:31.397 04:22:21 -- target/tls.sh@37 -- # return 1 00:20:31.397 04:22:21 -- common/autotest_common.sh@653 -- # es=1 00:20:31.397 04:22:21 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:31.397 04:22:21 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:31.397 04:22:21 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:31.397 04:22:21 -- target/tls.sh@158 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.397 04:22:21 -- common/autotest_common.sh@650 -- # local es=0 00:20:31.397 04:22:21 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.397 04:22:21 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:31.397 04:22:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:31.397 04:22:21 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:31.397 04:22:21 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:31.397 04:22:21 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host2 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:31.397 04:22:21 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:31.397 04:22:21 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:31.397 04:22:21 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host2 00:20:31.397 04:22:21 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:31.397 04:22:21 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:31.397 04:22:21 -- target/tls.sh@28 -- # bdevperf_pid=2390714 00:20:31.397 04:22:21 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:31.397 04:22:21 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:31.397 04:22:21 -- target/tls.sh@31 -- # waitforlisten 2390714 /var/tmp/bdevperf.sock 00:20:31.397 04:22:21 -- common/autotest_common.sh@829 -- # '[' -z 2390714 ']' 00:20:31.397 04:22:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:31.397 04:22:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:31.397 04:22:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:31.397 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:31.397 04:22:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:31.397 04:22:21 -- common/autotest_common.sh@10 -- # set +x 00:20:31.397 [2024-11-30 04:22:22.006432] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:31.397 [2024-11-30 04:22:22.006519] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2390714 ] 00:20:31.655 EAL: No free 2048 kB hugepages reported on node 1 00:20:31.655 [2024-11-30 04:22:22.066628] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:31.655 [2024-11-30 04:22:22.153906] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:32.607 04:22:23 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:32.607 04:22:23 -- common/autotest_common.sh@862 -- # return 0 00:20:32.607 04:22:23 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host2 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:32.865 [2024-11-30 04:22:23.282465] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:32.865 [2024-11-30 04:22:23.290969] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:32.865 [2024-11-30 04:22:23.291013] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host2 nqn.2016-06.io.spdk:cnode1 00:20:32.865 [2024-11-30 04:22:23.291065] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:32.865 [2024-11-30 04:22:23.291218] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24accf0 (107): Transport endpoint is not connected 00:20:32.865 [2024-11-30 04:22:23.292208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x24accf0 (9): Bad file descriptor 00:20:32.865 [2024-11-30 04:22:23.293206] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:32.865 [2024-11-30 04:22:23.293227] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:32.865 [2024-11-30 04:22:23.293240] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:32.865 request: 00:20:32.865 { 00:20:32.865 "name": "TLSTEST", 00:20:32.865 "trtype": "tcp", 00:20:32.865 "traddr": "10.0.0.2", 00:20:32.865 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:20:32.865 "adrfam": "ipv4", 00:20:32.865 "trsvcid": "4420", 00:20:32.865 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:32.865 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:32.865 "method": "bdev_nvme_attach_controller", 00:20:32.865 "req_id": 1 00:20:32.865 } 00:20:32.865 Got JSON-RPC error response 00:20:32.865 response: 00:20:32.865 { 00:20:32.865 "code": -32602, 00:20:32.865 "message": "Invalid parameters" 00:20:32.865 } 00:20:32.865 04:22:23 -- target/tls.sh@36 -- # killprocess 2390714 00:20:32.866 04:22:23 -- common/autotest_common.sh@936 -- # '[' -z 2390714 ']' 00:20:32.866 04:22:23 -- common/autotest_common.sh@940 -- # kill -0 2390714 00:20:32.866 04:22:23 -- common/autotest_common.sh@941 -- # uname 00:20:32.866 04:22:23 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:32.866 04:22:23 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2390714 00:20:32.866 04:22:23 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:32.866 04:22:23 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:32.866 04:22:23 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2390714' 00:20:32.866 killing process with pid 2390714 00:20:32.866 04:22:23 -- common/autotest_common.sh@955 -- # kill 2390714 00:20:32.866 Received shutdown signal, test time was about 10.000000 seconds 00:20:32.866 00:20:32.866 Latency(us) 00:20:32.866 [2024-11-30T03:22:23.497Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:32.866 [2024-11-30T03:22:23.497Z] =================================================================================================================== 00:20:32.866 [2024-11-30T03:22:23.497Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:32.866 04:22:23 -- common/autotest_common.sh@960 -- # wait 2390714 00:20:33.123 04:22:23 -- target/tls.sh@37 -- # return 1 00:20:33.123 04:22:23 -- common/autotest_common.sh@653 -- # es=1 00:20:33.123 04:22:23 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:33.123 04:22:23 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:33.123 04:22:23 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:33.123 04:22:23 -- target/tls.sh@161 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:33.124 04:22:23 -- common/autotest_common.sh@650 -- # local es=0 00:20:33.124 04:22:23 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:33.124 04:22:23 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:33.124 04:22:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.124 04:22:23 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:33.124 04:22:23 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:33.124 04:22:23 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode2 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:33.124 04:22:23 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:33.124 04:22:23 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode2 00:20:33.124 04:22:23 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:33.124 04:22:23 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt' 00:20:33.124 04:22:23 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:33.124 04:22:23 -- target/tls.sh@28 -- # bdevperf_pid=2390984 00:20:33.124 04:22:23 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:33.124 04:22:23 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:33.124 04:22:23 -- target/tls.sh@31 -- # waitforlisten 2390984 /var/tmp/bdevperf.sock 00:20:33.124 04:22:23 -- common/autotest_common.sh@829 -- # '[' -z 2390984 ']' 00:20:33.124 04:22:23 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:33.124 04:22:23 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:33.124 04:22:23 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:33.124 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:33.124 04:22:23 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:33.124 04:22:23 -- common/autotest_common.sh@10 -- # set +x 00:20:33.124 [2024-11-30 04:22:23.610260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:33.124 [2024-11-30 04:22:23.610338] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2390984 ] 00:20:33.124 EAL: No free 2048 kB hugepages reported on node 1 00:20:33.124 [2024-11-30 04:22:23.668489] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:33.124 [2024-11-30 04:22:23.750379] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:34.056 04:22:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:34.056 04:22:24 -- common/autotest_common.sh@862 -- # return 0 00:20:34.056 04:22:24 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt 00:20:34.313 [2024-11-30 04:22:24.812802] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:34.313 [2024-11-30 04:22:24.817703] tcp.c: 868:tcp_sock_get_key: *ERROR*: Could not find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:34.313 [2024-11-30 04:22:24.817734] posix.c: 583:posix_sock_psk_find_session_server_cb: *ERROR*: Unable to find PSK for identity: NVMe0R01 nqn.2016-06.io.spdk:host1 nqn.2016-06.io.spdk:cnode2 00:20:34.313 [2024-11-30 04:22:24.817785] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:34.313 [2024-11-30 04:22:24.818385] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe0ccf0 (107): Transport endpoint is not connected 00:20:34.313 [2024-11-30 04:22:24.819373] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xe0ccf0 (9): Bad file descriptor 00:20:34.313 [2024-11-30 04:22:24.820372] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:20:34.313 [2024-11-30 04:22:24.820391] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:34.313 [2024-11-30 04:22:24.820405] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:20:34.313 request: 00:20:34.313 { 00:20:34.313 "name": "TLSTEST", 00:20:34.313 "trtype": "tcp", 00:20:34.313 "traddr": "10.0.0.2", 00:20:34.313 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:34.313 "adrfam": "ipv4", 00:20:34.313 "trsvcid": "4420", 00:20:34.313 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:20:34.313 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt", 00:20:34.313 "method": "bdev_nvme_attach_controller", 00:20:34.313 "req_id": 1 00:20:34.313 } 00:20:34.313 Got JSON-RPC error response 00:20:34.313 response: 00:20:34.313 { 00:20:34.313 "code": -32602, 00:20:34.313 "message": "Invalid parameters" 00:20:34.313 } 00:20:34.313 04:22:24 -- target/tls.sh@36 -- # killprocess 2390984 00:20:34.313 04:22:24 -- common/autotest_common.sh@936 -- # '[' -z 2390984 ']' 00:20:34.313 04:22:24 -- common/autotest_common.sh@940 -- # kill -0 2390984 00:20:34.313 04:22:24 -- common/autotest_common.sh@941 -- # uname 00:20:34.313 04:22:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:34.313 04:22:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2390984 00:20:34.313 04:22:24 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:34.313 04:22:24 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:34.313 04:22:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2390984' 00:20:34.313 killing process with pid 2390984 00:20:34.313 04:22:24 -- common/autotest_common.sh@955 -- # kill 2390984 00:20:34.314 Received shutdown signal, test time was about 10.000000 seconds 00:20:34.314 00:20:34.314 Latency(us) 00:20:34.314 [2024-11-30T03:22:24.945Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:34.314 [2024-11-30T03:22:24.945Z] =================================================================================================================== 00:20:34.314 [2024-11-30T03:22:24.945Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:34.314 04:22:24 -- common/autotest_common.sh@960 -- # wait 2390984 00:20:34.571 04:22:25 -- target/tls.sh@37 -- # return 1 00:20:34.571 04:22:25 -- common/autotest_common.sh@653 -- # es=1 00:20:34.571 04:22:25 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:34.571 04:22:25 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:34.571 04:22:25 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:34.571 04:22:25 -- target/tls.sh@164 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:34.571 04:22:25 -- common/autotest_common.sh@650 -- # local es=0 00:20:34.571 04:22:25 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:34.571 04:22:25 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:34.571 04:22:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:34.571 04:22:25 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:34.571 04:22:25 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:34.571 04:22:25 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 '' 00:20:34.571 04:22:25 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:34.571 04:22:25 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:34.571 04:22:25 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:34.571 04:22:25 -- target/tls.sh@23 -- # psk= 00:20:34.571 04:22:25 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:34.571 04:22:25 -- target/tls.sh@28 -- # bdevperf_pid=2391138 00:20:34.571 04:22:25 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:34.571 04:22:25 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:34.571 04:22:25 -- target/tls.sh@31 -- # waitforlisten 2391138 /var/tmp/bdevperf.sock 00:20:34.571 04:22:25 -- common/autotest_common.sh@829 -- # '[' -z 2391138 ']' 00:20:34.571 04:22:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:34.571 04:22:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:34.571 04:22:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:34.571 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:34.571 04:22:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:34.571 04:22:25 -- common/autotest_common.sh@10 -- # set +x 00:20:34.571 [2024-11-30 04:22:25.140026] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:34.571 [2024-11-30 04:22:25.140118] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2391138 ] 00:20:34.571 EAL: No free 2048 kB hugepages reported on node 1 00:20:34.571 [2024-11-30 04:22:25.197409] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:34.828 [2024-11-30 04:22:25.276310] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:35.761 04:22:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:35.761 04:22:26 -- common/autotest_common.sh@862 -- # return 0 00:20:35.761 04:22:26 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 00:20:35.761 [2024-11-30 04:22:26.309002] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 107: Transport endpoint is not connected 00:20:35.761 [2024-11-30 04:22:26.310247] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2512720 (9): Bad file descriptor 00:20:35.761 [2024-11-30 04:22:26.311241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:20:35.761 [2024-11-30 04:22:26.311263] nvme.c: 708:nvme_ctrlr_poll_internal: *ERROR*: Failed to initialize SSD: 10.0.0.2 00:20:35.761 [2024-11-30 04:22:26.311277] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:20:35.761 request: 00:20:35.761 { 00:20:35.761 "name": "TLSTEST", 00:20:35.761 "trtype": "tcp", 00:20:35.761 "traddr": "10.0.0.2", 00:20:35.761 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:35.761 "adrfam": "ipv4", 00:20:35.761 "trsvcid": "4420", 00:20:35.761 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:35.761 "method": "bdev_nvme_attach_controller", 00:20:35.761 "req_id": 1 00:20:35.761 } 00:20:35.761 Got JSON-RPC error response 00:20:35.761 response: 00:20:35.761 { 00:20:35.761 "code": -32602, 00:20:35.761 "message": "Invalid parameters" 00:20:35.761 } 00:20:35.761 04:22:26 -- target/tls.sh@36 -- # killprocess 2391138 00:20:35.761 04:22:26 -- common/autotest_common.sh@936 -- # '[' -z 2391138 ']' 00:20:35.761 04:22:26 -- common/autotest_common.sh@940 -- # kill -0 2391138 00:20:35.761 04:22:26 -- common/autotest_common.sh@941 -- # uname 00:20:35.761 04:22:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:35.761 04:22:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2391138 00:20:35.761 04:22:26 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:35.761 04:22:26 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:35.761 04:22:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2391138' 00:20:35.761 killing process with pid 2391138 00:20:35.761 04:22:26 -- common/autotest_common.sh@955 -- # kill 2391138 00:20:35.761 Received shutdown signal, test time was about 10.000000 seconds 00:20:35.761 00:20:35.761 Latency(us) 00:20:35.761 [2024-11-30T03:22:26.392Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:35.761 [2024-11-30T03:22:26.392Z] =================================================================================================================== 00:20:35.761 [2024-11-30T03:22:26.392Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:35.761 04:22:26 -- common/autotest_common.sh@960 -- # wait 2391138 00:20:36.019 04:22:26 -- target/tls.sh@37 -- # return 1 00:20:36.019 04:22:26 -- common/autotest_common.sh@653 -- # es=1 00:20:36.019 04:22:26 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:36.019 04:22:26 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:36.019 04:22:26 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:36.019 04:22:26 -- target/tls.sh@167 -- # killprocess 2387228 00:20:36.019 04:22:26 -- common/autotest_common.sh@936 -- # '[' -z 2387228 ']' 00:20:36.019 04:22:26 -- common/autotest_common.sh@940 -- # kill -0 2387228 00:20:36.019 04:22:26 -- common/autotest_common.sh@941 -- # uname 00:20:36.019 04:22:26 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:36.019 04:22:26 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2387228 00:20:36.019 04:22:26 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:36.019 04:22:26 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:36.019 04:22:26 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2387228' 00:20:36.019 killing process with pid 2387228 00:20:36.019 04:22:26 -- common/autotest_common.sh@955 -- # kill 2387228 00:20:36.019 04:22:26 -- common/autotest_common.sh@960 -- # wait 2387228 00:20:36.277 04:22:26 -- target/tls.sh@168 -- # format_interchange_psk 00112233445566778899aabbccddeeff0011223344556677 02 00:20:36.277 04:22:26 -- target/tls.sh@49 -- # local key hash crc 00:20:36.277 04:22:26 -- target/tls.sh@51 -- # key=00112233445566778899aabbccddeeff0011223344556677 00:20:36.277 04:22:26 -- target/tls.sh@51 -- # hash=02 00:20:36.277 04:22:26 -- target/tls.sh@52 -- # echo -n 00112233445566778899aabbccddeeff0011223344556677 00:20:36.277 04:22:26 -- target/tls.sh@52 -- # gzip -1 -c 00:20:36.277 04:22:26 -- target/tls.sh@52 -- # tail -c8 00:20:36.277 04:22:26 -- target/tls.sh@52 -- # head -c 4 00:20:36.277 04:22:26 -- target/tls.sh@52 -- # crc='�e�'\''' 00:20:36.277 04:22:26 -- target/tls.sh@54 -- # base64 /dev/fd/62 00:20:36.277 04:22:26 -- target/tls.sh@54 -- # echo -n '00112233445566778899aabbccddeeff0011223344556677�e�'\''' 00:20:36.277 04:22:26 -- target/tls.sh@54 -- # echo NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:36.277 04:22:26 -- target/tls.sh@168 -- # key_long=NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:36.277 04:22:26 -- target/tls.sh@169 -- # key_long_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:36.277 04:22:26 -- target/tls.sh@170 -- # echo -n NVMeTLSkey-1:02:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmYwMDExMjIzMzQ0NTU2Njc3wWXNJw==: 00:20:36.277 04:22:26 -- target/tls.sh@171 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:36.277 04:22:26 -- target/tls.sh@172 -- # nvmfappstart -m 0x2 00:20:36.277 04:22:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:36.277 04:22:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:36.277 04:22:26 -- common/autotest_common.sh@10 -- # set +x 00:20:36.277 04:22:26 -- nvmf/common.sh@469 -- # nvmfpid=2391430 00:20:36.278 04:22:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:36.278 04:22:26 -- nvmf/common.sh@470 -- # waitforlisten 2391430 00:20:36.278 04:22:26 -- common/autotest_common.sh@829 -- # '[' -z 2391430 ']' 00:20:36.278 04:22:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:36.278 04:22:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:36.278 04:22:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:36.278 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:36.278 04:22:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:36.278 04:22:26 -- common/autotest_common.sh@10 -- # set +x 00:20:36.536 [2024-11-30 04:22:26.931065] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:36.536 [2024-11-30 04:22:26.931146] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:36.536 EAL: No free 2048 kB hugepages reported on node 1 00:20:36.536 [2024-11-30 04:22:26.994671] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:36.536 [2024-11-30 04:22:27.077385] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:36.536 [2024-11-30 04:22:27.077529] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:36.536 [2024-11-30 04:22:27.077545] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:36.536 [2024-11-30 04:22:27.077557] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:36.536 [2024-11-30 04:22:27.077593] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:37.469 04:22:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:37.469 04:22:27 -- common/autotest_common.sh@862 -- # return 0 00:20:37.469 04:22:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:37.469 04:22:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:37.469 04:22:27 -- common/autotest_common.sh@10 -- # set +x 00:20:37.469 04:22:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:37.469 04:22:27 -- target/tls.sh@174 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.469 04:22:27 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:37.469 04:22:27 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:37.726 [2024-11-30 04:22:28.206554] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:37.726 04:22:28 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:37.984 04:22:28 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:38.241 [2024-11-30 04:22:28.752033] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:38.241 [2024-11-30 04:22:28.752317] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:38.241 04:22:28 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:38.517 malloc0 00:20:38.517 04:22:29 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:38.846 04:22:29 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:39.130 04:22:29 -- target/tls.sh@176 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:39.130 04:22:29 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:39.130 04:22:29 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:39.130 04:22:29 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:39.130 04:22:29 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:39.130 04:22:29 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:39.130 04:22:29 -- target/tls.sh@28 -- # bdevperf_pid=2391733 00:20:39.130 04:22:29 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:39.130 04:22:29 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:39.130 04:22:29 -- target/tls.sh@31 -- # waitforlisten 2391733 /var/tmp/bdevperf.sock 00:20:39.130 04:22:29 -- common/autotest_common.sh@829 -- # '[' -z 2391733 ']' 00:20:39.130 04:22:29 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:39.130 04:22:29 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:39.130 04:22:29 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:39.130 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:39.130 04:22:29 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:39.130 04:22:29 -- common/autotest_common.sh@10 -- # set +x 00:20:39.130 [2024-11-30 04:22:29.639242] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:39.130 [2024-11-30 04:22:29.639317] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2391733 ] 00:20:39.130 EAL: No free 2048 kB hugepages reported on node 1 00:20:39.130 [2024-11-30 04:22:29.696443] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:39.389 [2024-11-30 04:22:29.778899] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:40.322 04:22:30 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:40.322 04:22:30 -- common/autotest_common.sh@862 -- # return 0 00:20:40.322 04:22:30 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:40.322 [2024-11-30 04:22:30.815710] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:40.322 TLSTESTn1 00:20:40.322 04:22:30 -- target/tls.sh@41 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:20:40.579 Running I/O for 10 seconds... 00:20:50.539 00:20:50.539 Latency(us) 00:20:50.539 [2024-11-30T03:22:41.170Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:50.539 [2024-11-30T03:22:41.170Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:20:50.539 Verification LBA range: start 0x0 length 0x2000 00:20:50.539 TLSTESTn1 : 10.02 4489.18 17.54 0.00 0.00 28471.34 4830.25 46603.38 00:20:50.539 [2024-11-30T03:22:41.170Z] =================================================================================================================== 00:20:50.539 [2024-11-30T03:22:41.170Z] Total : 4489.18 17.54 0.00 0.00 28471.34 4830.25 46603.38 00:20:50.539 0 00:20:50.539 04:22:41 -- target/tls.sh@44 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:20:50.539 04:22:41 -- target/tls.sh@45 -- # killprocess 2391733 00:20:50.539 04:22:41 -- common/autotest_common.sh@936 -- # '[' -z 2391733 ']' 00:20:50.539 04:22:41 -- common/autotest_common.sh@940 -- # kill -0 2391733 00:20:50.539 04:22:41 -- common/autotest_common.sh@941 -- # uname 00:20:50.539 04:22:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:50.539 04:22:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2391733 00:20:50.539 04:22:41 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:50.539 04:22:41 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:50.539 04:22:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2391733' 00:20:50.539 killing process with pid 2391733 00:20:50.539 04:22:41 -- common/autotest_common.sh@955 -- # kill 2391733 00:20:50.539 Received shutdown signal, test time was about 10.000000 seconds 00:20:50.539 00:20:50.539 Latency(us) 00:20:50.539 [2024-11-30T03:22:41.170Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:50.539 [2024-11-30T03:22:41.170Z] =================================================================================================================== 00:20:50.539 [2024-11-30T03:22:41.170Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:20:50.539 04:22:41 -- common/autotest_common.sh@960 -- # wait 2391733 00:20:50.797 04:22:41 -- target/tls.sh@179 -- # chmod 0666 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:50.797 04:22:41 -- target/tls.sh@180 -- # NOT run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:50.797 04:22:41 -- common/autotest_common.sh@650 -- # local es=0 00:20:50.797 04:22:41 -- common/autotest_common.sh@652 -- # valid_exec_arg run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:50.797 04:22:41 -- common/autotest_common.sh@638 -- # local arg=run_bdevperf 00:20:50.797 04:22:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:50.797 04:22:41 -- common/autotest_common.sh@642 -- # type -t run_bdevperf 00:20:50.797 04:22:41 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:50.797 04:22:41 -- common/autotest_common.sh@653 -- # run_bdevperf nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:50.797 04:22:41 -- target/tls.sh@22 -- # local subnqn hostnqn psk 00:20:50.797 04:22:41 -- target/tls.sh@23 -- # subnqn=nqn.2016-06.io.spdk:cnode1 00:20:50.797 04:22:41 -- target/tls.sh@23 -- # hostnqn=nqn.2016-06.io.spdk:host1 00:20:50.797 04:22:41 -- target/tls.sh@23 -- # psk='--psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt' 00:20:50.797 04:22:41 -- target/tls.sh@25 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:20:50.797 04:22:41 -- target/tls.sh@28 -- # bdevperf_pid=2393114 00:20:50.797 04:22:41 -- target/tls.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:50.797 04:22:41 -- target/tls.sh@30 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:50.797 04:22:41 -- target/tls.sh@31 -- # waitforlisten 2393114 /var/tmp/bdevperf.sock 00:20:50.797 04:22:41 -- common/autotest_common.sh@829 -- # '[' -z 2393114 ']' 00:20:50.797 04:22:41 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:50.797 04:22:41 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:50.797 04:22:41 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:50.797 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:50.797 04:22:41 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:50.797 04:22:41 -- common/autotest_common.sh@10 -- # set +x 00:20:50.797 [2024-11-30 04:22:41.380045] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:50.797 [2024-11-30 04:22:41.380137] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2393114 ] 00:20:50.797 EAL: No free 2048 kB hugepages reported on node 1 00:20:51.056 [2024-11-30 04:22:41.442749] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:51.056 [2024-11-30 04:22:41.528823] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:51.986 04:22:42 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:51.986 04:22:42 -- common/autotest_common.sh@862 -- # return 0 00:20:51.986 04:22:42 -- target/tls.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:52.243 [2024-11-30 04:22:42.671830] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:52.243 [2024-11-30 04:22:42.671877] bdev_nvme_rpc.c: 336:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:52.243 request: 00:20:52.243 { 00:20:52.243 "name": "TLSTEST", 00:20:52.243 "trtype": "tcp", 00:20:52.243 "traddr": "10.0.0.2", 00:20:52.243 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:52.243 "adrfam": "ipv4", 00:20:52.243 "trsvcid": "4420", 00:20:52.243 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:52.244 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:52.244 "method": "bdev_nvme_attach_controller", 00:20:52.244 "req_id": 1 00:20:52.244 } 00:20:52.244 Got JSON-RPC error response 00:20:52.244 response: 00:20:52.244 { 00:20:52.244 "code": -22, 00:20:52.244 "message": "Could not retrieve PSK from file: /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:52.244 } 00:20:52.244 04:22:42 -- target/tls.sh@36 -- # killprocess 2393114 00:20:52.244 04:22:42 -- common/autotest_common.sh@936 -- # '[' -z 2393114 ']' 00:20:52.244 04:22:42 -- common/autotest_common.sh@940 -- # kill -0 2393114 00:20:52.244 04:22:42 -- common/autotest_common.sh@941 -- # uname 00:20:52.244 04:22:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:52.244 04:22:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2393114 00:20:52.244 04:22:42 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:52.244 04:22:42 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:52.244 04:22:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2393114' 00:20:52.244 killing process with pid 2393114 00:20:52.244 04:22:42 -- common/autotest_common.sh@955 -- # kill 2393114 00:20:52.244 Received shutdown signal, test time was about 10.000000 seconds 00:20:52.244 00:20:52.244 Latency(us) 00:20:52.244 [2024-11-30T03:22:42.875Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:52.244 [2024-11-30T03:22:42.875Z] =================================================================================================================== 00:20:52.244 [2024-11-30T03:22:42.875Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:52.244 04:22:42 -- common/autotest_common.sh@960 -- # wait 2393114 00:20:52.501 04:22:42 -- target/tls.sh@37 -- # return 1 00:20:52.501 04:22:42 -- common/autotest_common.sh@653 -- # es=1 00:20:52.501 04:22:42 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:52.501 04:22:42 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:52.501 04:22:42 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:52.501 04:22:42 -- target/tls.sh@183 -- # killprocess 2391430 00:20:52.501 04:22:42 -- common/autotest_common.sh@936 -- # '[' -z 2391430 ']' 00:20:52.501 04:22:42 -- common/autotest_common.sh@940 -- # kill -0 2391430 00:20:52.501 04:22:42 -- common/autotest_common.sh@941 -- # uname 00:20:52.501 04:22:42 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:52.501 04:22:42 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2391430 00:20:52.502 04:22:42 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:52.502 04:22:42 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:52.502 04:22:42 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2391430' 00:20:52.502 killing process with pid 2391430 00:20:52.502 04:22:42 -- common/autotest_common.sh@955 -- # kill 2391430 00:20:52.502 04:22:42 -- common/autotest_common.sh@960 -- # wait 2391430 00:20:52.759 04:22:43 -- target/tls.sh@184 -- # nvmfappstart -m 0x2 00:20:52.759 04:22:43 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:52.759 04:22:43 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:52.759 04:22:43 -- common/autotest_common.sh@10 -- # set +x 00:20:52.759 04:22:43 -- nvmf/common.sh@469 -- # nvmfpid=2393389 00:20:52.759 04:22:43 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:52.759 04:22:43 -- nvmf/common.sh@470 -- # waitforlisten 2393389 00:20:52.759 04:22:43 -- common/autotest_common.sh@829 -- # '[' -z 2393389 ']' 00:20:52.759 04:22:43 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:52.759 04:22:43 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:52.759 04:22:43 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:52.759 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:52.759 04:22:43 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:52.759 04:22:43 -- common/autotest_common.sh@10 -- # set +x 00:20:52.759 [2024-11-30 04:22:43.275568] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:52.759 [2024-11-30 04:22:43.275640] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:52.759 EAL: No free 2048 kB hugepages reported on node 1 00:20:52.759 [2024-11-30 04:22:43.342045] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:53.017 [2024-11-30 04:22:43.431221] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:53.017 [2024-11-30 04:22:43.431371] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:53.017 [2024-11-30 04:22:43.431389] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:53.017 [2024-11-30 04:22:43.431402] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:53.017 [2024-11-30 04:22:43.431438] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:53.951 04:22:44 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:53.951 04:22:44 -- common/autotest_common.sh@862 -- # return 0 00:20:53.951 04:22:44 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:53.951 04:22:44 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:53.951 04:22:44 -- common/autotest_common.sh@10 -- # set +x 00:20:53.951 04:22:44 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:53.951 04:22:44 -- target/tls.sh@186 -- # NOT setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:53.951 04:22:44 -- common/autotest_common.sh@650 -- # local es=0 00:20:53.951 04:22:44 -- common/autotest_common.sh@652 -- # valid_exec_arg setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:53.951 04:22:44 -- common/autotest_common.sh@638 -- # local arg=setup_nvmf_tgt 00:20:53.951 04:22:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:53.951 04:22:44 -- common/autotest_common.sh@642 -- # type -t setup_nvmf_tgt 00:20:53.951 04:22:44 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:20:53.951 04:22:44 -- common/autotest_common.sh@653 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:53.951 04:22:44 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:53.951 04:22:44 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:54.209 [2024-11-30 04:22:44.641106] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:54.209 04:22:44 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:54.468 04:22:44 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:54.724 [2024-11-30 04:22:45.150499] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:54.724 [2024-11-30 04:22:45.150789] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:54.724 04:22:45 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:54.982 malloc0 00:20:54.982 04:22:45 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:55.240 04:22:45 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.498 [2024-11-30 04:22:45.884271] tcp.c:3551:tcp_load_psk: *ERROR*: Incorrect permissions for PSK file 00:20:55.498 [2024-11-30 04:22:45.884328] tcp.c:3620:nvmf_tcp_subsystem_add_host: *ERROR*: Could not retrieve PSK from file 00:20:55.498 [2024-11-30 04:22:45.884356] subsystem.c: 880:spdk_nvmf_subsystem_add_host: *ERROR*: Unable to add host to TCP transport 00:20:55.498 request: 00:20:55.498 { 00:20:55.498 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:55.498 "host": "nqn.2016-06.io.spdk:host1", 00:20:55.498 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:55.498 "method": "nvmf_subsystem_add_host", 00:20:55.498 "req_id": 1 00:20:55.498 } 00:20:55.498 Got JSON-RPC error response 00:20:55.498 response: 00:20:55.498 { 00:20:55.498 "code": -32603, 00:20:55.498 "message": "Internal error" 00:20:55.498 } 00:20:55.498 04:22:45 -- common/autotest_common.sh@653 -- # es=1 00:20:55.498 04:22:45 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:20:55.498 04:22:45 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:20:55.498 04:22:45 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:20:55.498 04:22:45 -- target/tls.sh@189 -- # killprocess 2393389 00:20:55.498 04:22:45 -- common/autotest_common.sh@936 -- # '[' -z 2393389 ']' 00:20:55.498 04:22:45 -- common/autotest_common.sh@940 -- # kill -0 2393389 00:20:55.498 04:22:45 -- common/autotest_common.sh@941 -- # uname 00:20:55.498 04:22:45 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:55.498 04:22:45 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2393389 00:20:55.498 04:22:45 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:55.498 04:22:45 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:55.498 04:22:45 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2393389' 00:20:55.498 killing process with pid 2393389 00:20:55.498 04:22:45 -- common/autotest_common.sh@955 -- # kill 2393389 00:20:55.498 04:22:45 -- common/autotest_common.sh@960 -- # wait 2393389 00:20:55.757 04:22:46 -- target/tls.sh@190 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:55.757 04:22:46 -- target/tls.sh@193 -- # nvmfappstart -m 0x2 00:20:55.757 04:22:46 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:20:55.757 04:22:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:20:55.757 04:22:46 -- common/autotest_common.sh@10 -- # set +x 00:20:55.757 04:22:46 -- nvmf/common.sh@469 -- # nvmfpid=2393822 00:20:55.757 04:22:46 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:20:55.757 04:22:46 -- nvmf/common.sh@470 -- # waitforlisten 2393822 00:20:55.757 04:22:46 -- common/autotest_common.sh@829 -- # '[' -z 2393822 ']' 00:20:55.757 04:22:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:20:55.757 04:22:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:55.757 04:22:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:20:55.757 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:20:55.757 04:22:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:55.757 04:22:46 -- common/autotest_common.sh@10 -- # set +x 00:20:55.757 [2024-11-30 04:22:46.239697] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:55.757 [2024-11-30 04:22:46.239782] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:20:55.757 EAL: No free 2048 kB hugepages reported on node 1 00:20:55.757 [2024-11-30 04:22:46.303814] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:55.757 [2024-11-30 04:22:46.386334] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:20:55.757 [2024-11-30 04:22:46.386484] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:20:55.757 [2024-11-30 04:22:46.386503] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:20:55.757 [2024-11-30 04:22:46.386516] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:20:55.757 [2024-11-30 04:22:46.386543] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:20:56.690 04:22:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:56.690 04:22:47 -- common/autotest_common.sh@862 -- # return 0 00:20:56.690 04:22:47 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:20:56.690 04:22:47 -- common/autotest_common.sh@728 -- # xtrace_disable 00:20:56.690 04:22:47 -- common/autotest_common.sh@10 -- # set +x 00:20:56.690 04:22:47 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:20:56.690 04:22:47 -- target/tls.sh@194 -- # setup_nvmf_tgt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.690 04:22:47 -- target/tls.sh@58 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:56.690 04:22:47 -- target/tls.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:20:56.948 [2024-11-30 04:22:47.474131] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:20:56.948 04:22:47 -- target/tls.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -s SPDK00000000000001 -m 10 00:20:57.204 04:22:47 -- target/tls.sh@62 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 -k 00:20:57.462 [2024-11-30 04:22:47.979507] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:20:57.462 [2024-11-30 04:22:47.979784] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:20:57.462 04:22:47 -- target/tls.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 32 4096 -b malloc0 00:20:57.719 malloc0 00:20:57.719 04:22:48 -- target/tls.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 malloc0 -n 1 00:20:57.977 04:22:48 -- target/tls.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode1 nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.235 04:22:48 -- target/tls.sh@197 -- # bdevperf_pid=2394120 00:20:58.235 04:22:48 -- target/tls.sh@196 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:20:58.235 04:22:48 -- target/tls.sh@199 -- # trap 'cleanup; exit 1' SIGINT SIGTERM EXIT 00:20:58.235 04:22:48 -- target/tls.sh@200 -- # waitforlisten 2394120 /var/tmp/bdevperf.sock 00:20:58.235 04:22:48 -- common/autotest_common.sh@829 -- # '[' -z 2394120 ']' 00:20:58.235 04:22:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:20:58.235 04:22:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:20:58.235 04:22:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:20:58.235 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:20:58.235 04:22:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:20:58.235 04:22:48 -- common/autotest_common.sh@10 -- # set +x 00:20:58.235 [2024-11-30 04:22:48.804307] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:20:58.235 [2024-11-30 04:22:48.804377] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2394120 ] 00:20:58.235 EAL: No free 2048 kB hugepages reported on node 1 00:20:58.235 [2024-11-30 04:22:48.861483] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:20:58.492 [2024-11-30 04:22:48.944811] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:20:58.492 04:22:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:20:58.492 04:22:49 -- common/autotest_common.sh@862 -- # return 0 00:20:58.492 04:22:49 -- target/tls.sh@201 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:20:58.748 [2024-11-30 04:22:49.341572] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:20:59.005 TLSTESTn1 00:20:59.005 04:22:49 -- target/tls.sh@205 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py save_config 00:20:59.263 04:22:49 -- target/tls.sh@205 -- # tgtconf='{ 00:20:59.263 "subsystems": [ 00:20:59.263 { 00:20:59.263 "subsystem": "iobuf", 00:20:59.263 "config": [ 00:20:59.263 { 00:20:59.263 "method": "iobuf_set_options", 00:20:59.263 "params": { 00:20:59.263 "small_pool_count": 8192, 00:20:59.263 "large_pool_count": 1024, 00:20:59.263 "small_bufsize": 8192, 00:20:59.263 "large_bufsize": 135168 00:20:59.263 } 00:20:59.263 } 00:20:59.263 ] 00:20:59.263 }, 00:20:59.263 { 00:20:59.263 "subsystem": "sock", 00:20:59.263 "config": [ 00:20:59.263 { 00:20:59.263 "method": "sock_impl_set_options", 00:20:59.263 "params": { 00:20:59.263 "impl_name": "posix", 00:20:59.263 "recv_buf_size": 2097152, 00:20:59.263 "send_buf_size": 2097152, 00:20:59.263 "enable_recv_pipe": true, 00:20:59.263 "enable_quickack": false, 00:20:59.263 "enable_placement_id": 0, 00:20:59.263 "enable_zerocopy_send_server": true, 00:20:59.263 "enable_zerocopy_send_client": false, 00:20:59.263 "zerocopy_threshold": 0, 00:20:59.263 "tls_version": 0, 00:20:59.263 "enable_ktls": false 00:20:59.263 } 00:20:59.263 }, 00:20:59.263 { 00:20:59.263 "method": "sock_impl_set_options", 00:20:59.263 "params": { 00:20:59.263 "impl_name": "ssl", 00:20:59.263 "recv_buf_size": 4096, 00:20:59.263 "send_buf_size": 4096, 00:20:59.263 "enable_recv_pipe": true, 00:20:59.263 "enable_quickack": false, 00:20:59.263 "enable_placement_id": 0, 00:20:59.263 "enable_zerocopy_send_server": true, 00:20:59.263 "enable_zerocopy_send_client": false, 00:20:59.263 "zerocopy_threshold": 0, 00:20:59.263 "tls_version": 0, 00:20:59.263 "enable_ktls": false 00:20:59.263 } 00:20:59.263 } 00:20:59.263 ] 00:20:59.263 }, 00:20:59.263 { 00:20:59.263 "subsystem": "vmd", 00:20:59.263 "config": [] 00:20:59.263 }, 00:20:59.263 { 00:20:59.263 "subsystem": "accel", 00:20:59.263 "config": [ 00:20:59.263 { 00:20:59.263 "method": "accel_set_options", 00:20:59.263 "params": { 00:20:59.263 "small_cache_size": 128, 00:20:59.263 "large_cache_size": 16, 00:20:59.263 "task_count": 2048, 00:20:59.263 "sequence_count": 2048, 00:20:59.263 "buf_count": 2048 00:20:59.263 } 00:20:59.263 } 00:20:59.263 ] 00:20:59.263 }, 00:20:59.263 { 00:20:59.263 "subsystem": "bdev", 00:20:59.263 "config": [ 00:20:59.263 { 00:20:59.263 "method": "bdev_set_options", 00:20:59.263 "params": { 00:20:59.263 "bdev_io_pool_size": 65535, 00:20:59.263 "bdev_io_cache_size": 256, 00:20:59.263 "bdev_auto_examine": true, 00:20:59.263 "iobuf_small_cache_size": 128, 00:20:59.263 "iobuf_large_cache_size": 16 00:20:59.263 } 00:20:59.263 }, 00:20:59.263 { 00:20:59.263 "method": "bdev_raid_set_options", 00:20:59.263 "params": { 00:20:59.263 "process_window_size_kb": 1024 00:20:59.263 } 00:20:59.263 }, 00:20:59.263 { 00:20:59.263 "method": "bdev_iscsi_set_options", 00:20:59.263 "params": { 00:20:59.264 "timeout_sec": 30 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "bdev_nvme_set_options", 00:20:59.264 "params": { 00:20:59.264 "action_on_timeout": "none", 00:20:59.264 "timeout_us": 0, 00:20:59.264 "timeout_admin_us": 0, 00:20:59.264 "keep_alive_timeout_ms": 10000, 00:20:59.264 "transport_retry_count": 4, 00:20:59.264 "arbitration_burst": 0, 00:20:59.264 "low_priority_weight": 0, 00:20:59.264 "medium_priority_weight": 0, 00:20:59.264 "high_priority_weight": 0, 00:20:59.264 "nvme_adminq_poll_period_us": 10000, 00:20:59.264 "nvme_ioq_poll_period_us": 0, 00:20:59.264 "io_queue_requests": 0, 00:20:59.264 "delay_cmd_submit": true, 00:20:59.264 "bdev_retry_count": 3, 00:20:59.264 "transport_ack_timeout": 0, 00:20:59.264 "ctrlr_loss_timeout_sec": 0, 00:20:59.264 "reconnect_delay_sec": 0, 00:20:59.264 "fast_io_fail_timeout_sec": 0, 00:20:59.264 "generate_uuids": false, 00:20:59.264 "transport_tos": 0, 00:20:59.264 "io_path_stat": false, 00:20:59.264 "allow_accel_sequence": false 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "bdev_nvme_set_hotplug", 00:20:59.264 "params": { 00:20:59.264 "period_us": 100000, 00:20:59.264 "enable": false 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "bdev_malloc_create", 00:20:59.264 "params": { 00:20:59.264 "name": "malloc0", 00:20:59.264 "num_blocks": 8192, 00:20:59.264 "block_size": 4096, 00:20:59.264 "physical_block_size": 4096, 00:20:59.264 "uuid": "f3b23990-7a35-4627-9e8e-56086cf5b641", 00:20:59.264 "optimal_io_boundary": 0 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "bdev_wait_for_examine" 00:20:59.264 } 00:20:59.264 ] 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "subsystem": "nbd", 00:20:59.264 "config": [] 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "subsystem": "scheduler", 00:20:59.264 "config": [ 00:20:59.264 { 00:20:59.264 "method": "framework_set_scheduler", 00:20:59.264 "params": { 00:20:59.264 "name": "static" 00:20:59.264 } 00:20:59.264 } 00:20:59.264 ] 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "subsystem": "nvmf", 00:20:59.264 "config": [ 00:20:59.264 { 00:20:59.264 "method": "nvmf_set_config", 00:20:59.264 "params": { 00:20:59.264 "discovery_filter": "match_any", 00:20:59.264 "admin_cmd_passthru": { 00:20:59.264 "identify_ctrlr": false 00:20:59.264 } 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "nvmf_set_max_subsystems", 00:20:59.264 "params": { 00:20:59.264 "max_subsystems": 1024 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "nvmf_set_crdt", 00:20:59.264 "params": { 00:20:59.264 "crdt1": 0, 00:20:59.264 "crdt2": 0, 00:20:59.264 "crdt3": 0 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "nvmf_create_transport", 00:20:59.264 "params": { 00:20:59.264 "trtype": "TCP", 00:20:59.264 "max_queue_depth": 128, 00:20:59.264 "max_io_qpairs_per_ctrlr": 127, 00:20:59.264 "in_capsule_data_size": 4096, 00:20:59.264 "max_io_size": 131072, 00:20:59.264 "io_unit_size": 131072, 00:20:59.264 "max_aq_depth": 128, 00:20:59.264 "num_shared_buffers": 511, 00:20:59.264 "buf_cache_size": 4294967295, 00:20:59.264 "dif_insert_or_strip": false, 00:20:59.264 "zcopy": false, 00:20:59.264 "c2h_success": false, 00:20:59.264 "sock_priority": 0, 00:20:59.264 "abort_timeout_sec": 1 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "nvmf_create_subsystem", 00:20:59.264 "params": { 00:20:59.264 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.264 "allow_any_host": false, 00:20:59.264 "serial_number": "SPDK00000000000001", 00:20:59.264 "model_number": "SPDK bdev Controller", 00:20:59.264 "max_namespaces": 10, 00:20:59.264 "min_cntlid": 1, 00:20:59.264 "max_cntlid": 65519, 00:20:59.264 "ana_reporting": false 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "nvmf_subsystem_add_host", 00:20:59.264 "params": { 00:20:59.264 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.264 "host": "nqn.2016-06.io.spdk:host1", 00:20:59.264 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "nvmf_subsystem_add_ns", 00:20:59.264 "params": { 00:20:59.264 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.264 "namespace": { 00:20:59.264 "nsid": 1, 00:20:59.264 "bdev_name": "malloc0", 00:20:59.264 "nguid": "F3B239907A3546279E8E56086CF5B641", 00:20:59.264 "uuid": "f3b23990-7a35-4627-9e8e-56086cf5b641" 00:20:59.264 } 00:20:59.264 } 00:20:59.264 }, 00:20:59.264 { 00:20:59.264 "method": "nvmf_subsystem_add_listener", 00:20:59.264 "params": { 00:20:59.264 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.264 "listen_address": { 00:20:59.264 "trtype": "TCP", 00:20:59.264 "adrfam": "IPv4", 00:20:59.264 "traddr": "10.0.0.2", 00:20:59.264 "trsvcid": "4420" 00:20:59.264 }, 00:20:59.264 "secure_channel": true 00:20:59.264 } 00:20:59.264 } 00:20:59.264 ] 00:20:59.264 } 00:20:59.264 ] 00:20:59.264 }' 00:20:59.264 04:22:49 -- target/tls.sh@206 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock save_config 00:20:59.522 04:22:50 -- target/tls.sh@206 -- # bdevperfconf='{ 00:20:59.522 "subsystems": [ 00:20:59.522 { 00:20:59.522 "subsystem": "iobuf", 00:20:59.522 "config": [ 00:20:59.522 { 00:20:59.522 "method": "iobuf_set_options", 00:20:59.522 "params": { 00:20:59.522 "small_pool_count": 8192, 00:20:59.522 "large_pool_count": 1024, 00:20:59.522 "small_bufsize": 8192, 00:20:59.522 "large_bufsize": 135168 00:20:59.522 } 00:20:59.522 } 00:20:59.522 ] 00:20:59.522 }, 00:20:59.522 { 00:20:59.522 "subsystem": "sock", 00:20:59.522 "config": [ 00:20:59.522 { 00:20:59.522 "method": "sock_impl_set_options", 00:20:59.522 "params": { 00:20:59.522 "impl_name": "posix", 00:20:59.522 "recv_buf_size": 2097152, 00:20:59.522 "send_buf_size": 2097152, 00:20:59.522 "enable_recv_pipe": true, 00:20:59.522 "enable_quickack": false, 00:20:59.522 "enable_placement_id": 0, 00:20:59.522 "enable_zerocopy_send_server": true, 00:20:59.522 "enable_zerocopy_send_client": false, 00:20:59.522 "zerocopy_threshold": 0, 00:20:59.522 "tls_version": 0, 00:20:59.522 "enable_ktls": false 00:20:59.522 } 00:20:59.522 }, 00:20:59.522 { 00:20:59.522 "method": "sock_impl_set_options", 00:20:59.522 "params": { 00:20:59.522 "impl_name": "ssl", 00:20:59.522 "recv_buf_size": 4096, 00:20:59.522 "send_buf_size": 4096, 00:20:59.522 "enable_recv_pipe": true, 00:20:59.522 "enable_quickack": false, 00:20:59.522 "enable_placement_id": 0, 00:20:59.522 "enable_zerocopy_send_server": true, 00:20:59.522 "enable_zerocopy_send_client": false, 00:20:59.522 "zerocopy_threshold": 0, 00:20:59.522 "tls_version": 0, 00:20:59.522 "enable_ktls": false 00:20:59.522 } 00:20:59.522 } 00:20:59.522 ] 00:20:59.522 }, 00:20:59.522 { 00:20:59.522 "subsystem": "vmd", 00:20:59.522 "config": [] 00:20:59.522 }, 00:20:59.522 { 00:20:59.522 "subsystem": "accel", 00:20:59.522 "config": [ 00:20:59.522 { 00:20:59.522 "method": "accel_set_options", 00:20:59.522 "params": { 00:20:59.522 "small_cache_size": 128, 00:20:59.522 "large_cache_size": 16, 00:20:59.522 "task_count": 2048, 00:20:59.522 "sequence_count": 2048, 00:20:59.522 "buf_count": 2048 00:20:59.522 } 00:20:59.522 } 00:20:59.522 ] 00:20:59.522 }, 00:20:59.522 { 00:20:59.522 "subsystem": "bdev", 00:20:59.522 "config": [ 00:20:59.522 { 00:20:59.522 "method": "bdev_set_options", 00:20:59.522 "params": { 00:20:59.522 "bdev_io_pool_size": 65535, 00:20:59.522 "bdev_io_cache_size": 256, 00:20:59.522 "bdev_auto_examine": true, 00:20:59.522 "iobuf_small_cache_size": 128, 00:20:59.522 "iobuf_large_cache_size": 16 00:20:59.522 } 00:20:59.522 }, 00:20:59.522 { 00:20:59.522 "method": "bdev_raid_set_options", 00:20:59.522 "params": { 00:20:59.522 "process_window_size_kb": 1024 00:20:59.522 } 00:20:59.522 }, 00:20:59.523 { 00:20:59.523 "method": "bdev_iscsi_set_options", 00:20:59.523 "params": { 00:20:59.523 "timeout_sec": 30 00:20:59.523 } 00:20:59.523 }, 00:20:59.523 { 00:20:59.523 "method": "bdev_nvme_set_options", 00:20:59.523 "params": { 00:20:59.523 "action_on_timeout": "none", 00:20:59.523 "timeout_us": 0, 00:20:59.523 "timeout_admin_us": 0, 00:20:59.523 "keep_alive_timeout_ms": 10000, 00:20:59.523 "transport_retry_count": 4, 00:20:59.523 "arbitration_burst": 0, 00:20:59.523 "low_priority_weight": 0, 00:20:59.523 "medium_priority_weight": 0, 00:20:59.523 "high_priority_weight": 0, 00:20:59.523 "nvme_adminq_poll_period_us": 10000, 00:20:59.523 "nvme_ioq_poll_period_us": 0, 00:20:59.523 "io_queue_requests": 512, 00:20:59.523 "delay_cmd_submit": true, 00:20:59.523 "bdev_retry_count": 3, 00:20:59.523 "transport_ack_timeout": 0, 00:20:59.523 "ctrlr_loss_timeout_sec": 0, 00:20:59.523 "reconnect_delay_sec": 0, 00:20:59.523 "fast_io_fail_timeout_sec": 0, 00:20:59.523 "generate_uuids": false, 00:20:59.523 "transport_tos": 0, 00:20:59.523 "io_path_stat": false, 00:20:59.523 "allow_accel_sequence": false 00:20:59.523 } 00:20:59.523 }, 00:20:59.523 { 00:20:59.523 "method": "bdev_nvme_attach_controller", 00:20:59.523 "params": { 00:20:59.523 "name": "TLSTEST", 00:20:59.523 "trtype": "TCP", 00:20:59.523 "adrfam": "IPv4", 00:20:59.523 "traddr": "10.0.0.2", 00:20:59.523 "trsvcid": "4420", 00:20:59.523 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:20:59.523 "prchk_reftag": false, 00:20:59.523 "prchk_guard": false, 00:20:59.523 "ctrlr_loss_timeout_sec": 0, 00:20:59.523 "reconnect_delay_sec": 0, 00:20:59.523 "fast_io_fail_timeout_sec": 0, 00:20:59.523 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:20:59.523 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:20:59.523 "hdgst": false, 00:20:59.523 "ddgst": false 00:20:59.523 } 00:20:59.523 }, 00:20:59.523 { 00:20:59.523 "method": "bdev_nvme_set_hotplug", 00:20:59.523 "params": { 00:20:59.523 "period_us": 100000, 00:20:59.523 "enable": false 00:20:59.523 } 00:20:59.523 }, 00:20:59.523 { 00:20:59.523 "method": "bdev_wait_for_examine" 00:20:59.523 } 00:20:59.523 ] 00:20:59.523 }, 00:20:59.523 { 00:20:59.523 "subsystem": "nbd", 00:20:59.523 "config": [] 00:20:59.523 } 00:20:59.523 ] 00:20:59.523 }' 00:20:59.523 04:22:50 -- target/tls.sh@208 -- # killprocess 2394120 00:20:59.523 04:22:50 -- common/autotest_common.sh@936 -- # '[' -z 2394120 ']' 00:20:59.523 04:22:50 -- common/autotest_common.sh@940 -- # kill -0 2394120 00:20:59.523 04:22:50 -- common/autotest_common.sh@941 -- # uname 00:20:59.523 04:22:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:59.523 04:22:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2394120 00:20:59.523 04:22:50 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:20:59.523 04:22:50 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:20:59.523 04:22:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2394120' 00:20:59.523 killing process with pid 2394120 00:20:59.523 04:22:50 -- common/autotest_common.sh@955 -- # kill 2394120 00:20:59.523 Received shutdown signal, test time was about 10.000000 seconds 00:20:59.523 00:20:59.523 Latency(us) 00:20:59.523 [2024-11-30T03:22:50.154Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:20:59.523 [2024-11-30T03:22:50.154Z] =================================================================================================================== 00:20:59.523 [2024-11-30T03:22:50.154Z] Total : 0.00 0.00 0.00 0.00 0.00 18446744073709551616.00 0.00 00:20:59.523 04:22:50 -- common/autotest_common.sh@960 -- # wait 2394120 00:20:59.781 04:22:50 -- target/tls.sh@209 -- # killprocess 2393822 00:20:59.781 04:22:50 -- common/autotest_common.sh@936 -- # '[' -z 2393822 ']' 00:20:59.781 04:22:50 -- common/autotest_common.sh@940 -- # kill -0 2393822 00:20:59.781 04:22:50 -- common/autotest_common.sh@941 -- # uname 00:20:59.781 04:22:50 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:20:59.781 04:22:50 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2393822 00:20:59.781 04:22:50 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:20:59.781 04:22:50 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:20:59.781 04:22:50 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2393822' 00:20:59.781 killing process with pid 2393822 00:20:59.781 04:22:50 -- common/autotest_common.sh@955 -- # kill 2393822 00:20:59.781 04:22:50 -- common/autotest_common.sh@960 -- # wait 2393822 00:21:00.040 04:22:50 -- target/tls.sh@212 -- # nvmfappstart -m 0x2 -c /dev/fd/62 00:21:00.040 04:22:50 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:00.040 04:22:50 -- target/tls.sh@212 -- # echo '{ 00:21:00.040 "subsystems": [ 00:21:00.040 { 00:21:00.040 "subsystem": "iobuf", 00:21:00.040 "config": [ 00:21:00.040 { 00:21:00.040 "method": "iobuf_set_options", 00:21:00.040 "params": { 00:21:00.040 "small_pool_count": 8192, 00:21:00.040 "large_pool_count": 1024, 00:21:00.040 "small_bufsize": 8192, 00:21:00.040 "large_bufsize": 135168 00:21:00.040 } 00:21:00.040 } 00:21:00.040 ] 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "subsystem": "sock", 00:21:00.040 "config": [ 00:21:00.040 { 00:21:00.040 "method": "sock_impl_set_options", 00:21:00.040 "params": { 00:21:00.040 "impl_name": "posix", 00:21:00.040 "recv_buf_size": 2097152, 00:21:00.040 "send_buf_size": 2097152, 00:21:00.040 "enable_recv_pipe": true, 00:21:00.040 "enable_quickack": false, 00:21:00.040 "enable_placement_id": 0, 00:21:00.040 "enable_zerocopy_send_server": true, 00:21:00.040 "enable_zerocopy_send_client": false, 00:21:00.040 "zerocopy_threshold": 0, 00:21:00.040 "tls_version": 0, 00:21:00.040 "enable_ktls": false 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "sock_impl_set_options", 00:21:00.040 "params": { 00:21:00.040 "impl_name": "ssl", 00:21:00.040 "recv_buf_size": 4096, 00:21:00.040 "send_buf_size": 4096, 00:21:00.040 "enable_recv_pipe": true, 00:21:00.040 "enable_quickack": false, 00:21:00.040 "enable_placement_id": 0, 00:21:00.040 "enable_zerocopy_send_server": true, 00:21:00.040 "enable_zerocopy_send_client": false, 00:21:00.040 "zerocopy_threshold": 0, 00:21:00.040 "tls_version": 0, 00:21:00.040 "enable_ktls": false 00:21:00.040 } 00:21:00.040 } 00:21:00.040 ] 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "subsystem": "vmd", 00:21:00.040 "config": [] 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "subsystem": "accel", 00:21:00.040 "config": [ 00:21:00.040 { 00:21:00.040 "method": "accel_set_options", 00:21:00.040 "params": { 00:21:00.040 "small_cache_size": 128, 00:21:00.040 "large_cache_size": 16, 00:21:00.040 "task_count": 2048, 00:21:00.040 "sequence_count": 2048, 00:21:00.040 "buf_count": 2048 00:21:00.040 } 00:21:00.040 } 00:21:00.040 ] 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "subsystem": "bdev", 00:21:00.040 "config": [ 00:21:00.040 { 00:21:00.040 "method": "bdev_set_options", 00:21:00.040 "params": { 00:21:00.040 "bdev_io_pool_size": 65535, 00:21:00.040 "bdev_io_cache_size": 256, 00:21:00.040 "bdev_auto_examine": true, 00:21:00.040 "iobuf_small_cache_size": 128, 00:21:00.040 "iobuf_large_cache_size": 16 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "bdev_raid_set_options", 00:21:00.040 "params": { 00:21:00.040 "process_window_size_kb": 1024 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "bdev_iscsi_set_options", 00:21:00.040 "params": { 00:21:00.040 "timeout_sec": 30 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "bdev_nvme_set_options", 00:21:00.040 "params": { 00:21:00.040 "action_on_timeout": "none", 00:21:00.040 "timeout_us": 0, 00:21:00.040 "timeout_admin_us": 0, 00:21:00.040 "keep_alive_timeout_ms": 10000, 00:21:00.040 "transport_retry_count": 4, 00:21:00.040 "arbitration_burst": 0, 00:21:00.040 "low_priority_weight": 0, 00:21:00.040 "medium_priority_weight": 0, 00:21:00.040 "high_priority_weight": 0, 00:21:00.040 "nvme_adminq_poll_period_us": 10000, 00:21:00.040 "nvme_ioq_poll_period_us": 0, 00:21:00.040 "io_queue_requests": 0, 00:21:00.040 "delay_cmd_submit": true, 00:21:00.040 "bdev_retry_count": 3, 00:21:00.040 "transport_ack_timeout": 0, 00:21:00.040 "ctrlr_loss_timeout_sec": 0, 00:21:00.040 "reconnect_delay_sec": 0, 00:21:00.040 "fast_io_fail_timeout_sec": 0, 00:21:00.040 "generate_uuids": false, 00:21:00.040 "transport_tos": 0, 00:21:00.040 "io_path_stat": false, 00:21:00.040 "allow_accel_sequence": false 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "bdev_nvme_set_hotplug", 00:21:00.040 "params": { 00:21:00.040 "period_us": 100000, 00:21:00.040 "enable": false 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "bdev_malloc_create", 00:21:00.040 "params": { 00:21:00.040 "name": "malloc0", 00:21:00.040 "num_blocks": 8192, 00:21:00.040 "block_size": 4096, 00:21:00.040 "physical_block_size": 4096, 00:21:00.040 "uuid": "f3b23990-7a35-4627-9e8e-56086cf5b641", 00:21:00.040 "optimal_io_boundary": 0 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "bdev_wait_for_examine" 00:21:00.040 } 00:21:00.040 ] 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "subsystem": "nbd", 00:21:00.040 "config": [] 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "subsystem": "scheduler", 00:21:00.040 "config": [ 00:21:00.040 { 00:21:00.040 "method": "framework_set_scheduler", 00:21:00.040 "params": { 00:21:00.040 "name": "static" 00:21:00.040 } 00:21:00.040 } 00:21:00.040 ] 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "subsystem": "nvmf", 00:21:00.040 "config": [ 00:21:00.040 { 00:21:00.040 "method": "nvmf_set_config", 00:21:00.040 "params": { 00:21:00.040 "discovery_filter": "match_any", 00:21:00.040 "admin_cmd_passthru": { 00:21:00.040 "identify_ctrlr": false 00:21:00.040 } 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "nvmf_set_max_subsystems", 00:21:00.040 "params": { 00:21:00.040 "max_subsystems": 1024 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "nvmf_set_crdt", 00:21:00.040 "params": { 00:21:00.040 "crdt1": 0, 00:21:00.040 "crdt2": 0, 00:21:00.040 "crdt3": 0 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "nvmf_create_transport", 00:21:00.040 "params": { 00:21:00.040 "trtype": "TCP", 00:21:00.040 "max_queue_depth": 128, 00:21:00.040 "max_io_qpairs_per_ctrlr": 127, 00:21:00.040 "in_capsule_data_size": 4096, 00:21:00.040 "max_io_size": 131072, 00:21:00.040 "io_unit_size": 131072, 00:21:00.040 "max_aq_depth": 128, 00:21:00.040 "num_shared_buffers": 511, 00:21:00.040 "buf_cache_size": 4294967295, 00:21:00.040 "dif_insert_or_strip": false, 00:21:00.040 "zcopy": false, 00:21:00.040 "c2h_success": false, 00:21:00.040 "sock_priority": 0, 00:21:00.040 "abort_timeout_sec": 1 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "nvmf_create_subsystem", 00:21:00.040 "params": { 00:21:00.040 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:00.040 "allow_any_host": false, 00:21:00.040 "serial_number": "SPDK00000000000001", 00:21:00.040 "model_number": "SPDK bdev Controller", 00:21:00.040 "max_namespaces": 10, 00:21:00.040 "min_cntlid": 1, 00:21:00.040 "max_cntlid": 65519, 00:21:00.040 "ana_reporting": false 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "nvmf_subsystem_add_host", 00:21:00.040 "params": { 00:21:00.040 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:00.040 "host": "nqn.2016-06.io.spdk:host1", 00:21:00.040 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt" 00:21:00.040 } 00:21:00.040 }, 00:21:00.040 { 00:21:00.040 "method": "nvmf_subsystem_add_ns", 00:21:00.040 "params": { 00:21:00.040 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:00.040 "namespace": { 00:21:00.040 "nsid": 1, 00:21:00.040 "bdev_name": "malloc0", 00:21:00.040 "nguid": "F3B239907A3546279E8E56086CF5B641", 00:21:00.041 "uuid": "f3b23990-7a35-4627-9e8e-56086cf5b641" 00:21:00.041 } 00:21:00.041 } 00:21:00.041 }, 00:21:00.041 { 00:21:00.041 "method": "nvmf_subsystem_add_listener", 00:21:00.041 "params": { 00:21:00.041 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:21:00.041 "listen_address": { 00:21:00.041 "trtype": "TCP", 00:21:00.041 "adrfam": "IPv4", 00:21:00.041 "traddr": "10.0.0.2", 00:21:00.041 "trsvcid": "4420" 00:21:00.041 }, 00:21:00.041 "secure_channel": true 00:21:00.041 } 00:21:00.041 } 00:21:00.041 ] 00:21:00.041 } 00:21:00.041 ] 00:21:00.041 }' 00:21:00.041 04:22:50 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:00.041 04:22:50 -- common/autotest_common.sh@10 -- # set +x 00:21:00.041 04:22:50 -- nvmf/common.sh@469 -- # nvmfpid=2394415 00:21:00.041 04:22:50 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 -c /dev/fd/62 00:21:00.041 04:22:50 -- nvmf/common.sh@470 -- # waitforlisten 2394415 00:21:00.041 04:22:50 -- common/autotest_common.sh@829 -- # '[' -z 2394415 ']' 00:21:00.041 04:22:50 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:00.041 04:22:50 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:00.041 04:22:50 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:00.041 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:00.041 04:22:50 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:00.041 04:22:50 -- common/autotest_common.sh@10 -- # set +x 00:21:00.041 [2024-11-30 04:22:50.649821] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:00.041 [2024-11-30 04:22:50.649921] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:00.299 EAL: No free 2048 kB hugepages reported on node 1 00:21:00.299 [2024-11-30 04:22:50.715729] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:00.299 [2024-11-30 04:22:50.807484] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:00.299 [2024-11-30 04:22:50.807646] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:00.299 [2024-11-30 04:22:50.807665] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:00.299 [2024-11-30 04:22:50.807679] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:00.299 [2024-11-30 04:22:50.807706] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:00.557 [2024-11-30 04:22:51.029010] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:00.557 [2024-11-30 04:22:51.061039] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:00.557 [2024-11-30 04:22:51.061328] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:01.118 04:22:51 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:01.118 04:22:51 -- common/autotest_common.sh@862 -- # return 0 00:21:01.118 04:22:51 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:01.118 04:22:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:01.118 04:22:51 -- common/autotest_common.sh@10 -- # set +x 00:21:01.119 04:22:51 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:01.119 04:22:51 -- target/tls.sh@216 -- # bdevperf_pid=2394571 00:21:01.119 04:22:51 -- target/tls.sh@217 -- # waitforlisten 2394571 /var/tmp/bdevperf.sock 00:21:01.119 04:22:51 -- common/autotest_common.sh@829 -- # '[' -z 2394571 ']' 00:21:01.119 04:22:51 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:01.119 04:22:51 -- target/tls.sh@213 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 -c /dev/fd/63 00:21:01.119 04:22:51 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:01.119 04:22:51 -- target/tls.sh@213 -- # echo '{ 00:21:01.119 "subsystems": [ 00:21:01.119 { 00:21:01.119 "subsystem": "iobuf", 00:21:01.119 "config": [ 00:21:01.119 { 00:21:01.119 "method": "iobuf_set_options", 00:21:01.119 "params": { 00:21:01.119 "small_pool_count": 8192, 00:21:01.119 "large_pool_count": 1024, 00:21:01.119 "small_bufsize": 8192, 00:21:01.119 "large_bufsize": 135168 00:21:01.119 } 00:21:01.119 } 00:21:01.119 ] 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "subsystem": "sock", 00:21:01.119 "config": [ 00:21:01.119 { 00:21:01.119 "method": "sock_impl_set_options", 00:21:01.119 "params": { 00:21:01.119 "impl_name": "posix", 00:21:01.119 "recv_buf_size": 2097152, 00:21:01.119 "send_buf_size": 2097152, 00:21:01.119 "enable_recv_pipe": true, 00:21:01.119 "enable_quickack": false, 00:21:01.119 "enable_placement_id": 0, 00:21:01.119 "enable_zerocopy_send_server": true, 00:21:01.119 "enable_zerocopy_send_client": false, 00:21:01.119 "zerocopy_threshold": 0, 00:21:01.119 "tls_version": 0, 00:21:01.119 "enable_ktls": false 00:21:01.119 } 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "method": "sock_impl_set_options", 00:21:01.119 "params": { 00:21:01.119 "impl_name": "ssl", 00:21:01.119 "recv_buf_size": 4096, 00:21:01.119 "send_buf_size": 4096, 00:21:01.119 "enable_recv_pipe": true, 00:21:01.119 "enable_quickack": false, 00:21:01.119 "enable_placement_id": 0, 00:21:01.119 "enable_zerocopy_send_server": true, 00:21:01.119 "enable_zerocopy_send_client": false, 00:21:01.119 "zerocopy_threshold": 0, 00:21:01.119 "tls_version": 0, 00:21:01.119 "enable_ktls": false 00:21:01.119 } 00:21:01.119 } 00:21:01.119 ] 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "subsystem": "vmd", 00:21:01.119 "config": [] 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "subsystem": "accel", 00:21:01.119 "config": [ 00:21:01.119 { 00:21:01.119 "method": "accel_set_options", 00:21:01.119 "params": { 00:21:01.119 "small_cache_size": 128, 00:21:01.119 "large_cache_size": 16, 00:21:01.119 "task_count": 2048, 00:21:01.119 "sequence_count": 2048, 00:21:01.119 "buf_count": 2048 00:21:01.119 } 00:21:01.119 } 00:21:01.119 ] 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "subsystem": "bdev", 00:21:01.119 "config": [ 00:21:01.119 { 00:21:01.119 "method": "bdev_set_options", 00:21:01.119 "params": { 00:21:01.119 "bdev_io_pool_size": 65535, 00:21:01.119 "bdev_io_cache_size": 256, 00:21:01.119 "bdev_auto_examine": true, 00:21:01.119 "iobuf_small_cache_size": 128, 00:21:01.119 "iobuf_large_cache_size": 16 00:21:01.119 } 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "method": "bdev_raid_set_options", 00:21:01.119 "params": { 00:21:01.119 "process_window_size_kb": 1024 00:21:01.119 } 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "method": "bdev_iscsi_set_options", 00:21:01.119 "params": { 00:21:01.119 "timeout_sec": 30 00:21:01.119 } 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "method": "bdev_nvme_set_options", 00:21:01.119 "params": { 00:21:01.119 "action_on_timeout": "none", 00:21:01.119 "timeout_us": 0, 00:21:01.119 "timeout_admin_us": 0, 00:21:01.119 "keep_alive_timeout_ms": 10000, 00:21:01.119 "transport_retry_count": 4, 00:21:01.119 "arbitration_burst": 0, 00:21:01.119 "low_priority_weight": 0, 00:21:01.119 "medium_priority_weight": 0, 00:21:01.119 "high_priority_weight": 0, 00:21:01.119 "nvme_adminq_poll_period_us": 10000, 00:21:01.119 "nvme_ioq_poll_period_us": 0, 00:21:01.119 "io_queue_requests": 512, 00:21:01.119 "delay_cmd_submit": true, 00:21:01.119 "bdev_retry_count": 3, 00:21:01.119 "transport_ack_timeout": 0, 00:21:01.119 "ctrlr_loss_timeout_sec": 0, 00:21:01.119 "reconnect_delay_sec": 0, 00:21:01.119 "fast_io_fail_timeout_sec": 0, 00:21:01.119 "generate_uuids": false, 00:21:01.119 "transport_tos": 0, 00:21:01.119 "io_path_stat": false, 00:21:01.119 "allow_accel_sequence": false 00:21:01.119 } 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "method": "bdev_nvme_attach_controller", 00:21:01.119 "params": { 00:21:01.119 "name": "TLSTEST", 00:21:01.119 "trtype": "TCP", 00:21:01.119 "adrfam": "IPv4", 00:21:01.119 "traddr": "10.0.0.2", 00:21:01.119 "trsvcid": "4420", 00:21:01.119 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:21:01.119 "prchk_reftag": false, 00:21:01.119 "prchk_guard": false, 00:21:01.119 "ctrlr_loss_timeout_sec": 0, 00:21:01.119 "reconnect_delay_sec": 0, 00:21:01.119 "fast_io_fail_timeout_sec": 0, 00:21:01.119 "psk": "/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt", 00:21:01.119 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:21:01.119 "hdgst": false, 00:21:01.119 "ddgst": false 00:21:01.119 } 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "method": "bdev_nvme_set_hotplug", 00:21:01.119 "params": { 00:21:01.119 "period_us": 100000, 00:21:01.119 "enable": false 00:21:01.119 } 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "method": "bdev_wait_for_examine" 00:21:01.119 } 00:21:01.119 ] 00:21:01.119 }, 00:21:01.119 { 00:21:01.119 "subsystem": "nbd", 00:21:01.119 "config": [] 00:21:01.119 } 00:21:01.119 ] 00:21:01.119 }' 00:21:01.119 04:22:51 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:01.119 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:01.119 04:22:51 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:01.119 04:22:51 -- common/autotest_common.sh@10 -- # set +x 00:21:01.119 [2024-11-30 04:22:51.666732] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:01.119 [2024-11-30 04:22:51.666808] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2394571 ] 00:21:01.119 EAL: No free 2048 kB hugepages reported on node 1 00:21:01.119 [2024-11-30 04:22:51.723766] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:01.376 [2024-11-30 04:22:51.806439] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:01.376 [2024-11-30 04:22:51.961058] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:02.305 04:22:52 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:02.305 04:22:52 -- common/autotest_common.sh@862 -- # return 0 00:21:02.305 04:22:52 -- target/tls.sh@220 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -t 20 -s /var/tmp/bdevperf.sock perform_tests 00:21:02.305 Running I/O for 10 seconds... 00:21:12.263 00:21:12.263 Latency(us) 00:21:12.263 [2024-11-30T03:23:02.894Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:12.263 [2024-11-30T03:23:02.894Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:12.263 Verification LBA range: start 0x0 length 0x2000 00:21:12.263 TLSTESTn1 : 10.02 4572.89 17.86 0.00 0.00 27947.97 4805.97 47574.28 00:21:12.263 [2024-11-30T03:23:02.894Z] =================================================================================================================== 00:21:12.263 [2024-11-30T03:23:02.894Z] Total : 4572.89 17.86 0.00 0.00 27947.97 4805.97 47574.28 00:21:12.263 0 00:21:12.263 04:23:02 -- target/tls.sh@222 -- # trap 'nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:21:12.263 04:23:02 -- target/tls.sh@223 -- # killprocess 2394571 00:21:12.263 04:23:02 -- common/autotest_common.sh@936 -- # '[' -z 2394571 ']' 00:21:12.263 04:23:02 -- common/autotest_common.sh@940 -- # kill -0 2394571 00:21:12.263 04:23:02 -- common/autotest_common.sh@941 -- # uname 00:21:12.263 04:23:02 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:12.263 04:23:02 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2394571 00:21:12.263 04:23:02 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:12.263 04:23:02 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:12.263 04:23:02 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2394571' 00:21:12.263 killing process with pid 2394571 00:21:12.263 04:23:02 -- common/autotest_common.sh@955 -- # kill 2394571 00:21:12.263 Received shutdown signal, test time was about 10.000000 seconds 00:21:12.263 00:21:12.263 Latency(us) 00:21:12.263 [2024-11-30T03:23:02.894Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:12.263 [2024-11-30T03:23:02.894Z] =================================================================================================================== 00:21:12.263 [2024-11-30T03:23:02.894Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:12.263 04:23:02 -- common/autotest_common.sh@960 -- # wait 2394571 00:21:12.521 04:23:03 -- target/tls.sh@224 -- # killprocess 2394415 00:21:12.521 04:23:03 -- common/autotest_common.sh@936 -- # '[' -z 2394415 ']' 00:21:12.521 04:23:03 -- common/autotest_common.sh@940 -- # kill -0 2394415 00:21:12.521 04:23:03 -- common/autotest_common.sh@941 -- # uname 00:21:12.521 04:23:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:12.521 04:23:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2394415 00:21:12.521 04:23:03 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:12.521 04:23:03 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:12.521 04:23:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2394415' 00:21:12.521 killing process with pid 2394415 00:21:12.521 04:23:03 -- common/autotest_common.sh@955 -- # kill 2394415 00:21:12.521 04:23:03 -- common/autotest_common.sh@960 -- # wait 2394415 00:21:12.780 04:23:03 -- target/tls.sh@226 -- # trap - SIGINT SIGTERM EXIT 00:21:12.780 04:23:03 -- target/tls.sh@227 -- # cleanup 00:21:12.780 04:23:03 -- target/tls.sh@15 -- # process_shm --id 0 00:21:12.780 04:23:03 -- common/autotest_common.sh@806 -- # type=--id 00:21:12.780 04:23:03 -- common/autotest_common.sh@807 -- # id=0 00:21:12.780 04:23:03 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:12.780 04:23:03 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:12.780 04:23:03 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:12.780 04:23:03 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:12.780 04:23:03 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:12.780 04:23:03 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:12.780 nvmf_trace.0 00:21:13.038 04:23:03 -- common/autotest_common.sh@821 -- # return 0 00:21:13.038 04:23:03 -- target/tls.sh@16 -- # killprocess 2394571 00:21:13.038 04:23:03 -- common/autotest_common.sh@936 -- # '[' -z 2394571 ']' 00:21:13.038 04:23:03 -- common/autotest_common.sh@940 -- # kill -0 2394571 00:21:13.038 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2394571) - No such process 00:21:13.038 04:23:03 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2394571 is not found' 00:21:13.038 Process with pid 2394571 is not found 00:21:13.038 04:23:03 -- target/tls.sh@17 -- # nvmftestfini 00:21:13.038 04:23:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:13.038 04:23:03 -- nvmf/common.sh@116 -- # sync 00:21:13.038 04:23:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:13.038 04:23:03 -- nvmf/common.sh@119 -- # set +e 00:21:13.038 04:23:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:13.038 04:23:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:13.038 rmmod nvme_tcp 00:21:13.038 rmmod nvme_fabrics 00:21:13.038 rmmod nvme_keyring 00:21:13.038 04:23:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:13.038 04:23:03 -- nvmf/common.sh@123 -- # set -e 00:21:13.038 04:23:03 -- nvmf/common.sh@124 -- # return 0 00:21:13.038 04:23:03 -- nvmf/common.sh@477 -- # '[' -n 2394415 ']' 00:21:13.038 04:23:03 -- nvmf/common.sh@478 -- # killprocess 2394415 00:21:13.038 04:23:03 -- common/autotest_common.sh@936 -- # '[' -z 2394415 ']' 00:21:13.038 04:23:03 -- common/autotest_common.sh@940 -- # kill -0 2394415 00:21:13.038 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2394415) - No such process 00:21:13.038 04:23:03 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2394415 is not found' 00:21:13.038 Process with pid 2394415 is not found 00:21:13.038 04:23:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:13.038 04:23:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:13.038 04:23:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:13.038 04:23:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:13.038 04:23:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:13.038 04:23:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:13.038 04:23:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:13.038 04:23:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:14.937 04:23:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:14.937 04:23:05 -- target/tls.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key2.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/key_long.txt 00:21:14.937 00:21:14.937 real 1m14.754s 00:21:14.937 user 2m2.232s 00:21:14.937 sys 0m22.338s 00:21:14.937 04:23:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:14.937 04:23:05 -- common/autotest_common.sh@10 -- # set +x 00:21:14.937 ************************************ 00:21:14.937 END TEST nvmf_tls 00:21:14.937 ************************************ 00:21:14.937 04:23:05 -- nvmf/nvmf.sh@60 -- # run_test nvmf_fips /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:14.937 04:23:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:14.937 04:23:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:14.937 04:23:05 -- common/autotest_common.sh@10 -- # set +x 00:21:14.937 ************************************ 00:21:14.937 START TEST nvmf_fips 00:21:14.937 ************************************ 00:21:14.937 04:23:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/fips.sh --transport=tcp 00:21:15.196 * Looking for test storage... 00:21:15.196 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips 00:21:15.196 04:23:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:15.196 04:23:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:15.196 04:23:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:15.196 04:23:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:15.196 04:23:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:15.196 04:23:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:15.196 04:23:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:15.196 04:23:05 -- scripts/common.sh@335 -- # IFS=.-: 00:21:15.196 04:23:05 -- scripts/common.sh@335 -- # read -ra ver1 00:21:15.196 04:23:05 -- scripts/common.sh@336 -- # IFS=.-: 00:21:15.196 04:23:05 -- scripts/common.sh@336 -- # read -ra ver2 00:21:15.196 04:23:05 -- scripts/common.sh@337 -- # local 'op=<' 00:21:15.196 04:23:05 -- scripts/common.sh@339 -- # ver1_l=2 00:21:15.196 04:23:05 -- scripts/common.sh@340 -- # ver2_l=1 00:21:15.196 04:23:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:15.196 04:23:05 -- scripts/common.sh@343 -- # case "$op" in 00:21:15.196 04:23:05 -- scripts/common.sh@344 -- # : 1 00:21:15.196 04:23:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:15.196 04:23:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:15.196 04:23:05 -- scripts/common.sh@364 -- # decimal 1 00:21:15.196 04:23:05 -- scripts/common.sh@352 -- # local d=1 00:21:15.196 04:23:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:15.196 04:23:05 -- scripts/common.sh@354 -- # echo 1 00:21:15.196 04:23:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:15.196 04:23:05 -- scripts/common.sh@365 -- # decimal 2 00:21:15.196 04:23:05 -- scripts/common.sh@352 -- # local d=2 00:21:15.196 04:23:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:15.196 04:23:05 -- scripts/common.sh@354 -- # echo 2 00:21:15.196 04:23:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:15.196 04:23:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:15.196 04:23:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:15.196 04:23:05 -- scripts/common.sh@367 -- # return 0 00:21:15.196 04:23:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:15.196 04:23:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:15.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:15.196 --rc genhtml_branch_coverage=1 00:21:15.196 --rc genhtml_function_coverage=1 00:21:15.196 --rc genhtml_legend=1 00:21:15.196 --rc geninfo_all_blocks=1 00:21:15.196 --rc geninfo_unexecuted_blocks=1 00:21:15.196 00:21:15.196 ' 00:21:15.196 04:23:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:15.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:15.196 --rc genhtml_branch_coverage=1 00:21:15.196 --rc genhtml_function_coverage=1 00:21:15.196 --rc genhtml_legend=1 00:21:15.196 --rc geninfo_all_blocks=1 00:21:15.196 --rc geninfo_unexecuted_blocks=1 00:21:15.196 00:21:15.196 ' 00:21:15.196 04:23:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:15.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:15.196 --rc genhtml_branch_coverage=1 00:21:15.196 --rc genhtml_function_coverage=1 00:21:15.196 --rc genhtml_legend=1 00:21:15.196 --rc geninfo_all_blocks=1 00:21:15.196 --rc geninfo_unexecuted_blocks=1 00:21:15.196 00:21:15.196 ' 00:21:15.196 04:23:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:15.196 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:15.196 --rc genhtml_branch_coverage=1 00:21:15.196 --rc genhtml_function_coverage=1 00:21:15.196 --rc genhtml_legend=1 00:21:15.196 --rc geninfo_all_blocks=1 00:21:15.196 --rc geninfo_unexecuted_blocks=1 00:21:15.196 00:21:15.196 ' 00:21:15.196 04:23:05 -- fips/fips.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:15.196 04:23:05 -- nvmf/common.sh@7 -- # uname -s 00:21:15.196 04:23:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:15.196 04:23:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:15.196 04:23:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:15.196 04:23:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:15.196 04:23:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:15.196 04:23:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:15.196 04:23:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:15.196 04:23:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:15.196 04:23:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:15.196 04:23:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:15.196 04:23:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:15.196 04:23:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:15.196 04:23:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:15.196 04:23:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:15.196 04:23:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:15.196 04:23:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:15.196 04:23:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:15.196 04:23:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:15.196 04:23:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:15.197 04:23:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.197 04:23:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.197 04:23:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.197 04:23:05 -- paths/export.sh@5 -- # export PATH 00:21:15.197 04:23:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:15.197 04:23:05 -- nvmf/common.sh@46 -- # : 0 00:21:15.197 04:23:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:15.197 04:23:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:15.197 04:23:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:15.197 04:23:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:15.197 04:23:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:15.197 04:23:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:15.197 04:23:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:15.197 04:23:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:15.197 04:23:05 -- fips/fips.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:15.197 04:23:05 -- fips/fips.sh@89 -- # check_openssl_version 00:21:15.197 04:23:05 -- fips/fips.sh@83 -- # local target=3.0.0 00:21:15.197 04:23:05 -- fips/fips.sh@85 -- # openssl version 00:21:15.197 04:23:05 -- fips/fips.sh@85 -- # awk '{print $2}' 00:21:15.197 04:23:05 -- fips/fips.sh@85 -- # ge 3.1.1 3.0.0 00:21:15.197 04:23:05 -- scripts/common.sh@375 -- # cmp_versions 3.1.1 '>=' 3.0.0 00:21:15.197 04:23:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:15.197 04:23:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:15.197 04:23:05 -- scripts/common.sh@335 -- # IFS=.-: 00:21:15.197 04:23:05 -- scripts/common.sh@335 -- # read -ra ver1 00:21:15.197 04:23:05 -- scripts/common.sh@336 -- # IFS=.-: 00:21:15.197 04:23:05 -- scripts/common.sh@336 -- # read -ra ver2 00:21:15.197 04:23:05 -- scripts/common.sh@337 -- # local 'op=>=' 00:21:15.197 04:23:05 -- scripts/common.sh@339 -- # ver1_l=3 00:21:15.197 04:23:05 -- scripts/common.sh@340 -- # ver2_l=3 00:21:15.197 04:23:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:15.197 04:23:05 -- scripts/common.sh@343 -- # case "$op" in 00:21:15.197 04:23:05 -- scripts/common.sh@347 -- # : 1 00:21:15.197 04:23:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:15.197 04:23:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:15.197 04:23:05 -- scripts/common.sh@364 -- # decimal 3 00:21:15.197 04:23:05 -- scripts/common.sh@352 -- # local d=3 00:21:15.197 04:23:05 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:15.197 04:23:05 -- scripts/common.sh@354 -- # echo 3 00:21:15.197 04:23:05 -- scripts/common.sh@364 -- # ver1[v]=3 00:21:15.197 04:23:05 -- scripts/common.sh@365 -- # decimal 3 00:21:15.197 04:23:05 -- scripts/common.sh@352 -- # local d=3 00:21:15.197 04:23:05 -- scripts/common.sh@353 -- # [[ 3 =~ ^[0-9]+$ ]] 00:21:15.197 04:23:05 -- scripts/common.sh@354 -- # echo 3 00:21:15.197 04:23:05 -- scripts/common.sh@365 -- # ver2[v]=3 00:21:15.197 04:23:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:15.197 04:23:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:15.197 04:23:05 -- scripts/common.sh@363 -- # (( v++ )) 00:21:15.197 04:23:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:15.197 04:23:05 -- scripts/common.sh@364 -- # decimal 1 00:21:15.197 04:23:05 -- scripts/common.sh@352 -- # local d=1 00:21:15.197 04:23:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:15.197 04:23:05 -- scripts/common.sh@354 -- # echo 1 00:21:15.197 04:23:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:15.197 04:23:05 -- scripts/common.sh@365 -- # decimal 0 00:21:15.197 04:23:05 -- scripts/common.sh@352 -- # local d=0 00:21:15.197 04:23:05 -- scripts/common.sh@353 -- # [[ 0 =~ ^[0-9]+$ ]] 00:21:15.197 04:23:05 -- scripts/common.sh@354 -- # echo 0 00:21:15.197 04:23:05 -- scripts/common.sh@365 -- # ver2[v]=0 00:21:15.197 04:23:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:15.197 04:23:05 -- scripts/common.sh@366 -- # return 0 00:21:15.197 04:23:05 -- fips/fips.sh@95 -- # openssl info -modulesdir 00:21:15.197 04:23:05 -- fips/fips.sh@95 -- # [[ ! -f /usr/lib64/ossl-modules/fips.so ]] 00:21:15.197 04:23:05 -- fips/fips.sh@100 -- # openssl fipsinstall -help 00:21:15.197 04:23:05 -- fips/fips.sh@100 -- # warn='This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode' 00:21:15.197 04:23:05 -- fips/fips.sh@101 -- # [[ This command is not enabled in the Red Hat Enterprise Linux OpenSSL build, please consult Red Hat documentation to learn how to enable FIPS mode == \T\h\i\s\ \c\o\m\m\a\n\d\ \i\s\ \n\o\t\ \e\n\a\b\l\e\d* ]] 00:21:15.197 04:23:05 -- fips/fips.sh@104 -- # export callback=build_openssl_config 00:21:15.197 04:23:05 -- fips/fips.sh@104 -- # callback=build_openssl_config 00:21:15.197 04:23:05 -- fips/fips.sh@113 -- # build_openssl_config 00:21:15.197 04:23:05 -- fips/fips.sh@37 -- # cat 00:21:15.197 04:23:05 -- fips/fips.sh@57 -- # [[ ! -t 0 ]] 00:21:15.197 04:23:05 -- fips/fips.sh@58 -- # cat - 00:21:15.197 04:23:05 -- fips/fips.sh@114 -- # export OPENSSL_CONF=spdk_fips.conf 00:21:15.197 04:23:05 -- fips/fips.sh@114 -- # OPENSSL_CONF=spdk_fips.conf 00:21:15.197 04:23:05 -- fips/fips.sh@116 -- # mapfile -t providers 00:21:15.197 04:23:05 -- fips/fips.sh@116 -- # openssl list -providers 00:21:15.197 04:23:05 -- fips/fips.sh@116 -- # grep name 00:21:15.197 04:23:05 -- fips/fips.sh@120 -- # (( 2 != 2 )) 00:21:15.197 04:23:05 -- fips/fips.sh@120 -- # [[ name: openssl base provider != *base* ]] 00:21:15.197 04:23:05 -- fips/fips.sh@120 -- # [[ name: red hat enterprise linux 9 - openssl fips provider != *fips* ]] 00:21:15.197 04:23:05 -- fips/fips.sh@127 -- # NOT openssl md5 /dev/fd/62 00:21:15.197 04:23:05 -- fips/fips.sh@127 -- # : 00:21:15.197 04:23:05 -- common/autotest_common.sh@650 -- # local es=0 00:21:15.197 04:23:05 -- common/autotest_common.sh@652 -- # valid_exec_arg openssl md5 /dev/fd/62 00:21:15.197 04:23:05 -- common/autotest_common.sh@638 -- # local arg=openssl 00:21:15.197 04:23:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:15.197 04:23:05 -- common/autotest_common.sh@642 -- # type -t openssl 00:21:15.197 04:23:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:15.197 04:23:05 -- common/autotest_common.sh@644 -- # type -P openssl 00:21:15.197 04:23:05 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:21:15.197 04:23:05 -- common/autotest_common.sh@644 -- # arg=/usr/bin/openssl 00:21:15.197 04:23:05 -- common/autotest_common.sh@644 -- # [[ -x /usr/bin/openssl ]] 00:21:15.197 04:23:05 -- common/autotest_common.sh@653 -- # openssl md5 /dev/fd/62 00:21:15.197 Error setting digest 00:21:15.197 4092309DAF7F0000:error:0308010C:digital envelope routines:inner_evp_generic_fetch:unsupported:crypto/evp/evp_fetch.c:341:Global default library context, Algorithm (MD5 : 95), Properties () 00:21:15.197 4092309DAF7F0000:error:03000086:digital envelope routines:evp_md_init_internal:initialization error:crypto/evp/digest.c:272: 00:21:15.197 04:23:05 -- common/autotest_common.sh@653 -- # es=1 00:21:15.197 04:23:05 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:21:15.197 04:23:05 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:21:15.197 04:23:05 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:21:15.197 04:23:05 -- fips/fips.sh@130 -- # nvmftestinit 00:21:15.197 04:23:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:15.197 04:23:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:15.197 04:23:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:15.197 04:23:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:15.197 04:23:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:15.197 04:23:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:15.197 04:23:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:15.197 04:23:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:15.197 04:23:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:15.197 04:23:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:15.197 04:23:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:15.197 04:23:05 -- common/autotest_common.sh@10 -- # set +x 00:21:17.728 04:23:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:17.729 04:23:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:17.729 04:23:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:17.729 04:23:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:17.729 04:23:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:17.729 04:23:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:17.729 04:23:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:17.729 04:23:07 -- nvmf/common.sh@294 -- # net_devs=() 00:21:17.729 04:23:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:17.729 04:23:07 -- nvmf/common.sh@295 -- # e810=() 00:21:17.729 04:23:07 -- nvmf/common.sh@295 -- # local -ga e810 00:21:17.729 04:23:07 -- nvmf/common.sh@296 -- # x722=() 00:21:17.729 04:23:07 -- nvmf/common.sh@296 -- # local -ga x722 00:21:17.729 04:23:07 -- nvmf/common.sh@297 -- # mlx=() 00:21:17.729 04:23:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:17.729 04:23:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:17.729 04:23:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:17.729 04:23:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:17.729 04:23:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:17.729 04:23:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:17.729 04:23:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:17.729 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:17.729 04:23:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:17.729 04:23:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:17.729 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:17.729 04:23:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:17.729 04:23:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:17.729 04:23:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:17.729 04:23:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:17.729 04:23:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:17.729 04:23:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:17.729 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:17.729 04:23:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:17.729 04:23:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:17.729 04:23:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:17.729 04:23:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:17.729 04:23:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:17.729 04:23:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:17.729 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:17.729 04:23:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:17.729 04:23:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:17.729 04:23:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:17.729 04:23:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:17.729 04:23:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:17.729 04:23:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:17.729 04:23:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:17.729 04:23:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:17.729 04:23:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:17.729 04:23:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:17.729 04:23:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:17.729 04:23:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:17.729 04:23:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:17.729 04:23:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:17.729 04:23:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:17.729 04:23:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:17.729 04:23:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:17.729 04:23:07 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:17.729 04:23:07 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:17.729 04:23:07 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:17.729 04:23:07 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:17.729 04:23:07 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:17.729 04:23:07 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:17.729 04:23:07 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:17.729 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:17.729 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.226 ms 00:21:17.729 00:21:17.729 --- 10.0.0.2 ping statistics --- 00:21:17.729 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:17.729 rtt min/avg/max/mdev = 0.226/0.226/0.226/0.000 ms 00:21:17.729 04:23:07 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:17.729 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:17.729 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.126 ms 00:21:17.729 00:21:17.729 --- 10.0.0.1 ping statistics --- 00:21:17.729 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:17.729 rtt min/avg/max/mdev = 0.126/0.126/0.126/0.000 ms 00:21:17.729 04:23:07 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:17.729 04:23:07 -- nvmf/common.sh@410 -- # return 0 00:21:17.729 04:23:07 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:17.729 04:23:07 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:17.729 04:23:07 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:17.729 04:23:07 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:17.729 04:23:07 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:17.729 04:23:07 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:17.729 04:23:07 -- fips/fips.sh@131 -- # nvmfappstart -m 0x2 00:21:17.729 04:23:07 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:21:17.729 04:23:07 -- common/autotest_common.sh@722 -- # xtrace_disable 00:21:17.729 04:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:17.729 04:23:07 -- nvmf/common.sh@469 -- # nvmfpid=2397911 00:21:17.729 04:23:07 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:21:17.729 04:23:07 -- nvmf/common.sh@470 -- # waitforlisten 2397911 00:21:17.729 04:23:07 -- common/autotest_common.sh@829 -- # '[' -z 2397911 ']' 00:21:17.729 04:23:07 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:17.729 04:23:07 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:17.729 04:23:07 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:17.729 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:17.729 04:23:07 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:17.729 04:23:07 -- common/autotest_common.sh@10 -- # set +x 00:21:17.729 [2024-11-30 04:23:08.010791] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:17.729 [2024-11-30 04:23:08.010899] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:21:17.729 EAL: No free 2048 kB hugepages reported on node 1 00:21:17.729 [2024-11-30 04:23:08.079602] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:17.729 [2024-11-30 04:23:08.170771] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:21:17.729 [2024-11-30 04:23:08.170967] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:21:17.729 [2024-11-30 04:23:08.170989] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:21:17.729 [2024-11-30 04:23:08.171003] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:21:17.729 [2024-11-30 04:23:08.171044] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:21:18.663 04:23:08 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:18.663 04:23:08 -- common/autotest_common.sh@862 -- # return 0 00:21:18.663 04:23:08 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:21:18.663 04:23:08 -- common/autotest_common.sh@728 -- # xtrace_disable 00:21:18.663 04:23:08 -- common/autotest_common.sh@10 -- # set +x 00:21:18.663 04:23:08 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:21:18.663 04:23:08 -- fips/fips.sh@133 -- # trap cleanup EXIT 00:21:18.663 04:23:08 -- fips/fips.sh@136 -- # key=NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:18.663 04:23:08 -- fips/fips.sh@137 -- # key_path=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:18.663 04:23:08 -- fips/fips.sh@138 -- # echo -n NVMeTLSkey-1:01:VRLbtnN9AQb2WXW3c9+wEf/DRLz0QuLdbYvEhwtdWwNf9LrZ: 00:21:18.663 04:23:08 -- fips/fips.sh@139 -- # chmod 0600 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:18.663 04:23:08 -- fips/fips.sh@141 -- # setup_nvmf_tgt_conf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:18.663 04:23:08 -- fips/fips.sh@22 -- # local key=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:18.663 04:23:08 -- fips/fips.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:21:18.663 [2024-11-30 04:23:09.220352] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:21:18.663 [2024-11-30 04:23:09.236332] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:21:18.663 [2024-11-30 04:23:09.236621] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:21:18.663 malloc0 00:21:18.663 04:23:09 -- fips/fips.sh@144 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:21:18.663 04:23:09 -- fips/fips.sh@147 -- # bdevperf_pid=2398075 00:21:18.663 04:23:09 -- fips/fips.sh@145 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 0x4 -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 10 00:21:18.663 04:23:09 -- fips/fips.sh@148 -- # waitforlisten 2398075 /var/tmp/bdevperf.sock 00:21:18.663 04:23:09 -- common/autotest_common.sh@829 -- # '[' -z 2398075 ']' 00:21:18.663 04:23:09 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:21:18.663 04:23:09 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:18.663 04:23:09 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:21:18.663 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:21:18.663 04:23:09 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:18.663 04:23:09 -- common/autotest_common.sh@10 -- # set +x 00:21:18.921 [2024-11-30 04:23:09.360178] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:21:18.921 [2024-11-30 04:23:09.360278] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x4 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2398075 ] 00:21:18.921 EAL: No free 2048 kB hugepages reported on node 1 00:21:18.921 [2024-11-30 04:23:09.423341] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:21:18.921 [2024-11-30 04:23:09.514911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:21:19.854 04:23:10 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:19.854 04:23:10 -- common/autotest_common.sh@862 -- # return 0 00:21:19.854 04:23:10 -- fips/fips.sh@150 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b TLSTEST -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -q nqn.2016-06.io.spdk:host1 --psk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:20.112 [2024-11-30 04:23:10.609874] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:21:20.112 TLSTESTn1 00:21:20.112 04:23:10 -- fips/fips.sh@154 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:21:20.369 Running I/O for 10 seconds... 00:21:30.443 00:21:30.443 Latency(us) 00:21:30.443 [2024-11-30T03:23:21.074Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:30.443 [2024-11-30T03:23:21.074Z] Job: TLSTESTn1 (Core Mask 0x4, workload: verify, depth: 128, IO size: 4096) 00:21:30.443 Verification LBA range: start 0x0 length 0x2000 00:21:30.443 TLSTESTn1 : 10.02 4375.61 17.09 0.00 0.00 29208.18 6262.33 53205.52 00:21:30.443 [2024-11-30T03:23:21.074Z] =================================================================================================================== 00:21:30.443 [2024-11-30T03:23:21.074Z] Total : 4375.61 17.09 0.00 0.00 29208.18 6262.33 53205.52 00:21:30.443 0 00:21:30.443 04:23:20 -- fips/fips.sh@1 -- # cleanup 00:21:30.443 04:23:20 -- fips/fips.sh@15 -- # process_shm --id 0 00:21:30.443 04:23:20 -- common/autotest_common.sh@806 -- # type=--id 00:21:30.443 04:23:20 -- common/autotest_common.sh@807 -- # id=0 00:21:30.443 04:23:20 -- common/autotest_common.sh@808 -- # '[' --id = --pid ']' 00:21:30.443 04:23:20 -- common/autotest_common.sh@812 -- # find /dev/shm -name '*.0' -printf '%f\n' 00:21:30.443 04:23:20 -- common/autotest_common.sh@812 -- # shm_files=nvmf_trace.0 00:21:30.443 04:23:20 -- common/autotest_common.sh@814 -- # [[ -z nvmf_trace.0 ]] 00:21:30.443 04:23:20 -- common/autotest_common.sh@818 -- # for n in $shm_files 00:21:30.443 04:23:20 -- common/autotest_common.sh@819 -- # tar -C /dev/shm/ -cvzf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_trace.0_shm.tar.gz nvmf_trace.0 00:21:30.443 nvmf_trace.0 00:21:30.443 04:23:20 -- common/autotest_common.sh@821 -- # return 0 00:21:30.443 04:23:20 -- fips/fips.sh@16 -- # killprocess 2398075 00:21:30.443 04:23:20 -- common/autotest_common.sh@936 -- # '[' -z 2398075 ']' 00:21:30.443 04:23:20 -- common/autotest_common.sh@940 -- # kill -0 2398075 00:21:30.443 04:23:20 -- common/autotest_common.sh@941 -- # uname 00:21:30.443 04:23:20 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:30.443 04:23:20 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2398075 00:21:30.443 04:23:20 -- common/autotest_common.sh@942 -- # process_name=reactor_2 00:21:30.443 04:23:20 -- common/autotest_common.sh@946 -- # '[' reactor_2 = sudo ']' 00:21:30.443 04:23:20 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2398075' 00:21:30.443 killing process with pid 2398075 00:21:30.443 04:23:20 -- common/autotest_common.sh@955 -- # kill 2398075 00:21:30.443 Received shutdown signal, test time was about 10.000000 seconds 00:21:30.443 00:21:30.443 Latency(us) 00:21:30.443 [2024-11-30T03:23:21.074Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:21:30.443 [2024-11-30T03:23:21.074Z] =================================================================================================================== 00:21:30.443 [2024-11-30T03:23:21.074Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:21:30.443 04:23:20 -- common/autotest_common.sh@960 -- # wait 2398075 00:21:30.702 04:23:21 -- fips/fips.sh@17 -- # nvmftestfini 00:21:30.702 04:23:21 -- nvmf/common.sh@476 -- # nvmfcleanup 00:21:30.702 04:23:21 -- nvmf/common.sh@116 -- # sync 00:21:30.702 04:23:21 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:21:30.702 04:23:21 -- nvmf/common.sh@119 -- # set +e 00:21:30.702 04:23:21 -- nvmf/common.sh@120 -- # for i in {1..20} 00:21:30.702 04:23:21 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:21:30.702 rmmod nvme_tcp 00:21:30.702 rmmod nvme_fabrics 00:21:30.702 rmmod nvme_keyring 00:21:30.702 04:23:21 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:21:30.702 04:23:21 -- nvmf/common.sh@123 -- # set -e 00:21:30.702 04:23:21 -- nvmf/common.sh@124 -- # return 0 00:21:30.702 04:23:21 -- nvmf/common.sh@477 -- # '[' -n 2397911 ']' 00:21:30.702 04:23:21 -- nvmf/common.sh@478 -- # killprocess 2397911 00:21:30.702 04:23:21 -- common/autotest_common.sh@936 -- # '[' -z 2397911 ']' 00:21:30.702 04:23:21 -- common/autotest_common.sh@940 -- # kill -0 2397911 00:21:30.702 04:23:21 -- common/autotest_common.sh@941 -- # uname 00:21:30.702 04:23:21 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:21:30.702 04:23:21 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2397911 00:21:30.702 04:23:21 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:21:30.702 04:23:21 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:21:30.702 04:23:21 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2397911' 00:21:30.702 killing process with pid 2397911 00:21:30.702 04:23:21 -- common/autotest_common.sh@955 -- # kill 2397911 00:21:30.702 04:23:21 -- common/autotest_common.sh@960 -- # wait 2397911 00:21:30.961 04:23:21 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:21:30.961 04:23:21 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:21:30.961 04:23:21 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:21:30.961 04:23:21 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:21:30.961 04:23:21 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:21:30.961 04:23:21 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:30.961 04:23:21 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:30.961 04:23:21 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:33.496 04:23:23 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:21:33.496 04:23:23 -- fips/fips.sh@18 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/fips/key.txt 00:21:33.496 00:21:33.496 real 0m18.030s 00:21:33.496 user 0m23.284s 00:21:33.496 sys 0m6.051s 00:21:33.496 04:23:23 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:21:33.496 04:23:23 -- common/autotest_common.sh@10 -- # set +x 00:21:33.496 ************************************ 00:21:33.496 END TEST nvmf_fips 00:21:33.496 ************************************ 00:21:33.496 04:23:23 -- nvmf/nvmf.sh@63 -- # '[' 1 -eq 1 ']' 00:21:33.496 04:23:23 -- nvmf/nvmf.sh@64 -- # run_test nvmf_fuzz /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:33.496 04:23:23 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:21:33.496 04:23:23 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:21:33.496 04:23:23 -- common/autotest_common.sh@10 -- # set +x 00:21:33.496 ************************************ 00:21:33.496 START TEST nvmf_fuzz 00:21:33.496 ************************************ 00:21:33.496 04:23:23 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/fabrics_fuzz.sh --transport=tcp 00:21:33.496 * Looking for test storage... 00:21:33.496 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:21:33.496 04:23:23 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:21:33.496 04:23:23 -- common/autotest_common.sh@1690 -- # lcov --version 00:21:33.496 04:23:23 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:21:33.496 04:23:23 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:21:33.496 04:23:23 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:21:33.496 04:23:23 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:21:33.496 04:23:23 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:21:33.496 04:23:23 -- scripts/common.sh@335 -- # IFS=.-: 00:21:33.496 04:23:23 -- scripts/common.sh@335 -- # read -ra ver1 00:21:33.496 04:23:23 -- scripts/common.sh@336 -- # IFS=.-: 00:21:33.496 04:23:23 -- scripts/common.sh@336 -- # read -ra ver2 00:21:33.496 04:23:23 -- scripts/common.sh@337 -- # local 'op=<' 00:21:33.496 04:23:23 -- scripts/common.sh@339 -- # ver1_l=2 00:21:33.496 04:23:23 -- scripts/common.sh@340 -- # ver2_l=1 00:21:33.496 04:23:23 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:21:33.496 04:23:23 -- scripts/common.sh@343 -- # case "$op" in 00:21:33.496 04:23:23 -- scripts/common.sh@344 -- # : 1 00:21:33.496 04:23:23 -- scripts/common.sh@363 -- # (( v = 0 )) 00:21:33.496 04:23:23 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:21:33.496 04:23:23 -- scripts/common.sh@364 -- # decimal 1 00:21:33.496 04:23:23 -- scripts/common.sh@352 -- # local d=1 00:21:33.496 04:23:23 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:21:33.496 04:23:23 -- scripts/common.sh@354 -- # echo 1 00:21:33.496 04:23:23 -- scripts/common.sh@364 -- # ver1[v]=1 00:21:33.496 04:23:23 -- scripts/common.sh@365 -- # decimal 2 00:21:33.496 04:23:23 -- scripts/common.sh@352 -- # local d=2 00:21:33.496 04:23:23 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:21:33.496 04:23:23 -- scripts/common.sh@354 -- # echo 2 00:21:33.496 04:23:23 -- scripts/common.sh@365 -- # ver2[v]=2 00:21:33.496 04:23:23 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:21:33.496 04:23:23 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:21:33.496 04:23:23 -- scripts/common.sh@367 -- # return 0 00:21:33.496 04:23:23 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:21:33.496 04:23:23 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:21:33.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:33.496 --rc genhtml_branch_coverage=1 00:21:33.496 --rc genhtml_function_coverage=1 00:21:33.496 --rc genhtml_legend=1 00:21:33.496 --rc geninfo_all_blocks=1 00:21:33.496 --rc geninfo_unexecuted_blocks=1 00:21:33.496 00:21:33.496 ' 00:21:33.496 04:23:23 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:21:33.496 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:33.496 --rc genhtml_branch_coverage=1 00:21:33.497 --rc genhtml_function_coverage=1 00:21:33.497 --rc genhtml_legend=1 00:21:33.497 --rc geninfo_all_blocks=1 00:21:33.497 --rc geninfo_unexecuted_blocks=1 00:21:33.497 00:21:33.497 ' 00:21:33.497 04:23:23 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:21:33.497 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:33.497 --rc genhtml_branch_coverage=1 00:21:33.497 --rc genhtml_function_coverage=1 00:21:33.497 --rc genhtml_legend=1 00:21:33.497 --rc geninfo_all_blocks=1 00:21:33.497 --rc geninfo_unexecuted_blocks=1 00:21:33.497 00:21:33.497 ' 00:21:33.497 04:23:23 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:21:33.497 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:21:33.497 --rc genhtml_branch_coverage=1 00:21:33.497 --rc genhtml_function_coverage=1 00:21:33.497 --rc genhtml_legend=1 00:21:33.497 --rc geninfo_all_blocks=1 00:21:33.497 --rc geninfo_unexecuted_blocks=1 00:21:33.497 00:21:33.497 ' 00:21:33.497 04:23:23 -- target/fabrics_fuzz.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:21:33.497 04:23:23 -- nvmf/common.sh@7 -- # uname -s 00:21:33.497 04:23:23 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:21:33.497 04:23:23 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:21:33.497 04:23:23 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:21:33.497 04:23:23 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:21:33.497 04:23:23 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:21:33.497 04:23:23 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:21:33.497 04:23:23 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:21:33.497 04:23:23 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:21:33.497 04:23:23 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:21:33.497 04:23:23 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:21:33.497 04:23:23 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:21:33.497 04:23:23 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:21:33.497 04:23:23 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:21:33.497 04:23:23 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:21:33.497 04:23:23 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:21:33.497 04:23:23 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:21:33.497 04:23:23 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:21:33.497 04:23:23 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:21:33.497 04:23:23 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:21:33.497 04:23:23 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:33.497 04:23:23 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:33.497 04:23:23 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:33.497 04:23:23 -- paths/export.sh@5 -- # export PATH 00:21:33.497 04:23:23 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:21:33.497 04:23:23 -- nvmf/common.sh@46 -- # : 0 00:21:33.497 04:23:23 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:21:33.497 04:23:23 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:21:33.497 04:23:23 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:21:33.497 04:23:23 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:21:33.497 04:23:23 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:21:33.497 04:23:23 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:21:33.497 04:23:23 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:21:33.497 04:23:23 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:21:33.497 04:23:23 -- target/fabrics_fuzz.sh@11 -- # nvmftestinit 00:21:33.497 04:23:23 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:21:33.497 04:23:23 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:21:33.497 04:23:23 -- nvmf/common.sh@436 -- # prepare_net_devs 00:21:33.497 04:23:23 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:21:33.497 04:23:23 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:21:33.497 04:23:23 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:21:33.497 04:23:23 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:21:33.497 04:23:23 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:21:33.497 04:23:23 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:21:33.497 04:23:23 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:21:33.497 04:23:23 -- nvmf/common.sh@284 -- # xtrace_disable 00:21:33.497 04:23:23 -- common/autotest_common.sh@10 -- # set +x 00:21:35.398 04:23:25 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:21:35.398 04:23:25 -- nvmf/common.sh@290 -- # pci_devs=() 00:21:35.398 04:23:25 -- nvmf/common.sh@290 -- # local -a pci_devs 00:21:35.398 04:23:25 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:21:35.398 04:23:25 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:21:35.398 04:23:25 -- nvmf/common.sh@292 -- # pci_drivers=() 00:21:35.398 04:23:25 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:21:35.398 04:23:25 -- nvmf/common.sh@294 -- # net_devs=() 00:21:35.398 04:23:25 -- nvmf/common.sh@294 -- # local -ga net_devs 00:21:35.398 04:23:25 -- nvmf/common.sh@295 -- # e810=() 00:21:35.398 04:23:25 -- nvmf/common.sh@295 -- # local -ga e810 00:21:35.398 04:23:25 -- nvmf/common.sh@296 -- # x722=() 00:21:35.398 04:23:25 -- nvmf/common.sh@296 -- # local -ga x722 00:21:35.398 04:23:25 -- nvmf/common.sh@297 -- # mlx=() 00:21:35.398 04:23:25 -- nvmf/common.sh@297 -- # local -ga mlx 00:21:35.398 04:23:25 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:21:35.398 04:23:25 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:21:35.398 04:23:25 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:21:35.398 04:23:25 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:21:35.398 04:23:25 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:21:35.398 04:23:25 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:21:35.398 04:23:25 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:21:35.398 04:23:25 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:21:35.399 04:23:25 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:21:35.399 04:23:25 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:21:35.399 04:23:25 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:21:35.399 04:23:25 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:21:35.399 04:23:25 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:21:35.399 04:23:25 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:21:35.399 04:23:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:35.399 04:23:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:21:35.399 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:21:35.399 04:23:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:21:35.399 04:23:25 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:21:35.399 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:21:35.399 04:23:25 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:21:35.399 04:23:25 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:35.399 04:23:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:35.399 04:23:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:35.399 04:23:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:35.399 04:23:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:21:35.399 Found net devices under 0000:0a:00.0: cvl_0_0 00:21:35.399 04:23:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:35.399 04:23:25 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:21:35.399 04:23:25 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:21:35.399 04:23:25 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:21:35.399 04:23:25 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:21:35.399 04:23:25 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:21:35.399 Found net devices under 0000:0a:00.1: cvl_0_1 00:21:35.399 04:23:25 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:21:35.399 04:23:25 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:21:35.399 04:23:25 -- nvmf/common.sh@402 -- # is_hw=yes 00:21:35.399 04:23:25 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:21:35.399 04:23:25 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:21:35.399 04:23:25 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:21:35.399 04:23:25 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:21:35.399 04:23:25 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:21:35.399 04:23:25 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:21:35.399 04:23:25 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:21:35.399 04:23:25 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:21:35.399 04:23:25 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:21:35.399 04:23:25 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:21:35.399 04:23:25 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:21:35.399 04:23:25 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:21:35.399 04:23:25 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:21:35.399 04:23:25 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:21:35.399 04:23:25 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:21:35.399 04:23:25 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:21:35.399 04:23:25 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:21:35.399 04:23:25 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:21:35.399 04:23:25 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:21:35.399 04:23:25 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:21:35.399 04:23:25 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:21:35.399 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:21:35.399 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.363 ms 00:21:35.399 00:21:35.399 --- 10.0.0.2 ping statistics --- 00:21:35.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:35.399 rtt min/avg/max/mdev = 0.363/0.363/0.363/0.000 ms 00:21:35.399 04:23:25 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:21:35.399 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:21:35.399 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.111 ms 00:21:35.399 00:21:35.399 --- 10.0.0.1 ping statistics --- 00:21:35.399 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:21:35.399 rtt min/avg/max/mdev = 0.111/0.111/0.111/0.000 ms 00:21:35.399 04:23:25 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:21:35.399 04:23:25 -- nvmf/common.sh@410 -- # return 0 00:21:35.399 04:23:25 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:21:35.399 04:23:25 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:21:35.399 04:23:25 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:21:35.399 04:23:25 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:21:35.399 04:23:25 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:21:35.399 04:23:25 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:21:35.399 04:23:25 -- target/fabrics_fuzz.sh@14 -- # nvmfpid=2401518 00:21:35.399 04:23:25 -- target/fabrics_fuzz.sh@13 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:21:35.399 04:23:25 -- target/fabrics_fuzz.sh@16 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:21:35.399 04:23:25 -- target/fabrics_fuzz.sh@18 -- # waitforlisten 2401518 00:21:35.399 04:23:25 -- common/autotest_common.sh@829 -- # '[' -z 2401518 ']' 00:21:35.399 04:23:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:21:35.399 04:23:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:21:35.399 04:23:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:21:35.399 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:21:35.399 04:23:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:21:35.399 04:23:25 -- common/autotest_common.sh@10 -- # set +x 00:21:36.334 04:23:26 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:21:36.334 04:23:26 -- common/autotest_common.sh@862 -- # return 0 00:21:36.334 04:23:26 -- target/fabrics_fuzz.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:21:36.334 04:23:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.334 04:23:26 -- common/autotest_common.sh@10 -- # set +x 00:21:36.334 04:23:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.334 04:23:26 -- target/fabrics_fuzz.sh@21 -- # rpc_cmd bdev_malloc_create -b Malloc0 64 512 00:21:36.334 04:23:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.334 04:23:26 -- common/autotest_common.sh@10 -- # set +x 00:21:36.334 Malloc0 00:21:36.334 04:23:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.334 04:23:26 -- target/fabrics_fuzz.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:21:36.334 04:23:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.334 04:23:26 -- common/autotest_common.sh@10 -- # set +x 00:21:36.334 04:23:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.334 04:23:26 -- target/fabrics_fuzz.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:21:36.334 04:23:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.334 04:23:26 -- common/autotest_common.sh@10 -- # set +x 00:21:36.334 04:23:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.334 04:23:26 -- target/fabrics_fuzz.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:21:36.334 04:23:26 -- common/autotest_common.sh@561 -- # xtrace_disable 00:21:36.334 04:23:26 -- common/autotest_common.sh@10 -- # set +x 00:21:36.334 04:23:26 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:21:36.334 04:23:26 -- target/fabrics_fuzz.sh@27 -- # trid='trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' 00:21:36.334 04:23:26 -- target/fabrics_fuzz.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -t 30 -S 123456 -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -N -a 00:22:08.404 Fuzzing completed. Shutting down the fuzz application 00:22:08.404 00:22:08.404 Dumping successful admin opcodes: 00:22:08.404 8, 9, 10, 24, 00:22:08.404 Dumping successful io opcodes: 00:22:08.404 0, 9, 00:22:08.404 NS: 0x200003aeff00 I/O qp, Total commands completed: 448681, total successful commands: 2608, random_seed: 4087939712 00:22:08.404 NS: 0x200003aeff00 admin qp, Total commands completed: 56208, total successful commands: 447, random_seed: 4173622336 00:22:08.404 04:23:57 -- target/fabrics_fuzz.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/nvme_fuzz -m 0x2 -r /var/tmp/nvme_fuzz -F 'trtype:tcp adrfam:IPv4 subnqn:nqn.2016-06.io.spdk:cnode1 traddr:10.0.0.2 trsvcid:4420' -j /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/fuzz/nvme_fuzz/example.json -a 00:22:08.404 Fuzzing completed. Shutting down the fuzz application 00:22:08.404 00:22:08.404 Dumping successful admin opcodes: 00:22:08.404 24, 00:22:08.404 Dumping successful io opcodes: 00:22:08.404 00:22:08.404 NS: 0x200003aeff00 I/O qp, Total commands completed: 0, total successful commands: 0, random_seed: 615342045 00:22:08.404 NS: 0x200003aeff00 admin qp, Total commands completed: 16, total successful commands: 4, random_seed: 615522856 00:22:08.404 04:23:58 -- target/fabrics_fuzz.sh@34 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:22:08.404 04:23:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:08.404 04:23:58 -- common/autotest_common.sh@10 -- # set +x 00:22:08.404 04:23:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:08.404 04:23:58 -- target/fabrics_fuzz.sh@36 -- # trap - SIGINT SIGTERM EXIT 00:22:08.404 04:23:58 -- target/fabrics_fuzz.sh@38 -- # nvmftestfini 00:22:08.404 04:23:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:22:08.404 04:23:58 -- nvmf/common.sh@116 -- # sync 00:22:08.404 04:23:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:22:08.404 04:23:58 -- nvmf/common.sh@119 -- # set +e 00:22:08.404 04:23:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:22:08.404 04:23:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:22:08.404 rmmod nvme_tcp 00:22:08.404 rmmod nvme_fabrics 00:22:08.404 rmmod nvme_keyring 00:22:08.404 04:23:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:22:08.404 04:23:58 -- nvmf/common.sh@123 -- # set -e 00:22:08.404 04:23:58 -- nvmf/common.sh@124 -- # return 0 00:22:08.404 04:23:58 -- nvmf/common.sh@477 -- # '[' -n 2401518 ']' 00:22:08.404 04:23:58 -- nvmf/common.sh@478 -- # killprocess 2401518 00:22:08.404 04:23:58 -- common/autotest_common.sh@936 -- # '[' -z 2401518 ']' 00:22:08.404 04:23:58 -- common/autotest_common.sh@940 -- # kill -0 2401518 00:22:08.404 04:23:58 -- common/autotest_common.sh@941 -- # uname 00:22:08.404 04:23:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:22:08.404 04:23:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2401518 00:22:08.404 04:23:58 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:22:08.404 04:23:58 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:22:08.404 04:23:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2401518' 00:22:08.404 killing process with pid 2401518 00:22:08.404 04:23:58 -- common/autotest_common.sh@955 -- # kill 2401518 00:22:08.404 04:23:58 -- common/autotest_common.sh@960 -- # wait 2401518 00:22:08.663 04:23:59 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:22:08.663 04:23:59 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:22:08.663 04:23:59 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:22:08.663 04:23:59 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:22:08.663 04:23:59 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:22:08.663 04:23:59 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:08.663 04:23:59 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:08.663 04:23:59 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:11.194 04:24:01 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:22:11.194 04:24:01 -- target/fabrics_fuzz.sh@39 -- # rm /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs1.txt /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/nvmf_fuzz_logs2.txt 00:22:11.194 00:22:11.194 real 0m37.620s 00:22:11.194 user 0m51.504s 00:22:11.194 sys 0m15.317s 00:22:11.194 04:24:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:22:11.194 04:24:01 -- common/autotest_common.sh@10 -- # set +x 00:22:11.194 ************************************ 00:22:11.194 END TEST nvmf_fuzz 00:22:11.194 ************************************ 00:22:11.194 04:24:01 -- nvmf/nvmf.sh@65 -- # run_test nvmf_multiconnection /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:11.194 04:24:01 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:22:11.194 04:24:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:22:11.194 04:24:01 -- common/autotest_common.sh@10 -- # set +x 00:22:11.194 ************************************ 00:22:11.194 START TEST nvmf_multiconnection 00:22:11.194 ************************************ 00:22:11.194 04:24:01 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/multiconnection.sh --transport=tcp 00:22:11.194 * Looking for test storage... 00:22:11.194 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:22:11.194 04:24:01 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:22:11.194 04:24:01 -- common/autotest_common.sh@1690 -- # lcov --version 00:22:11.194 04:24:01 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:22:11.194 04:24:01 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:22:11.194 04:24:01 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:22:11.194 04:24:01 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:22:11.194 04:24:01 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:22:11.194 04:24:01 -- scripts/common.sh@335 -- # IFS=.-: 00:22:11.194 04:24:01 -- scripts/common.sh@335 -- # read -ra ver1 00:22:11.194 04:24:01 -- scripts/common.sh@336 -- # IFS=.-: 00:22:11.194 04:24:01 -- scripts/common.sh@336 -- # read -ra ver2 00:22:11.194 04:24:01 -- scripts/common.sh@337 -- # local 'op=<' 00:22:11.194 04:24:01 -- scripts/common.sh@339 -- # ver1_l=2 00:22:11.194 04:24:01 -- scripts/common.sh@340 -- # ver2_l=1 00:22:11.194 04:24:01 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:22:11.194 04:24:01 -- scripts/common.sh@343 -- # case "$op" in 00:22:11.194 04:24:01 -- scripts/common.sh@344 -- # : 1 00:22:11.194 04:24:01 -- scripts/common.sh@363 -- # (( v = 0 )) 00:22:11.194 04:24:01 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:22:11.194 04:24:01 -- scripts/common.sh@364 -- # decimal 1 00:22:11.194 04:24:01 -- scripts/common.sh@352 -- # local d=1 00:22:11.194 04:24:01 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:22:11.194 04:24:01 -- scripts/common.sh@354 -- # echo 1 00:22:11.194 04:24:01 -- scripts/common.sh@364 -- # ver1[v]=1 00:22:11.194 04:24:01 -- scripts/common.sh@365 -- # decimal 2 00:22:11.194 04:24:01 -- scripts/common.sh@352 -- # local d=2 00:22:11.194 04:24:01 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:22:11.194 04:24:01 -- scripts/common.sh@354 -- # echo 2 00:22:11.194 04:24:01 -- scripts/common.sh@365 -- # ver2[v]=2 00:22:11.194 04:24:01 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:22:11.194 04:24:01 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:22:11.194 04:24:01 -- scripts/common.sh@367 -- # return 0 00:22:11.194 04:24:01 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:22:11.194 04:24:01 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:22:11.194 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:11.194 --rc genhtml_branch_coverage=1 00:22:11.194 --rc genhtml_function_coverage=1 00:22:11.194 --rc genhtml_legend=1 00:22:11.194 --rc geninfo_all_blocks=1 00:22:11.194 --rc geninfo_unexecuted_blocks=1 00:22:11.194 00:22:11.194 ' 00:22:11.194 04:24:01 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:22:11.194 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:11.194 --rc genhtml_branch_coverage=1 00:22:11.194 --rc genhtml_function_coverage=1 00:22:11.194 --rc genhtml_legend=1 00:22:11.194 --rc geninfo_all_blocks=1 00:22:11.194 --rc geninfo_unexecuted_blocks=1 00:22:11.194 00:22:11.194 ' 00:22:11.194 04:24:01 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:22:11.194 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:11.194 --rc genhtml_branch_coverage=1 00:22:11.194 --rc genhtml_function_coverage=1 00:22:11.194 --rc genhtml_legend=1 00:22:11.194 --rc geninfo_all_blocks=1 00:22:11.194 --rc geninfo_unexecuted_blocks=1 00:22:11.194 00:22:11.194 ' 00:22:11.194 04:24:01 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:22:11.194 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:22:11.194 --rc genhtml_branch_coverage=1 00:22:11.194 --rc genhtml_function_coverage=1 00:22:11.194 --rc genhtml_legend=1 00:22:11.194 --rc geninfo_all_blocks=1 00:22:11.194 --rc geninfo_unexecuted_blocks=1 00:22:11.194 00:22:11.194 ' 00:22:11.194 04:24:01 -- target/multiconnection.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:22:11.194 04:24:01 -- nvmf/common.sh@7 -- # uname -s 00:22:11.194 04:24:01 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:22:11.194 04:24:01 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:22:11.194 04:24:01 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:22:11.194 04:24:01 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:22:11.194 04:24:01 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:22:11.194 04:24:01 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:22:11.194 04:24:01 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:22:11.194 04:24:01 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:22:11.194 04:24:01 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:22:11.194 04:24:01 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:22:11.194 04:24:01 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:22:11.194 04:24:01 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:22:11.194 04:24:01 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:22:11.194 04:24:01 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:22:11.194 04:24:01 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:22:11.194 04:24:01 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:22:11.194 04:24:01 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:22:11.194 04:24:01 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:22:11.194 04:24:01 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:22:11.194 04:24:01 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:11.194 04:24:01 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:11.194 04:24:01 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:11.194 04:24:01 -- paths/export.sh@5 -- # export PATH 00:22:11.194 04:24:01 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:22:11.194 04:24:01 -- nvmf/common.sh@46 -- # : 0 00:22:11.194 04:24:01 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:22:11.194 04:24:01 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:22:11.194 04:24:01 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:22:11.194 04:24:01 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:22:11.194 04:24:01 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:22:11.194 04:24:01 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:22:11.194 04:24:01 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:22:11.194 04:24:01 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:22:11.194 04:24:01 -- target/multiconnection.sh@11 -- # MALLOC_BDEV_SIZE=64 00:22:11.194 04:24:01 -- target/multiconnection.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:22:11.194 04:24:01 -- target/multiconnection.sh@14 -- # NVMF_SUBSYS=11 00:22:11.194 04:24:01 -- target/multiconnection.sh@16 -- # nvmftestinit 00:22:11.194 04:24:01 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:22:11.194 04:24:01 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:22:11.194 04:24:01 -- nvmf/common.sh@436 -- # prepare_net_devs 00:22:11.194 04:24:01 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:22:11.194 04:24:01 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:22:11.194 04:24:01 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:22:11.194 04:24:01 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:22:11.194 04:24:01 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:22:11.194 04:24:01 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:22:11.194 04:24:01 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:22:11.194 04:24:01 -- nvmf/common.sh@284 -- # xtrace_disable 00:22:11.195 04:24:01 -- common/autotest_common.sh@10 -- # set +x 00:22:13.097 04:24:03 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:22:13.097 04:24:03 -- nvmf/common.sh@290 -- # pci_devs=() 00:22:13.097 04:24:03 -- nvmf/common.sh@290 -- # local -a pci_devs 00:22:13.097 04:24:03 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:22:13.097 04:24:03 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:22:13.097 04:24:03 -- nvmf/common.sh@292 -- # pci_drivers=() 00:22:13.097 04:24:03 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:22:13.097 04:24:03 -- nvmf/common.sh@294 -- # net_devs=() 00:22:13.097 04:24:03 -- nvmf/common.sh@294 -- # local -ga net_devs 00:22:13.097 04:24:03 -- nvmf/common.sh@295 -- # e810=() 00:22:13.097 04:24:03 -- nvmf/common.sh@295 -- # local -ga e810 00:22:13.097 04:24:03 -- nvmf/common.sh@296 -- # x722=() 00:22:13.097 04:24:03 -- nvmf/common.sh@296 -- # local -ga x722 00:22:13.097 04:24:03 -- nvmf/common.sh@297 -- # mlx=() 00:22:13.097 04:24:03 -- nvmf/common.sh@297 -- # local -ga mlx 00:22:13.097 04:24:03 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:22:13.097 04:24:03 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:22:13.097 04:24:03 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:22:13.098 04:24:03 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:22:13.098 04:24:03 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:22:13.098 04:24:03 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:22:13.098 04:24:03 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:22:13.098 04:24:03 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:22:13.098 04:24:03 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:22:13.098 04:24:03 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:22:13.098 04:24:03 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:22:13.098 04:24:03 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:22:13.098 04:24:03 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:22:13.098 04:24:03 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:22:13.098 04:24:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:13.098 04:24:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:22:13.098 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:22:13.098 04:24:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:22:13.098 04:24:03 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:22:13.098 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:22:13.098 04:24:03 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:22:13.098 04:24:03 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:13.098 04:24:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:13.098 04:24:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:13.098 04:24:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:13.098 04:24:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:22:13.098 Found net devices under 0000:0a:00.0: cvl_0_0 00:22:13.098 04:24:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:13.098 04:24:03 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:22:13.098 04:24:03 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:22:13.098 04:24:03 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:22:13.098 04:24:03 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:22:13.098 04:24:03 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:22:13.098 Found net devices under 0000:0a:00.1: cvl_0_1 00:22:13.098 04:24:03 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:22:13.098 04:24:03 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:22:13.098 04:24:03 -- nvmf/common.sh@402 -- # is_hw=yes 00:22:13.098 04:24:03 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:22:13.098 04:24:03 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:22:13.098 04:24:03 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:22:13.098 04:24:03 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:22:13.098 04:24:03 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:22:13.098 04:24:03 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:22:13.098 04:24:03 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:22:13.098 04:24:03 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:22:13.098 04:24:03 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:22:13.098 04:24:03 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:22:13.098 04:24:03 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:22:13.098 04:24:03 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:22:13.098 04:24:03 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:22:13.098 04:24:03 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:22:13.098 04:24:03 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:22:13.098 04:24:03 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:22:13.098 04:24:03 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:22:13.098 04:24:03 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:22:13.098 04:24:03 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:22:13.098 04:24:03 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:22:13.098 04:24:03 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:22:13.098 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:22:13.098 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.249 ms 00:22:13.098 00:22:13.098 --- 10.0.0.2 ping statistics --- 00:22:13.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:13.098 rtt min/avg/max/mdev = 0.249/0.249/0.249/0.000 ms 00:22:13.098 04:24:03 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:22:13.098 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:22:13.098 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.148 ms 00:22:13.098 00:22:13.098 --- 10.0.0.1 ping statistics --- 00:22:13.098 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:22:13.098 rtt min/avg/max/mdev = 0.148/0.148/0.148/0.000 ms 00:22:13.098 04:24:03 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:22:13.098 04:24:03 -- nvmf/common.sh@410 -- # return 0 00:22:13.098 04:24:03 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:22:13.098 04:24:03 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:22:13.098 04:24:03 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:22:13.098 04:24:03 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:22:13.098 04:24:03 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:22:13.098 04:24:03 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:22:13.098 04:24:03 -- target/multiconnection.sh@17 -- # nvmfappstart -m 0xF 00:22:13.098 04:24:03 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:22:13.098 04:24:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:22:13.098 04:24:03 -- common/autotest_common.sh@10 -- # set +x 00:22:13.098 04:24:03 -- nvmf/common.sh@469 -- # nvmfpid=2407503 00:22:13.098 04:24:03 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:22:13.098 04:24:03 -- nvmf/common.sh@470 -- # waitforlisten 2407503 00:22:13.098 04:24:03 -- common/autotest_common.sh@829 -- # '[' -z 2407503 ']' 00:22:13.098 04:24:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:22:13.098 04:24:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:22:13.098 04:24:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:22:13.098 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:22:13.098 04:24:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:22:13.098 04:24:03 -- common/autotest_common.sh@10 -- # set +x 00:22:13.356 [2024-11-30 04:24:03.741601] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:22:13.356 [2024-11-30 04:24:03.741673] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:22:13.356 EAL: No free 2048 kB hugepages reported on node 1 00:22:13.356 [2024-11-30 04:24:03.808139] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:22:13.356 [2024-11-30 04:24:03.894590] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:22:13.356 [2024-11-30 04:24:03.894747] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:22:13.356 [2024-11-30 04:24:03.894763] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:22:13.356 [2024-11-30 04:24:03.894776] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:22:13.356 [2024-11-30 04:24:03.894827] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:22:13.356 [2024-11-30 04:24:03.894896] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:22:13.356 [2024-11-30 04:24:03.894968] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:22:13.356 [2024-11-30 04:24:03.894969] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:22:14.290 04:24:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:22:14.290 04:24:04 -- common/autotest_common.sh@862 -- # return 0 00:22:14.290 04:24:04 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:22:14.290 04:24:04 -- common/autotest_common.sh@728 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 04:24:04 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:22:14.290 04:24:04 -- target/multiconnection.sh@19 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 [2024-11-30 04:24:04.750708] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@21 -- # seq 1 11 00:22:14.290 04:24:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.290 04:24:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 Malloc1 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK1 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 [2024-11-30 04:24:04.808183] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.290 04:24:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc2 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 Malloc2 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK2 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc2 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.290 04:24:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc3 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 Malloc3 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK3 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 Malloc3 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.290 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.290 04:24:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.290 04:24:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc4 00:22:14.290 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.290 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.577 Malloc4 00:22:14.577 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.577 04:24:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode4 -a -s SPDK4 00:22:14.577 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.577 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.577 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.577 04:24:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode4 Malloc4 00:22:14.577 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.577 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.577 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.577 04:24:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode4 -t tcp -a 10.0.0.2 -s 4420 00:22:14.577 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.577 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.577 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.577 04:24:04 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.577 04:24:04 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc5 00:22:14.577 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.577 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.577 Malloc5 00:22:14.577 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.577 04:24:04 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode5 -a -s SPDK5 00:22:14.578 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:04 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode5 Malloc5 00:22:14.578 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:04 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode5 -t tcp -a 10.0.0.2 -s 4420 00:22:14.578 04:24:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:04 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.578 04:24:05 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc6 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 Malloc6 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode6 -a -s SPDK6 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode6 Malloc6 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode6 -t tcp -a 10.0.0.2 -s 4420 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.578 04:24:05 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc7 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 Malloc7 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode7 -a -s SPDK7 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode7 Malloc7 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode7 -t tcp -a 10.0.0.2 -s 4420 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.578 04:24:05 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc8 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 Malloc8 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode8 -a -s SPDK8 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode8 Malloc8 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode8 -t tcp -a 10.0.0.2 -s 4420 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.578 04:24:05 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc9 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 Malloc9 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode9 -a -s SPDK9 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.578 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.578 04:24:05 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode9 Malloc9 00:22:14.578 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.578 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.835 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.835 04:24:05 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode9 -t tcp -a 10.0.0.2 -s 4420 00:22:14.835 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.835 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.835 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.835 04:24:05 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.835 04:24:05 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc10 00:22:14.835 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.835 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.835 Malloc10 00:22:14.835 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.835 04:24:05 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode10 -a -s SPDK10 00:22:14.835 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.835 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.835 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.835 04:24:05 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode10 Malloc10 00:22:14.835 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.835 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.835 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.835 04:24:05 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode10 -t tcp -a 10.0.0.2 -s 4420 00:22:14.835 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.835 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.835 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.835 04:24:05 -- target/multiconnection.sh@21 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.835 04:24:05 -- target/multiconnection.sh@22 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc11 00:22:14.835 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.835 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.835 Malloc11 00:22:14.835 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.835 04:24:05 -- target/multiconnection.sh@23 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode11 -a -s SPDK11 00:22:14.835 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.835 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.835 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.835 04:24:05 -- target/multiconnection.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode11 Malloc11 00:22:14.835 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.835 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.835 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.835 04:24:05 -- target/multiconnection.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode11 -t tcp -a 10.0.0.2 -s 4420 00:22:14.835 04:24:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:22:14.835 04:24:05 -- common/autotest_common.sh@10 -- # set +x 00:22:14.835 04:24:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:22:14.835 04:24:05 -- target/multiconnection.sh@28 -- # seq 1 11 00:22:14.835 04:24:05 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:14.835 04:24:05 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:22:15.400 04:24:06 -- target/multiconnection.sh@30 -- # waitforserial SPDK1 00:22:15.400 04:24:06 -- common/autotest_common.sh@1187 -- # local i=0 00:22:15.400 04:24:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:15.400 04:24:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:15.400 04:24:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:17.929 04:24:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:17.929 04:24:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:17.929 04:24:08 -- common/autotest_common.sh@1196 -- # grep -c SPDK1 00:22:17.929 04:24:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:17.929 04:24:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:17.929 04:24:08 -- common/autotest_common.sh@1197 -- # return 0 00:22:17.929 04:24:08 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:17.929 04:24:08 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode2 -a 10.0.0.2 -s 4420 00:22:18.187 04:24:08 -- target/multiconnection.sh@30 -- # waitforserial SPDK2 00:22:18.187 04:24:08 -- common/autotest_common.sh@1187 -- # local i=0 00:22:18.187 04:24:08 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:18.187 04:24:08 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:18.187 04:24:08 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:20.087 04:24:10 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:20.087 04:24:10 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:20.087 04:24:10 -- common/autotest_common.sh@1196 -- # grep -c SPDK2 00:22:20.087 04:24:10 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:20.087 04:24:10 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:20.087 04:24:10 -- common/autotest_common.sh@1197 -- # return 0 00:22:20.087 04:24:10 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:20.087 04:24:10 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode3 -a 10.0.0.2 -s 4420 00:22:21.019 04:24:11 -- target/multiconnection.sh@30 -- # waitforserial SPDK3 00:22:21.019 04:24:11 -- common/autotest_common.sh@1187 -- # local i=0 00:22:21.019 04:24:11 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:21.019 04:24:11 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:21.019 04:24:11 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:22.916 04:24:13 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:22.916 04:24:13 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:22.916 04:24:13 -- common/autotest_common.sh@1196 -- # grep -c SPDK3 00:22:22.916 04:24:13 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:22.916 04:24:13 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:22.916 04:24:13 -- common/autotest_common.sh@1197 -- # return 0 00:22:22.916 04:24:13 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:22.916 04:24:13 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode4 -a 10.0.0.2 -s 4420 00:22:23.848 04:24:14 -- target/multiconnection.sh@30 -- # waitforserial SPDK4 00:22:23.848 04:24:14 -- common/autotest_common.sh@1187 -- # local i=0 00:22:23.848 04:24:14 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:23.848 04:24:14 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:23.848 04:24:14 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:25.745 04:24:16 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:25.745 04:24:16 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:25.745 04:24:16 -- common/autotest_common.sh@1196 -- # grep -c SPDK4 00:22:25.745 04:24:16 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:25.745 04:24:16 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:25.745 04:24:16 -- common/autotest_common.sh@1197 -- # return 0 00:22:25.745 04:24:16 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:25.745 04:24:16 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode5 -a 10.0.0.2 -s 4420 00:22:26.680 04:24:16 -- target/multiconnection.sh@30 -- # waitforserial SPDK5 00:22:26.680 04:24:16 -- common/autotest_common.sh@1187 -- # local i=0 00:22:26.680 04:24:16 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:26.680 04:24:16 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:26.680 04:24:16 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:28.576 04:24:18 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:28.576 04:24:18 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:28.576 04:24:18 -- common/autotest_common.sh@1196 -- # grep -c SPDK5 00:22:28.576 04:24:18 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:28.576 04:24:18 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:28.576 04:24:18 -- common/autotest_common.sh@1197 -- # return 0 00:22:28.576 04:24:18 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:28.576 04:24:18 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode6 -a 10.0.0.2 -s 4420 00:22:29.141 04:24:19 -- target/multiconnection.sh@30 -- # waitforserial SPDK6 00:22:29.141 04:24:19 -- common/autotest_common.sh@1187 -- # local i=0 00:22:29.141 04:24:19 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:29.141 04:24:19 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:29.141 04:24:19 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:31.667 04:24:21 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:31.667 04:24:21 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:31.667 04:24:21 -- common/autotest_common.sh@1196 -- # grep -c SPDK6 00:22:31.667 04:24:21 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:31.667 04:24:21 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:31.667 04:24:21 -- common/autotest_common.sh@1197 -- # return 0 00:22:31.667 04:24:21 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:31.667 04:24:21 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode7 -a 10.0.0.2 -s 4420 00:22:32.234 04:24:22 -- target/multiconnection.sh@30 -- # waitforserial SPDK7 00:22:32.234 04:24:22 -- common/autotest_common.sh@1187 -- # local i=0 00:22:32.234 04:24:22 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:32.234 04:24:22 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:32.234 04:24:22 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:34.201 04:24:24 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:34.201 04:24:24 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:34.201 04:24:24 -- common/autotest_common.sh@1196 -- # grep -c SPDK7 00:22:34.201 04:24:24 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:34.201 04:24:24 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:34.201 04:24:24 -- common/autotest_common.sh@1197 -- # return 0 00:22:34.201 04:24:24 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:34.201 04:24:24 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode8 -a 10.0.0.2 -s 4420 00:22:34.765 04:24:25 -- target/multiconnection.sh@30 -- # waitforserial SPDK8 00:22:34.765 04:24:25 -- common/autotest_common.sh@1187 -- # local i=0 00:22:34.765 04:24:25 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:34.765 04:24:25 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:34.765 04:24:25 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:37.292 04:24:27 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:37.292 04:24:27 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:37.292 04:24:27 -- common/autotest_common.sh@1196 -- # grep -c SPDK8 00:22:37.292 04:24:27 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:37.292 04:24:27 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:37.292 04:24:27 -- common/autotest_common.sh@1197 -- # return 0 00:22:37.292 04:24:27 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:37.292 04:24:27 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode9 -a 10.0.0.2 -s 4420 00:22:37.550 04:24:28 -- target/multiconnection.sh@30 -- # waitforserial SPDK9 00:22:37.550 04:24:28 -- common/autotest_common.sh@1187 -- # local i=0 00:22:37.550 04:24:28 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:37.550 04:24:28 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:37.550 04:24:28 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:40.076 04:24:30 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:40.076 04:24:30 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:40.076 04:24:30 -- common/autotest_common.sh@1196 -- # grep -c SPDK9 00:22:40.076 04:24:30 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:40.076 04:24:30 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:40.076 04:24:30 -- common/autotest_common.sh@1197 -- # return 0 00:22:40.076 04:24:30 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:40.076 04:24:30 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode10 -a 10.0.0.2 -s 4420 00:22:40.334 04:24:30 -- target/multiconnection.sh@30 -- # waitforserial SPDK10 00:22:40.334 04:24:30 -- common/autotest_common.sh@1187 -- # local i=0 00:22:40.334 04:24:30 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:40.334 04:24:30 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:40.334 04:24:30 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:42.859 04:24:32 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:42.859 04:24:32 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:42.859 04:24:32 -- common/autotest_common.sh@1196 -- # grep -c SPDK10 00:22:42.859 04:24:32 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:42.859 04:24:32 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:42.859 04:24:32 -- common/autotest_common.sh@1197 -- # return 0 00:22:42.859 04:24:32 -- target/multiconnection.sh@28 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:22:42.859 04:24:32 -- target/multiconnection.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode11 -a 10.0.0.2 -s 4420 00:22:43.424 04:24:33 -- target/multiconnection.sh@30 -- # waitforserial SPDK11 00:22:43.424 04:24:33 -- common/autotest_common.sh@1187 -- # local i=0 00:22:43.424 04:24:33 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:22:43.424 04:24:33 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:22:43.424 04:24:33 -- common/autotest_common.sh@1194 -- # sleep 2 00:22:45.323 04:24:35 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:22:45.323 04:24:35 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:22:45.323 04:24:35 -- common/autotest_common.sh@1196 -- # grep -c SPDK11 00:22:45.323 04:24:35 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:22:45.323 04:24:35 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:22:45.323 04:24:35 -- common/autotest_common.sh@1197 -- # return 0 00:22:45.323 04:24:35 -- target/multiconnection.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t read -r 10 00:22:45.323 [global] 00:22:45.323 thread=1 00:22:45.323 invalidate=1 00:22:45.323 rw=read 00:22:45.323 time_based=1 00:22:45.323 runtime=10 00:22:45.323 ioengine=libaio 00:22:45.323 direct=1 00:22:45.323 bs=262144 00:22:45.323 iodepth=64 00:22:45.323 norandommap=1 00:22:45.323 numjobs=1 00:22:45.323 00:22:45.323 [job0] 00:22:45.323 filename=/dev/nvme0n1 00:22:45.323 [job1] 00:22:45.323 filename=/dev/nvme10n1 00:22:45.323 [job2] 00:22:45.323 filename=/dev/nvme1n1 00:22:45.323 [job3] 00:22:45.323 filename=/dev/nvme2n1 00:22:45.323 [job4] 00:22:45.323 filename=/dev/nvme3n1 00:22:45.323 [job5] 00:22:45.323 filename=/dev/nvme4n1 00:22:45.323 [job6] 00:22:45.323 filename=/dev/nvme5n1 00:22:45.323 [job7] 00:22:45.323 filename=/dev/nvme6n1 00:22:45.323 [job8] 00:22:45.323 filename=/dev/nvme7n1 00:22:45.323 [job9] 00:22:45.323 filename=/dev/nvme8n1 00:22:45.323 [job10] 00:22:45.323 filename=/dev/nvme9n1 00:22:45.323 Could not set queue depth (nvme0n1) 00:22:45.323 Could not set queue depth (nvme10n1) 00:22:45.323 Could not set queue depth (nvme1n1) 00:22:45.323 Could not set queue depth (nvme2n1) 00:22:45.323 Could not set queue depth (nvme3n1) 00:22:45.323 Could not set queue depth (nvme4n1) 00:22:45.323 Could not set queue depth (nvme5n1) 00:22:45.323 Could not set queue depth (nvme6n1) 00:22:45.323 Could not set queue depth (nvme7n1) 00:22:45.323 Could not set queue depth (nvme8n1) 00:22:45.323 Could not set queue depth (nvme9n1) 00:22:45.581 job0: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 job1: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 job2: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 job3: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 job4: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 job5: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 job6: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 job7: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 job8: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 job9: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 job10: (g=0): rw=read, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:45.581 fio-3.35 00:22:45.581 Starting 11 threads 00:22:57.785 00:22:57.785 job0: (groupid=0, jobs=1): err= 0: pid=2412516: Sat Nov 30 04:24:46 2024 00:22:57.785 read: IOPS=625, BW=156MiB/s (164MB/s)(1571MiB/10039msec) 00:22:57.785 slat (usec): min=13, max=57927, avg=1462.51, stdev=4516.39 00:22:57.785 clat (msec): min=10, max=213, avg=100.72, stdev=37.26 00:22:57.785 lat (msec): min=10, max=213, avg=102.19, stdev=37.91 00:22:57.785 clat percentiles (msec): 00:22:57.785 | 1.00th=[ 26], 5.00th=[ 47], 10.00th=[ 53], 20.00th=[ 61], 00:22:57.785 | 30.00th=[ 71], 40.00th=[ 92], 50.00th=[ 104], 60.00th=[ 115], 00:22:57.785 | 70.00th=[ 127], 80.00th=[ 138], 90.00th=[ 148], 95.00th=[ 159], 00:22:57.785 | 99.00th=[ 169], 99.50th=[ 178], 99.90th=[ 209], 99.95th=[ 209], 00:22:57.785 | 99.99th=[ 213] 00:22:57.785 bw ( KiB/s): min=102912, max=262144, per=7.83%, avg=159194.45, stdev=49120.54, samples=20 00:22:57.785 iops : min= 402, max= 1024, avg=621.85, stdev=191.88, samples=20 00:22:57.785 lat (msec) : 20=0.62%, 50=6.88%, 100=38.98%, 250=53.52% 00:22:57.785 cpu : usr=0.30%, sys=2.26%, ctx=1195, majf=0, minf=4097 00:22:57.785 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:57.785 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.785 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.785 issued rwts: total=6282,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.785 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.785 job1: (groupid=0, jobs=1): err= 0: pid=2412517: Sat Nov 30 04:24:46 2024 00:22:57.785 read: IOPS=813, BW=203MiB/s (213MB/s)(2038MiB/10016msec) 00:22:57.785 slat (usec): min=8, max=78552, avg=877.26, stdev=3675.13 00:22:57.785 clat (usec): min=842, max=213204, avg=77694.69, stdev=43587.25 00:22:57.785 lat (usec): min=870, max=213236, avg=78571.95, stdev=44159.35 00:22:57.785 clat percentiles (msec): 00:22:57.785 | 1.00th=[ 4], 5.00th=[ 12], 10.00th=[ 22], 20.00th=[ 32], 00:22:57.785 | 30.00th=[ 48], 40.00th=[ 62], 50.00th=[ 79], 60.00th=[ 91], 00:22:57.785 | 70.00th=[ 105], 80.00th=[ 120], 90.00th=[ 138], 95.00th=[ 150], 00:22:57.785 | 99.00th=[ 169], 99.50th=[ 176], 99.90th=[ 192], 99.95th=[ 205], 00:22:57.785 | 99.99th=[ 213] 00:22:57.785 bw ( KiB/s): min=113664, max=376320, per=10.18%, avg=207054.35, stdev=74353.06, samples=20 00:22:57.785 iops : min= 444, max= 1470, avg=808.80, stdev=290.44, samples=20 00:22:57.785 lat (usec) : 1000=0.01% 00:22:57.785 lat (msec) : 2=0.53%, 4=0.90%, 10=3.02%, 20=4.48%, 50=22.23% 00:22:57.785 lat (msec) : 100=35.70%, 250=33.15% 00:22:57.785 cpu : usr=0.39%, sys=2.14%, ctx=1786, majf=0, minf=4098 00:22:57.785 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:57.785 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.785 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.785 issued rwts: total=8152,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.785 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.785 job2: (groupid=0, jobs=1): err= 0: pid=2412518: Sat Nov 30 04:24:46 2024 00:22:57.785 read: IOPS=745, BW=186MiB/s (195MB/s)(1870MiB/10038msec) 00:22:57.785 slat (usec): min=9, max=56197, avg=1089.76, stdev=3683.17 00:22:57.785 clat (msec): min=4, max=216, avg=84.73, stdev=40.65 00:22:57.785 lat (msec): min=4, max=216, avg=85.82, stdev=41.19 00:22:57.785 clat percentiles (msec): 00:22:57.785 | 1.00th=[ 23], 5.00th=[ 30], 10.00th=[ 36], 20.00th=[ 44], 00:22:57.785 | 30.00th=[ 55], 40.00th=[ 68], 50.00th=[ 81], 60.00th=[ 94], 00:22:57.785 | 70.00th=[ 108], 80.00th=[ 124], 90.00th=[ 146], 95.00th=[ 157], 00:22:57.785 | 99.00th=[ 174], 99.50th=[ 186], 99.90th=[ 209], 99.95th=[ 211], 00:22:57.785 | 99.99th=[ 218] 00:22:57.785 bw ( KiB/s): min=109568, max=424448, per=9.34%, avg=189836.20, stdev=83617.52, samples=20 00:22:57.785 iops : min= 428, max= 1658, avg=741.45, stdev=326.70, samples=20 00:22:57.785 lat (msec) : 10=0.11%, 20=0.64%, 50=24.37%, 100=39.24%, 250=35.64% 00:22:57.785 cpu : usr=0.58%, sys=2.22%, ctx=1561, majf=0, minf=4097 00:22:57.785 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.2% 00:22:57.785 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.785 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.785 issued rwts: total=7480,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.785 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.785 job3: (groupid=0, jobs=1): err= 0: pid=2412519: Sat Nov 30 04:24:46 2024 00:22:57.785 read: IOPS=713, BW=178MiB/s (187MB/s)(1814MiB/10165msec) 00:22:57.785 slat (usec): min=9, max=58233, avg=1274.45, stdev=3769.37 00:22:57.785 clat (usec): min=1615, max=336959, avg=88303.67, stdev=41069.57 00:22:57.785 lat (usec): min=1636, max=336983, avg=89578.12, stdev=41596.05 00:22:57.785 clat percentiles (msec): 00:22:57.786 | 1.00th=[ 27], 5.00th=[ 32], 10.00th=[ 46], 20.00th=[ 55], 00:22:57.786 | 30.00th=[ 62], 40.00th=[ 69], 50.00th=[ 81], 60.00th=[ 92], 00:22:57.786 | 70.00th=[ 106], 80.00th=[ 128], 90.00th=[ 146], 95.00th=[ 161], 00:22:57.786 | 99.00th=[ 180], 99.50th=[ 228], 99.90th=[ 313], 99.95th=[ 338], 00:22:57.786 | 99.99th=[ 338] 00:22:57.786 bw ( KiB/s): min=104960, max=411337, per=9.06%, avg=184106.95, stdev=72570.44, samples=20 00:22:57.786 iops : min= 410, max= 1606, avg=719.10, stdev=283.35, samples=20 00:22:57.786 lat (msec) : 2=0.08%, 4=0.28%, 20=0.14%, 50=13.78%, 100=52.12% 00:22:57.786 lat (msec) : 250=33.12%, 500=0.48% 00:22:57.786 cpu : usr=0.39%, sys=2.22%, ctx=1404, majf=0, minf=4097 00:22:57.786 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.1% 00:22:57.786 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.786 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.786 issued rwts: total=7256,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.786 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.786 job4: (groupid=0, jobs=1): err= 0: pid=2412520: Sat Nov 30 04:24:46 2024 00:22:57.786 read: IOPS=682, BW=171MiB/s (179MB/s)(1727MiB/10128msec) 00:22:57.786 slat (usec): min=10, max=75997, avg=1261.42, stdev=4147.76 00:22:57.786 clat (usec): min=1901, max=296061, avg=92464.67, stdev=40120.77 00:22:57.786 lat (usec): min=1932, max=305270, avg=93726.09, stdev=40696.51 00:22:57.786 clat percentiles (msec): 00:22:57.786 | 1.00th=[ 10], 5.00th=[ 28], 10.00th=[ 32], 20.00th=[ 59], 00:22:57.786 | 30.00th=[ 75], 40.00th=[ 87], 50.00th=[ 96], 60.00th=[ 105], 00:22:57.786 | 70.00th=[ 113], 80.00th=[ 126], 90.00th=[ 142], 95.00th=[ 153], 00:22:57.786 | 99.00th=[ 176], 99.50th=[ 213], 99.90th=[ 284], 99.95th=[ 296], 00:22:57.786 | 99.99th=[ 296] 00:22:57.786 bw ( KiB/s): min=101376, max=378880, per=8.62%, avg=175237.80, stdev=68036.67, samples=20 00:22:57.786 iops : min= 396, max= 1480, avg=684.50, stdev=265.76, samples=20 00:22:57.786 lat (msec) : 2=0.01%, 4=0.09%, 10=1.04%, 20=1.75%, 50=14.03% 00:22:57.786 lat (msec) : 100=37.62%, 250=45.16%, 500=0.30% 00:22:57.786 cpu : usr=0.45%, sys=2.22%, ctx=1401, majf=0, minf=4097 00:22:57.786 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:57.786 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.786 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.786 issued rwts: total=6909,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.786 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.786 job5: (groupid=0, jobs=1): err= 0: pid=2412521: Sat Nov 30 04:24:46 2024 00:22:57.786 read: IOPS=645, BW=161MiB/s (169MB/s)(1634MiB/10131msec) 00:22:57.786 slat (usec): min=10, max=92518, avg=1121.03, stdev=3886.17 00:22:57.786 clat (usec): min=879, max=271996, avg=97991.27, stdev=35567.82 00:22:57.786 lat (usec): min=906, max=272029, avg=99112.30, stdev=36091.21 00:22:57.786 clat percentiles (msec): 00:22:57.786 | 1.00th=[ 7], 5.00th=[ 45], 10.00th=[ 58], 20.00th=[ 71], 00:22:57.786 | 30.00th=[ 80], 40.00th=[ 88], 50.00th=[ 96], 60.00th=[ 106], 00:22:57.786 | 70.00th=[ 114], 80.00th=[ 127], 90.00th=[ 144], 95.00th=[ 159], 00:22:57.786 | 99.00th=[ 178], 99.50th=[ 205], 99.90th=[ 262], 99.95th=[ 271], 00:22:57.786 | 99.99th=[ 271] 00:22:57.786 bw ( KiB/s): min=96768, max=282112, per=8.15%, avg=165697.20, stdev=44976.98, samples=20 00:22:57.786 iops : min= 378, max= 1102, avg=647.25, stdev=175.70, samples=20 00:22:57.786 lat (usec) : 1000=0.02% 00:22:57.786 lat (msec) : 2=0.34%, 4=0.58%, 10=0.24%, 20=0.81%, 50=5.19% 00:22:57.786 lat (msec) : 100=47.33%, 250=45.25%, 500=0.24% 00:22:57.786 cpu : usr=0.30%, sys=2.30%, ctx=1494, majf=0, minf=3725 00:22:57.786 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.0% 00:22:57.786 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.786 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.786 issued rwts: total=6537,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.786 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.786 job6: (groupid=0, jobs=1): err= 0: pid=2412522: Sat Nov 30 04:24:46 2024 00:22:57.786 read: IOPS=628, BW=157MiB/s (165MB/s)(1591MiB/10127msec) 00:22:57.786 slat (usec): min=9, max=90251, avg=1167.72, stdev=4036.48 00:22:57.786 clat (msec): min=8, max=303, avg=100.60, stdev=39.49 00:22:57.786 lat (msec): min=8, max=303, avg=101.77, stdev=40.08 00:22:57.786 clat percentiles (msec): 00:22:57.786 | 1.00th=[ 26], 5.00th=[ 42], 10.00th=[ 49], 20.00th=[ 63], 00:22:57.786 | 30.00th=[ 80], 40.00th=[ 90], 50.00th=[ 102], 60.00th=[ 111], 00:22:57.786 | 70.00th=[ 121], 80.00th=[ 136], 90.00th=[ 153], 95.00th=[ 161], 00:22:57.786 | 99.00th=[ 184], 99.50th=[ 228], 99.90th=[ 292], 99.95th=[ 300], 00:22:57.786 | 99.99th=[ 305] 00:22:57.786 bw ( KiB/s): min=98304, max=306688, per=7.93%, avg=161242.85, stdev=46529.83, samples=20 00:22:57.786 iops : min= 384, max= 1198, avg=629.85, stdev=181.76, samples=20 00:22:57.786 lat (msec) : 10=0.09%, 20=0.46%, 50=11.11%, 100=37.50%, 250=50.41% 00:22:57.786 lat (msec) : 500=0.42% 00:22:57.786 cpu : usr=0.32%, sys=2.09%, ctx=1486, majf=0, minf=4097 00:22:57.786 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:22:57.786 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.786 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.786 issued rwts: total=6362,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.786 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.786 job7: (groupid=0, jobs=1): err= 0: pid=2412523: Sat Nov 30 04:24:46 2024 00:22:57.786 read: IOPS=684, BW=171MiB/s (179MB/s)(1734MiB/10131msec) 00:22:57.786 slat (usec): min=9, max=64749, avg=891.95, stdev=3545.36 00:22:57.786 clat (usec): min=1579, max=310005, avg=92530.91, stdev=43042.54 00:22:57.786 lat (usec): min=1612, max=310022, avg=93422.86, stdev=43574.56 00:22:57.786 clat percentiles (msec): 00:22:57.786 | 1.00th=[ 6], 5.00th=[ 13], 10.00th=[ 24], 20.00th=[ 56], 00:22:57.786 | 30.00th=[ 72], 40.00th=[ 86], 50.00th=[ 97], 60.00th=[ 109], 00:22:57.786 | 70.00th=[ 121], 80.00th=[ 130], 90.00th=[ 144], 95.00th=[ 155], 00:22:57.786 | 99.00th=[ 176], 99.50th=[ 186], 99.90th=[ 236], 99.95th=[ 300], 00:22:57.786 | 99.99th=[ 309] 00:22:57.786 bw ( KiB/s): min=110882, max=307712, per=8.65%, avg=175866.50, stdev=58118.95, samples=20 00:22:57.786 iops : min= 433, max= 1202, avg=686.95, stdev=227.03, samples=20 00:22:57.786 lat (msec) : 2=0.09%, 4=0.39%, 10=3.09%, 20=5.21%, 50=8.12% 00:22:57.786 lat (msec) : 100=35.61%, 250=47.43%, 500=0.07% 00:22:57.786 cpu : usr=0.40%, sys=1.92%, ctx=1639, majf=0, minf=4097 00:22:57.786 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:57.786 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.786 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.786 issued rwts: total=6934,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.786 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.786 job8: (groupid=0, jobs=1): err= 0: pid=2412524: Sat Nov 30 04:24:46 2024 00:22:57.786 read: IOPS=680, BW=170MiB/s (178MB/s)(1705MiB/10017msec) 00:22:57.786 slat (usec): min=9, max=55217, avg=1091.64, stdev=3738.53 00:22:57.786 clat (msec): min=4, max=191, avg=92.85, stdev=36.56 00:22:57.786 lat (msec): min=4, max=200, avg=93.94, stdev=37.08 00:22:57.786 clat percentiles (msec): 00:22:57.786 | 1.00th=[ 11], 5.00th=[ 29], 10.00th=[ 46], 20.00th=[ 61], 00:22:57.786 | 30.00th=[ 70], 40.00th=[ 84], 50.00th=[ 95], 60.00th=[ 105], 00:22:57.786 | 70.00th=[ 115], 80.00th=[ 128], 90.00th=[ 140], 95.00th=[ 150], 00:22:57.786 | 99.00th=[ 165], 99.50th=[ 171], 99.90th=[ 182], 99.95th=[ 186], 00:22:57.786 | 99.99th=[ 192] 00:22:57.786 bw ( KiB/s): min=110592, max=304128, per=8.51%, avg=172943.05, stdev=57607.98, samples=20 00:22:57.786 iops : min= 432, max= 1188, avg=675.55, stdev=225.03, samples=20 00:22:57.786 lat (msec) : 10=0.97%, 20=1.94%, 50=8.99%, 100=42.72%, 250=45.39% 00:22:57.786 cpu : usr=0.35%, sys=1.96%, ctx=1492, majf=0, minf=4097 00:22:57.786 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.5%, >=64=99.1% 00:22:57.786 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.786 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.786 issued rwts: total=6819,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.786 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.786 job9: (groupid=0, jobs=1): err= 0: pid=2412525: Sat Nov 30 04:24:46 2024 00:22:57.786 read: IOPS=934, BW=234MiB/s (245MB/s)(2366MiB/10132msec) 00:22:57.786 slat (usec): min=9, max=130404, avg=846.21, stdev=3415.28 00:22:57.786 clat (msec): min=3, max=247, avg=67.61, stdev=40.24 00:22:57.786 lat (msec): min=3, max=249, avg=68.45, stdev=40.66 00:22:57.786 clat percentiles (msec): 00:22:57.786 | 1.00th=[ 10], 5.00th=[ 19], 10.00th=[ 27], 20.00th=[ 32], 00:22:57.786 | 30.00th=[ 36], 40.00th=[ 52], 50.00th=[ 59], 60.00th=[ 71], 00:22:57.786 | 70.00th=[ 84], 80.00th=[ 101], 90.00th=[ 125], 95.00th=[ 153], 00:22:57.786 | 99.00th=[ 167], 99.50th=[ 184], 99.90th=[ 245], 99.95th=[ 249], 00:22:57.786 | 99.99th=[ 249] 00:22:57.786 bw ( KiB/s): min=125440, max=530944, per=11.84%, avg=240667.45, stdev=110762.50, samples=20 00:22:57.786 iops : min= 490, max= 2074, avg=940.05, stdev=432.70, samples=20 00:22:57.786 lat (msec) : 4=0.05%, 10=0.97%, 20=5.31%, 50=31.98%, 100=41.60% 00:22:57.786 lat (msec) : 250=20.08% 00:22:57.786 cpu : usr=0.48%, sys=2.72%, ctx=1837, majf=0, minf=4097 00:22:57.786 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.3%, >=64=99.3% 00:22:57.786 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.786 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.786 issued rwts: total=9465,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.786 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.786 job10: (groupid=0, jobs=1): err= 0: pid=2412526: Sat Nov 30 04:24:46 2024 00:22:57.786 read: IOPS=842, BW=211MiB/s (221MB/s)(2133MiB/10130msec) 00:22:57.786 slat (usec): min=9, max=91971, avg=921.72, stdev=3653.92 00:22:57.786 clat (usec): min=1467, max=278855, avg=75029.70, stdev=39256.86 00:22:57.786 lat (usec): min=1489, max=278887, avg=75951.41, stdev=39760.80 00:22:57.786 clat percentiles (msec): 00:22:57.786 | 1.00th=[ 5], 5.00th=[ 18], 10.00th=[ 28], 20.00th=[ 39], 00:22:57.786 | 30.00th=[ 52], 40.00th=[ 63], 50.00th=[ 72], 60.00th=[ 83], 00:22:57.786 | 70.00th=[ 95], 80.00th=[ 109], 90.00th=[ 127], 95.00th=[ 142], 00:22:57.786 | 99.00th=[ 178], 99.50th=[ 199], 99.90th=[ 268], 99.95th=[ 279], 00:22:57.786 | 99.99th=[ 279] 00:22:57.787 bw ( KiB/s): min=115712, max=369664, per=10.66%, avg=216692.20, stdev=71376.77, samples=20 00:22:57.787 iops : min= 452, max= 1444, avg=846.40, stdev=278.78, samples=20 00:22:57.787 lat (msec) : 2=0.04%, 4=0.57%, 10=1.50%, 20=3.73%, 50=22.79% 00:22:57.787 lat (msec) : 100=45.39%, 250=25.70%, 500=0.28% 00:22:57.787 cpu : usr=0.44%, sys=2.47%, ctx=1576, majf=0, minf=4097 00:22:57.787 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.2%, 32=0.4%, >=64=99.3% 00:22:57.787 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:22:57.787 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:22:57.787 issued rwts: total=8530,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:22:57.787 latency : target=0, window=0, percentile=100.00%, depth=64 00:22:57.787 00:22:57.787 Run status group 0 (all jobs): 00:22:57.787 READ: bw=1985MiB/s (2082MB/s), 156MiB/s-234MiB/s (164MB/s-245MB/s), io=19.7GiB (21.2GB), run=10016-10165msec 00:22:57.787 00:22:57.787 Disk stats (read/write): 00:22:57.787 nvme0n1: ios=12346/0, merge=0/0, ticks=1235025/0, in_queue=1235025, util=97.43% 00:22:57.787 nvme10n1: ios=16067/0, merge=0/0, ticks=1244064/0, in_queue=1244064, util=97.63% 00:22:57.787 nvme1n1: ios=14761/0, merge=0/0, ticks=1239356/0, in_queue=1239356, util=97.86% 00:22:57.787 nvme2n1: ios=14346/0, merge=0/0, ticks=1228679/0, in_queue=1228679, util=97.97% 00:22:57.787 nvme3n1: ios=13674/0, merge=0/0, ticks=1232240/0, in_queue=1232240, util=98.06% 00:22:57.787 nvme4n1: ios=12931/0, merge=0/0, ticks=1237572/0, in_queue=1237572, util=98.37% 00:22:57.787 nvme5n1: ios=12569/0, merge=0/0, ticks=1233222/0, in_queue=1233222, util=98.51% 00:22:57.787 nvme6n1: ios=13685/0, merge=0/0, ticks=1237311/0, in_queue=1237311, util=98.60% 00:22:57.787 nvme7n1: ios=13405/0, merge=0/0, ticks=1241641/0, in_queue=1241641, util=98.98% 00:22:57.787 nvme8n1: ios=18756/0, merge=0/0, ticks=1238938/0, in_queue=1238938, util=99.14% 00:22:57.787 nvme9n1: ios=16917/0, merge=0/0, ticks=1236914/0, in_queue=1236914, util=99.24% 00:22:57.787 04:24:46 -- target/multiconnection.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 262144 -d 64 -t randwrite -r 10 00:22:57.787 [global] 00:22:57.787 thread=1 00:22:57.787 invalidate=1 00:22:57.787 rw=randwrite 00:22:57.787 time_based=1 00:22:57.787 runtime=10 00:22:57.787 ioengine=libaio 00:22:57.787 direct=1 00:22:57.787 bs=262144 00:22:57.787 iodepth=64 00:22:57.787 norandommap=1 00:22:57.787 numjobs=1 00:22:57.787 00:22:57.787 [job0] 00:22:57.787 filename=/dev/nvme0n1 00:22:57.787 [job1] 00:22:57.787 filename=/dev/nvme10n1 00:22:57.787 [job2] 00:22:57.787 filename=/dev/nvme1n1 00:22:57.787 [job3] 00:22:57.787 filename=/dev/nvme2n1 00:22:57.787 [job4] 00:22:57.787 filename=/dev/nvme3n1 00:22:57.787 [job5] 00:22:57.787 filename=/dev/nvme4n1 00:22:57.787 [job6] 00:22:57.787 filename=/dev/nvme5n1 00:22:57.787 [job7] 00:22:57.787 filename=/dev/nvme6n1 00:22:57.787 [job8] 00:22:57.787 filename=/dev/nvme7n1 00:22:57.787 [job9] 00:22:57.787 filename=/dev/nvme8n1 00:22:57.787 [job10] 00:22:57.787 filename=/dev/nvme9n1 00:22:57.787 Could not set queue depth (nvme0n1) 00:22:57.787 Could not set queue depth (nvme10n1) 00:22:57.787 Could not set queue depth (nvme1n1) 00:22:57.787 Could not set queue depth (nvme2n1) 00:22:57.787 Could not set queue depth (nvme3n1) 00:22:57.787 Could not set queue depth (nvme4n1) 00:22:57.787 Could not set queue depth (nvme5n1) 00:22:57.787 Could not set queue depth (nvme6n1) 00:22:57.787 Could not set queue depth (nvme7n1) 00:22:57.787 Could not set queue depth (nvme8n1) 00:22:57.787 Could not set queue depth (nvme9n1) 00:22:57.787 job0: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 job1: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 job2: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 job3: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 job4: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 job5: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 job6: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 job7: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 job8: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 job9: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 job10: (g=0): rw=randwrite, bs=(R) 256KiB-256KiB, (W) 256KiB-256KiB, (T) 256KiB-256KiB, ioengine=libaio, iodepth=64 00:22:57.787 fio-3.35 00:22:57.787 Starting 11 threads 00:23:07.753 00:23:07.753 job0: (groupid=0, jobs=1): err= 0: pid=2413572: Sat Nov 30 04:24:57 2024 00:23:07.753 write: IOPS=579, BW=145MiB/s (152MB/s)(1473MiB/10176msec); 0 zone resets 00:23:07.753 slat (usec): min=16, max=117499, avg=958.11, stdev=3367.79 00:23:07.753 clat (usec): min=866, max=361988, avg=109494.02, stdev=62555.86 00:23:07.753 lat (usec): min=903, max=362044, avg=110452.13, stdev=63157.38 00:23:07.753 clat percentiles (msec): 00:23:07.753 | 1.00th=[ 7], 5.00th=[ 17], 10.00th=[ 33], 20.00th=[ 59], 00:23:07.753 | 30.00th=[ 77], 40.00th=[ 84], 50.00th=[ 92], 60.00th=[ 112], 00:23:07.753 | 70.00th=[ 138], 80.00th=[ 174], 90.00th=[ 201], 95.00th=[ 224], 00:23:07.753 | 99.00th=[ 257], 99.50th=[ 275], 99.90th=[ 326], 99.95th=[ 363], 00:23:07.753 | 99.99th=[ 363] 00:23:07.753 bw ( KiB/s): min=77824, max=227840, per=9.94%, avg=149248.00, stdev=41450.37, samples=20 00:23:07.753 iops : min= 304, max= 890, avg=583.00, stdev=161.92, samples=20 00:23:07.753 lat (usec) : 1000=0.02% 00:23:07.753 lat (msec) : 2=0.07%, 4=0.25%, 10=1.87%, 20=3.85%, 50=9.96% 00:23:07.753 lat (msec) : 100=37.88%, 250=44.90%, 500=1.20% 00:23:07.753 cpu : usr=1.85%, sys=1.98%, ctx=3789, majf=0, minf=1 00:23:07.753 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:23:07.753 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.753 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.753 issued rwts: total=0,5893,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.753 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.753 job1: (groupid=0, jobs=1): err= 0: pid=2413573: Sat Nov 30 04:24:57 2024 00:23:07.753 write: IOPS=584, BW=146MiB/s (153MB/s)(1466MiB/10038msec); 0 zone resets 00:23:07.753 slat (usec): min=24, max=24871, avg=1419.23, stdev=3174.11 00:23:07.753 clat (msec): min=2, max=241, avg=108.08, stdev=54.29 00:23:07.753 lat (msec): min=2, max=244, avg=109.49, stdev=54.97 00:23:07.753 clat percentiles (msec): 00:23:07.753 | 1.00th=[ 8], 5.00th=[ 30], 10.00th=[ 41], 20.00th=[ 44], 00:23:07.753 | 30.00th=[ 75], 40.00th=[ 88], 50.00th=[ 113], 60.00th=[ 124], 00:23:07.753 | 70.00th=[ 142], 80.00th=[ 161], 90.00th=[ 180], 95.00th=[ 197], 00:23:07.753 | 99.00th=[ 228], 99.50th=[ 232], 99.90th=[ 239], 99.95th=[ 241], 00:23:07.753 | 99.99th=[ 243] 00:23:07.753 bw ( KiB/s): min=92160, max=376832, per=9.89%, avg=148531.20, stdev=63736.54, samples=20 00:23:07.753 iops : min= 360, max= 1472, avg=580.20, stdev=248.97, samples=20 00:23:07.753 lat (msec) : 4=0.24%, 10=1.18%, 20=2.20%, 50=19.05%, 100=21.09% 00:23:07.753 lat (msec) : 250=56.25% 00:23:07.753 cpu : usr=1.78%, sys=2.19%, ctx=2380, majf=0, minf=1 00:23:07.753 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=98.9% 00:23:07.753 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.753 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.753 issued rwts: total=0,5865,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.753 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.753 job2: (groupid=0, jobs=1): err= 0: pid=2413574: Sat Nov 30 04:24:57 2024 00:23:07.753 write: IOPS=554, BW=139MiB/s (145MB/s)(1408MiB/10155msec); 0 zone resets 00:23:07.753 slat (usec): min=16, max=37253, avg=1335.76, stdev=3183.73 00:23:07.753 clat (usec): min=1262, max=331290, avg=113995.61, stdev=53960.70 00:23:07.753 lat (usec): min=1879, max=331328, avg=115331.37, stdev=54602.78 00:23:07.753 clat percentiles (msec): 00:23:07.753 | 1.00th=[ 11], 5.00th=[ 35], 10.00th=[ 44], 20.00th=[ 65], 00:23:07.753 | 30.00th=[ 82], 40.00th=[ 97], 50.00th=[ 114], 60.00th=[ 122], 00:23:07.753 | 70.00th=[ 140], 80.00th=[ 165], 90.00th=[ 190], 95.00th=[ 209], 00:23:07.753 | 99.00th=[ 239], 99.50th=[ 251], 99.90th=[ 321], 99.95th=[ 321], 00:23:07.753 | 99.99th=[ 330] 00:23:07.753 bw ( KiB/s): min=75776, max=253440, per=9.49%, avg=142577.80, stdev=47798.60, samples=20 00:23:07.754 iops : min= 296, max= 990, avg=556.90, stdev=186.74, samples=20 00:23:07.754 lat (msec) : 2=0.05%, 4=0.12%, 10=0.67%, 20=1.94%, 50=11.10% 00:23:07.754 lat (msec) : 100=27.47%, 250=58.10%, 500=0.55% 00:23:07.754 cpu : usr=1.95%, sys=1.98%, ctx=2583, majf=0, minf=1 00:23:07.754 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:07.754 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.754 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.754 issued rwts: total=0,5632,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.754 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.754 job3: (groupid=0, jobs=1): err= 0: pid=2413581: Sat Nov 30 04:24:57 2024 00:23:07.754 write: IOPS=483, BW=121MiB/s (127MB/s)(1228MiB/10171msec); 0 zone resets 00:23:07.754 slat (usec): min=26, max=35993, avg=1559.77, stdev=3789.31 00:23:07.754 clat (usec): min=1818, max=396948, avg=130855.12, stdev=59072.01 00:23:07.754 lat (usec): min=1881, max=396978, avg=132414.89, stdev=60007.17 00:23:07.754 clat percentiles (msec): 00:23:07.754 | 1.00th=[ 14], 5.00th=[ 30], 10.00th=[ 46], 20.00th=[ 75], 00:23:07.754 | 30.00th=[ 97], 40.00th=[ 116], 50.00th=[ 136], 60.00th=[ 153], 00:23:07.754 | 70.00th=[ 169], 80.00th=[ 182], 90.00th=[ 203], 95.00th=[ 218], 00:23:07.754 | 99.00th=[ 249], 99.50th=[ 279], 99.90th=[ 384], 99.95th=[ 384], 00:23:07.754 | 99.99th=[ 397] 00:23:07.754 bw ( KiB/s): min=70144, max=171008, per=8.27%, avg=124176.35, stdev=32211.94, samples=20 00:23:07.754 iops : min= 274, max= 668, avg=485.05, stdev=125.81, samples=20 00:23:07.754 lat (msec) : 2=0.02%, 10=0.39%, 20=1.99%, 50=9.04%, 100=20.03% 00:23:07.754 lat (msec) : 250=67.68%, 500=0.85% 00:23:07.754 cpu : usr=1.74%, sys=1.94%, ctx=2504, majf=0, minf=1 00:23:07.754 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:07.754 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.754 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.754 issued rwts: total=0,4913,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.754 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.754 job4: (groupid=0, jobs=1): err= 0: pid=2413587: Sat Nov 30 04:24:57 2024 00:23:07.754 write: IOPS=607, BW=152MiB/s (159MB/s)(1525MiB/10043msec); 0 zone resets 00:23:07.754 slat (usec): min=18, max=47339, avg=1052.43, stdev=2860.53 00:23:07.754 clat (usec): min=823, max=244790, avg=104297.44, stdev=54980.42 00:23:07.754 lat (usec): min=853, max=244976, avg=105349.86, stdev=55603.48 00:23:07.754 clat percentiles (msec): 00:23:07.754 | 1.00th=[ 5], 5.00th=[ 27], 10.00th=[ 42], 20.00th=[ 47], 00:23:07.754 | 30.00th=[ 68], 40.00th=[ 83], 50.00th=[ 100], 60.00th=[ 118], 00:23:07.754 | 70.00th=[ 138], 80.00th=[ 161], 90.00th=[ 184], 95.00th=[ 197], 00:23:07.754 | 99.00th=[ 218], 99.50th=[ 222], 99.90th=[ 234], 99.95th=[ 239], 00:23:07.754 | 99.99th=[ 245] 00:23:07.754 bw ( KiB/s): min=80384, max=326144, per=10.29%, avg=154521.60, stdev=71535.03, samples=20 00:23:07.754 iops : min= 314, max= 1274, avg=603.60, stdev=279.43, samples=20 00:23:07.754 lat (usec) : 1000=0.02% 00:23:07.754 lat (msec) : 2=0.25%, 4=0.48%, 10=1.69%, 20=1.41%, 50=20.30% 00:23:07.754 lat (msec) : 100=26.30%, 250=49.57% 00:23:07.754 cpu : usr=2.15%, sys=2.11%, ctx=3073, majf=0, minf=1 00:23:07.754 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.5%, >=64=99.0% 00:23:07.754 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.754 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.754 issued rwts: total=0,6099,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.754 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.754 job5: (groupid=0, jobs=1): err= 0: pid=2413603: Sat Nov 30 04:24:57 2024 00:23:07.754 write: IOPS=516, BW=129MiB/s (135MB/s)(1313MiB/10166msec); 0 zone resets 00:23:07.754 slat (usec): min=20, max=75570, avg=1389.75, stdev=3628.60 00:23:07.754 clat (msec): min=4, max=365, avg=122.41, stdev=57.01 00:23:07.754 lat (msec): min=4, max=365, avg=123.80, stdev=57.77 00:23:07.754 clat percentiles (msec): 00:23:07.754 | 1.00th=[ 13], 5.00th=[ 33], 10.00th=[ 53], 20.00th=[ 69], 00:23:07.754 | 30.00th=[ 92], 40.00th=[ 105], 50.00th=[ 117], 60.00th=[ 136], 00:23:07.754 | 70.00th=[ 153], 80.00th=[ 176], 90.00th=[ 197], 95.00th=[ 218], 00:23:07.754 | 99.00th=[ 253], 99.50th=[ 288], 99.90th=[ 355], 99.95th=[ 355], 00:23:07.754 | 99.99th=[ 368] 00:23:07.754 bw ( KiB/s): min=74752, max=223744, per=8.85%, avg=132864.00, stdev=43504.15, samples=20 00:23:07.754 iops : min= 292, max= 874, avg=519.00, stdev=169.94, samples=20 00:23:07.754 lat (msec) : 10=0.38%, 20=1.81%, 50=7.23%, 100=26.78%, 250=62.71% 00:23:07.754 lat (msec) : 500=1.09% 00:23:07.754 cpu : usr=1.87%, sys=1.86%, ctx=2643, majf=0, minf=1 00:23:07.754 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:07.754 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.754 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.754 issued rwts: total=0,5253,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.754 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.754 job6: (groupid=0, jobs=1): err= 0: pid=2413614: Sat Nov 30 04:24:57 2024 00:23:07.754 write: IOPS=551, BW=138MiB/s (145MB/s)(1400MiB/10156msec); 0 zone resets 00:23:07.754 slat (usec): min=24, max=41584, avg=1220.09, stdev=3313.85 00:23:07.754 clat (msec): min=3, max=330, avg=114.76, stdev=59.67 00:23:07.754 lat (msec): min=4, max=330, avg=115.98, stdev=60.50 00:23:07.754 clat percentiles (msec): 00:23:07.754 | 1.00th=[ 12], 5.00th=[ 31], 10.00th=[ 42], 20.00th=[ 53], 00:23:07.754 | 30.00th=[ 73], 40.00th=[ 90], 50.00th=[ 116], 60.00th=[ 134], 00:23:07.754 | 70.00th=[ 146], 80.00th=[ 171], 90.00th=[ 197], 95.00th=[ 213], 00:23:07.754 | 99.00th=[ 255], 99.50th=[ 262], 99.90th=[ 321], 99.95th=[ 321], 00:23:07.754 | 99.99th=[ 330] 00:23:07.754 bw ( KiB/s): min=67584, max=285696, per=9.44%, avg=141788.90, stdev=55738.47, samples=20 00:23:07.754 iops : min= 264, max= 1116, avg=553.85, stdev=217.72, samples=20 00:23:07.754 lat (msec) : 4=0.02%, 10=0.57%, 20=2.16%, 50=13.98%, 100=27.12% 00:23:07.754 lat (msec) : 250=54.94%, 500=1.21% 00:23:07.754 cpu : usr=1.91%, sys=2.15%, ctx=3226, majf=0, minf=1 00:23:07.754 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.9% 00:23:07.754 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.754 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.754 issued rwts: total=0,5601,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.754 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.754 job7: (groupid=0, jobs=1): err= 0: pid=2413622: Sat Nov 30 04:24:57 2024 00:23:07.754 write: IOPS=480, BW=120MiB/s (126MB/s)(1221MiB/10169msec); 0 zone resets 00:23:07.754 slat (usec): min=19, max=39614, avg=1614.99, stdev=3705.78 00:23:07.754 clat (msec): min=5, max=336, avg=131.63, stdev=55.31 00:23:07.754 lat (msec): min=5, max=336, avg=133.24, stdev=55.98 00:23:07.754 clat percentiles (msec): 00:23:07.754 | 1.00th=[ 13], 5.00th=[ 40], 10.00th=[ 45], 20.00th=[ 79], 00:23:07.754 | 30.00th=[ 104], 40.00th=[ 127], 50.00th=[ 140], 60.00th=[ 153], 00:23:07.754 | 70.00th=[ 165], 80.00th=[ 180], 90.00th=[ 199], 95.00th=[ 209], 00:23:07.754 | 99.00th=[ 241], 99.50th=[ 271], 99.90th=[ 326], 99.95th=[ 326], 00:23:07.754 | 99.99th=[ 338] 00:23:07.754 bw ( KiB/s): min=79360, max=260608, per=8.22%, avg=123366.40, stdev=39896.41, samples=20 00:23:07.754 iops : min= 310, max= 1018, avg=481.90, stdev=155.85, samples=20 00:23:07.754 lat (msec) : 10=0.35%, 20=2.21%, 50=8.95%, 100=16.67%, 250=71.20% 00:23:07.754 lat (msec) : 500=0.61% 00:23:07.754 cpu : usr=1.65%, sys=1.73%, ctx=2144, majf=0, minf=1 00:23:07.754 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:07.754 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.754 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.754 issued rwts: total=0,4882,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.754 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.754 job8: (groupid=0, jobs=1): err= 0: pid=2413669: Sat Nov 30 04:24:57 2024 00:23:07.754 write: IOPS=519, BW=130MiB/s (136MB/s)(1319MiB/10157msec); 0 zone resets 00:23:07.754 slat (usec): min=20, max=53948, avg=1524.18, stdev=3568.01 00:23:07.754 clat (usec): min=1184, max=329075, avg=121638.00, stdev=56429.98 00:23:07.754 lat (usec): min=1225, max=329106, avg=123162.18, stdev=57275.43 00:23:07.754 clat percentiles (msec): 00:23:07.754 | 1.00th=[ 8], 5.00th=[ 23], 10.00th=[ 44], 20.00th=[ 70], 00:23:07.754 | 30.00th=[ 95], 40.00th=[ 112], 50.00th=[ 120], 60.00th=[ 134], 00:23:07.754 | 70.00th=[ 153], 80.00th=[ 176], 90.00th=[ 199], 95.00th=[ 211], 00:23:07.754 | 99.00th=[ 234], 99.50th=[ 249], 99.90th=[ 317], 99.95th=[ 317], 00:23:07.754 | 99.99th=[ 330] 00:23:07.754 bw ( KiB/s): min=79872, max=272896, per=8.89%, avg=133427.20, stdev=46378.87, samples=20 00:23:07.754 iops : min= 312, max= 1066, avg=521.20, stdev=181.17, samples=20 00:23:07.754 lat (msec) : 2=0.08%, 4=0.13%, 10=1.19%, 20=2.90%, 50=9.80% 00:23:07.754 lat (msec) : 100=18.24%, 250=67.17%, 500=0.49% 00:23:07.754 cpu : usr=1.82%, sys=1.92%, ctx=2504, majf=0, minf=1 00:23:07.754 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:07.754 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.754 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.754 issued rwts: total=0,5275,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.754 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.754 job9: (groupid=0, jobs=1): err= 0: pid=2413692: Sat Nov 30 04:24:57 2024 00:23:07.754 write: IOPS=531, BW=133MiB/s (139MB/s)(1350MiB/10157msec); 0 zone resets 00:23:07.754 slat (usec): min=19, max=62393, avg=1559.03, stdev=3700.09 00:23:07.754 clat (usec): min=1212, max=326200, avg=118793.26, stdev=63074.89 00:23:07.754 lat (usec): min=1295, max=326242, avg=120352.29, stdev=63861.72 00:23:07.754 clat percentiles (msec): 00:23:07.754 | 1.00th=[ 5], 5.00th=[ 18], 10.00th=[ 46], 20.00th=[ 59], 00:23:07.754 | 30.00th=[ 83], 40.00th=[ 92], 50.00th=[ 110], 60.00th=[ 136], 00:23:07.754 | 70.00th=[ 161], 80.00th=[ 180], 90.00th=[ 199], 95.00th=[ 218], 00:23:07.754 | 99.00th=[ 271], 99.50th=[ 284], 99.90th=[ 317], 99.95th=[ 317], 00:23:07.754 | 99.99th=[ 326] 00:23:07.754 bw ( KiB/s): min=86016, max=281088, per=9.10%, avg=136595.70, stdev=50942.92, samples=20 00:23:07.754 iops : min= 336, max= 1098, avg=533.55, stdev=198.96, samples=20 00:23:07.754 lat (msec) : 2=0.11%, 4=0.87%, 10=2.54%, 20=2.39%, 50=11.10% 00:23:07.754 lat (msec) : 100=28.38%, 250=52.58%, 500=2.04% 00:23:07.754 cpu : usr=1.85%, sys=1.66%, ctx=2239, majf=0, minf=1 00:23:07.755 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.3%, 32=0.6%, >=64=98.8% 00:23:07.755 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.755 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.755 issued rwts: total=0,5398,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.755 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.755 job10: (groupid=0, jobs=1): err= 0: pid=2413709: Sat Nov 30 04:24:57 2024 00:23:07.755 write: IOPS=480, BW=120MiB/s (126MB/s)(1220MiB/10166msec); 0 zone resets 00:23:07.755 slat (usec): min=25, max=60110, avg=1508.54, stdev=3657.18 00:23:07.755 clat (msec): min=8, max=393, avg=131.72, stdev=52.25 00:23:07.755 lat (msec): min=9, max=393, avg=133.23, stdev=52.95 00:23:07.755 clat percentiles (msec): 00:23:07.755 | 1.00th=[ 23], 5.00th=[ 44], 10.00th=[ 62], 20.00th=[ 88], 00:23:07.755 | 30.00th=[ 108], 40.00th=[ 118], 50.00th=[ 133], 60.00th=[ 144], 00:23:07.755 | 70.00th=[ 155], 80.00th=[ 169], 90.00th=[ 194], 95.00th=[ 218], 00:23:07.755 | 99.00th=[ 264], 99.50th=[ 330], 99.90th=[ 384], 99.95th=[ 384], 00:23:07.755 | 99.99th=[ 393] 00:23:07.755 bw ( KiB/s): min=64000, max=180224, per=8.21%, avg=123353.50, stdev=28888.94, samples=20 00:23:07.755 iops : min= 250, max= 704, avg=481.80, stdev=112.84, samples=20 00:23:07.755 lat (msec) : 10=0.06%, 20=0.45%, 50=6.43%, 100=18.95%, 250=72.30% 00:23:07.755 lat (msec) : 500=1.80% 00:23:07.755 cpu : usr=1.61%, sys=1.90%, ctx=2428, majf=0, minf=1 00:23:07.755 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.3%, 32=0.7%, >=64=98.7% 00:23:07.755 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:23:07.755 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.1%, >=64=0.0% 00:23:07.755 issued rwts: total=0,4881,0,0 short=0,0,0,0 dropped=0,0,0,0 00:23:07.755 latency : target=0, window=0, percentile=100.00%, depth=64 00:23:07.755 00:23:07.755 Run status group 0 (all jobs): 00:23:07.755 WRITE: bw=1466MiB/s (1538MB/s), 120MiB/s-152MiB/s (126MB/s-159MB/s), io=14.6GiB (15.6GB), run=10038-10176msec 00:23:07.755 00:23:07.755 Disk stats (read/write): 00:23:07.755 nvme0n1: ios=49/11769, merge=0/0, ticks=327/1252674, in_queue=1253001, util=99.59% 00:23:07.755 nvme10n1: ios=40/11308, merge=0/0, ticks=1115/1216269, in_queue=1217384, util=99.92% 00:23:07.755 nvme1n1: ios=49/11075, merge=0/0, ticks=47/1212564, in_queue=1212611, util=97.72% 00:23:07.755 nvme2n1: ios=49/9815, merge=0/0, ticks=153/1242415, in_queue=1242568, util=99.03% 00:23:07.755 nvme3n1: ios=48/11836, merge=0/0, ticks=322/1226128, in_queue=1226450, util=100.00% 00:23:07.755 nvme4n1: ios=47/10495, merge=0/0, ticks=114/1244341, in_queue=1244455, util=99.02% 00:23:07.755 nvme5n1: ios=23/11012, merge=0/0, ticks=143/1216154, in_queue=1216297, util=99.46% 00:23:07.755 nvme6n1: ios=47/9747, merge=0/0, ticks=81/1241446, in_queue=1241527, util=98.62% 00:23:07.755 nvme7n1: ios=0/10361, merge=0/0, ticks=0/1209871, in_queue=1209871, util=98.78% 00:23:07.755 nvme8n1: ios=0/10603, merge=0/0, ticks=0/1208146, in_queue=1208146, util=98.99% 00:23:07.755 nvme9n1: ios=0/9750, merge=0/0, ticks=0/1243478, in_queue=1243478, util=99.09% 00:23:07.755 04:24:57 -- target/multiconnection.sh@36 -- # sync 00:23:07.755 04:24:57 -- target/multiconnection.sh@37 -- # seq 1 11 00:23:07.755 04:24:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.755 04:24:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:23:07.755 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:23:07.755 04:24:57 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK1 00:23:07.755 04:24:57 -- common/autotest_common.sh@1208 -- # local i=0 00:23:07.755 04:24:57 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:07.755 04:24:57 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK1 00:23:07.755 04:24:57 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:07.755 04:24:57 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK1 00:23:07.755 04:24:57 -- common/autotest_common.sh@1220 -- # return 0 00:23:07.755 04:24:57 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:23:07.755 04:24:57 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.755 04:24:57 -- common/autotest_common.sh@10 -- # set +x 00:23:07.755 04:24:57 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.755 04:24:57 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.755 04:24:57 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode2 00:23:07.755 NQN:nqn.2016-06.io.spdk:cnode2 disconnected 1 controller(s) 00:23:07.755 04:24:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK2 00:23:07.755 04:24:58 -- common/autotest_common.sh@1208 -- # local i=0 00:23:07.755 04:24:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:07.755 04:24:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK2 00:23:07.755 04:24:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:07.755 04:24:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK2 00:23:07.755 04:24:58 -- common/autotest_common.sh@1220 -- # return 0 00:23:07.755 04:24:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:23:07.755 04:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:07.755 04:24:58 -- common/autotest_common.sh@10 -- # set +x 00:23:07.755 04:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:07.755 04:24:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:07.755 04:24:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode3 00:23:08.014 NQN:nqn.2016-06.io.spdk:cnode3 disconnected 1 controller(s) 00:23:08.014 04:24:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK3 00:23:08.014 04:24:58 -- common/autotest_common.sh@1208 -- # local i=0 00:23:08.014 04:24:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:08.014 04:24:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK3 00:23:08.014 04:24:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:08.014 04:24:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK3 00:23:08.014 04:24:58 -- common/autotest_common.sh@1220 -- # return 0 00:23:08.014 04:24:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:23:08.014 04:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.014 04:24:58 -- common/autotest_common.sh@10 -- # set +x 00:23:08.014 04:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.014 04:24:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.014 04:24:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode4 00:23:08.272 NQN:nqn.2016-06.io.spdk:cnode4 disconnected 1 controller(s) 00:23:08.272 04:24:58 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK4 00:23:08.272 04:24:58 -- common/autotest_common.sh@1208 -- # local i=0 00:23:08.272 04:24:58 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK4 00:23:08.272 04:24:58 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:08.272 04:24:58 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:08.272 04:24:58 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK4 00:23:08.272 04:24:58 -- common/autotest_common.sh@1220 -- # return 0 00:23:08.272 04:24:58 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode4 00:23:08.272 04:24:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.272 04:24:58 -- common/autotest_common.sh@10 -- # set +x 00:23:08.272 04:24:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.272 04:24:58 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.272 04:24:58 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode5 00:23:08.531 NQN:nqn.2016-06.io.spdk:cnode5 disconnected 1 controller(s) 00:23:08.531 04:24:59 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK5 00:23:08.531 04:24:59 -- common/autotest_common.sh@1208 -- # local i=0 00:23:08.531 04:24:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:08.531 04:24:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK5 00:23:08.531 04:24:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:08.531 04:24:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK5 00:23:08.531 04:24:59 -- common/autotest_common.sh@1220 -- # return 0 00:23:08.531 04:24:59 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode5 00:23:08.531 04:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:08.531 04:24:59 -- common/autotest_common.sh@10 -- # set +x 00:23:08.531 04:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:08.531 04:24:59 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:08.531 04:24:59 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode6 00:23:08.789 NQN:nqn.2016-06.io.spdk:cnode6 disconnected 1 controller(s) 00:23:08.789 04:24:59 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK6 00:23:08.789 04:24:59 -- common/autotest_common.sh@1208 -- # local i=0 00:23:08.789 04:24:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:08.789 04:24:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK6 00:23:08.789 04:24:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:08.789 04:24:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK6 00:23:09.048 04:24:59 -- common/autotest_common.sh@1220 -- # return 0 00:23:09.048 04:24:59 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode6 00:23:09.048 04:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.048 04:24:59 -- common/autotest_common.sh@10 -- # set +x 00:23:09.048 04:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.048 04:24:59 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:09.048 04:24:59 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode7 00:23:09.048 NQN:nqn.2016-06.io.spdk:cnode7 disconnected 1 controller(s) 00:23:09.048 04:24:59 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK7 00:23:09.048 04:24:59 -- common/autotest_common.sh@1208 -- # local i=0 00:23:09.048 04:24:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:09.048 04:24:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK7 00:23:09.048 04:24:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:09.048 04:24:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK7 00:23:09.048 04:24:59 -- common/autotest_common.sh@1220 -- # return 0 00:23:09.048 04:24:59 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode7 00:23:09.048 04:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.048 04:24:59 -- common/autotest_common.sh@10 -- # set +x 00:23:09.048 04:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.048 04:24:59 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:09.048 04:24:59 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode8 00:23:09.307 NQN:nqn.2016-06.io.spdk:cnode8 disconnected 1 controller(s) 00:23:09.307 04:24:59 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK8 00:23:09.307 04:24:59 -- common/autotest_common.sh@1208 -- # local i=0 00:23:09.307 04:24:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:09.307 04:24:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK8 00:23:09.307 04:24:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:09.307 04:24:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK8 00:23:09.307 04:24:59 -- common/autotest_common.sh@1220 -- # return 0 00:23:09.307 04:24:59 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode8 00:23:09.307 04:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.307 04:24:59 -- common/autotest_common.sh@10 -- # set +x 00:23:09.307 04:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.307 04:24:59 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:09.307 04:24:59 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode9 00:23:09.307 NQN:nqn.2016-06.io.spdk:cnode9 disconnected 1 controller(s) 00:23:09.307 04:24:59 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK9 00:23:09.307 04:24:59 -- common/autotest_common.sh@1208 -- # local i=0 00:23:09.307 04:24:59 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:09.307 04:24:59 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK9 00:23:09.565 04:24:59 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:09.565 04:24:59 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK9 00:23:09.565 04:24:59 -- common/autotest_common.sh@1220 -- # return 0 00:23:09.565 04:24:59 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode9 00:23:09.565 04:24:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.565 04:24:59 -- common/autotest_common.sh@10 -- # set +x 00:23:09.565 04:24:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.565 04:24:59 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:09.565 04:24:59 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode10 00:23:09.565 NQN:nqn.2016-06.io.spdk:cnode10 disconnected 1 controller(s) 00:23:09.565 04:25:00 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK10 00:23:09.565 04:25:00 -- common/autotest_common.sh@1208 -- # local i=0 00:23:09.565 04:25:00 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:09.565 04:25:00 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK10 00:23:09.565 04:25:00 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:09.565 04:25:00 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK10 00:23:09.565 04:25:00 -- common/autotest_common.sh@1220 -- # return 0 00:23:09.565 04:25:00 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode10 00:23:09.565 04:25:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.565 04:25:00 -- common/autotest_common.sh@10 -- # set +x 00:23:09.565 04:25:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.565 04:25:00 -- target/multiconnection.sh@37 -- # for i in $(seq 1 $NVMF_SUBSYS) 00:23:09.565 04:25:00 -- target/multiconnection.sh@38 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode11 00:23:09.565 NQN:nqn.2016-06.io.spdk:cnode11 disconnected 1 controller(s) 00:23:09.565 04:25:00 -- target/multiconnection.sh@39 -- # waitforserial_disconnect SPDK11 00:23:09.565 04:25:00 -- common/autotest_common.sh@1208 -- # local i=0 00:23:09.565 04:25:00 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:23:09.565 04:25:00 -- common/autotest_common.sh@1209 -- # grep -q -w SPDK11 00:23:09.565 04:25:00 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:23:09.565 04:25:00 -- common/autotest_common.sh@1216 -- # grep -q -w SPDK11 00:23:09.565 04:25:00 -- common/autotest_common.sh@1220 -- # return 0 00:23:09.565 04:25:00 -- target/multiconnection.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode11 00:23:09.565 04:25:00 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:09.565 04:25:00 -- common/autotest_common.sh@10 -- # set +x 00:23:09.565 04:25:00 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:09.565 04:25:00 -- target/multiconnection.sh@43 -- # rm -f ./local-job0-0-verify.state 00:23:09.565 04:25:00 -- target/multiconnection.sh@45 -- # trap - SIGINT SIGTERM EXIT 00:23:09.565 04:25:00 -- target/multiconnection.sh@47 -- # nvmftestfini 00:23:09.565 04:25:00 -- nvmf/common.sh@476 -- # nvmfcleanup 00:23:09.565 04:25:00 -- nvmf/common.sh@116 -- # sync 00:23:09.565 04:25:00 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:23:09.565 04:25:00 -- nvmf/common.sh@119 -- # set +e 00:23:09.565 04:25:00 -- nvmf/common.sh@120 -- # for i in {1..20} 00:23:09.565 04:25:00 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:23:09.565 rmmod nvme_tcp 00:23:09.823 rmmod nvme_fabrics 00:23:09.823 rmmod nvme_keyring 00:23:09.823 04:25:00 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:23:09.823 04:25:00 -- nvmf/common.sh@123 -- # set -e 00:23:09.823 04:25:00 -- nvmf/common.sh@124 -- # return 0 00:23:09.823 04:25:00 -- nvmf/common.sh@477 -- # '[' -n 2407503 ']' 00:23:09.823 04:25:00 -- nvmf/common.sh@478 -- # killprocess 2407503 00:23:09.823 04:25:00 -- common/autotest_common.sh@936 -- # '[' -z 2407503 ']' 00:23:09.823 04:25:00 -- common/autotest_common.sh@940 -- # kill -0 2407503 00:23:09.823 04:25:00 -- common/autotest_common.sh@941 -- # uname 00:23:09.823 04:25:00 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:23:09.824 04:25:00 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2407503 00:23:09.824 04:25:00 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:23:09.824 04:25:00 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:23:09.824 04:25:00 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2407503' 00:23:09.824 killing process with pid 2407503 00:23:09.824 04:25:00 -- common/autotest_common.sh@955 -- # kill 2407503 00:23:09.824 04:25:00 -- common/autotest_common.sh@960 -- # wait 2407503 00:23:10.389 04:25:00 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:23:10.389 04:25:00 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:23:10.389 04:25:00 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:23:10.389 04:25:00 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:23:10.389 04:25:00 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:23:10.389 04:25:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:10.389 04:25:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:10.389 04:25:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:12.294 04:25:02 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:23:12.294 00:23:12.294 real 1m1.569s 00:23:12.294 user 3m26.740s 00:23:12.294 sys 0m26.612s 00:23:12.294 04:25:02 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:23:12.294 04:25:02 -- common/autotest_common.sh@10 -- # set +x 00:23:12.294 ************************************ 00:23:12.294 END TEST nvmf_multiconnection 00:23:12.294 ************************************ 00:23:12.294 04:25:02 -- nvmf/nvmf.sh@66 -- # run_test nvmf_initiator_timeout /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:12.294 04:25:02 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:23:12.294 04:25:02 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:23:12.294 04:25:02 -- common/autotest_common.sh@10 -- # set +x 00:23:12.294 ************************************ 00:23:12.294 START TEST nvmf_initiator_timeout 00:23:12.294 ************************************ 00:23:12.294 04:25:02 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/initiator_timeout.sh --transport=tcp 00:23:12.294 * Looking for test storage... 00:23:12.294 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:23:12.294 04:25:02 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:23:12.294 04:25:02 -- common/autotest_common.sh@1690 -- # lcov --version 00:23:12.294 04:25:02 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:23:12.553 04:25:02 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:23:12.553 04:25:02 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:23:12.553 04:25:02 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:23:12.553 04:25:02 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:23:12.553 04:25:02 -- scripts/common.sh@335 -- # IFS=.-: 00:23:12.553 04:25:02 -- scripts/common.sh@335 -- # read -ra ver1 00:23:12.553 04:25:02 -- scripts/common.sh@336 -- # IFS=.-: 00:23:12.553 04:25:02 -- scripts/common.sh@336 -- # read -ra ver2 00:23:12.553 04:25:02 -- scripts/common.sh@337 -- # local 'op=<' 00:23:12.553 04:25:02 -- scripts/common.sh@339 -- # ver1_l=2 00:23:12.553 04:25:02 -- scripts/common.sh@340 -- # ver2_l=1 00:23:12.553 04:25:02 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:23:12.553 04:25:02 -- scripts/common.sh@343 -- # case "$op" in 00:23:12.553 04:25:02 -- scripts/common.sh@344 -- # : 1 00:23:12.553 04:25:02 -- scripts/common.sh@363 -- # (( v = 0 )) 00:23:12.553 04:25:02 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:23:12.553 04:25:02 -- scripts/common.sh@364 -- # decimal 1 00:23:12.553 04:25:02 -- scripts/common.sh@352 -- # local d=1 00:23:12.553 04:25:02 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:23:12.553 04:25:02 -- scripts/common.sh@354 -- # echo 1 00:23:12.553 04:25:02 -- scripts/common.sh@364 -- # ver1[v]=1 00:23:12.553 04:25:02 -- scripts/common.sh@365 -- # decimal 2 00:23:12.553 04:25:02 -- scripts/common.sh@352 -- # local d=2 00:23:12.553 04:25:02 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:23:12.553 04:25:02 -- scripts/common.sh@354 -- # echo 2 00:23:12.553 04:25:02 -- scripts/common.sh@365 -- # ver2[v]=2 00:23:12.553 04:25:02 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:23:12.553 04:25:02 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:23:12.553 04:25:02 -- scripts/common.sh@367 -- # return 0 00:23:12.553 04:25:02 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:23:12.553 04:25:02 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:23:12.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:12.553 --rc genhtml_branch_coverage=1 00:23:12.553 --rc genhtml_function_coverage=1 00:23:12.553 --rc genhtml_legend=1 00:23:12.553 --rc geninfo_all_blocks=1 00:23:12.553 --rc geninfo_unexecuted_blocks=1 00:23:12.553 00:23:12.553 ' 00:23:12.553 04:25:02 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:23:12.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:12.553 --rc genhtml_branch_coverage=1 00:23:12.553 --rc genhtml_function_coverage=1 00:23:12.553 --rc genhtml_legend=1 00:23:12.553 --rc geninfo_all_blocks=1 00:23:12.553 --rc geninfo_unexecuted_blocks=1 00:23:12.553 00:23:12.553 ' 00:23:12.553 04:25:02 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:23:12.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:12.553 --rc genhtml_branch_coverage=1 00:23:12.553 --rc genhtml_function_coverage=1 00:23:12.553 --rc genhtml_legend=1 00:23:12.553 --rc geninfo_all_blocks=1 00:23:12.553 --rc geninfo_unexecuted_blocks=1 00:23:12.553 00:23:12.553 ' 00:23:12.553 04:25:02 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:23:12.553 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:23:12.553 --rc genhtml_branch_coverage=1 00:23:12.553 --rc genhtml_function_coverage=1 00:23:12.553 --rc genhtml_legend=1 00:23:12.553 --rc geninfo_all_blocks=1 00:23:12.553 --rc geninfo_unexecuted_blocks=1 00:23:12.553 00:23:12.553 ' 00:23:12.553 04:25:02 -- target/initiator_timeout.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:23:12.553 04:25:02 -- nvmf/common.sh@7 -- # uname -s 00:23:12.553 04:25:02 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:23:12.553 04:25:02 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:23:12.553 04:25:02 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:23:12.553 04:25:02 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:23:12.553 04:25:02 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:23:12.553 04:25:02 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:23:12.553 04:25:02 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:23:12.553 04:25:02 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:23:12.553 04:25:02 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:23:12.553 04:25:02 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:23:12.553 04:25:03 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:23:12.553 04:25:03 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:23:12.553 04:25:03 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:23:12.553 04:25:03 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:23:12.553 04:25:03 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:23:12.553 04:25:03 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:23:12.553 04:25:03 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:23:12.553 04:25:03 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:23:12.553 04:25:03 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:23:12.553 04:25:03 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:12.553 04:25:03 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:12.553 04:25:03 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:12.554 04:25:03 -- paths/export.sh@5 -- # export PATH 00:23:12.554 04:25:03 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:23:12.554 04:25:03 -- nvmf/common.sh@46 -- # : 0 00:23:12.554 04:25:03 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:23:12.554 04:25:03 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:23:12.554 04:25:03 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:23:12.554 04:25:03 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:23:12.554 04:25:03 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:23:12.554 04:25:03 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:23:12.554 04:25:03 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:23:12.554 04:25:03 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:23:12.554 04:25:03 -- target/initiator_timeout.sh@11 -- # MALLOC_BDEV_SIZE=64 00:23:12.554 04:25:03 -- target/initiator_timeout.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:23:12.554 04:25:03 -- target/initiator_timeout.sh@14 -- # nvmftestinit 00:23:12.554 04:25:03 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:23:12.554 04:25:03 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:23:12.554 04:25:03 -- nvmf/common.sh@436 -- # prepare_net_devs 00:23:12.554 04:25:03 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:23:12.554 04:25:03 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:23:12.554 04:25:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:23:12.554 04:25:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:23:12.554 04:25:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:23:12.554 04:25:03 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:23:12.554 04:25:03 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:23:12.554 04:25:03 -- nvmf/common.sh@284 -- # xtrace_disable 00:23:12.554 04:25:03 -- common/autotest_common.sh@10 -- # set +x 00:23:14.455 04:25:04 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:23:14.455 04:25:04 -- nvmf/common.sh@290 -- # pci_devs=() 00:23:14.455 04:25:04 -- nvmf/common.sh@290 -- # local -a pci_devs 00:23:14.455 04:25:04 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:23:14.455 04:25:04 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:23:14.455 04:25:04 -- nvmf/common.sh@292 -- # pci_drivers=() 00:23:14.455 04:25:04 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:23:14.455 04:25:04 -- nvmf/common.sh@294 -- # net_devs=() 00:23:14.455 04:25:04 -- nvmf/common.sh@294 -- # local -ga net_devs 00:23:14.455 04:25:04 -- nvmf/common.sh@295 -- # e810=() 00:23:14.455 04:25:04 -- nvmf/common.sh@295 -- # local -ga e810 00:23:14.455 04:25:04 -- nvmf/common.sh@296 -- # x722=() 00:23:14.455 04:25:04 -- nvmf/common.sh@296 -- # local -ga x722 00:23:14.455 04:25:04 -- nvmf/common.sh@297 -- # mlx=() 00:23:14.455 04:25:04 -- nvmf/common.sh@297 -- # local -ga mlx 00:23:14.455 04:25:04 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:23:14.455 04:25:04 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:23:14.455 04:25:04 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:23:14.455 04:25:04 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:23:14.455 04:25:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:14.455 04:25:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:23:14.455 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:23:14.455 04:25:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:23:14.455 04:25:04 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:23:14.455 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:23:14.455 04:25:04 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:23:14.455 04:25:04 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:14.455 04:25:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:14.455 04:25:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:14.455 04:25:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:14.455 04:25:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:23:14.455 Found net devices under 0000:0a:00.0: cvl_0_0 00:23:14.455 04:25:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:14.455 04:25:04 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:23:14.455 04:25:04 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:23:14.455 04:25:04 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:23:14.455 04:25:04 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:23:14.455 04:25:04 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:23:14.455 Found net devices under 0000:0a:00.1: cvl_0_1 00:23:14.455 04:25:04 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:23:14.455 04:25:04 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:23:14.455 04:25:04 -- nvmf/common.sh@402 -- # is_hw=yes 00:23:14.455 04:25:04 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:23:14.455 04:25:04 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:23:14.455 04:25:04 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:23:14.455 04:25:04 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:23:14.455 04:25:04 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:23:14.455 04:25:04 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:23:14.455 04:25:04 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:23:14.455 04:25:04 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:23:14.455 04:25:04 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:23:14.455 04:25:04 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:23:14.455 04:25:04 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:23:14.455 04:25:04 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:23:14.455 04:25:04 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:23:14.455 04:25:04 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:23:14.455 04:25:04 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:23:14.455 04:25:05 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:23:14.455 04:25:05 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:23:14.455 04:25:05 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:23:14.455 04:25:05 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:23:14.456 04:25:05 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:23:14.456 04:25:05 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:23:14.456 04:25:05 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:23:14.456 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:23:14.456 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.268 ms 00:23:14.456 00:23:14.456 --- 10.0.0.2 ping statistics --- 00:23:14.456 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:14.456 rtt min/avg/max/mdev = 0.268/0.268/0.268/0.000 ms 00:23:14.456 04:25:05 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:23:14.713 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:23:14.713 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.108 ms 00:23:14.713 00:23:14.713 --- 10.0.0.1 ping statistics --- 00:23:14.713 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:23:14.713 rtt min/avg/max/mdev = 0.108/0.108/0.108/0.000 ms 00:23:14.713 04:25:05 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:23:14.713 04:25:05 -- nvmf/common.sh@410 -- # return 0 00:23:14.713 04:25:05 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:23:14.713 04:25:05 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:23:14.713 04:25:05 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:23:14.713 04:25:05 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:23:14.713 04:25:05 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:23:14.713 04:25:05 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:23:14.713 04:25:05 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:23:14.713 04:25:05 -- target/initiator_timeout.sh@15 -- # nvmfappstart -m 0xF 00:23:14.713 04:25:05 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:23:14.713 04:25:05 -- common/autotest_common.sh@722 -- # xtrace_disable 00:23:14.713 04:25:05 -- common/autotest_common.sh@10 -- # set +x 00:23:14.713 04:25:05 -- nvmf/common.sh@469 -- # nvmfpid=2417131 00:23:14.713 04:25:05 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:23:14.713 04:25:05 -- nvmf/common.sh@470 -- # waitforlisten 2417131 00:23:14.713 04:25:05 -- common/autotest_common.sh@829 -- # '[' -z 2417131 ']' 00:23:14.713 04:25:05 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:23:14.713 04:25:05 -- common/autotest_common.sh@834 -- # local max_retries=100 00:23:14.713 04:25:05 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:23:14.713 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:23:14.713 04:25:05 -- common/autotest_common.sh@838 -- # xtrace_disable 00:23:14.713 04:25:05 -- common/autotest_common.sh@10 -- # set +x 00:23:14.713 [2024-11-30 04:25:05.156848] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:23:14.713 [2024-11-30 04:25:05.156928] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:23:14.713 EAL: No free 2048 kB hugepages reported on node 1 00:23:14.713 [2024-11-30 04:25:05.230151] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:23:14.713 [2024-11-30 04:25:05.319249] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:23:14.713 [2024-11-30 04:25:05.319420] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:23:14.713 [2024-11-30 04:25:05.319441] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:23:14.713 [2024-11-30 04:25:05.319456] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:23:14.713 [2024-11-30 04:25:05.319549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:23:14.713 [2024-11-30 04:25:05.319604] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:23:14.713 [2024-11-30 04:25:05.319717] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:23:14.713 [2024-11-30 04:25:05.319720] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:23:15.645 04:25:06 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:23:15.645 04:25:06 -- common/autotest_common.sh@862 -- # return 0 00:23:15.645 04:25:06 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:23:15.645 04:25:06 -- common/autotest_common.sh@728 -- # xtrace_disable 00:23:15.645 04:25:06 -- common/autotest_common.sh@10 -- # set +x 00:23:15.645 04:25:06 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:23:15.646 04:25:06 -- target/initiator_timeout.sh@17 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $nvmfpid; nvmftestfini $1; exit 1' SIGINT SIGTERM EXIT 00:23:15.646 04:25:06 -- target/initiator_timeout.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:23:15.646 04:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:15.646 04:25:06 -- common/autotest_common.sh@10 -- # set +x 00:23:15.646 Malloc0 00:23:15.646 04:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:15.646 04:25:06 -- target/initiator_timeout.sh@22 -- # rpc_cmd bdev_delay_create -b Malloc0 -d Delay0 -r 30 -t 30 -w 30 -n 30 00:23:15.646 04:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:15.646 04:25:06 -- common/autotest_common.sh@10 -- # set +x 00:23:15.646 Delay0 00:23:15.646 04:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:15.646 04:25:06 -- target/initiator_timeout.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:23:15.646 04:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:15.646 04:25:06 -- common/autotest_common.sh@10 -- # set +x 00:23:15.646 [2024-11-30 04:25:06.175629] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:23:15.646 04:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:15.646 04:25:06 -- target/initiator_timeout.sh@25 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDKISFASTANDAWESOME 00:23:15.646 04:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:15.646 04:25:06 -- common/autotest_common.sh@10 -- # set +x 00:23:15.646 04:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:15.646 04:25:06 -- target/initiator_timeout.sh@26 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Delay0 00:23:15.646 04:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:15.646 04:25:06 -- common/autotest_common.sh@10 -- # set +x 00:23:15.646 04:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:15.646 04:25:06 -- target/initiator_timeout.sh@27 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:23:15.646 04:25:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:15.646 04:25:06 -- common/autotest_common.sh@10 -- # set +x 00:23:15.646 [2024-11-30 04:25:06.203970] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:23:15.646 04:25:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:15.646 04:25:06 -- target/initiator_timeout.sh@29 -- # nvme connect --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -t tcp -n nqn.2016-06.io.spdk:cnode1 -a 10.0.0.2 -s 4420 00:23:16.211 04:25:06 -- target/initiator_timeout.sh@31 -- # waitforserial SPDKISFASTANDAWESOME 00:23:16.211 04:25:06 -- common/autotest_common.sh@1187 -- # local i=0 00:23:16.211 04:25:06 -- common/autotest_common.sh@1188 -- # local nvme_device_counter=1 nvme_devices=0 00:23:16.211 04:25:06 -- common/autotest_common.sh@1189 -- # [[ -n '' ]] 00:23:16.211 04:25:06 -- common/autotest_common.sh@1194 -- # sleep 2 00:23:18.738 04:25:08 -- common/autotest_common.sh@1195 -- # (( i++ <= 15 )) 00:23:18.738 04:25:08 -- common/autotest_common.sh@1196 -- # lsblk -l -o NAME,SERIAL 00:23:18.738 04:25:08 -- common/autotest_common.sh@1196 -- # grep -c SPDKISFASTANDAWESOME 00:23:18.738 04:25:08 -- common/autotest_common.sh@1196 -- # nvme_devices=1 00:23:18.738 04:25:08 -- common/autotest_common.sh@1197 -- # (( nvme_devices == nvme_device_counter )) 00:23:18.738 04:25:08 -- common/autotest_common.sh@1197 -- # return 0 00:23:18.738 04:25:08 -- target/initiator_timeout.sh@35 -- # fio_pid=2417588 00:23:18.738 04:25:08 -- target/initiator_timeout.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/fio-wrapper -p nvmf -i 4096 -d 1 -t write -r 60 -v 00:23:18.738 04:25:08 -- target/initiator_timeout.sh@37 -- # sleep 3 00:23:18.738 [global] 00:23:18.738 thread=1 00:23:18.738 invalidate=1 00:23:18.738 rw=write 00:23:18.738 time_based=1 00:23:18.738 runtime=60 00:23:18.738 ioengine=libaio 00:23:18.738 direct=1 00:23:18.738 bs=4096 00:23:18.738 iodepth=1 00:23:18.738 norandommap=0 00:23:18.738 numjobs=1 00:23:18.738 00:23:18.738 verify_dump=1 00:23:18.738 verify_backlog=512 00:23:18.738 verify_state_save=0 00:23:18.738 do_verify=1 00:23:18.738 verify=crc32c-intel 00:23:18.738 [job0] 00:23:18.738 filename=/dev/nvme0n1 00:23:18.738 Could not set queue depth (nvme0n1) 00:23:18.738 job0: (g=0): rw=write, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=libaio, iodepth=1 00:23:18.738 fio-3.35 00:23:18.738 Starting 1 thread 00:23:21.266 04:25:11 -- target/initiator_timeout.sh@40 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 31000000 00:23:21.266 04:25:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.266 04:25:11 -- common/autotest_common.sh@10 -- # set +x 00:23:21.266 true 00:23:21.266 04:25:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.266 04:25:11 -- target/initiator_timeout.sh@41 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 31000000 00:23:21.266 04:25:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.266 04:25:11 -- common/autotest_common.sh@10 -- # set +x 00:23:21.266 true 00:23:21.266 04:25:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.266 04:25:11 -- target/initiator_timeout.sh@42 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 31000000 00:23:21.266 04:25:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.266 04:25:11 -- common/autotest_common.sh@10 -- # set +x 00:23:21.266 true 00:23:21.266 04:25:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.266 04:25:11 -- target/initiator_timeout.sh@43 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 310000000 00:23:21.266 04:25:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:21.266 04:25:11 -- common/autotest_common.sh@10 -- # set +x 00:23:21.266 true 00:23:21.266 04:25:11 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:21.266 04:25:11 -- target/initiator_timeout.sh@45 -- # sleep 3 00:23:24.544 04:25:14 -- target/initiator_timeout.sh@48 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_read 30 00:23:24.544 04:25:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.544 04:25:14 -- common/autotest_common.sh@10 -- # set +x 00:23:24.544 true 00:23:24.544 04:25:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.544 04:25:14 -- target/initiator_timeout.sh@49 -- # rpc_cmd bdev_delay_update_latency Delay0 avg_write 30 00:23:24.544 04:25:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.544 04:25:14 -- common/autotest_common.sh@10 -- # set +x 00:23:24.544 true 00:23:24.544 04:25:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.544 04:25:14 -- target/initiator_timeout.sh@50 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_read 30 00:23:24.544 04:25:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.544 04:25:14 -- common/autotest_common.sh@10 -- # set +x 00:23:24.544 true 00:23:24.544 04:25:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.544 04:25:14 -- target/initiator_timeout.sh@51 -- # rpc_cmd bdev_delay_update_latency Delay0 p99_write 30 00:23:24.544 04:25:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:23:24.544 04:25:14 -- common/autotest_common.sh@10 -- # set +x 00:23:24.544 true 00:23:24.544 04:25:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:23:24.544 04:25:14 -- target/initiator_timeout.sh@53 -- # fio_status=0 00:23:24.544 04:25:14 -- target/initiator_timeout.sh@54 -- # wait 2417588 00:24:20.828 00:24:20.828 job0: (groupid=0, jobs=1): err= 0: pid=2417666: Sat Nov 30 04:26:09 2024 00:24:20.828 read: IOPS=49, BW=198KiB/s (203kB/s)(11.6MiB/60028msec) 00:24:20.828 slat (nsec): min=5866, max=68167, avg=15772.97, stdev=9084.13 00:24:20.828 clat (usec): min=217, max=41095k, avg=19907.90, stdev=753335.43 00:24:20.828 lat (usec): min=224, max=41095k, avg=19923.67, stdev=753335.49 00:24:20.828 clat percentiles (usec): 00:24:20.828 | 1.00th=[ 229], 5.00th=[ 235], 10.00th=[ 241], 00:24:20.828 | 20.00th=[ 247], 30.00th=[ 253], 40.00th=[ 262], 00:24:20.828 | 50.00th=[ 277], 60.00th=[ 285], 70.00th=[ 293], 00:24:20.828 | 80.00th=[ 343], 90.00th=[ 41157], 95.00th=[ 41681], 00:24:20.828 | 99.00th=[ 42206], 99.50th=[ 42206], 99.90th=[ 42206], 00:24:20.828 | 99.95th=[ 42206], 99.99th=[17112761] 00:24:20.828 write: IOPS=51, BW=205KiB/s (210kB/s)(12.0MiB/60028msec); 0 zone resets 00:24:20.828 slat (usec): min=7, max=27950, avg=22.41, stdev=504.13 00:24:20.828 clat (usec): min=170, max=438, avg=208.85, stdev=44.40 00:24:20.828 lat (usec): min=178, max=28204, avg=231.26, stdev=507.36 00:24:20.828 clat percentiles (usec): 00:24:20.828 | 1.00th=[ 176], 5.00th=[ 180], 10.00th=[ 184], 20.00th=[ 186], 00:24:20.828 | 30.00th=[ 190], 40.00th=[ 192], 50.00th=[ 196], 60.00th=[ 200], 00:24:20.828 | 70.00th=[ 204], 80.00th=[ 215], 90.00th=[ 241], 95.00th=[ 351], 00:24:20.828 | 99.00th=[ 392], 99.50th=[ 400], 99.90th=[ 416], 99.95th=[ 424], 00:24:20.828 | 99.99th=[ 437] 00:24:20.828 bw ( KiB/s): min= 2136, max= 7840, per=100.00%, avg=4096.00, stdev=2363.53, samples=6 00:24:20.828 iops : min= 534, max= 1960, avg=1024.00, stdev=590.88, samples=6 00:24:20.828 lat (usec) : 250=59.26%, 500=33.73% 00:24:20.828 lat (msec) : 4=0.02%, 50=6.98%, >=2000=0.02% 00:24:20.828 cpu : usr=0.08%, sys=0.15%, ctx=6050, majf=0, minf=1 00:24:20.828 IO depths : 1=100.0%, 2=0.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:24:20.828 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:20.828 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:24:20.828 issued rwts: total=2976,3072,0,0 short=0,0,0,0 dropped=0,0,0,0 00:24:20.828 latency : target=0, window=0, percentile=100.00%, depth=1 00:24:20.828 00:24:20.828 Run status group 0 (all jobs): 00:24:20.828 READ: bw=198KiB/s (203kB/s), 198KiB/s-198KiB/s (203kB/s-203kB/s), io=11.6MiB (12.2MB), run=60028-60028msec 00:24:20.828 WRITE: bw=205KiB/s (210kB/s), 205KiB/s-205KiB/s (210kB/s-210kB/s), io=12.0MiB (12.6MB), run=60028-60028msec 00:24:20.828 00:24:20.828 Disk stats (read/write): 00:24:20.828 nvme0n1: ios=3024/3072, merge=0/0, ticks=19250/628, in_queue=19878, util=99.75% 00:24:20.828 04:26:09 -- target/initiator_timeout.sh@56 -- # nvme disconnect -n nqn.2016-06.io.spdk:cnode1 00:24:20.828 NQN:nqn.2016-06.io.spdk:cnode1 disconnected 1 controller(s) 00:24:20.828 04:26:09 -- target/initiator_timeout.sh@57 -- # waitforserial_disconnect SPDKISFASTANDAWESOME 00:24:20.828 04:26:09 -- common/autotest_common.sh@1208 -- # local i=0 00:24:20.828 04:26:09 -- common/autotest_common.sh@1209 -- # lsblk -o NAME,SERIAL 00:24:20.828 04:26:09 -- common/autotest_common.sh@1209 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:20.828 04:26:09 -- common/autotest_common.sh@1216 -- # lsblk -l -o NAME,SERIAL 00:24:20.828 04:26:09 -- common/autotest_common.sh@1216 -- # grep -q -w SPDKISFASTANDAWESOME 00:24:20.828 04:26:09 -- common/autotest_common.sh@1220 -- # return 0 00:24:20.828 04:26:09 -- target/initiator_timeout.sh@59 -- # '[' 0 -eq 0 ']' 00:24:20.828 04:26:09 -- target/initiator_timeout.sh@60 -- # echo 'nvmf hotplug test: fio successful as expected' 00:24:20.828 nvmf hotplug test: fio successful as expected 00:24:20.828 04:26:09 -- target/initiator_timeout.sh@67 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:24:20.828 04:26:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:20.828 04:26:09 -- common/autotest_common.sh@10 -- # set +x 00:24:20.828 04:26:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:20.828 04:26:09 -- target/initiator_timeout.sh@69 -- # rm -f ./local-job0-0-verify.state 00:24:20.828 04:26:09 -- target/initiator_timeout.sh@71 -- # trap - SIGINT SIGTERM EXIT 00:24:20.828 04:26:09 -- target/initiator_timeout.sh@73 -- # nvmftestfini 00:24:20.828 04:26:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:20.828 04:26:09 -- nvmf/common.sh@116 -- # sync 00:24:20.828 04:26:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:20.828 04:26:09 -- nvmf/common.sh@119 -- # set +e 00:24:20.828 04:26:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:20.828 04:26:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:20.828 rmmod nvme_tcp 00:24:20.828 rmmod nvme_fabrics 00:24:20.828 rmmod nvme_keyring 00:24:20.828 04:26:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:20.828 04:26:09 -- nvmf/common.sh@123 -- # set -e 00:24:20.828 04:26:09 -- nvmf/common.sh@124 -- # return 0 00:24:20.828 04:26:09 -- nvmf/common.sh@477 -- # '[' -n 2417131 ']' 00:24:20.828 04:26:09 -- nvmf/common.sh@478 -- # killprocess 2417131 00:24:20.828 04:26:09 -- common/autotest_common.sh@936 -- # '[' -z 2417131 ']' 00:24:20.828 04:26:09 -- common/autotest_common.sh@940 -- # kill -0 2417131 00:24:20.828 04:26:09 -- common/autotest_common.sh@941 -- # uname 00:24:20.828 04:26:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:20.828 04:26:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2417131 00:24:20.828 04:26:09 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:20.828 04:26:09 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:20.828 04:26:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2417131' 00:24:20.828 killing process with pid 2417131 00:24:20.828 04:26:09 -- common/autotest_common.sh@955 -- # kill 2417131 00:24:20.828 04:26:09 -- common/autotest_common.sh@960 -- # wait 2417131 00:24:20.828 04:26:09 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:20.828 04:26:09 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:20.828 04:26:09 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:20.828 04:26:09 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:20.828 04:26:09 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:20.828 04:26:09 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:20.828 04:26:09 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:20.828 04:26:09 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:21.398 04:26:11 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:21.398 00:24:21.398 real 1m8.918s 00:24:21.398 user 4m13.515s 00:24:21.398 sys 0m6.846s 00:24:21.398 04:26:11 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:24:21.398 04:26:11 -- common/autotest_common.sh@10 -- # set +x 00:24:21.398 ************************************ 00:24:21.398 END TEST nvmf_initiator_timeout 00:24:21.398 ************************************ 00:24:21.398 04:26:11 -- nvmf/nvmf.sh@69 -- # [[ phy == phy ]] 00:24:21.398 04:26:11 -- nvmf/nvmf.sh@70 -- # '[' tcp = tcp ']' 00:24:21.398 04:26:11 -- nvmf/nvmf.sh@71 -- # gather_supported_nvmf_pci_devs 00:24:21.398 04:26:11 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:21.398 04:26:11 -- common/autotest_common.sh@10 -- # set +x 00:24:23.304 04:26:13 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:23.304 04:26:13 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:23.304 04:26:13 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:23.304 04:26:13 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:23.304 04:26:13 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:23.304 04:26:13 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:23.304 04:26:13 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:23.304 04:26:13 -- nvmf/common.sh@294 -- # net_devs=() 00:24:23.304 04:26:13 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:23.304 04:26:13 -- nvmf/common.sh@295 -- # e810=() 00:24:23.304 04:26:13 -- nvmf/common.sh@295 -- # local -ga e810 00:24:23.304 04:26:13 -- nvmf/common.sh@296 -- # x722=() 00:24:23.304 04:26:13 -- nvmf/common.sh@296 -- # local -ga x722 00:24:23.304 04:26:13 -- nvmf/common.sh@297 -- # mlx=() 00:24:23.304 04:26:13 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:23.304 04:26:13 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:23.304 04:26:13 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:23.304 04:26:13 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:23.304 04:26:13 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:23.304 04:26:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:23.304 04:26:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:23.304 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:23.304 04:26:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:23.304 04:26:13 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:23.304 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:23.304 04:26:13 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:23.304 04:26:13 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:23.304 04:26:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:23.304 04:26:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:23.304 04:26:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:23.304 04:26:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:23.304 04:26:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:23.304 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:23.304 04:26:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:23.304 04:26:13 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:23.304 04:26:13 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:23.304 04:26:13 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:23.304 04:26:13 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:23.304 04:26:13 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:23.304 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:23.304 04:26:13 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:23.304 04:26:13 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:23.304 04:26:13 -- nvmf/nvmf.sh@72 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:23.304 04:26:13 -- nvmf/nvmf.sh@73 -- # (( 2 > 0 )) 00:24:23.304 04:26:13 -- nvmf/nvmf.sh@74 -- # run_test nvmf_perf_adq /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:23.304 04:26:13 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:24:23.304 04:26:13 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:24:23.304 04:26:13 -- common/autotest_common.sh@10 -- # set +x 00:24:23.304 ************************************ 00:24:23.304 START TEST nvmf_perf_adq 00:24:23.304 ************************************ 00:24:23.304 04:26:13 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/perf_adq.sh --transport=tcp 00:24:23.562 * Looking for test storage... 00:24:23.562 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:24:23.562 04:26:13 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:24:23.562 04:26:13 -- common/autotest_common.sh@1690 -- # lcov --version 00:24:23.562 04:26:13 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:24:23.562 04:26:14 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:24:23.562 04:26:14 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:24:23.562 04:26:14 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:24:23.562 04:26:14 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:24:23.562 04:26:14 -- scripts/common.sh@335 -- # IFS=.-: 00:24:23.562 04:26:14 -- scripts/common.sh@335 -- # read -ra ver1 00:24:23.562 04:26:14 -- scripts/common.sh@336 -- # IFS=.-: 00:24:23.562 04:26:14 -- scripts/common.sh@336 -- # read -ra ver2 00:24:23.562 04:26:14 -- scripts/common.sh@337 -- # local 'op=<' 00:24:23.562 04:26:14 -- scripts/common.sh@339 -- # ver1_l=2 00:24:23.562 04:26:14 -- scripts/common.sh@340 -- # ver2_l=1 00:24:23.562 04:26:14 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:24:23.562 04:26:14 -- scripts/common.sh@343 -- # case "$op" in 00:24:23.562 04:26:14 -- scripts/common.sh@344 -- # : 1 00:24:23.562 04:26:14 -- scripts/common.sh@363 -- # (( v = 0 )) 00:24:23.562 04:26:14 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:24:23.562 04:26:14 -- scripts/common.sh@364 -- # decimal 1 00:24:23.562 04:26:14 -- scripts/common.sh@352 -- # local d=1 00:24:23.562 04:26:14 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:24:23.562 04:26:14 -- scripts/common.sh@354 -- # echo 1 00:24:23.562 04:26:14 -- scripts/common.sh@364 -- # ver1[v]=1 00:24:23.562 04:26:14 -- scripts/common.sh@365 -- # decimal 2 00:24:23.563 04:26:14 -- scripts/common.sh@352 -- # local d=2 00:24:23.563 04:26:14 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:24:23.563 04:26:14 -- scripts/common.sh@354 -- # echo 2 00:24:23.563 04:26:14 -- scripts/common.sh@365 -- # ver2[v]=2 00:24:23.563 04:26:14 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:24:23.563 04:26:14 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:24:23.563 04:26:14 -- scripts/common.sh@367 -- # return 0 00:24:23.563 04:26:14 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:24:23.563 04:26:14 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:24:23.563 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:23.563 --rc genhtml_branch_coverage=1 00:24:23.563 --rc genhtml_function_coverage=1 00:24:23.563 --rc genhtml_legend=1 00:24:23.563 --rc geninfo_all_blocks=1 00:24:23.563 --rc geninfo_unexecuted_blocks=1 00:24:23.563 00:24:23.563 ' 00:24:23.563 04:26:14 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:24:23.563 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:23.563 --rc genhtml_branch_coverage=1 00:24:23.563 --rc genhtml_function_coverage=1 00:24:23.563 --rc genhtml_legend=1 00:24:23.563 --rc geninfo_all_blocks=1 00:24:23.563 --rc geninfo_unexecuted_blocks=1 00:24:23.563 00:24:23.563 ' 00:24:23.563 04:26:14 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:24:23.563 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:23.563 --rc genhtml_branch_coverage=1 00:24:23.563 --rc genhtml_function_coverage=1 00:24:23.563 --rc genhtml_legend=1 00:24:23.563 --rc geninfo_all_blocks=1 00:24:23.563 --rc geninfo_unexecuted_blocks=1 00:24:23.563 00:24:23.563 ' 00:24:23.563 04:26:14 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:24:23.563 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:24:23.563 --rc genhtml_branch_coverage=1 00:24:23.563 --rc genhtml_function_coverage=1 00:24:23.563 --rc genhtml_legend=1 00:24:23.563 --rc geninfo_all_blocks=1 00:24:23.563 --rc geninfo_unexecuted_blocks=1 00:24:23.563 00:24:23.563 ' 00:24:23.563 04:26:14 -- target/perf_adq.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:24:23.563 04:26:14 -- nvmf/common.sh@7 -- # uname -s 00:24:23.563 04:26:14 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:24:23.563 04:26:14 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:24:23.563 04:26:14 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:24:23.563 04:26:14 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:24:23.563 04:26:14 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:24:23.563 04:26:14 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:24:23.563 04:26:14 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:24:23.563 04:26:14 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:24:23.563 04:26:14 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:24:23.563 04:26:14 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:24:23.563 04:26:14 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:24:23.563 04:26:14 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:24:23.563 04:26:14 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:24:23.563 04:26:14 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:24:23.563 04:26:14 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:24:23.563 04:26:14 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:24:23.563 04:26:14 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:24:23.563 04:26:14 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:24:23.563 04:26:14 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:24:23.563 04:26:14 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.563 04:26:14 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.563 04:26:14 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.563 04:26:14 -- paths/export.sh@5 -- # export PATH 00:24:23.563 04:26:14 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:24:23.563 04:26:14 -- nvmf/common.sh@46 -- # : 0 00:24:23.563 04:26:14 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:24:23.563 04:26:14 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:24:23.563 04:26:14 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:24:23.563 04:26:14 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:24:23.563 04:26:14 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:24:23.563 04:26:14 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:24:23.563 04:26:14 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:24:23.563 04:26:14 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:24:23.563 04:26:14 -- target/perf_adq.sh@11 -- # gather_supported_nvmf_pci_devs 00:24:23.563 04:26:14 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:23.563 04:26:14 -- common/autotest_common.sh@10 -- # set +x 00:24:25.467 04:26:16 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:25.467 04:26:16 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:25.467 04:26:16 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:25.467 04:26:16 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:25.467 04:26:16 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:25.467 04:26:16 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:25.467 04:26:16 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:25.467 04:26:16 -- nvmf/common.sh@294 -- # net_devs=() 00:24:25.467 04:26:16 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:25.467 04:26:16 -- nvmf/common.sh@295 -- # e810=() 00:24:25.467 04:26:16 -- nvmf/common.sh@295 -- # local -ga e810 00:24:25.467 04:26:16 -- nvmf/common.sh@296 -- # x722=() 00:24:25.467 04:26:16 -- nvmf/common.sh@296 -- # local -ga x722 00:24:25.467 04:26:16 -- nvmf/common.sh@297 -- # mlx=() 00:24:25.467 04:26:16 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:25.467 04:26:16 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:25.467 04:26:16 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:25.467 04:26:16 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:25.468 04:26:16 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:25.468 04:26:16 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:25.468 04:26:16 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:25.468 04:26:16 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:25.468 04:26:16 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:25.468 04:26:16 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:25.468 04:26:16 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:25.468 04:26:16 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:25.468 04:26:16 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:25.468 04:26:16 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:25.468 04:26:16 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:25.468 04:26:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:25.468 04:26:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:25.468 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:25.468 04:26:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:25.468 04:26:16 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:25.468 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:25.468 04:26:16 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:25.468 04:26:16 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:25.468 04:26:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:25.468 04:26:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:25.468 04:26:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:25.468 04:26:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:25.468 04:26:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:25.468 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:25.468 04:26:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:25.468 04:26:16 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:25.468 04:26:16 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:25.468 04:26:16 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:25.468 04:26:16 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:25.468 04:26:16 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:25.468 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:25.468 04:26:16 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:25.468 04:26:16 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:25.468 04:26:16 -- target/perf_adq.sh@12 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:25.468 04:26:16 -- target/perf_adq.sh@13 -- # (( 2 == 0 )) 00:24:25.468 04:26:16 -- target/perf_adq.sh@18 -- # perf=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf 00:24:25.468 04:26:16 -- target/perf_adq.sh@59 -- # adq_reload_driver 00:24:25.468 04:26:16 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:26.407 04:26:16 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:28.942 04:26:19 -- target/perf_adq.sh@54 -- # sleep 5 00:24:34.226 04:26:24 -- target/perf_adq.sh@67 -- # nvmftestinit 00:24:34.226 04:26:24 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:34.226 04:26:24 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:34.226 04:26:24 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:34.226 04:26:24 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:34.226 04:26:24 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:34.226 04:26:24 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:34.226 04:26:24 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:34.226 04:26:24 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:34.226 04:26:24 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:34.226 04:26:24 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:34.226 04:26:24 -- common/autotest_common.sh@10 -- # set +x 00:24:34.226 04:26:24 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:34.226 04:26:24 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:34.226 04:26:24 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:34.226 04:26:24 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:34.226 04:26:24 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:34.226 04:26:24 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:34.226 04:26:24 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:34.226 04:26:24 -- nvmf/common.sh@294 -- # net_devs=() 00:24:34.226 04:26:24 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:34.226 04:26:24 -- nvmf/common.sh@295 -- # e810=() 00:24:34.226 04:26:24 -- nvmf/common.sh@295 -- # local -ga e810 00:24:34.226 04:26:24 -- nvmf/common.sh@296 -- # x722=() 00:24:34.226 04:26:24 -- nvmf/common.sh@296 -- # local -ga x722 00:24:34.226 04:26:24 -- nvmf/common.sh@297 -- # mlx=() 00:24:34.226 04:26:24 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:34.226 04:26:24 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:34.226 04:26:24 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:34.226 04:26:24 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:34.226 04:26:24 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:34.226 04:26:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:34.226 04:26:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:34.226 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:34.226 04:26:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:34.226 04:26:24 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:34.226 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:34.226 04:26:24 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:34.226 04:26:24 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:34.226 04:26:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:34.226 04:26:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:34.226 04:26:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:34.226 04:26:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:34.226 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:34.226 04:26:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:34.226 04:26:24 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:34.226 04:26:24 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:34.226 04:26:24 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:34.226 04:26:24 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:34.226 04:26:24 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:34.226 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:34.226 04:26:24 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:34.226 04:26:24 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:34.226 04:26:24 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:34.226 04:26:24 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:34.226 04:26:24 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:34.226 04:26:24 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:34.226 04:26:24 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:34.226 04:26:24 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:34.226 04:26:24 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:34.226 04:26:24 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:34.226 04:26:24 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:34.226 04:26:24 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:34.226 04:26:24 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:34.226 04:26:24 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:34.226 04:26:24 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:34.226 04:26:24 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:34.226 04:26:24 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:34.226 04:26:24 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:34.226 04:26:24 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:34.226 04:26:24 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:34.226 04:26:24 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:34.226 04:26:24 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:34.226 04:26:24 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:34.226 04:26:24 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:34.226 04:26:24 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:34.226 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:34.226 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.314 ms 00:24:34.226 00:24:34.226 --- 10.0.0.2 ping statistics --- 00:24:34.226 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:34.226 rtt min/avg/max/mdev = 0.314/0.314/0.314/0.000 ms 00:24:34.226 04:26:24 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:34.226 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:34.226 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.156 ms 00:24:34.226 00:24:34.226 --- 10.0.0.1 ping statistics --- 00:24:34.226 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:34.226 rtt min/avg/max/mdev = 0.156/0.156/0.156/0.000 ms 00:24:34.226 04:26:24 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:34.226 04:26:24 -- nvmf/common.sh@410 -- # return 0 00:24:34.226 04:26:24 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:34.226 04:26:24 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:34.227 04:26:24 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:34.227 04:26:24 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:34.227 04:26:24 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:34.227 04:26:24 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:34.227 04:26:24 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:34.227 04:26:24 -- target/perf_adq.sh@68 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:34.227 04:26:24 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:34.227 04:26:24 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:34.227 04:26:24 -- common/autotest_common.sh@10 -- # set +x 00:24:34.227 04:26:24 -- nvmf/common.sh@469 -- # nvmfpid=2429711 00:24:34.227 04:26:24 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:34.227 04:26:24 -- nvmf/common.sh@470 -- # waitforlisten 2429711 00:24:34.227 04:26:24 -- common/autotest_common.sh@829 -- # '[' -z 2429711 ']' 00:24:34.227 04:26:24 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:34.227 04:26:24 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:34.227 04:26:24 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:34.227 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:34.227 04:26:24 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:34.227 04:26:24 -- common/autotest_common.sh@10 -- # set +x 00:24:34.227 [2024-11-30 04:26:24.636093] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:34.227 [2024-11-30 04:26:24.636180] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:34.227 EAL: No free 2048 kB hugepages reported on node 1 00:24:34.227 [2024-11-30 04:26:24.701020] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:34.227 [2024-11-30 04:26:24.785851] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:34.227 [2024-11-30 04:26:24.786019] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:34.227 [2024-11-30 04:26:24.786039] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:34.227 [2024-11-30 04:26:24.786053] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:34.227 [2024-11-30 04:26:24.786122] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:34.227 [2024-11-30 04:26:24.786165] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:34.227 [2024-11-30 04:26:24.786214] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:34.227 [2024-11-30 04:26:24.786216] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:34.227 04:26:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:34.227 04:26:24 -- common/autotest_common.sh@862 -- # return 0 00:24:34.485 04:26:24 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:34.485 04:26:24 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:34.485 04:26:24 -- common/autotest_common.sh@10 -- # set +x 00:24:34.485 04:26:24 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:34.485 04:26:24 -- target/perf_adq.sh@69 -- # adq_configure_nvmf_target 0 00:24:34.485 04:26:24 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 0 --enable-zerocopy-send-server -i posix 00:24:34.485 04:26:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:34.485 04:26:24 -- common/autotest_common.sh@10 -- # set +x 00:24:34.485 04:26:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:34.485 04:26:24 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:34.485 04:26:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:34.485 04:26:24 -- common/autotest_common.sh@10 -- # set +x 00:24:34.485 04:26:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:34.485 04:26:25 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 0 00:24:34.485 04:26:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:34.485 04:26:25 -- common/autotest_common.sh@10 -- # set +x 00:24:34.485 [2024-11-30 04:26:25.008908] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:34.485 04:26:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:34.485 04:26:25 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:34.485 04:26:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:34.485 04:26:25 -- common/autotest_common.sh@10 -- # set +x 00:24:34.485 Malloc1 00:24:34.485 04:26:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:34.485 04:26:25 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:34.485 04:26:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:34.485 04:26:25 -- common/autotest_common.sh@10 -- # set +x 00:24:34.485 04:26:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:34.485 04:26:25 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:34.485 04:26:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:34.485 04:26:25 -- common/autotest_common.sh@10 -- # set +x 00:24:34.485 04:26:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:34.485 04:26:25 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:34.485 04:26:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:34.485 04:26:25 -- common/autotest_common.sh@10 -- # set +x 00:24:34.486 [2024-11-30 04:26:25.062410] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:34.486 04:26:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:34.486 04:26:25 -- target/perf_adq.sh@73 -- # perfpid=2429745 00:24:34.486 04:26:25 -- target/perf_adq.sh@74 -- # sleep 2 00:24:34.486 04:26:25 -- target/perf_adq.sh@70 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:34.486 EAL: No free 2048 kB hugepages reported on node 1 00:24:37.014 04:26:27 -- target/perf_adq.sh@76 -- # rpc_cmd nvmf_get_stats 00:24:37.015 04:26:27 -- target/perf_adq.sh@76 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 1) | length' 00:24:37.015 04:26:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:37.015 04:26:27 -- target/perf_adq.sh@76 -- # wc -l 00:24:37.015 04:26:27 -- common/autotest_common.sh@10 -- # set +x 00:24:37.015 04:26:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:37.015 04:26:27 -- target/perf_adq.sh@76 -- # count=4 00:24:37.015 04:26:27 -- target/perf_adq.sh@77 -- # [[ 4 -ne 4 ]] 00:24:37.015 04:26:27 -- target/perf_adq.sh@81 -- # wait 2429745 00:24:45.125 Initializing NVMe Controllers 00:24:45.125 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:24:45.125 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:24:45.125 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:24:45.125 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:24:45.125 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:24:45.125 Initialization complete. Launching workers. 00:24:45.125 ======================================================== 00:24:45.125 Latency(us) 00:24:45.125 Device Information : IOPS MiB/s Average min max 00:24:45.125 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 11206.19 43.77 5711.34 1275.09 10048.52 00:24:45.125 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 11494.49 44.90 5568.59 1230.57 9462.23 00:24:45.125 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 11580.69 45.24 5526.45 1583.71 9210.31 00:24:45.125 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 10928.19 42.69 5856.20 1780.24 10000.97 00:24:45.125 ======================================================== 00:24:45.125 Total : 45209.56 176.60 5662.70 1230.57 10048.52 00:24:45.125 00:24:45.125 04:26:35 -- target/perf_adq.sh@82 -- # nvmftestfini 00:24:45.125 04:26:35 -- nvmf/common.sh@476 -- # nvmfcleanup 00:24:45.125 04:26:35 -- nvmf/common.sh@116 -- # sync 00:24:45.125 04:26:35 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:24:45.125 04:26:35 -- nvmf/common.sh@119 -- # set +e 00:24:45.125 04:26:35 -- nvmf/common.sh@120 -- # for i in {1..20} 00:24:45.125 04:26:35 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:24:45.125 rmmod nvme_tcp 00:24:45.125 rmmod nvme_fabrics 00:24:45.125 rmmod nvme_keyring 00:24:45.125 04:26:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:24:45.125 04:26:35 -- nvmf/common.sh@123 -- # set -e 00:24:45.125 04:26:35 -- nvmf/common.sh@124 -- # return 0 00:24:45.125 04:26:35 -- nvmf/common.sh@477 -- # '[' -n 2429711 ']' 00:24:45.125 04:26:35 -- nvmf/common.sh@478 -- # killprocess 2429711 00:24:45.125 04:26:35 -- common/autotest_common.sh@936 -- # '[' -z 2429711 ']' 00:24:45.125 04:26:35 -- common/autotest_common.sh@940 -- # kill -0 2429711 00:24:45.125 04:26:35 -- common/autotest_common.sh@941 -- # uname 00:24:45.125 04:26:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:24:45.125 04:26:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2429711 00:24:45.125 04:26:35 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:24:45.125 04:26:35 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:24:45.125 04:26:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2429711' 00:24:45.125 killing process with pid 2429711 00:24:45.125 04:26:35 -- common/autotest_common.sh@955 -- # kill 2429711 00:24:45.125 04:26:35 -- common/autotest_common.sh@960 -- # wait 2429711 00:24:45.125 04:26:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:24:45.125 04:26:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:24:45.125 04:26:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:24:45.125 04:26:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:24:45.125 04:26:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:24:45.125 04:26:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:45.125 04:26:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:45.125 04:26:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:47.032 04:26:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:24:47.032 04:26:37 -- target/perf_adq.sh@84 -- # adq_reload_driver 00:24:47.032 04:26:37 -- target/perf_adq.sh@52 -- # rmmod ice 00:24:47.970 04:26:38 -- target/perf_adq.sh@53 -- # modprobe ice 00:24:50.504 04:26:40 -- target/perf_adq.sh@54 -- # sleep 5 00:24:55.868 04:26:45 -- target/perf_adq.sh@87 -- # nvmftestinit 00:24:55.868 04:26:45 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:24:55.868 04:26:45 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:24:55.868 04:26:45 -- nvmf/common.sh@436 -- # prepare_net_devs 00:24:55.868 04:26:45 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:24:55.868 04:26:45 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:24:55.868 04:26:45 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:24:55.868 04:26:45 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:24:55.868 04:26:45 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:24:55.868 04:26:45 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:24:55.868 04:26:45 -- nvmf/common.sh@284 -- # xtrace_disable 00:24:55.868 04:26:45 -- common/autotest_common.sh@10 -- # set +x 00:24:55.868 04:26:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:24:55.868 04:26:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:24:55.868 04:26:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:24:55.868 04:26:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:24:55.868 04:26:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:24:55.868 04:26:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:24:55.868 04:26:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:24:55.868 04:26:45 -- nvmf/common.sh@294 -- # net_devs=() 00:24:55.868 04:26:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:24:55.868 04:26:45 -- nvmf/common.sh@295 -- # e810=() 00:24:55.868 04:26:45 -- nvmf/common.sh@295 -- # local -ga e810 00:24:55.868 04:26:45 -- nvmf/common.sh@296 -- # x722=() 00:24:55.868 04:26:45 -- nvmf/common.sh@296 -- # local -ga x722 00:24:55.868 04:26:45 -- nvmf/common.sh@297 -- # mlx=() 00:24:55.868 04:26:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:24:55.868 04:26:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:24:55.868 04:26:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:24:55.868 04:26:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:24:55.868 04:26:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:24:55.868 04:26:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:55.868 04:26:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:24:55.868 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:24:55.868 04:26:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:24:55.868 04:26:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:24:55.868 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:24:55.868 04:26:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:24:55.868 04:26:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:55.868 04:26:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:55.868 04:26:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:55.868 04:26:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:55.868 04:26:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:24:55.868 Found net devices under 0000:0a:00.0: cvl_0_0 00:24:55.868 04:26:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:55.868 04:26:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:24:55.868 04:26:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:24:55.868 04:26:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:24:55.868 04:26:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:24:55.868 04:26:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:24:55.868 Found net devices under 0000:0a:00.1: cvl_0_1 00:24:55.868 04:26:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:24:55.868 04:26:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:24:55.868 04:26:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:24:55.868 04:26:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:24:55.868 04:26:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:24:55.868 04:26:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:24:55.868 04:26:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:24:55.868 04:26:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:24:55.868 04:26:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:24:55.868 04:26:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:24:55.868 04:26:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:24:55.868 04:26:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:24:55.868 04:26:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:24:55.868 04:26:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:24:55.868 04:26:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:24:55.868 04:26:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:24:55.868 04:26:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:24:55.868 04:26:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:24:55.868 04:26:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:24:55.868 04:26:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:24:55.868 04:26:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:24:55.868 04:26:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:24:55.868 04:26:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:24:55.868 04:26:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:24:55.868 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:24:55.868 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.218 ms 00:24:55.868 00:24:55.868 --- 10.0.0.2 ping statistics --- 00:24:55.868 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:55.868 rtt min/avg/max/mdev = 0.218/0.218/0.218/0.000 ms 00:24:55.868 04:26:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:24:55.868 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:24:55.868 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:24:55.868 00:24:55.868 --- 10.0.0.1 ping statistics --- 00:24:55.868 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:24:55.868 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:24:55.868 04:26:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:24:55.868 04:26:45 -- nvmf/common.sh@410 -- # return 0 00:24:55.868 04:26:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:24:55.868 04:26:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:24:55.868 04:26:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:24:55.868 04:26:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:24:55.868 04:26:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:24:55.868 04:26:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:24:55.868 04:26:45 -- target/perf_adq.sh@88 -- # adq_configure_driver 00:24:55.868 04:26:45 -- target/perf_adq.sh@22 -- # ip netns exec cvl_0_0_ns_spdk ethtool --offload cvl_0_0 hw-tc-offload on 00:24:55.868 04:26:45 -- target/perf_adq.sh@24 -- # ip netns exec cvl_0_0_ns_spdk ethtool --set-priv-flags cvl_0_0 channel-pkt-inspect-optimize off 00:24:55.868 04:26:45 -- target/perf_adq.sh@26 -- # sysctl -w net.core.busy_poll=1 00:24:55.868 net.core.busy_poll = 1 00:24:55.868 04:26:45 -- target/perf_adq.sh@27 -- # sysctl -w net.core.busy_read=1 00:24:55.868 net.core.busy_read = 1 00:24:55.868 04:26:45 -- target/perf_adq.sh@29 -- # tc=/usr/sbin/tc 00:24:55.868 04:26:45 -- target/perf_adq.sh@31 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 root mqprio num_tc 2 map 0 1 queues 2@0 2@2 hw 1 mode channel 00:24:55.868 04:26:45 -- target/perf_adq.sh@33 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc qdisc add dev cvl_0_0 ingress 00:24:55.868 04:26:45 -- target/perf_adq.sh@35 -- # ip netns exec cvl_0_0_ns_spdk /usr/sbin/tc filter add dev cvl_0_0 protocol ip parent ffff: prio 1 flower dst_ip 10.0.0.2/32 ip_proto tcp dst_port 4420 skip_sw hw_tc 1 00:24:55.868 04:26:45 -- target/perf_adq.sh@38 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/perf/nvmf/set_xps_rxqs cvl_0_0 00:24:55.868 04:26:45 -- target/perf_adq.sh@89 -- # nvmfappstart -m 0xF --wait-for-rpc 00:24:55.868 04:26:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:24:55.868 04:26:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:24:55.868 04:26:45 -- common/autotest_common.sh@10 -- # set +x 00:24:55.868 04:26:45 -- nvmf/common.sh@469 -- # nvmfpid=2432432 00:24:55.868 04:26:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:24:55.868 04:26:45 -- nvmf/common.sh@470 -- # waitforlisten 2432432 00:24:55.868 04:26:45 -- common/autotest_common.sh@829 -- # '[' -z 2432432 ']' 00:24:55.868 04:26:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:24:55.868 04:26:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:24:55.868 04:26:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:24:55.868 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:24:55.868 04:26:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:24:55.868 04:26:45 -- common/autotest_common.sh@10 -- # set +x 00:24:55.868 [2024-11-30 04:26:45.961403] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:24:55.868 [2024-11-30 04:26:45.961486] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:24:55.868 EAL: No free 2048 kB hugepages reported on node 1 00:24:55.868 [2024-11-30 04:26:46.027365] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:24:55.868 [2024-11-30 04:26:46.116227] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:24:55.868 [2024-11-30 04:26:46.116375] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:24:55.868 [2024-11-30 04:26:46.116391] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:24:55.868 [2024-11-30 04:26:46.116405] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:24:55.868 [2024-11-30 04:26:46.116458] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:24:55.868 [2024-11-30 04:26:46.116490] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:24:55.869 [2024-11-30 04:26:46.116565] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:24:55.869 [2024-11-30 04:26:46.116569] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:24:55.869 04:26:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:24:55.869 04:26:46 -- common/autotest_common.sh@862 -- # return 0 00:24:55.869 04:26:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:24:55.869 04:26:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:24:55.869 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:24:55.869 04:26:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:24:55.869 04:26:46 -- target/perf_adq.sh@90 -- # adq_configure_nvmf_target 1 00:24:55.869 04:26:46 -- target/perf_adq.sh@42 -- # rpc_cmd sock_impl_set_options --enable-placement-id 1 --enable-zerocopy-send-server -i posix 00:24:55.869 04:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:55.869 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:24:55.869 04:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.869 04:26:46 -- target/perf_adq.sh@43 -- # rpc_cmd framework_start_init 00:24:55.869 04:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:55.869 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:24:55.869 04:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.869 04:26:46 -- target/perf_adq.sh@44 -- # rpc_cmd nvmf_create_transport -t tcp -o --io-unit-size 8192 --sock-priority 1 00:24:55.869 04:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:55.869 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:24:55.869 [2024-11-30 04:26:46.325866] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:24:55.869 04:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.869 04:26:46 -- target/perf_adq.sh@45 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:24:55.869 04:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:55.869 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:24:55.869 Malloc1 00:24:55.869 04:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.869 04:26:46 -- target/perf_adq.sh@46 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:24:55.869 04:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:55.869 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:24:55.869 04:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.869 04:26:46 -- target/perf_adq.sh@47 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:24:55.869 04:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:55.869 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:24:55.869 04:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.869 04:26:46 -- target/perf_adq.sh@48 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:24:55.869 04:26:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:55.869 04:26:46 -- common/autotest_common.sh@10 -- # set +x 00:24:55.869 [2024-11-30 04:26:46.379232] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:24:55.869 04:26:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:55.869 04:26:46 -- target/perf_adq.sh@94 -- # perfpid=2432579 00:24:55.869 04:26:46 -- target/perf_adq.sh@95 -- # sleep 2 00:24:55.869 04:26:46 -- target/perf_adq.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 64 -o 4096 -w randread -t 10 -c 0xF0 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:24:55.869 EAL: No free 2048 kB hugepages reported on node 1 00:24:57.769 04:26:48 -- target/perf_adq.sh@97 -- # rpc_cmd nvmf_get_stats 00:24:57.769 04:26:48 -- target/perf_adq.sh@97 -- # jq -r '.poll_groups[] | select(.current_io_qpairs == 0) | length' 00:24:57.769 04:26:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:24:57.769 04:26:48 -- target/perf_adq.sh@97 -- # wc -l 00:24:57.769 04:26:48 -- common/autotest_common.sh@10 -- # set +x 00:24:58.027 04:26:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:24:58.027 04:26:48 -- target/perf_adq.sh@97 -- # count=2 00:24:58.027 04:26:48 -- target/perf_adq.sh@98 -- # [[ 2 -lt 2 ]] 00:24:58.027 04:26:48 -- target/perf_adq.sh@103 -- # wait 2432579 00:25:06.134 Initializing NVMe Controllers 00:25:06.134 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:25:06.134 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 4 00:25:06.134 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 5 00:25:06.134 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 6 00:25:06.134 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 7 00:25:06.134 Initialization complete. Launching workers. 00:25:06.134 ======================================================== 00:25:06.134 Latency(us) 00:25:06.134 Device Information : IOPS MiB/s Average min max 00:25:06.134 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 4: 5095.70 19.91 12565.16 1661.27 59217.14 00:25:06.134 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 5: 13213.30 51.61 4843.86 1157.83 46068.20 00:25:06.134 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 6: 5272.90 20.60 12140.64 1244.20 60435.27 00:25:06.134 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 7: 5071.90 19.81 12626.99 1123.14 59942.34 00:25:06.134 ======================================================== 00:25:06.134 Total : 28653.80 111.93 8937.41 1123.14 60435.27 00:25:06.134 00:25:06.134 04:26:56 -- target/perf_adq.sh@104 -- # nvmftestfini 00:25:06.134 04:26:56 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:06.134 04:26:56 -- nvmf/common.sh@116 -- # sync 00:25:06.134 04:26:56 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:06.134 04:26:56 -- nvmf/common.sh@119 -- # set +e 00:25:06.134 04:26:56 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:06.134 04:26:56 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:06.134 rmmod nvme_tcp 00:25:06.134 rmmod nvme_fabrics 00:25:06.134 rmmod nvme_keyring 00:25:06.134 04:26:56 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:06.134 04:26:56 -- nvmf/common.sh@123 -- # set -e 00:25:06.134 04:26:56 -- nvmf/common.sh@124 -- # return 0 00:25:06.134 04:26:56 -- nvmf/common.sh@477 -- # '[' -n 2432432 ']' 00:25:06.134 04:26:56 -- nvmf/common.sh@478 -- # killprocess 2432432 00:25:06.134 04:26:56 -- common/autotest_common.sh@936 -- # '[' -z 2432432 ']' 00:25:06.134 04:26:56 -- common/autotest_common.sh@940 -- # kill -0 2432432 00:25:06.134 04:26:56 -- common/autotest_common.sh@941 -- # uname 00:25:06.134 04:26:56 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:06.134 04:26:56 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2432432 00:25:06.134 04:26:56 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:06.134 04:26:56 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:06.134 04:26:56 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2432432' 00:25:06.134 killing process with pid 2432432 00:25:06.134 04:26:56 -- common/autotest_common.sh@955 -- # kill 2432432 00:25:06.134 04:26:56 -- common/autotest_common.sh@960 -- # wait 2432432 00:25:06.393 04:26:56 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:06.393 04:26:56 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:06.393 04:26:56 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:06.393 04:26:56 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:06.393 04:26:56 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:06.393 04:26:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:06.393 04:26:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:06.393 04:26:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:09.681 04:26:59 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:09.681 04:26:59 -- target/perf_adq.sh@106 -- # trap - SIGINT SIGTERM EXIT 00:25:09.681 00:25:09.681 real 0m46.022s 00:25:09.681 user 2m38.083s 00:25:09.681 sys 0m10.152s 00:25:09.681 04:26:59 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:09.681 04:26:59 -- common/autotest_common.sh@10 -- # set +x 00:25:09.681 ************************************ 00:25:09.681 END TEST nvmf_perf_adq 00:25:09.681 ************************************ 00:25:09.681 04:26:59 -- nvmf/nvmf.sh@81 -- # run_test nvmf_shutdown /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:09.681 04:26:59 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:09.681 04:26:59 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:09.681 04:26:59 -- common/autotest_common.sh@10 -- # set +x 00:25:09.681 ************************************ 00:25:09.681 START TEST nvmf_shutdown 00:25:09.681 ************************************ 00:25:09.681 04:26:59 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh --transport=tcp 00:25:09.681 * Looking for test storage... 00:25:09.681 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:25:09.681 04:27:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:09.681 04:27:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:09.681 04:27:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:09.681 04:27:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:09.681 04:27:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:09.681 04:27:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:09.681 04:27:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:09.681 04:27:00 -- scripts/common.sh@335 -- # IFS=.-: 00:25:09.681 04:27:00 -- scripts/common.sh@335 -- # read -ra ver1 00:25:09.681 04:27:00 -- scripts/common.sh@336 -- # IFS=.-: 00:25:09.681 04:27:00 -- scripts/common.sh@336 -- # read -ra ver2 00:25:09.681 04:27:00 -- scripts/common.sh@337 -- # local 'op=<' 00:25:09.681 04:27:00 -- scripts/common.sh@339 -- # ver1_l=2 00:25:09.681 04:27:00 -- scripts/common.sh@340 -- # ver2_l=1 00:25:09.681 04:27:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:09.681 04:27:00 -- scripts/common.sh@343 -- # case "$op" in 00:25:09.681 04:27:00 -- scripts/common.sh@344 -- # : 1 00:25:09.681 04:27:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:09.681 04:27:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:09.681 04:27:00 -- scripts/common.sh@364 -- # decimal 1 00:25:09.681 04:27:00 -- scripts/common.sh@352 -- # local d=1 00:25:09.681 04:27:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:09.681 04:27:00 -- scripts/common.sh@354 -- # echo 1 00:25:09.681 04:27:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:09.681 04:27:00 -- scripts/common.sh@365 -- # decimal 2 00:25:09.681 04:27:00 -- scripts/common.sh@352 -- # local d=2 00:25:09.681 04:27:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:09.681 04:27:00 -- scripts/common.sh@354 -- # echo 2 00:25:09.681 04:27:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:09.681 04:27:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:09.681 04:27:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:09.681 04:27:00 -- scripts/common.sh@367 -- # return 0 00:25:09.681 04:27:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:09.681 04:27:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:09.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:09.681 --rc genhtml_branch_coverage=1 00:25:09.681 --rc genhtml_function_coverage=1 00:25:09.681 --rc genhtml_legend=1 00:25:09.681 --rc geninfo_all_blocks=1 00:25:09.681 --rc geninfo_unexecuted_blocks=1 00:25:09.681 00:25:09.681 ' 00:25:09.681 04:27:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:09.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:09.681 --rc genhtml_branch_coverage=1 00:25:09.681 --rc genhtml_function_coverage=1 00:25:09.681 --rc genhtml_legend=1 00:25:09.681 --rc geninfo_all_blocks=1 00:25:09.681 --rc geninfo_unexecuted_blocks=1 00:25:09.681 00:25:09.681 ' 00:25:09.681 04:27:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:09.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:09.681 --rc genhtml_branch_coverage=1 00:25:09.681 --rc genhtml_function_coverage=1 00:25:09.681 --rc genhtml_legend=1 00:25:09.681 --rc geninfo_all_blocks=1 00:25:09.681 --rc geninfo_unexecuted_blocks=1 00:25:09.681 00:25:09.681 ' 00:25:09.681 04:27:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:09.681 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:09.681 --rc genhtml_branch_coverage=1 00:25:09.681 --rc genhtml_function_coverage=1 00:25:09.681 --rc genhtml_legend=1 00:25:09.681 --rc geninfo_all_blocks=1 00:25:09.681 --rc geninfo_unexecuted_blocks=1 00:25:09.681 00:25:09.681 ' 00:25:09.681 04:27:00 -- target/shutdown.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:09.681 04:27:00 -- nvmf/common.sh@7 -- # uname -s 00:25:09.681 04:27:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:09.681 04:27:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:09.681 04:27:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:09.681 04:27:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:09.681 04:27:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:09.681 04:27:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:09.681 04:27:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:09.681 04:27:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:09.681 04:27:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:09.681 04:27:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:09.681 04:27:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:09.681 04:27:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:09.681 04:27:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:09.681 04:27:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:09.681 04:27:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:09.681 04:27:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:09.681 04:27:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:09.681 04:27:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:09.681 04:27:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:09.681 04:27:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:09.681 04:27:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:09.681 04:27:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:09.681 04:27:00 -- paths/export.sh@5 -- # export PATH 00:25:09.681 04:27:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:09.681 04:27:00 -- nvmf/common.sh@46 -- # : 0 00:25:09.681 04:27:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:09.681 04:27:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:09.681 04:27:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:09.681 04:27:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:09.681 04:27:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:09.681 04:27:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:09.682 04:27:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:09.682 04:27:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:09.682 04:27:00 -- target/shutdown.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:09.682 04:27:00 -- target/shutdown.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:09.682 04:27:00 -- target/shutdown.sh@146 -- # run_test nvmf_shutdown_tc1 nvmf_shutdown_tc1 00:25:09.682 04:27:00 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:09.682 04:27:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:09.682 04:27:00 -- common/autotest_common.sh@10 -- # set +x 00:25:09.682 ************************************ 00:25:09.682 START TEST nvmf_shutdown_tc1 00:25:09.682 ************************************ 00:25:09.682 04:27:00 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc1 00:25:09.682 04:27:00 -- target/shutdown.sh@74 -- # starttarget 00:25:09.682 04:27:00 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:09.682 04:27:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:09.682 04:27:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:09.682 04:27:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:09.682 04:27:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:09.682 04:27:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:09.682 04:27:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:09.682 04:27:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:09.682 04:27:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:09.682 04:27:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:09.682 04:27:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:09.682 04:27:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:09.682 04:27:00 -- common/autotest_common.sh@10 -- # set +x 00:25:11.583 04:27:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:11.583 04:27:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:11.583 04:27:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:11.583 04:27:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:11.583 04:27:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:11.583 04:27:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:11.583 04:27:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:11.583 04:27:02 -- nvmf/common.sh@294 -- # net_devs=() 00:25:11.583 04:27:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:11.583 04:27:02 -- nvmf/common.sh@295 -- # e810=() 00:25:11.583 04:27:02 -- nvmf/common.sh@295 -- # local -ga e810 00:25:11.583 04:27:02 -- nvmf/common.sh@296 -- # x722=() 00:25:11.583 04:27:02 -- nvmf/common.sh@296 -- # local -ga x722 00:25:11.583 04:27:02 -- nvmf/common.sh@297 -- # mlx=() 00:25:11.583 04:27:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:11.583 04:27:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:11.583 04:27:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:11.583 04:27:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:11.583 04:27:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:11.583 04:27:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:11.583 04:27:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:11.583 04:27:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:11.583 04:27:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:11.583 04:27:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:11.583 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:11.583 04:27:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:11.583 04:27:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:11.583 04:27:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:11.583 04:27:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:11.583 04:27:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:11.583 04:27:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:11.583 04:27:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:11.583 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:11.584 04:27:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:11.584 04:27:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:11.584 04:27:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:11.584 04:27:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:11.584 04:27:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:11.584 04:27:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:11.584 04:27:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:11.584 04:27:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:11.584 04:27:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:11.584 04:27:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:11.584 04:27:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:11.584 04:27:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:11.584 04:27:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:11.584 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:11.584 04:27:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:11.584 04:27:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:11.584 04:27:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:11.584 04:27:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:11.584 04:27:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:11.584 04:27:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:11.584 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:11.584 04:27:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:11.584 04:27:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:11.584 04:27:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:11.584 04:27:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:11.584 04:27:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:11.584 04:27:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:11.584 04:27:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:11.584 04:27:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:11.584 04:27:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:11.584 04:27:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:11.584 04:27:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:11.584 04:27:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:11.584 04:27:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:11.584 04:27:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:11.584 04:27:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:11.584 04:27:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:11.584 04:27:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:11.584 04:27:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:11.584 04:27:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:11.842 04:27:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:11.842 04:27:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:11.842 04:27:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:11.842 04:27:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:11.842 04:27:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:11.842 04:27:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:11.842 04:27:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:11.842 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:11.842 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.277 ms 00:25:11.842 00:25:11.842 --- 10.0.0.2 ping statistics --- 00:25:11.842 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:11.842 rtt min/avg/max/mdev = 0.277/0.277/0.277/0.000 ms 00:25:11.842 04:27:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:11.842 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:11.842 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:25:11.842 00:25:11.842 --- 10.0.0.1 ping statistics --- 00:25:11.842 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:11.842 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:25:11.842 04:27:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:11.842 04:27:02 -- nvmf/common.sh@410 -- # return 0 00:25:11.842 04:27:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:11.842 04:27:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:11.842 04:27:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:11.842 04:27:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:11.842 04:27:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:11.842 04:27:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:11.842 04:27:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:11.842 04:27:02 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:11.842 04:27:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:11.842 04:27:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:11.842 04:27:02 -- common/autotest_common.sh@10 -- # set +x 00:25:11.842 04:27:02 -- nvmf/common.sh@469 -- # nvmfpid=2436035 00:25:11.842 04:27:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:11.842 04:27:02 -- nvmf/common.sh@470 -- # waitforlisten 2436035 00:25:11.842 04:27:02 -- common/autotest_common.sh@829 -- # '[' -z 2436035 ']' 00:25:11.842 04:27:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:11.842 04:27:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:11.842 04:27:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:11.842 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:11.842 04:27:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:11.842 04:27:02 -- common/autotest_common.sh@10 -- # set +x 00:25:11.843 [2024-11-30 04:27:02.400140] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:11.843 [2024-11-30 04:27:02.400220] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:11.843 EAL: No free 2048 kB hugepages reported on node 1 00:25:11.843 [2024-11-30 04:27:02.467850] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:12.101 [2024-11-30 04:27:02.554859] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:12.101 [2024-11-30 04:27:02.555045] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:12.101 [2024-11-30 04:27:02.555065] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:12.101 [2024-11-30 04:27:02.555078] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:12.101 [2024-11-30 04:27:02.555155] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:12.101 [2024-11-30 04:27:02.555209] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:12.101 [2024-11-30 04:27:02.555265] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:12.101 [2024-11-30 04:27:02.555267] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:13.031 04:27:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:13.031 04:27:03 -- common/autotest_common.sh@862 -- # return 0 00:25:13.031 04:27:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:13.031 04:27:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:13.031 04:27:03 -- common/autotest_common.sh@10 -- # set +x 00:25:13.031 04:27:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:13.031 04:27:03 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:13.031 04:27:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.031 04:27:03 -- common/autotest_common.sh@10 -- # set +x 00:25:13.031 [2024-11-30 04:27:03.413765] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:13.031 04:27:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.031 04:27:03 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:13.031 04:27:03 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:13.031 04:27:03 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:13.031 04:27:03 -- common/autotest_common.sh@10 -- # set +x 00:25:13.031 04:27:03 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:13.031 04:27:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.031 04:27:03 -- target/shutdown.sh@28 -- # cat 00:25:13.031 04:27:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.031 04:27:03 -- target/shutdown.sh@28 -- # cat 00:25:13.031 04:27:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.031 04:27:03 -- target/shutdown.sh@28 -- # cat 00:25:13.031 04:27:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.031 04:27:03 -- target/shutdown.sh@28 -- # cat 00:25:13.031 04:27:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.031 04:27:03 -- target/shutdown.sh@28 -- # cat 00:25:13.031 04:27:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.031 04:27:03 -- target/shutdown.sh@28 -- # cat 00:25:13.031 04:27:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.031 04:27:03 -- target/shutdown.sh@28 -- # cat 00:25:13.031 04:27:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.031 04:27:03 -- target/shutdown.sh@28 -- # cat 00:25:13.031 04:27:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.031 04:27:03 -- target/shutdown.sh@28 -- # cat 00:25:13.031 04:27:03 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:13.031 04:27:03 -- target/shutdown.sh@28 -- # cat 00:25:13.031 04:27:03 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:13.031 04:27:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:13.031 04:27:03 -- common/autotest_common.sh@10 -- # set +x 00:25:13.031 Malloc1 00:25:13.031 [2024-11-30 04:27:03.503768] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:13.031 Malloc2 00:25:13.031 Malloc3 00:25:13.031 Malloc4 00:25:13.287 Malloc5 00:25:13.287 Malloc6 00:25:13.287 Malloc7 00:25:13.287 Malloc8 00:25:13.287 Malloc9 00:25:13.544 Malloc10 00:25:13.544 04:27:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:13.544 04:27:03 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:13.544 04:27:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:13.544 04:27:03 -- common/autotest_common.sh@10 -- # set +x 00:25:13.544 04:27:03 -- target/shutdown.sh@78 -- # perfpid=2436234 00:25:13.544 04:27:03 -- target/shutdown.sh@79 -- # waitforlisten 2436234 /var/tmp/bdevperf.sock 00:25:13.544 04:27:03 -- common/autotest_common.sh@829 -- # '[' -z 2436234 ']' 00:25:13.544 04:27:03 -- target/shutdown.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json /dev/fd/63 00:25:13.544 04:27:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:13.544 04:27:03 -- target/shutdown.sh@77 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:13.544 04:27:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:13.544 04:27:03 -- nvmf/common.sh@520 -- # config=() 00:25:13.544 04:27:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:13.544 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:13.544 04:27:03 -- nvmf/common.sh@520 -- # local subsystem config 00:25:13.544 04:27:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:13.544 04:27:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.544 04:27:03 -- common/autotest_common.sh@10 -- # set +x 00:25:13.544 04:27:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.544 { 00:25:13.544 "params": { 00:25:13.544 "name": "Nvme$subsystem", 00:25:13.544 "trtype": "$TEST_TRANSPORT", 00:25:13.544 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.544 "adrfam": "ipv4", 00:25:13.544 "trsvcid": "$NVMF_PORT", 00:25:13.544 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.544 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.544 "hdgst": ${hdgst:-false}, 00:25:13.544 "ddgst": ${ddgst:-false} 00:25:13.544 }, 00:25:13.544 "method": "bdev_nvme_attach_controller" 00:25:13.544 } 00:25:13.544 EOF 00:25:13.544 )") 00:25:13.544 04:27:03 -- nvmf/common.sh@542 -- # cat 00:25:13.544 04:27:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.544 04:27:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.544 { 00:25:13.544 "params": { 00:25:13.544 "name": "Nvme$subsystem", 00:25:13.544 "trtype": "$TEST_TRANSPORT", 00:25:13.544 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.544 "adrfam": "ipv4", 00:25:13.544 "trsvcid": "$NVMF_PORT", 00:25:13.544 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.544 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.544 "hdgst": ${hdgst:-false}, 00:25:13.544 "ddgst": ${ddgst:-false} 00:25:13.544 }, 00:25:13.544 "method": "bdev_nvme_attach_controller" 00:25:13.544 } 00:25:13.544 EOF 00:25:13.544 )") 00:25:13.544 04:27:03 -- nvmf/common.sh@542 -- # cat 00:25:13.545 04:27:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.545 04:27:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.545 { 00:25:13.545 "params": { 00:25:13.545 "name": "Nvme$subsystem", 00:25:13.545 "trtype": "$TEST_TRANSPORT", 00:25:13.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.545 "adrfam": "ipv4", 00:25:13.545 "trsvcid": "$NVMF_PORT", 00:25:13.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.545 "hdgst": ${hdgst:-false}, 00:25:13.545 "ddgst": ${ddgst:-false} 00:25:13.545 }, 00:25:13.545 "method": "bdev_nvme_attach_controller" 00:25:13.545 } 00:25:13.545 EOF 00:25:13.545 )") 00:25:13.545 04:27:03 -- nvmf/common.sh@542 -- # cat 00:25:13.545 04:27:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.545 04:27:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.545 { 00:25:13.545 "params": { 00:25:13.545 "name": "Nvme$subsystem", 00:25:13.545 "trtype": "$TEST_TRANSPORT", 00:25:13.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.545 "adrfam": "ipv4", 00:25:13.545 "trsvcid": "$NVMF_PORT", 00:25:13.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.545 "hdgst": ${hdgst:-false}, 00:25:13.545 "ddgst": ${ddgst:-false} 00:25:13.545 }, 00:25:13.545 "method": "bdev_nvme_attach_controller" 00:25:13.545 } 00:25:13.545 EOF 00:25:13.545 )") 00:25:13.545 04:27:03 -- nvmf/common.sh@542 -- # cat 00:25:13.545 04:27:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.545 04:27:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.545 { 00:25:13.545 "params": { 00:25:13.545 "name": "Nvme$subsystem", 00:25:13.545 "trtype": "$TEST_TRANSPORT", 00:25:13.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.545 "adrfam": "ipv4", 00:25:13.545 "trsvcid": "$NVMF_PORT", 00:25:13.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.545 "hdgst": ${hdgst:-false}, 00:25:13.545 "ddgst": ${ddgst:-false} 00:25:13.545 }, 00:25:13.545 "method": "bdev_nvme_attach_controller" 00:25:13.545 } 00:25:13.545 EOF 00:25:13.545 )") 00:25:13.545 04:27:03 -- nvmf/common.sh@542 -- # cat 00:25:13.545 04:27:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.545 04:27:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.545 { 00:25:13.545 "params": { 00:25:13.545 "name": "Nvme$subsystem", 00:25:13.545 "trtype": "$TEST_TRANSPORT", 00:25:13.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.545 "adrfam": "ipv4", 00:25:13.545 "trsvcid": "$NVMF_PORT", 00:25:13.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.545 "hdgst": ${hdgst:-false}, 00:25:13.545 "ddgst": ${ddgst:-false} 00:25:13.545 }, 00:25:13.545 "method": "bdev_nvme_attach_controller" 00:25:13.545 } 00:25:13.545 EOF 00:25:13.545 )") 00:25:13.545 04:27:03 -- nvmf/common.sh@542 -- # cat 00:25:13.545 04:27:03 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.545 04:27:03 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.545 { 00:25:13.545 "params": { 00:25:13.545 "name": "Nvme$subsystem", 00:25:13.545 "trtype": "$TEST_TRANSPORT", 00:25:13.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.545 "adrfam": "ipv4", 00:25:13.545 "trsvcid": "$NVMF_PORT", 00:25:13.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.545 "hdgst": ${hdgst:-false}, 00:25:13.545 "ddgst": ${ddgst:-false} 00:25:13.545 }, 00:25:13.545 "method": "bdev_nvme_attach_controller" 00:25:13.545 } 00:25:13.545 EOF 00:25:13.545 )") 00:25:13.545 04:27:04 -- nvmf/common.sh@542 -- # cat 00:25:13.545 04:27:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.545 04:27:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.545 { 00:25:13.545 "params": { 00:25:13.545 "name": "Nvme$subsystem", 00:25:13.545 "trtype": "$TEST_TRANSPORT", 00:25:13.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.545 "adrfam": "ipv4", 00:25:13.545 "trsvcid": "$NVMF_PORT", 00:25:13.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.545 "hdgst": ${hdgst:-false}, 00:25:13.545 "ddgst": ${ddgst:-false} 00:25:13.545 }, 00:25:13.545 "method": "bdev_nvme_attach_controller" 00:25:13.545 } 00:25:13.545 EOF 00:25:13.545 )") 00:25:13.545 04:27:04 -- nvmf/common.sh@542 -- # cat 00:25:13.545 04:27:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.545 04:27:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.545 { 00:25:13.545 "params": { 00:25:13.545 "name": "Nvme$subsystem", 00:25:13.545 "trtype": "$TEST_TRANSPORT", 00:25:13.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.545 "adrfam": "ipv4", 00:25:13.545 "trsvcid": "$NVMF_PORT", 00:25:13.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.545 "hdgst": ${hdgst:-false}, 00:25:13.545 "ddgst": ${ddgst:-false} 00:25:13.545 }, 00:25:13.545 "method": "bdev_nvme_attach_controller" 00:25:13.545 } 00:25:13.545 EOF 00:25:13.545 )") 00:25:13.545 04:27:04 -- nvmf/common.sh@542 -- # cat 00:25:13.545 04:27:04 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:13.545 04:27:04 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:13.545 { 00:25:13.545 "params": { 00:25:13.545 "name": "Nvme$subsystem", 00:25:13.545 "trtype": "$TEST_TRANSPORT", 00:25:13.545 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:13.545 "adrfam": "ipv4", 00:25:13.545 "trsvcid": "$NVMF_PORT", 00:25:13.545 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:13.545 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:13.545 "hdgst": ${hdgst:-false}, 00:25:13.545 "ddgst": ${ddgst:-false} 00:25:13.545 }, 00:25:13.545 "method": "bdev_nvme_attach_controller" 00:25:13.545 } 00:25:13.545 EOF 00:25:13.545 )") 00:25:13.545 04:27:04 -- nvmf/common.sh@542 -- # cat 00:25:13.545 04:27:04 -- nvmf/common.sh@544 -- # jq . 00:25:13.545 04:27:04 -- nvmf/common.sh@545 -- # IFS=, 00:25:13.545 04:27:04 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:13.545 "params": { 00:25:13.545 "name": "Nvme1", 00:25:13.545 "trtype": "tcp", 00:25:13.546 "traddr": "10.0.0.2", 00:25:13.546 "adrfam": "ipv4", 00:25:13.546 "trsvcid": "4420", 00:25:13.546 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:13.546 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:13.546 "hdgst": false, 00:25:13.546 "ddgst": false 00:25:13.546 }, 00:25:13.546 "method": "bdev_nvme_attach_controller" 00:25:13.546 },{ 00:25:13.546 "params": { 00:25:13.546 "name": "Nvme2", 00:25:13.546 "trtype": "tcp", 00:25:13.546 "traddr": "10.0.0.2", 00:25:13.546 "adrfam": "ipv4", 00:25:13.546 "trsvcid": "4420", 00:25:13.546 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:13.546 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:13.546 "hdgst": false, 00:25:13.546 "ddgst": false 00:25:13.546 }, 00:25:13.546 "method": "bdev_nvme_attach_controller" 00:25:13.546 },{ 00:25:13.546 "params": { 00:25:13.546 "name": "Nvme3", 00:25:13.546 "trtype": "tcp", 00:25:13.546 "traddr": "10.0.0.2", 00:25:13.546 "adrfam": "ipv4", 00:25:13.546 "trsvcid": "4420", 00:25:13.546 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:13.546 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:13.546 "hdgst": false, 00:25:13.546 "ddgst": false 00:25:13.546 }, 00:25:13.546 "method": "bdev_nvme_attach_controller" 00:25:13.546 },{ 00:25:13.546 "params": { 00:25:13.546 "name": "Nvme4", 00:25:13.546 "trtype": "tcp", 00:25:13.546 "traddr": "10.0.0.2", 00:25:13.546 "adrfam": "ipv4", 00:25:13.546 "trsvcid": "4420", 00:25:13.546 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:13.546 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:13.546 "hdgst": false, 00:25:13.546 "ddgst": false 00:25:13.546 }, 00:25:13.546 "method": "bdev_nvme_attach_controller" 00:25:13.546 },{ 00:25:13.546 "params": { 00:25:13.546 "name": "Nvme5", 00:25:13.546 "trtype": "tcp", 00:25:13.546 "traddr": "10.0.0.2", 00:25:13.546 "adrfam": "ipv4", 00:25:13.546 "trsvcid": "4420", 00:25:13.546 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:13.546 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:13.546 "hdgst": false, 00:25:13.546 "ddgst": false 00:25:13.546 }, 00:25:13.546 "method": "bdev_nvme_attach_controller" 00:25:13.546 },{ 00:25:13.546 "params": { 00:25:13.546 "name": "Nvme6", 00:25:13.546 "trtype": "tcp", 00:25:13.546 "traddr": "10.0.0.2", 00:25:13.546 "adrfam": "ipv4", 00:25:13.546 "trsvcid": "4420", 00:25:13.546 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:13.546 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:13.546 "hdgst": false, 00:25:13.546 "ddgst": false 00:25:13.546 }, 00:25:13.546 "method": "bdev_nvme_attach_controller" 00:25:13.546 },{ 00:25:13.546 "params": { 00:25:13.546 "name": "Nvme7", 00:25:13.546 "trtype": "tcp", 00:25:13.546 "traddr": "10.0.0.2", 00:25:13.546 "adrfam": "ipv4", 00:25:13.546 "trsvcid": "4420", 00:25:13.546 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:13.546 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:13.546 "hdgst": false, 00:25:13.546 "ddgst": false 00:25:13.546 }, 00:25:13.546 "method": "bdev_nvme_attach_controller" 00:25:13.546 },{ 00:25:13.546 "params": { 00:25:13.546 "name": "Nvme8", 00:25:13.546 "trtype": "tcp", 00:25:13.546 "traddr": "10.0.0.2", 00:25:13.546 "adrfam": "ipv4", 00:25:13.546 "trsvcid": "4420", 00:25:13.546 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:13.546 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:13.546 "hdgst": false, 00:25:13.546 "ddgst": false 00:25:13.546 }, 00:25:13.546 "method": "bdev_nvme_attach_controller" 00:25:13.546 },{ 00:25:13.546 "params": { 00:25:13.546 "name": "Nvme9", 00:25:13.546 "trtype": "tcp", 00:25:13.546 "traddr": "10.0.0.2", 00:25:13.546 "adrfam": "ipv4", 00:25:13.546 "trsvcid": "4420", 00:25:13.546 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:13.546 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:13.546 "hdgst": false, 00:25:13.546 "ddgst": false 00:25:13.546 }, 00:25:13.546 "method": "bdev_nvme_attach_controller" 00:25:13.546 },{ 00:25:13.546 "params": { 00:25:13.546 "name": "Nvme10", 00:25:13.546 "trtype": "tcp", 00:25:13.546 "traddr": "10.0.0.2", 00:25:13.546 "adrfam": "ipv4", 00:25:13.546 "trsvcid": "4420", 00:25:13.546 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:13.546 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:13.546 "hdgst": false, 00:25:13.546 "ddgst": false 00:25:13.546 }, 00:25:13.546 "method": "bdev_nvme_attach_controller" 00:25:13.546 }' 00:25:13.546 [2024-11-30 04:27:04.020383] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:13.546 [2024-11-30 04:27:04.020473] [ DPDK EAL parameters: bdev_svc -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk1 --proc-type=auto ] 00:25:13.546 EAL: No free 2048 kB hugepages reported on node 1 00:25:13.546 [2024-11-30 04:27:04.083188] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:13.546 [2024-11-30 04:27:04.166835] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:15.441 04:27:05 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:15.441 04:27:05 -- common/autotest_common.sh@862 -- # return 0 00:25:15.441 04:27:05 -- target/shutdown.sh@80 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:15.441 04:27:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:15.441 04:27:05 -- common/autotest_common.sh@10 -- # set +x 00:25:15.441 04:27:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:15.441 04:27:05 -- target/shutdown.sh@83 -- # kill -9 2436234 00:25:15.441 04:27:05 -- target/shutdown.sh@84 -- # rm -f /var/run/spdk_bdev1 00:25:15.441 04:27:05 -- target/shutdown.sh@87 -- # sleep 1 00:25:16.375 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 73: 2436234 Killed $rootdir/test/app/bdev_svc/bdev_svc -m 0x1 -i 1 -r /var/tmp/bdevperf.sock --json <(gen_nvmf_target_json "${num_subsystems[@]}") 00:25:16.375 04:27:06 -- target/shutdown.sh@88 -- # kill -0 2436035 00:25:16.375 04:27:06 -- target/shutdown.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/62 -q 64 -o 65536 -w verify -t 1 00:25:16.375 04:27:06 -- target/shutdown.sh@91 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:16.375 04:27:06 -- nvmf/common.sh@520 -- # config=() 00:25:16.375 04:27:06 -- nvmf/common.sh@520 -- # local subsystem config 00:25:16.375 04:27:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:16.375 { 00:25:16.375 "params": { 00:25:16.375 "name": "Nvme$subsystem", 00:25:16.375 "trtype": "$TEST_TRANSPORT", 00:25:16.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:16.375 "adrfam": "ipv4", 00:25:16.375 "trsvcid": "$NVMF_PORT", 00:25:16.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:16.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:16.375 "hdgst": ${hdgst:-false}, 00:25:16.375 "ddgst": ${ddgst:-false} 00:25:16.375 }, 00:25:16.375 "method": "bdev_nvme_attach_controller" 00:25:16.375 } 00:25:16.375 EOF 00:25:16.375 )") 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # cat 00:25:16.375 04:27:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:16.375 { 00:25:16.375 "params": { 00:25:16.375 "name": "Nvme$subsystem", 00:25:16.375 "trtype": "$TEST_TRANSPORT", 00:25:16.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:16.375 "adrfam": "ipv4", 00:25:16.375 "trsvcid": "$NVMF_PORT", 00:25:16.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:16.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:16.375 "hdgst": ${hdgst:-false}, 00:25:16.375 "ddgst": ${ddgst:-false} 00:25:16.375 }, 00:25:16.375 "method": "bdev_nvme_attach_controller" 00:25:16.375 } 00:25:16.375 EOF 00:25:16.375 )") 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # cat 00:25:16.375 04:27:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:16.375 { 00:25:16.375 "params": { 00:25:16.375 "name": "Nvme$subsystem", 00:25:16.375 "trtype": "$TEST_TRANSPORT", 00:25:16.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:16.375 "adrfam": "ipv4", 00:25:16.375 "trsvcid": "$NVMF_PORT", 00:25:16.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:16.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:16.375 "hdgst": ${hdgst:-false}, 00:25:16.375 "ddgst": ${ddgst:-false} 00:25:16.375 }, 00:25:16.375 "method": "bdev_nvme_attach_controller" 00:25:16.375 } 00:25:16.375 EOF 00:25:16.375 )") 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # cat 00:25:16.375 04:27:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:16.375 { 00:25:16.375 "params": { 00:25:16.375 "name": "Nvme$subsystem", 00:25:16.375 "trtype": "$TEST_TRANSPORT", 00:25:16.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:16.375 "adrfam": "ipv4", 00:25:16.375 "trsvcid": "$NVMF_PORT", 00:25:16.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:16.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:16.375 "hdgst": ${hdgst:-false}, 00:25:16.375 "ddgst": ${ddgst:-false} 00:25:16.375 }, 00:25:16.375 "method": "bdev_nvme_attach_controller" 00:25:16.375 } 00:25:16.375 EOF 00:25:16.375 )") 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # cat 00:25:16.375 04:27:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:16.375 { 00:25:16.375 "params": { 00:25:16.375 "name": "Nvme$subsystem", 00:25:16.375 "trtype": "$TEST_TRANSPORT", 00:25:16.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:16.375 "adrfam": "ipv4", 00:25:16.375 "trsvcid": "$NVMF_PORT", 00:25:16.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:16.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:16.375 "hdgst": ${hdgst:-false}, 00:25:16.375 "ddgst": ${ddgst:-false} 00:25:16.375 }, 00:25:16.375 "method": "bdev_nvme_attach_controller" 00:25:16.375 } 00:25:16.375 EOF 00:25:16.375 )") 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # cat 00:25:16.375 04:27:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:16.375 { 00:25:16.375 "params": { 00:25:16.375 "name": "Nvme$subsystem", 00:25:16.375 "trtype": "$TEST_TRANSPORT", 00:25:16.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:16.375 "adrfam": "ipv4", 00:25:16.375 "trsvcid": "$NVMF_PORT", 00:25:16.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:16.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:16.375 "hdgst": ${hdgst:-false}, 00:25:16.375 "ddgst": ${ddgst:-false} 00:25:16.375 }, 00:25:16.375 "method": "bdev_nvme_attach_controller" 00:25:16.375 } 00:25:16.375 EOF 00:25:16.375 )") 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # cat 00:25:16.375 04:27:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:16.375 { 00:25:16.375 "params": { 00:25:16.375 "name": "Nvme$subsystem", 00:25:16.375 "trtype": "$TEST_TRANSPORT", 00:25:16.375 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:16.375 "adrfam": "ipv4", 00:25:16.375 "trsvcid": "$NVMF_PORT", 00:25:16.375 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:16.375 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:16.375 "hdgst": ${hdgst:-false}, 00:25:16.375 "ddgst": ${ddgst:-false} 00:25:16.375 }, 00:25:16.375 "method": "bdev_nvme_attach_controller" 00:25:16.375 } 00:25:16.375 EOF 00:25:16.375 )") 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # cat 00:25:16.375 04:27:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:16.375 04:27:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:16.376 { 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme$subsystem", 00:25:16.376 "trtype": "$TEST_TRANSPORT", 00:25:16.376 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "$NVMF_PORT", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:16.376 "hdgst": ${hdgst:-false}, 00:25:16.376 "ddgst": ${ddgst:-false} 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 } 00:25:16.376 EOF 00:25:16.376 )") 00:25:16.376 04:27:06 -- nvmf/common.sh@542 -- # cat 00:25:16.376 04:27:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:16.376 04:27:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:16.376 { 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme$subsystem", 00:25:16.376 "trtype": "$TEST_TRANSPORT", 00:25:16.376 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "$NVMF_PORT", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:16.376 "hdgst": ${hdgst:-false}, 00:25:16.376 "ddgst": ${ddgst:-false} 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 } 00:25:16.376 EOF 00:25:16.376 )") 00:25:16.376 04:27:06 -- nvmf/common.sh@542 -- # cat 00:25:16.376 04:27:06 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:16.376 04:27:06 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:16.376 { 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme$subsystem", 00:25:16.376 "trtype": "$TEST_TRANSPORT", 00:25:16.376 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "$NVMF_PORT", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:16.376 "hdgst": ${hdgst:-false}, 00:25:16.376 "ddgst": ${ddgst:-false} 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 } 00:25:16.376 EOF 00:25:16.376 )") 00:25:16.376 04:27:06 -- nvmf/common.sh@542 -- # cat 00:25:16.376 04:27:06 -- nvmf/common.sh@544 -- # jq . 00:25:16.376 04:27:06 -- nvmf/common.sh@545 -- # IFS=, 00:25:16.376 04:27:06 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme1", 00:25:16.376 "trtype": "tcp", 00:25:16.376 "traddr": "10.0.0.2", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "4420", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:16.376 "hdgst": false, 00:25:16.376 "ddgst": false 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 },{ 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme2", 00:25:16.376 "trtype": "tcp", 00:25:16.376 "traddr": "10.0.0.2", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "4420", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:16.376 "hdgst": false, 00:25:16.376 "ddgst": false 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 },{ 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme3", 00:25:16.376 "trtype": "tcp", 00:25:16.376 "traddr": "10.0.0.2", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "4420", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:16.376 "hdgst": false, 00:25:16.376 "ddgst": false 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 },{ 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme4", 00:25:16.376 "trtype": "tcp", 00:25:16.376 "traddr": "10.0.0.2", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "4420", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:16.376 "hdgst": false, 00:25:16.376 "ddgst": false 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 },{ 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme5", 00:25:16.376 "trtype": "tcp", 00:25:16.376 "traddr": "10.0.0.2", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "4420", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:16.376 "hdgst": false, 00:25:16.376 "ddgst": false 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 },{ 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme6", 00:25:16.376 "trtype": "tcp", 00:25:16.376 "traddr": "10.0.0.2", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "4420", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:16.376 "hdgst": false, 00:25:16.376 "ddgst": false 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 },{ 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme7", 00:25:16.376 "trtype": "tcp", 00:25:16.376 "traddr": "10.0.0.2", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "4420", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:16.376 "hdgst": false, 00:25:16.376 "ddgst": false 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 },{ 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme8", 00:25:16.376 "trtype": "tcp", 00:25:16.376 "traddr": "10.0.0.2", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "4420", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:16.376 "hdgst": false, 00:25:16.376 "ddgst": false 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.376 },{ 00:25:16.376 "params": { 00:25:16.376 "name": "Nvme9", 00:25:16.376 "trtype": "tcp", 00:25:16.376 "traddr": "10.0.0.2", 00:25:16.376 "adrfam": "ipv4", 00:25:16.376 "trsvcid": "4420", 00:25:16.376 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:16.376 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:16.376 "hdgst": false, 00:25:16.376 "ddgst": false 00:25:16.376 }, 00:25:16.376 "method": "bdev_nvme_attach_controller" 00:25:16.377 },{ 00:25:16.377 "params": { 00:25:16.377 "name": "Nvme10", 00:25:16.377 "trtype": "tcp", 00:25:16.377 "traddr": "10.0.0.2", 00:25:16.377 "adrfam": "ipv4", 00:25:16.377 "trsvcid": "4420", 00:25:16.377 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:16.377 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:16.377 "hdgst": false, 00:25:16.377 "ddgst": false 00:25:16.377 }, 00:25:16.377 "method": "bdev_nvme_attach_controller" 00:25:16.377 }' 00:25:16.377 [2024-11-30 04:27:06.822824] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:16.377 [2024-11-30 04:27:06.822914] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2436665 ] 00:25:16.377 EAL: No free 2048 kB hugepages reported on node 1 00:25:16.377 [2024-11-30 04:27:06.888247] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:16.377 [2024-11-30 04:27:06.975952] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:18.275 Running I/O for 1 seconds... 00:25:19.209 00:25:19.210 Latency(us) 00:25:19.210 [2024-11-30T03:27:09.841Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:19.210 [2024-11-30T03:27:09.841Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:19.210 Verification LBA range: start 0x0 length 0x400 00:25:19.210 Nvme1n1 : 1.09 397.60 24.85 0.00 0.00 158449.81 15825.73 124275.67 00:25:19.210 [2024-11-30T03:27:09.841Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:19.210 Verification LBA range: start 0x0 length 0x400 00:25:19.210 Nvme2n1 : 1.10 396.03 24.75 0.00 0.00 157712.23 18252.99 121168.78 00:25:19.210 [2024-11-30T03:27:09.841Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:19.210 Verification LBA range: start 0x0 length 0x400 00:25:19.210 Nvme3n1 : 1.07 371.64 23.23 0.00 0.00 165428.82 39030.33 150684.25 00:25:19.210 [2024-11-30T03:27:09.841Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:19.210 Verification LBA range: start 0x0 length 0x400 00:25:19.210 Nvme4n1 : 1.10 393.33 24.58 0.00 0.00 156406.66 19320.98 130489.46 00:25:19.210 [2024-11-30T03:27:09.841Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:19.210 Verification LBA range: start 0x0 length 0x400 00:25:19.210 Nvme5n1 : 1.10 395.58 24.72 0.00 0.00 154506.46 18058.81 117285.17 00:25:19.210 [2024-11-30T03:27:09.841Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:19.210 Verification LBA range: start 0x0 length 0x400 00:25:19.210 Nvme6n1 : 1.10 395.01 24.69 0.00 0.00 153782.53 16990.81 116508.44 00:25:19.210 [2024-11-30T03:27:09.841Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:19.210 Verification LBA range: start 0x0 length 0x400 00:25:19.210 Nvme7n1 : 1.11 392.50 24.53 0.00 0.00 153490.14 18738.44 121945.51 00:25:19.210 [2024-11-30T03:27:09.841Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:19.210 Verification LBA range: start 0x0 length 0x400 00:25:19.210 Nvme8n1 : 1.11 391.05 24.44 0.00 0.00 153306.93 16117.00 124275.67 00:25:19.210 [2024-11-30T03:27:09.841Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:19.210 Verification LBA range: start 0x0 length 0x400 00:25:19.210 Nvme9n1 : 1.11 390.34 24.40 0.00 0.00 153212.46 10097.40 128159.29 00:25:19.210 [2024-11-30T03:27:09.841Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:19.210 Verification LBA range: start 0x0 length 0x400 00:25:19.210 Nvme10n1 : 1.11 389.48 24.34 0.00 0.00 152964.84 5776.88 131266.18 00:25:19.210 [2024-11-30T03:27:09.841Z] =================================================================================================================== 00:25:19.210 [2024-11-30T03:27:09.841Z] Total : 3912.56 244.53 0.00 0.00 155846.60 5776.88 150684.25 00:25:19.210 04:27:09 -- target/shutdown.sh@93 -- # stoptarget 00:25:19.210 04:27:09 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:19.210 04:27:09 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:19.210 04:27:09 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:19.210 04:27:09 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:19.210 04:27:09 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:19.210 04:27:09 -- nvmf/common.sh@116 -- # sync 00:25:19.210 04:27:09 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:19.210 04:27:09 -- nvmf/common.sh@119 -- # set +e 00:25:19.210 04:27:09 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:19.210 04:27:09 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:19.210 rmmod nvme_tcp 00:25:19.210 rmmod nvme_fabrics 00:25:19.210 rmmod nvme_keyring 00:25:19.210 04:27:09 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:19.210 04:27:09 -- nvmf/common.sh@123 -- # set -e 00:25:19.210 04:27:09 -- nvmf/common.sh@124 -- # return 0 00:25:19.210 04:27:09 -- nvmf/common.sh@477 -- # '[' -n 2436035 ']' 00:25:19.210 04:27:09 -- nvmf/common.sh@478 -- # killprocess 2436035 00:25:19.210 04:27:09 -- common/autotest_common.sh@936 -- # '[' -z 2436035 ']' 00:25:19.210 04:27:09 -- common/autotest_common.sh@940 -- # kill -0 2436035 00:25:19.210 04:27:09 -- common/autotest_common.sh@941 -- # uname 00:25:19.210 04:27:09 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:19.210 04:27:09 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2436035 00:25:19.210 04:27:09 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:19.210 04:27:09 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:19.210 04:27:09 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2436035' 00:25:19.210 killing process with pid 2436035 00:25:19.210 04:27:09 -- common/autotest_common.sh@955 -- # kill 2436035 00:25:19.210 04:27:09 -- common/autotest_common.sh@960 -- # wait 2436035 00:25:19.783 04:27:10 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:19.783 04:27:10 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:19.783 04:27:10 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:19.783 04:27:10 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:19.783 04:27:10 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:19.783 04:27:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:19.783 04:27:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:19.783 04:27:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:22.320 04:27:12 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:22.320 00:25:22.320 real 0m12.244s 00:25:22.320 user 0m35.925s 00:25:22.320 sys 0m3.208s 00:25:22.320 04:27:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:22.320 04:27:12 -- common/autotest_common.sh@10 -- # set +x 00:25:22.320 ************************************ 00:25:22.320 END TEST nvmf_shutdown_tc1 00:25:22.320 ************************************ 00:25:22.320 04:27:12 -- target/shutdown.sh@147 -- # run_test nvmf_shutdown_tc2 nvmf_shutdown_tc2 00:25:22.320 04:27:12 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:22.320 04:27:12 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:22.320 04:27:12 -- common/autotest_common.sh@10 -- # set +x 00:25:22.320 ************************************ 00:25:22.320 START TEST nvmf_shutdown_tc2 00:25:22.320 ************************************ 00:25:22.320 04:27:12 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc2 00:25:22.320 04:27:12 -- target/shutdown.sh@98 -- # starttarget 00:25:22.320 04:27:12 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:22.320 04:27:12 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:22.320 04:27:12 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:22.320 04:27:12 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:22.320 04:27:12 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:22.320 04:27:12 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:22.320 04:27:12 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:22.320 04:27:12 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:22.320 04:27:12 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:22.320 04:27:12 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:22.320 04:27:12 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:22.320 04:27:12 -- common/autotest_common.sh@10 -- # set +x 00:25:22.320 04:27:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:22.320 04:27:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:22.320 04:27:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:22.320 04:27:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:22.320 04:27:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:22.320 04:27:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:22.320 04:27:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:22.320 04:27:12 -- nvmf/common.sh@294 -- # net_devs=() 00:25:22.320 04:27:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:22.320 04:27:12 -- nvmf/common.sh@295 -- # e810=() 00:25:22.320 04:27:12 -- nvmf/common.sh@295 -- # local -ga e810 00:25:22.320 04:27:12 -- nvmf/common.sh@296 -- # x722=() 00:25:22.320 04:27:12 -- nvmf/common.sh@296 -- # local -ga x722 00:25:22.320 04:27:12 -- nvmf/common.sh@297 -- # mlx=() 00:25:22.320 04:27:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:22.320 04:27:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:22.320 04:27:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:22.320 04:27:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:22.320 04:27:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:22.320 04:27:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:22.320 04:27:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:22.320 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:22.320 04:27:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:22.320 04:27:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:22.320 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:22.320 04:27:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:22.320 04:27:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:22.320 04:27:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:22.320 04:27:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:22.320 04:27:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:22.320 04:27:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:22.320 04:27:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:22.320 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:22.320 04:27:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:22.320 04:27:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:22.320 04:27:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:22.320 04:27:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:22.320 04:27:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:22.321 04:27:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:22.321 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:22.321 04:27:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:22.321 04:27:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:22.321 04:27:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:22.321 04:27:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:22.321 04:27:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:22.321 04:27:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:22.321 04:27:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:22.321 04:27:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:22.321 04:27:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:22.321 04:27:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:22.321 04:27:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:22.321 04:27:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:22.321 04:27:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:22.321 04:27:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:22.321 04:27:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:22.321 04:27:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:22.321 04:27:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:22.321 04:27:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:22.321 04:27:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:22.321 04:27:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:22.321 04:27:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:22.321 04:27:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:22.321 04:27:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:22.321 04:27:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:22.321 04:27:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:22.321 04:27:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:22.321 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:22.321 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:25:22.321 00:25:22.321 --- 10.0.0.2 ping statistics --- 00:25:22.321 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:22.321 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:25:22.321 04:27:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:22.321 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:22.321 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.152 ms 00:25:22.321 00:25:22.321 --- 10.0.0.1 ping statistics --- 00:25:22.321 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:22.321 rtt min/avg/max/mdev = 0.152/0.152/0.152/0.000 ms 00:25:22.321 04:27:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:22.321 04:27:12 -- nvmf/common.sh@410 -- # return 0 00:25:22.321 04:27:12 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:22.321 04:27:12 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:22.321 04:27:12 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:22.321 04:27:12 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:22.321 04:27:12 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:22.321 04:27:12 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:22.321 04:27:12 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:22.321 04:27:12 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:22.321 04:27:12 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:22.321 04:27:12 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:22.321 04:27:12 -- common/autotest_common.sh@10 -- # set +x 00:25:22.321 04:27:12 -- nvmf/common.sh@469 -- # nvmfpid=2437954 00:25:22.321 04:27:12 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:22.321 04:27:12 -- nvmf/common.sh@470 -- # waitforlisten 2437954 00:25:22.321 04:27:12 -- common/autotest_common.sh@829 -- # '[' -z 2437954 ']' 00:25:22.321 04:27:12 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:22.321 04:27:12 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:22.321 04:27:12 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:22.321 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:22.321 04:27:12 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:22.321 04:27:12 -- common/autotest_common.sh@10 -- # set +x 00:25:22.321 [2024-11-30 04:27:12.641748] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:22.321 [2024-11-30 04:27:12.641842] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:22.321 EAL: No free 2048 kB hugepages reported on node 1 00:25:22.321 [2024-11-30 04:27:12.709705] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:22.321 [2024-11-30 04:27:12.796926] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:22.321 [2024-11-30 04:27:12.797115] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:22.321 [2024-11-30 04:27:12.797133] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:22.321 [2024-11-30 04:27:12.797145] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:22.321 [2024-11-30 04:27:12.797235] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:22.321 [2024-11-30 04:27:12.797285] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:22.321 [2024-11-30 04:27:12.797336] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:22.321 [2024-11-30 04:27:12.797338] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:23.255 04:27:13 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:23.255 04:27:13 -- common/autotest_common.sh@862 -- # return 0 00:25:23.255 04:27:13 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:23.255 04:27:13 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:23.255 04:27:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.255 04:27:13 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:23.255 04:27:13 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:23.255 04:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:23.255 04:27:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.255 [2024-11-30 04:27:13.647742] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:23.256 04:27:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:23.256 04:27:13 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:23.256 04:27:13 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:23.256 04:27:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:23.256 04:27:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.256 04:27:13 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:23.256 04:27:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:23.256 04:27:13 -- target/shutdown.sh@28 -- # cat 00:25:23.256 04:27:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:23.256 04:27:13 -- target/shutdown.sh@28 -- # cat 00:25:23.256 04:27:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:23.256 04:27:13 -- target/shutdown.sh@28 -- # cat 00:25:23.256 04:27:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:23.256 04:27:13 -- target/shutdown.sh@28 -- # cat 00:25:23.256 04:27:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:23.256 04:27:13 -- target/shutdown.sh@28 -- # cat 00:25:23.256 04:27:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:23.256 04:27:13 -- target/shutdown.sh@28 -- # cat 00:25:23.256 04:27:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:23.256 04:27:13 -- target/shutdown.sh@28 -- # cat 00:25:23.256 04:27:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:23.256 04:27:13 -- target/shutdown.sh@28 -- # cat 00:25:23.256 04:27:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:23.256 04:27:13 -- target/shutdown.sh@28 -- # cat 00:25:23.256 04:27:13 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:23.256 04:27:13 -- target/shutdown.sh@28 -- # cat 00:25:23.256 04:27:13 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:23.256 04:27:13 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:23.256 04:27:13 -- common/autotest_common.sh@10 -- # set +x 00:25:23.256 Malloc1 00:25:23.256 [2024-11-30 04:27:13.737093] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:23.256 Malloc2 00:25:23.256 Malloc3 00:25:23.256 Malloc4 00:25:23.514 Malloc5 00:25:23.514 Malloc6 00:25:23.514 Malloc7 00:25:23.514 Malloc8 00:25:23.514 Malloc9 00:25:23.773 Malloc10 00:25:23.773 04:27:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:23.774 04:27:14 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:23.774 04:27:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:23.774 04:27:14 -- common/autotest_common.sh@10 -- # set +x 00:25:23.774 04:27:14 -- target/shutdown.sh@102 -- # perfpid=2438145 00:25:23.774 04:27:14 -- target/shutdown.sh@103 -- # waitforlisten 2438145 /var/tmp/bdevperf.sock 00:25:23.774 04:27:14 -- common/autotest_common.sh@829 -- # '[' -z 2438145 ']' 00:25:23.774 04:27:14 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:23.774 04:27:14 -- target/shutdown.sh@101 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:23.774 04:27:14 -- target/shutdown.sh@101 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:23.774 04:27:14 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:23.774 04:27:14 -- nvmf/common.sh@520 -- # config=() 00:25:23.774 04:27:14 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:23.774 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:23.774 04:27:14 -- nvmf/common.sh@520 -- # local subsystem config 00:25:23.774 04:27:14 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:23.774 04:27:14 -- common/autotest_common.sh@10 -- # set +x 00:25:23.774 04:27:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:23.774 { 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme$subsystem", 00:25:23.774 "trtype": "$TEST_TRANSPORT", 00:25:23.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "$NVMF_PORT", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:23.774 "hdgst": ${hdgst:-false}, 00:25:23.774 "ddgst": ${ddgst:-false} 00:25:23.774 }, 00:25:23.774 "method": "bdev_nvme_attach_controller" 00:25:23.774 } 00:25:23.774 EOF 00:25:23.774 )") 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # cat 00:25:23.774 04:27:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:23.774 { 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme$subsystem", 00:25:23.774 "trtype": "$TEST_TRANSPORT", 00:25:23.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "$NVMF_PORT", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:23.774 "hdgst": ${hdgst:-false}, 00:25:23.774 "ddgst": ${ddgst:-false} 00:25:23.774 }, 00:25:23.774 "method": "bdev_nvme_attach_controller" 00:25:23.774 } 00:25:23.774 EOF 00:25:23.774 )") 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # cat 00:25:23.774 04:27:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:23.774 { 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme$subsystem", 00:25:23.774 "trtype": "$TEST_TRANSPORT", 00:25:23.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "$NVMF_PORT", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:23.774 "hdgst": ${hdgst:-false}, 00:25:23.774 "ddgst": ${ddgst:-false} 00:25:23.774 }, 00:25:23.774 "method": "bdev_nvme_attach_controller" 00:25:23.774 } 00:25:23.774 EOF 00:25:23.774 )") 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # cat 00:25:23.774 04:27:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:23.774 { 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme$subsystem", 00:25:23.774 "trtype": "$TEST_TRANSPORT", 00:25:23.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "$NVMF_PORT", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:23.774 "hdgst": ${hdgst:-false}, 00:25:23.774 "ddgst": ${ddgst:-false} 00:25:23.774 }, 00:25:23.774 "method": "bdev_nvme_attach_controller" 00:25:23.774 } 00:25:23.774 EOF 00:25:23.774 )") 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # cat 00:25:23.774 04:27:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:23.774 { 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme$subsystem", 00:25:23.774 "trtype": "$TEST_TRANSPORT", 00:25:23.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "$NVMF_PORT", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:23.774 "hdgst": ${hdgst:-false}, 00:25:23.774 "ddgst": ${ddgst:-false} 00:25:23.774 }, 00:25:23.774 "method": "bdev_nvme_attach_controller" 00:25:23.774 } 00:25:23.774 EOF 00:25:23.774 )") 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # cat 00:25:23.774 04:27:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:23.774 { 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme$subsystem", 00:25:23.774 "trtype": "$TEST_TRANSPORT", 00:25:23.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "$NVMF_PORT", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:23.774 "hdgst": ${hdgst:-false}, 00:25:23.774 "ddgst": ${ddgst:-false} 00:25:23.774 }, 00:25:23.774 "method": "bdev_nvme_attach_controller" 00:25:23.774 } 00:25:23.774 EOF 00:25:23.774 )") 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # cat 00:25:23.774 04:27:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:23.774 { 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme$subsystem", 00:25:23.774 "trtype": "$TEST_TRANSPORT", 00:25:23.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "$NVMF_PORT", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:23.774 "hdgst": ${hdgst:-false}, 00:25:23.774 "ddgst": ${ddgst:-false} 00:25:23.774 }, 00:25:23.774 "method": "bdev_nvme_attach_controller" 00:25:23.774 } 00:25:23.774 EOF 00:25:23.774 )") 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # cat 00:25:23.774 04:27:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:23.774 { 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme$subsystem", 00:25:23.774 "trtype": "$TEST_TRANSPORT", 00:25:23.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "$NVMF_PORT", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:23.774 "hdgst": ${hdgst:-false}, 00:25:23.774 "ddgst": ${ddgst:-false} 00:25:23.774 }, 00:25:23.774 "method": "bdev_nvme_attach_controller" 00:25:23.774 } 00:25:23.774 EOF 00:25:23.774 )") 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # cat 00:25:23.774 04:27:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:23.774 { 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme$subsystem", 00:25:23.774 "trtype": "$TEST_TRANSPORT", 00:25:23.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "$NVMF_PORT", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:23.774 "hdgst": ${hdgst:-false}, 00:25:23.774 "ddgst": ${ddgst:-false} 00:25:23.774 }, 00:25:23.774 "method": "bdev_nvme_attach_controller" 00:25:23.774 } 00:25:23.774 EOF 00:25:23.774 )") 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # cat 00:25:23.774 04:27:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:23.774 { 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme$subsystem", 00:25:23.774 "trtype": "$TEST_TRANSPORT", 00:25:23.774 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "$NVMF_PORT", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:23.774 "hdgst": ${hdgst:-false}, 00:25:23.774 "ddgst": ${ddgst:-false} 00:25:23.774 }, 00:25:23.774 "method": "bdev_nvme_attach_controller" 00:25:23.774 } 00:25:23.774 EOF 00:25:23.774 )") 00:25:23.774 04:27:14 -- nvmf/common.sh@542 -- # cat 00:25:23.774 04:27:14 -- nvmf/common.sh@544 -- # jq . 00:25:23.774 04:27:14 -- nvmf/common.sh@545 -- # IFS=, 00:25:23.774 04:27:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:23.774 "params": { 00:25:23.774 "name": "Nvme1", 00:25:23.774 "trtype": "tcp", 00:25:23.774 "traddr": "10.0.0.2", 00:25:23.774 "adrfam": "ipv4", 00:25:23.774 "trsvcid": "4420", 00:25:23.774 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:23.774 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:23.774 "hdgst": false, 00:25:23.775 "ddgst": false 00:25:23.775 }, 00:25:23.775 "method": "bdev_nvme_attach_controller" 00:25:23.775 },{ 00:25:23.775 "params": { 00:25:23.775 "name": "Nvme2", 00:25:23.775 "trtype": "tcp", 00:25:23.775 "traddr": "10.0.0.2", 00:25:23.775 "adrfam": "ipv4", 00:25:23.775 "trsvcid": "4420", 00:25:23.775 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:23.775 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:23.775 "hdgst": false, 00:25:23.775 "ddgst": false 00:25:23.775 }, 00:25:23.775 "method": "bdev_nvme_attach_controller" 00:25:23.775 },{ 00:25:23.775 "params": { 00:25:23.775 "name": "Nvme3", 00:25:23.775 "trtype": "tcp", 00:25:23.775 "traddr": "10.0.0.2", 00:25:23.775 "adrfam": "ipv4", 00:25:23.775 "trsvcid": "4420", 00:25:23.775 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:23.775 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:23.775 "hdgst": false, 00:25:23.775 "ddgst": false 00:25:23.775 }, 00:25:23.775 "method": "bdev_nvme_attach_controller" 00:25:23.775 },{ 00:25:23.775 "params": { 00:25:23.775 "name": "Nvme4", 00:25:23.775 "trtype": "tcp", 00:25:23.775 "traddr": "10.0.0.2", 00:25:23.775 "adrfam": "ipv4", 00:25:23.775 "trsvcid": "4420", 00:25:23.775 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:23.775 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:23.775 "hdgst": false, 00:25:23.775 "ddgst": false 00:25:23.775 }, 00:25:23.775 "method": "bdev_nvme_attach_controller" 00:25:23.775 },{ 00:25:23.775 "params": { 00:25:23.775 "name": "Nvme5", 00:25:23.775 "trtype": "tcp", 00:25:23.775 "traddr": "10.0.0.2", 00:25:23.775 "adrfam": "ipv4", 00:25:23.775 "trsvcid": "4420", 00:25:23.775 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:23.775 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:23.775 "hdgst": false, 00:25:23.775 "ddgst": false 00:25:23.775 }, 00:25:23.775 "method": "bdev_nvme_attach_controller" 00:25:23.775 },{ 00:25:23.775 "params": { 00:25:23.775 "name": "Nvme6", 00:25:23.775 "trtype": "tcp", 00:25:23.775 "traddr": "10.0.0.2", 00:25:23.775 "adrfam": "ipv4", 00:25:23.775 "trsvcid": "4420", 00:25:23.775 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:23.775 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:23.775 "hdgst": false, 00:25:23.775 "ddgst": false 00:25:23.775 }, 00:25:23.775 "method": "bdev_nvme_attach_controller" 00:25:23.775 },{ 00:25:23.775 "params": { 00:25:23.775 "name": "Nvme7", 00:25:23.775 "trtype": "tcp", 00:25:23.775 "traddr": "10.0.0.2", 00:25:23.775 "adrfam": "ipv4", 00:25:23.775 "trsvcid": "4420", 00:25:23.775 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:23.775 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:23.775 "hdgst": false, 00:25:23.775 "ddgst": false 00:25:23.775 }, 00:25:23.775 "method": "bdev_nvme_attach_controller" 00:25:23.775 },{ 00:25:23.775 "params": { 00:25:23.775 "name": "Nvme8", 00:25:23.775 "trtype": "tcp", 00:25:23.775 "traddr": "10.0.0.2", 00:25:23.775 "adrfam": "ipv4", 00:25:23.775 "trsvcid": "4420", 00:25:23.775 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:23.775 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:23.775 "hdgst": false, 00:25:23.775 "ddgst": false 00:25:23.775 }, 00:25:23.775 "method": "bdev_nvme_attach_controller" 00:25:23.775 },{ 00:25:23.775 "params": { 00:25:23.775 "name": "Nvme9", 00:25:23.775 "trtype": "tcp", 00:25:23.775 "traddr": "10.0.0.2", 00:25:23.775 "adrfam": "ipv4", 00:25:23.775 "trsvcid": "4420", 00:25:23.775 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:23.775 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:23.775 "hdgst": false, 00:25:23.775 "ddgst": false 00:25:23.775 }, 00:25:23.775 "method": "bdev_nvme_attach_controller" 00:25:23.775 },{ 00:25:23.775 "params": { 00:25:23.775 "name": "Nvme10", 00:25:23.775 "trtype": "tcp", 00:25:23.775 "traddr": "10.0.0.2", 00:25:23.775 "adrfam": "ipv4", 00:25:23.775 "trsvcid": "4420", 00:25:23.775 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:23.775 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:23.775 "hdgst": false, 00:25:23.775 "ddgst": false 00:25:23.775 }, 00:25:23.775 "method": "bdev_nvme_attach_controller" 00:25:23.775 }' 00:25:23.775 [2024-11-30 04:27:14.251367] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:23.775 [2024-11-30 04:27:14.251445] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2438145 ] 00:25:23.775 EAL: No free 2048 kB hugepages reported on node 1 00:25:23.775 [2024-11-30 04:27:14.315738] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:23.775 [2024-11-30 04:27:14.400558] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:25.673 Running I/O for 10 seconds... 00:25:25.673 04:27:16 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:25.673 04:27:16 -- common/autotest_common.sh@862 -- # return 0 00:25:25.673 04:27:16 -- target/shutdown.sh@104 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:25.673 04:27:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.673 04:27:16 -- common/autotest_common.sh@10 -- # set +x 00:25:25.673 04:27:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.673 04:27:16 -- target/shutdown.sh@106 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:25.673 04:27:16 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:25.673 04:27:16 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:25.673 04:27:16 -- target/shutdown.sh@57 -- # local ret=1 00:25:25.673 04:27:16 -- target/shutdown.sh@58 -- # local i 00:25:25.673 04:27:16 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:25.673 04:27:16 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:25.673 04:27:16 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:25.673 04:27:16 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:25.673 04:27:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.673 04:27:16 -- common/autotest_common.sh@10 -- # set +x 00:25:25.673 04:27:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.673 04:27:16 -- target/shutdown.sh@60 -- # read_io_count=42 00:25:25.673 04:27:16 -- target/shutdown.sh@63 -- # '[' 42 -ge 100 ']' 00:25:25.673 04:27:16 -- target/shutdown.sh@67 -- # sleep 0.25 00:25:25.932 04:27:16 -- target/shutdown.sh@59 -- # (( i-- )) 00:25:25.932 04:27:16 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:25.932 04:27:16 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:25.932 04:27:16 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:25.932 04:27:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:25.932 04:27:16 -- common/autotest_common.sh@10 -- # set +x 00:25:25.932 04:27:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:25.932 04:27:16 -- target/shutdown.sh@60 -- # read_io_count=167 00:25:25.932 04:27:16 -- target/shutdown.sh@63 -- # '[' 167 -ge 100 ']' 00:25:25.932 04:27:16 -- target/shutdown.sh@64 -- # ret=0 00:25:25.932 04:27:16 -- target/shutdown.sh@65 -- # break 00:25:25.932 04:27:16 -- target/shutdown.sh@69 -- # return 0 00:25:25.932 04:27:16 -- target/shutdown.sh@109 -- # killprocess 2438145 00:25:25.932 04:27:16 -- common/autotest_common.sh@936 -- # '[' -z 2438145 ']' 00:25:25.932 04:27:16 -- common/autotest_common.sh@940 -- # kill -0 2438145 00:25:25.932 04:27:16 -- common/autotest_common.sh@941 -- # uname 00:25:25.932 04:27:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:25.932 04:27:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2438145 00:25:25.932 04:27:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:25.932 04:27:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:25.932 04:27:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2438145' 00:25:25.932 killing process with pid 2438145 00:25:25.932 04:27:16 -- common/autotest_common.sh@955 -- # kill 2438145 00:25:25.932 04:27:16 -- common/autotest_common.sh@960 -- # wait 2438145 00:25:25.932 Received shutdown signal, test time was about 0.631313 seconds 00:25:25.932 00:25:25.932 Latency(us) 00:25:25.932 [2024-11-30T03:27:16.563Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:25.932 [2024-11-30T03:27:16.563Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:25.932 Verification LBA range: start 0x0 length 0x400 00:25:25.932 Nvme1n1 : 0.63 434.08 27.13 0.00 0.00 143442.63 18350.08 117285.17 00:25:25.932 [2024-11-30T03:27:16.563Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:25.932 Verification LBA range: start 0x0 length 0x400 00:25:25.932 Nvme2n1 : 0.60 382.95 23.93 0.00 0.00 160007.06 19223.89 159228.21 00:25:25.932 [2024-11-30T03:27:16.563Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:25.932 Verification LBA range: start 0x0 length 0x400 00:25:25.932 Nvme3n1 : 0.62 436.59 27.29 0.00 0.00 139831.46 9611.95 116508.44 00:25:25.932 [2024-11-30T03:27:16.563Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:25.932 Verification LBA range: start 0x0 length 0x400 00:25:25.932 Nvme4n1 : 0.62 435.39 27.21 0.00 0.00 138395.01 13883.92 114955.00 00:25:25.932 [2024-11-30T03:27:16.563Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:25.932 Verification LBA range: start 0x0 length 0x400 00:25:25.932 Nvme5n1 : 0.63 431.40 26.96 0.00 0.00 137259.19 18058.81 112624.83 00:25:25.932 [2024-11-30T03:27:16.563Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:25.932 Verification LBA range: start 0x0 length 0x400 00:25:25.932 Nvme6n1 : 0.59 384.30 24.02 0.00 0.00 151015.98 18447.17 118061.89 00:25:25.933 [2024-11-30T03:27:16.564Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:25.933 Verification LBA range: start 0x0 length 0x400 00:25:25.933 Nvme7n1 : 0.63 432.34 27.02 0.00 0.00 134033.43 14660.65 111848.11 00:25:25.933 [2024-11-30T03:27:16.564Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:25.933 Verification LBA range: start 0x0 length 0x400 00:25:25.933 Nvme8n1 : 0.60 379.46 23.72 0.00 0.00 148880.84 20000.62 121945.51 00:25:25.933 [2024-11-30T03:27:16.564Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:25.933 Verification LBA range: start 0x0 length 0x400 00:25:25.933 Nvme9n1 : 0.60 377.10 23.57 0.00 0.00 147664.66 18447.17 123498.95 00:25:25.933 [2024-11-30T03:27:16.564Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:25.933 Verification LBA range: start 0x0 length 0x400 00:25:25.933 Nvme10n1 : 0.62 369.80 23.11 0.00 0.00 149503.84 18155.90 123498.95 00:25:25.933 [2024-11-30T03:27:16.564Z] =================================================================================================================== 00:25:25.933 [2024-11-30T03:27:16.564Z] Total : 4063.42 253.96 0.00 0.00 144439.24 9611.95 159228.21 00:25:26.191 04:27:16 -- target/shutdown.sh@112 -- # sleep 1 00:25:27.564 04:27:17 -- target/shutdown.sh@113 -- # kill -0 2437954 00:25:27.564 04:27:17 -- target/shutdown.sh@115 -- # stoptarget 00:25:27.564 04:27:17 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:27.564 04:27:17 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:27.564 04:27:17 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:27.564 04:27:17 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:27.564 04:27:17 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:27.564 04:27:17 -- nvmf/common.sh@116 -- # sync 00:25:27.564 04:27:17 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:27.564 04:27:17 -- nvmf/common.sh@119 -- # set +e 00:25:27.564 04:27:17 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:27.564 04:27:17 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:27.564 rmmod nvme_tcp 00:25:27.564 rmmod nvme_fabrics 00:25:27.564 rmmod nvme_keyring 00:25:27.564 04:27:17 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:27.564 04:27:17 -- nvmf/common.sh@123 -- # set -e 00:25:27.564 04:27:17 -- nvmf/common.sh@124 -- # return 0 00:25:27.564 04:27:17 -- nvmf/common.sh@477 -- # '[' -n 2437954 ']' 00:25:27.564 04:27:17 -- nvmf/common.sh@478 -- # killprocess 2437954 00:25:27.564 04:27:17 -- common/autotest_common.sh@936 -- # '[' -z 2437954 ']' 00:25:27.564 04:27:17 -- common/autotest_common.sh@940 -- # kill -0 2437954 00:25:27.564 04:27:17 -- common/autotest_common.sh@941 -- # uname 00:25:27.564 04:27:17 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:27.564 04:27:17 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2437954 00:25:27.564 04:27:17 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:27.564 04:27:17 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:27.564 04:27:17 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2437954' 00:25:27.564 killing process with pid 2437954 00:25:27.564 04:27:17 -- common/autotest_common.sh@955 -- # kill 2437954 00:25:27.564 04:27:17 -- common/autotest_common.sh@960 -- # wait 2437954 00:25:27.822 04:27:18 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:27.822 04:27:18 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:27.822 04:27:18 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:27.822 04:27:18 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:27.822 04:27:18 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:27.822 04:27:18 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:27.822 04:27:18 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:27.822 04:27:18 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:30.419 04:27:20 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:30.419 00:25:30.419 real 0m7.977s 00:25:30.419 user 0m24.544s 00:25:30.419 sys 0m1.507s 00:25:30.419 04:27:20 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:30.419 04:27:20 -- common/autotest_common.sh@10 -- # set +x 00:25:30.419 ************************************ 00:25:30.419 END TEST nvmf_shutdown_tc2 00:25:30.419 ************************************ 00:25:30.420 04:27:20 -- target/shutdown.sh@148 -- # run_test nvmf_shutdown_tc3 nvmf_shutdown_tc3 00:25:30.420 04:27:20 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:25:30.420 04:27:20 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:30.420 04:27:20 -- common/autotest_common.sh@10 -- # set +x 00:25:30.420 ************************************ 00:25:30.420 START TEST nvmf_shutdown_tc3 00:25:30.420 ************************************ 00:25:30.420 04:27:20 -- common/autotest_common.sh@1114 -- # nvmf_shutdown_tc3 00:25:30.420 04:27:20 -- target/shutdown.sh@120 -- # starttarget 00:25:30.420 04:27:20 -- target/shutdown.sh@15 -- # nvmftestinit 00:25:30.420 04:27:20 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:30.420 04:27:20 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:30.420 04:27:20 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:30.420 04:27:20 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:30.420 04:27:20 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:30.420 04:27:20 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:30.420 04:27:20 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:30.420 04:27:20 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:30.420 04:27:20 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:30.420 04:27:20 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:30.420 04:27:20 -- common/autotest_common.sh@10 -- # set +x 00:25:30.420 04:27:20 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:30.420 04:27:20 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:30.420 04:27:20 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:30.420 04:27:20 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:30.420 04:27:20 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:30.420 04:27:20 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:30.420 04:27:20 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:30.420 04:27:20 -- nvmf/common.sh@294 -- # net_devs=() 00:25:30.420 04:27:20 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:30.420 04:27:20 -- nvmf/common.sh@295 -- # e810=() 00:25:30.420 04:27:20 -- nvmf/common.sh@295 -- # local -ga e810 00:25:30.420 04:27:20 -- nvmf/common.sh@296 -- # x722=() 00:25:30.420 04:27:20 -- nvmf/common.sh@296 -- # local -ga x722 00:25:30.420 04:27:20 -- nvmf/common.sh@297 -- # mlx=() 00:25:30.420 04:27:20 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:30.420 04:27:20 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:30.420 04:27:20 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:30.420 04:27:20 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:30.420 04:27:20 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:30.420 04:27:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:30.420 04:27:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:30.420 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:30.420 04:27:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:30.420 04:27:20 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:30.420 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:30.420 04:27:20 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:30.420 04:27:20 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:30.420 04:27:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:30.420 04:27:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:30.420 04:27:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:30.420 04:27:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:30.420 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:30.420 04:27:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:30.420 04:27:20 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:30.420 04:27:20 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:30.420 04:27:20 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:30.420 04:27:20 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:30.420 04:27:20 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:30.420 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:30.420 04:27:20 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:30.420 04:27:20 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:30.420 04:27:20 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:30.420 04:27:20 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:30.420 04:27:20 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:30.420 04:27:20 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:30.420 04:27:20 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:30.420 04:27:20 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:30.420 04:27:20 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:30.420 04:27:20 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:30.420 04:27:20 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:30.420 04:27:20 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:30.420 04:27:20 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:30.420 04:27:20 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:30.420 04:27:20 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:30.420 04:27:20 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:30.420 04:27:20 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:30.420 04:27:20 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:30.420 04:27:20 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:30.420 04:27:20 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:30.420 04:27:20 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:30.420 04:27:20 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:30.420 04:27:20 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:30.420 04:27:20 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:30.420 04:27:20 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:30.420 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:30.420 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.211 ms 00:25:30.420 00:25:30.420 --- 10.0.0.2 ping statistics --- 00:25:30.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:30.420 rtt min/avg/max/mdev = 0.211/0.211/0.211/0.000 ms 00:25:30.420 04:27:20 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:30.420 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:30.420 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.113 ms 00:25:30.420 00:25:30.420 --- 10.0.0.1 ping statistics --- 00:25:30.420 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:30.421 rtt min/avg/max/mdev = 0.113/0.113/0.113/0.000 ms 00:25:30.421 04:27:20 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:30.421 04:27:20 -- nvmf/common.sh@410 -- # return 0 00:25:30.421 04:27:20 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:30.421 04:27:20 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:30.421 04:27:20 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:30.421 04:27:20 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:30.421 04:27:20 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:30.421 04:27:20 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:30.421 04:27:20 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:30.421 04:27:20 -- target/shutdown.sh@18 -- # nvmfappstart -m 0x1E 00:25:30.421 04:27:20 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:30.421 04:27:20 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:30.421 04:27:20 -- common/autotest_common.sh@10 -- # set +x 00:25:30.421 04:27:20 -- nvmf/common.sh@469 -- # nvmfpid=2439075 00:25:30.421 04:27:20 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1E 00:25:30.421 04:27:20 -- nvmf/common.sh@470 -- # waitforlisten 2439075 00:25:30.421 04:27:20 -- common/autotest_common.sh@829 -- # '[' -z 2439075 ']' 00:25:30.421 04:27:20 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:30.421 04:27:20 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:30.421 04:27:20 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:30.421 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:30.421 04:27:20 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:30.421 04:27:20 -- common/autotest_common.sh@10 -- # set +x 00:25:30.421 [2024-11-30 04:27:20.625260] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:30.421 [2024-11-30 04:27:20.625351] [ DPDK EAL parameters: nvmf -c 0x1E --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:30.421 EAL: No free 2048 kB hugepages reported on node 1 00:25:30.421 [2024-11-30 04:27:20.693661] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:30.421 [2024-11-30 04:27:20.783307] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:30.421 [2024-11-30 04:27:20.783468] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:30.421 [2024-11-30 04:27:20.783488] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:30.421 [2024-11-30 04:27:20.783503] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:30.421 [2024-11-30 04:27:20.783594] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:30.421 [2024-11-30 04:27:20.783708] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:30.421 [2024-11-30 04:27:20.783773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:25:30.421 [2024-11-30 04:27:20.783775] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:30.986 04:27:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:30.986 04:27:21 -- common/autotest_common.sh@862 -- # return 0 00:25:30.986 04:27:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:30.986 04:27:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:30.986 04:27:21 -- common/autotest_common.sh@10 -- # set +x 00:25:30.986 04:27:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:30.986 04:27:21 -- target/shutdown.sh@20 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:30.986 04:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:30.986 04:27:21 -- common/autotest_common.sh@10 -- # set +x 00:25:31.244 [2024-11-30 04:27:21.619697] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:31.244 04:27:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:31.244 04:27:21 -- target/shutdown.sh@22 -- # num_subsystems=({1..10}) 00:25:31.244 04:27:21 -- target/shutdown.sh@24 -- # timing_enter create_subsystems 00:25:31.244 04:27:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:31.244 04:27:21 -- common/autotest_common.sh@10 -- # set +x 00:25:31.244 04:27:21 -- target/shutdown.sh@26 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:31.244 04:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:31.244 04:27:21 -- target/shutdown.sh@28 -- # cat 00:25:31.244 04:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:31.244 04:27:21 -- target/shutdown.sh@28 -- # cat 00:25:31.244 04:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:31.244 04:27:21 -- target/shutdown.sh@28 -- # cat 00:25:31.244 04:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:31.244 04:27:21 -- target/shutdown.sh@28 -- # cat 00:25:31.244 04:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:31.244 04:27:21 -- target/shutdown.sh@28 -- # cat 00:25:31.244 04:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:31.244 04:27:21 -- target/shutdown.sh@28 -- # cat 00:25:31.244 04:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:31.244 04:27:21 -- target/shutdown.sh@28 -- # cat 00:25:31.244 04:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:31.244 04:27:21 -- target/shutdown.sh@28 -- # cat 00:25:31.244 04:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:31.244 04:27:21 -- target/shutdown.sh@28 -- # cat 00:25:31.244 04:27:21 -- target/shutdown.sh@27 -- # for i in "${num_subsystems[@]}" 00:25:31.244 04:27:21 -- target/shutdown.sh@28 -- # cat 00:25:31.244 04:27:21 -- target/shutdown.sh@35 -- # rpc_cmd 00:25:31.244 04:27:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:31.244 04:27:21 -- common/autotest_common.sh@10 -- # set +x 00:25:31.244 Malloc1 00:25:31.244 [2024-11-30 04:27:21.694612] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:31.244 Malloc2 00:25:31.244 Malloc3 00:25:31.244 Malloc4 00:25:31.244 Malloc5 00:25:31.502 Malloc6 00:25:31.502 Malloc7 00:25:31.502 Malloc8 00:25:31.502 Malloc9 00:25:31.502 Malloc10 00:25:31.502 04:27:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:31.502 04:27:22 -- target/shutdown.sh@36 -- # timing_exit create_subsystems 00:25:31.502 04:27:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:31.502 04:27:22 -- common/autotest_common.sh@10 -- # set +x 00:25:31.761 04:27:22 -- target/shutdown.sh@124 -- # perfpid=2439268 00:25:31.761 04:27:22 -- target/shutdown.sh@125 -- # waitforlisten 2439268 /var/tmp/bdevperf.sock 00:25:31.761 04:27:22 -- common/autotest_common.sh@829 -- # '[' -z 2439268 ']' 00:25:31.761 04:27:22 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:31.761 04:27:22 -- target/shutdown.sh@123 -- # gen_nvmf_target_json 1 2 3 4 5 6 7 8 9 10 00:25:31.761 04:27:22 -- target/shutdown.sh@123 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -r /var/tmp/bdevperf.sock --json /dev/fd/63 -q 64 -o 65536 -w verify -t 10 00:25:31.761 04:27:22 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:31.761 04:27:22 -- nvmf/common.sh@520 -- # config=() 00:25:31.761 04:27:22 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:31.761 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:31.761 04:27:22 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:31.761 04:27:22 -- nvmf/common.sh@520 -- # local subsystem config 00:25:31.761 04:27:22 -- common/autotest_common.sh@10 -- # set +x 00:25:31.761 04:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:31.761 { 00:25:31.761 "params": { 00:25:31.761 "name": "Nvme$subsystem", 00:25:31.761 "trtype": "$TEST_TRANSPORT", 00:25:31.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:31.761 "adrfam": "ipv4", 00:25:31.761 "trsvcid": "$NVMF_PORT", 00:25:31.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:31.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:31.761 "hdgst": ${hdgst:-false}, 00:25:31.761 "ddgst": ${ddgst:-false} 00:25:31.761 }, 00:25:31.761 "method": "bdev_nvme_attach_controller" 00:25:31.761 } 00:25:31.761 EOF 00:25:31.761 )") 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # cat 00:25:31.761 04:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:31.761 { 00:25:31.761 "params": { 00:25:31.761 "name": "Nvme$subsystem", 00:25:31.761 "trtype": "$TEST_TRANSPORT", 00:25:31.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:31.761 "adrfam": "ipv4", 00:25:31.761 "trsvcid": "$NVMF_PORT", 00:25:31.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:31.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:31.761 "hdgst": ${hdgst:-false}, 00:25:31.761 "ddgst": ${ddgst:-false} 00:25:31.761 }, 00:25:31.761 "method": "bdev_nvme_attach_controller" 00:25:31.761 } 00:25:31.761 EOF 00:25:31.761 )") 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # cat 00:25:31.761 04:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:31.761 { 00:25:31.761 "params": { 00:25:31.761 "name": "Nvme$subsystem", 00:25:31.761 "trtype": "$TEST_TRANSPORT", 00:25:31.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:31.761 "adrfam": "ipv4", 00:25:31.761 "trsvcid": "$NVMF_PORT", 00:25:31.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:31.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:31.761 "hdgst": ${hdgst:-false}, 00:25:31.761 "ddgst": ${ddgst:-false} 00:25:31.761 }, 00:25:31.761 "method": "bdev_nvme_attach_controller" 00:25:31.761 } 00:25:31.761 EOF 00:25:31.761 )") 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # cat 00:25:31.761 04:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:31.761 { 00:25:31.761 "params": { 00:25:31.761 "name": "Nvme$subsystem", 00:25:31.761 "trtype": "$TEST_TRANSPORT", 00:25:31.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:31.761 "adrfam": "ipv4", 00:25:31.761 "trsvcid": "$NVMF_PORT", 00:25:31.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:31.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:31.761 "hdgst": ${hdgst:-false}, 00:25:31.761 "ddgst": ${ddgst:-false} 00:25:31.761 }, 00:25:31.761 "method": "bdev_nvme_attach_controller" 00:25:31.761 } 00:25:31.761 EOF 00:25:31.761 )") 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # cat 00:25:31.761 04:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:31.761 { 00:25:31.761 "params": { 00:25:31.761 "name": "Nvme$subsystem", 00:25:31.761 "trtype": "$TEST_TRANSPORT", 00:25:31.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:31.761 "adrfam": "ipv4", 00:25:31.761 "trsvcid": "$NVMF_PORT", 00:25:31.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:31.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:31.761 "hdgst": ${hdgst:-false}, 00:25:31.761 "ddgst": ${ddgst:-false} 00:25:31.761 }, 00:25:31.761 "method": "bdev_nvme_attach_controller" 00:25:31.761 } 00:25:31.761 EOF 00:25:31.761 )") 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # cat 00:25:31.761 04:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:31.761 { 00:25:31.761 "params": { 00:25:31.761 "name": "Nvme$subsystem", 00:25:31.761 "trtype": "$TEST_TRANSPORT", 00:25:31.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:31.761 "adrfam": "ipv4", 00:25:31.761 "trsvcid": "$NVMF_PORT", 00:25:31.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:31.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:31.761 "hdgst": ${hdgst:-false}, 00:25:31.761 "ddgst": ${ddgst:-false} 00:25:31.761 }, 00:25:31.761 "method": "bdev_nvme_attach_controller" 00:25:31.761 } 00:25:31.761 EOF 00:25:31.761 )") 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # cat 00:25:31.761 04:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:31.761 { 00:25:31.761 "params": { 00:25:31.761 "name": "Nvme$subsystem", 00:25:31.761 "trtype": "$TEST_TRANSPORT", 00:25:31.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:31.761 "adrfam": "ipv4", 00:25:31.761 "trsvcid": "$NVMF_PORT", 00:25:31.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:31.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:31.761 "hdgst": ${hdgst:-false}, 00:25:31.761 "ddgst": ${ddgst:-false} 00:25:31.761 }, 00:25:31.761 "method": "bdev_nvme_attach_controller" 00:25:31.761 } 00:25:31.761 EOF 00:25:31.761 )") 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # cat 00:25:31.761 04:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:31.761 { 00:25:31.761 "params": { 00:25:31.761 "name": "Nvme$subsystem", 00:25:31.761 "trtype": "$TEST_TRANSPORT", 00:25:31.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:31.761 "adrfam": "ipv4", 00:25:31.761 "trsvcid": "$NVMF_PORT", 00:25:31.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:31.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:31.761 "hdgst": ${hdgst:-false}, 00:25:31.761 "ddgst": ${ddgst:-false} 00:25:31.761 }, 00:25:31.761 "method": "bdev_nvme_attach_controller" 00:25:31.761 } 00:25:31.761 EOF 00:25:31.761 )") 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # cat 00:25:31.761 04:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:31.761 { 00:25:31.761 "params": { 00:25:31.761 "name": "Nvme$subsystem", 00:25:31.761 "trtype": "$TEST_TRANSPORT", 00:25:31.761 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:31.761 "adrfam": "ipv4", 00:25:31.761 "trsvcid": "$NVMF_PORT", 00:25:31.761 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:31.761 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:31.761 "hdgst": ${hdgst:-false}, 00:25:31.761 "ddgst": ${ddgst:-false} 00:25:31.761 }, 00:25:31.761 "method": "bdev_nvme_attach_controller" 00:25:31.761 } 00:25:31.761 EOF 00:25:31.761 )") 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # cat 00:25:31.761 04:27:22 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:25:31.761 04:27:22 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:25:31.761 { 00:25:31.761 "params": { 00:25:31.761 "name": "Nvme$subsystem", 00:25:31.761 "trtype": "$TEST_TRANSPORT", 00:25:31.762 "traddr": "$NVMF_FIRST_TARGET_IP", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "$NVMF_PORT", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:25:31.762 "hdgst": ${hdgst:-false}, 00:25:31.762 "ddgst": ${ddgst:-false} 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 } 00:25:31.762 EOF 00:25:31.762 )") 00:25:31.762 04:27:22 -- nvmf/common.sh@542 -- # cat 00:25:31.762 04:27:22 -- nvmf/common.sh@544 -- # jq . 00:25:31.762 04:27:22 -- nvmf/common.sh@545 -- # IFS=, 00:25:31.762 04:27:22 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:25:31.762 "params": { 00:25:31.762 "name": "Nvme1", 00:25:31.762 "trtype": "tcp", 00:25:31.762 "traddr": "10.0.0.2", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "4420", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:25:31.762 "hdgst": false, 00:25:31.762 "ddgst": false 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 },{ 00:25:31.762 "params": { 00:25:31.762 "name": "Nvme2", 00:25:31.762 "trtype": "tcp", 00:25:31.762 "traddr": "10.0.0.2", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "4420", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:25:31.762 "hdgst": false, 00:25:31.762 "ddgst": false 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 },{ 00:25:31.762 "params": { 00:25:31.762 "name": "Nvme3", 00:25:31.762 "trtype": "tcp", 00:25:31.762 "traddr": "10.0.0.2", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "4420", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode3", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host3", 00:25:31.762 "hdgst": false, 00:25:31.762 "ddgst": false 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 },{ 00:25:31.762 "params": { 00:25:31.762 "name": "Nvme4", 00:25:31.762 "trtype": "tcp", 00:25:31.762 "traddr": "10.0.0.2", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "4420", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode4", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host4", 00:25:31.762 "hdgst": false, 00:25:31.762 "ddgst": false 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 },{ 00:25:31.762 "params": { 00:25:31.762 "name": "Nvme5", 00:25:31.762 "trtype": "tcp", 00:25:31.762 "traddr": "10.0.0.2", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "4420", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode5", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host5", 00:25:31.762 "hdgst": false, 00:25:31.762 "ddgst": false 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 },{ 00:25:31.762 "params": { 00:25:31.762 "name": "Nvme6", 00:25:31.762 "trtype": "tcp", 00:25:31.762 "traddr": "10.0.0.2", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "4420", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode6", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host6", 00:25:31.762 "hdgst": false, 00:25:31.762 "ddgst": false 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 },{ 00:25:31.762 "params": { 00:25:31.762 "name": "Nvme7", 00:25:31.762 "trtype": "tcp", 00:25:31.762 "traddr": "10.0.0.2", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "4420", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode7", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host7", 00:25:31.762 "hdgst": false, 00:25:31.762 "ddgst": false 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 },{ 00:25:31.762 "params": { 00:25:31.762 "name": "Nvme8", 00:25:31.762 "trtype": "tcp", 00:25:31.762 "traddr": "10.0.0.2", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "4420", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode8", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host8", 00:25:31.762 "hdgst": false, 00:25:31.762 "ddgst": false 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 },{ 00:25:31.762 "params": { 00:25:31.762 "name": "Nvme9", 00:25:31.762 "trtype": "tcp", 00:25:31.762 "traddr": "10.0.0.2", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "4420", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode9", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host9", 00:25:31.762 "hdgst": false, 00:25:31.762 "ddgst": false 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 },{ 00:25:31.762 "params": { 00:25:31.762 "name": "Nvme10", 00:25:31.762 "trtype": "tcp", 00:25:31.762 "traddr": "10.0.0.2", 00:25:31.762 "adrfam": "ipv4", 00:25:31.762 "trsvcid": "4420", 00:25:31.762 "subnqn": "nqn.2016-06.io.spdk:cnode10", 00:25:31.762 "hostnqn": "nqn.2016-06.io.spdk:host10", 00:25:31.762 "hdgst": false, 00:25:31.762 "ddgst": false 00:25:31.762 }, 00:25:31.762 "method": "bdev_nvme_attach_controller" 00:25:31.762 }' 00:25:31.762 [2024-11-30 04:27:22.182746] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:31.762 [2024-11-30 04:27:22.182822] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2439268 ] 00:25:31.762 EAL: No free 2048 kB hugepages reported on node 1 00:25:31.762 [2024-11-30 04:27:22.247302] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:31.762 [2024-11-30 04:27:22.331888] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:33.659 Running I/O for 10 seconds... 00:25:34.237 04:27:24 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:34.237 04:27:24 -- common/autotest_common.sh@862 -- # return 0 00:25:34.237 04:27:24 -- target/shutdown.sh@126 -- # rpc_cmd -s /var/tmp/bdevperf.sock framework_wait_init 00:25:34.237 04:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.237 04:27:24 -- common/autotest_common.sh@10 -- # set +x 00:25:34.237 04:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.237 04:27:24 -- target/shutdown.sh@129 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill -9 $perfpid || true; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:34.237 04:27:24 -- target/shutdown.sh@131 -- # waitforio /var/tmp/bdevperf.sock Nvme1n1 00:25:34.237 04:27:24 -- target/shutdown.sh@50 -- # '[' -z /var/tmp/bdevperf.sock ']' 00:25:34.237 04:27:24 -- target/shutdown.sh@54 -- # '[' -z Nvme1n1 ']' 00:25:34.237 04:27:24 -- target/shutdown.sh@57 -- # local ret=1 00:25:34.237 04:27:24 -- target/shutdown.sh@58 -- # local i 00:25:34.237 04:27:24 -- target/shutdown.sh@59 -- # (( i = 10 )) 00:25:34.237 04:27:24 -- target/shutdown.sh@59 -- # (( i != 0 )) 00:25:34.237 04:27:24 -- target/shutdown.sh@60 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_get_iostat -b Nvme1n1 00:25:34.237 04:27:24 -- target/shutdown.sh@60 -- # jq -r '.bdevs[0].num_read_ops' 00:25:34.237 04:27:24 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:34.237 04:27:24 -- common/autotest_common.sh@10 -- # set +x 00:25:34.237 04:27:24 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:34.237 04:27:24 -- target/shutdown.sh@60 -- # read_io_count=211 00:25:34.237 04:27:24 -- target/shutdown.sh@63 -- # '[' 211 -ge 100 ']' 00:25:34.237 04:27:24 -- target/shutdown.sh@64 -- # ret=0 00:25:34.237 04:27:24 -- target/shutdown.sh@65 -- # break 00:25:34.237 04:27:24 -- target/shutdown.sh@69 -- # return 0 00:25:34.237 04:27:24 -- target/shutdown.sh@134 -- # killprocess 2439075 00:25:34.237 04:27:24 -- common/autotest_common.sh@936 -- # '[' -z 2439075 ']' 00:25:34.237 04:27:24 -- common/autotest_common.sh@940 -- # kill -0 2439075 00:25:34.237 04:27:24 -- common/autotest_common.sh@941 -- # uname 00:25:34.237 04:27:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:34.237 04:27:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2439075 00:25:34.237 04:27:24 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:34.237 04:27:24 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:34.237 04:27:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2439075' 00:25:34.237 killing process with pid 2439075 00:25:34.237 04:27:24 -- common/autotest_common.sh@955 -- # kill 2439075 00:25:34.237 04:27:24 -- common/autotest_common.sh@960 -- # wait 2439075 00:25:34.237 [2024-11-30 04:27:24.793398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793515] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793547] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793598] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793634] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793658] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793670] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793682] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793694] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793706] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793718] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793768] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793804] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793816] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.237 [2024-11-30 04:27:24.793828] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793840] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793851] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793863] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793875] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793898] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793910] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793947] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793967] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793982] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.793995] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794007] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794020] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794032] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794044] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794067] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794082] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794094] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794108] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794120] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794143] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794155] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794166] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794202] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794260] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794275] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794287] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.794299] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c2e90 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.795097] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.238 [2024-11-30 04:27:24.795135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.238 [2024-11-30 04:27:24.795153] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.238 [2024-11-30 04:27:24.795168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.238 [2024-11-30 04:27:24.795181] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.238 [2024-11-30 04:27:24.795194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.238 [2024-11-30 04:27:24.795208] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.238 [2024-11-30 04:27:24.795221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.238 [2024-11-30 04:27:24.795241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ac96b0 is same with the state(5) to be set 00:25:34.238 [2024-11-30 04:27:24.796580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.238 [2024-11-30 04:27:24.796608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.238 [2024-11-30 04:27:24.796640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.238 [2024-11-30 04:27:24.796656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.238 [2024-11-30 04:27:24.796673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.238 [2024-11-30 04:27:24.796689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.238 [2024-11-30 04:27:24.796704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.238 [2024-11-30 04:27:24.796719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.238 [2024-11-30 04:27:24.796734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.238 [2024-11-30 04:27:24.796749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.238 [2024-11-30 04:27:24.796764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.238 [2024-11-30 04:27:24.796777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.238 [2024-11-30 04:27:24.796792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.238 [2024-11-30 04:27:24.796808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.796824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.796838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.796854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.796867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.796883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.796896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.796912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.796926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.796941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.796955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.796990] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797046] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797135] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797338] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797592] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.239 [2024-11-30 04:27:24.797697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.239 [2024-11-30 04:27:24.797713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.797728] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.797746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.797761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.797776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.797790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.797806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.797820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.797836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.797850] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.797866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.797880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.797896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.797910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.797925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.797939] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.797955] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.797977] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.797993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798064] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798156] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798170] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798186] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798354] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798369] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798441] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798470] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798552] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.240 [2024-11-30 04:27:24.798567] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.240 [2024-11-30 04:27:24.798679] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1a993c0 was disconnected and freed. reset controller. 00:25:34.240 [2024-11-30 04:27:24.800604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.240 [2024-11-30 04:27:24.800664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.240 [2024-11-30 04:27:24.800681] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800730] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800767] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800779] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800790] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800802] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800814] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800826] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800861] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800873] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800887] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800928] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.800943] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801002] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801050] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801101] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801113] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801148] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801178] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801221] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801233] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801262] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801284] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801309] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801321] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801342] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801355] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801367] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801562] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801587] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801610] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801753] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801783] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801796] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801808] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801820] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801844] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801856] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801868] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801880] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c5600 is same with the state(5) to be set 00:25:34.241 [2024-11-30 04:27:24.801991] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:34.241 [2024-11-30 04:27:24.802043] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ac96b0 (9): Bad file descriptor 00:25:34.241 [2024-11-30 04:27:24.804932] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805035] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805052] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805064] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805076] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805089] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805109] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805123] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805135] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805147] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805159] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805205] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805223] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805235] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805247] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805259] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805280] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805327] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805339] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805445] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805516] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805629] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805641] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805653] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805664] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805676] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805688] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805795] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805807] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805819] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805831] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805855] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.805867] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3340 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.806330] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.242 [2024-11-30 04:27:24.806362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.242 [2024-11-30 04:27:24.806387] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.242 [2024-11-30 04:27:24.806402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.242 [2024-11-30 04:27:24.806416] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.242 [2024-11-30 04:27:24.806429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.242 [2024-11-30 04:27:24.806443] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.242 [2024-11-30 04:27:24.806457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.242 [2024-11-30 04:27:24.806470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c8ec50 is same with the state(5) to be set 00:25:34.242 [2024-11-30 04:27:24.807157] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:34.242 [2024-11-30 04:27:24.808589] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:34.242 [2024-11-30 04:27:24.810359] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810400] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810416] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810429] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810441] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810453] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810467] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810480] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810521] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810542] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810566] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810592] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810642] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810667] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810691] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810713] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810742] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810757] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810781] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810793] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810805] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810829] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810841] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810878] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810896] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810916] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810939] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.810997] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811025] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811091] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811115] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811131] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811144] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811156] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811168] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811203] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811215] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811227] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811273] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811297] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811311] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811323] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811334] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811346] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811357] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811368] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.811381] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c37f0 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.813822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.243 [2024-11-30 04:27:24.813881] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.813900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.813913] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.813926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.813938] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.813950] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.813970] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.813984] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.813996] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814017] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814042] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814061] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814074] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814086] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814098] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814110] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814129] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814141] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814153] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814225] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814237] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814249] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814261] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814277] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814289] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814301] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814313] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814325] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814337] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814360] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814372] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814383] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814399] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 [2024-11-30 04:27:24.814412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.244 [2024-11-30 04:27:24.814436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814449] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 [2024-11-30 04:27:24.814460] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-30 04:27:24.814473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.244 the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814488] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 [2024-11-30 04:27:24.814499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814506] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.244 [2024-11-30 04:27:24.814512] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with [2024-11-30 04:27:24.814523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:12the state(5) to be set 00:25:34.244 8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 [2024-11-30 04:27:24.814539] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814541] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.244 [2024-11-30 04:27:24.814551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 [2024-11-30 04:27:24.814563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.244 [2024-11-30 04:27:24.814575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814588] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with [2024-11-30 04:27:24.814589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128the state(5) to be set 00:25:34.244 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 [2024-11-30 04:27:24.814605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with [2024-11-30 04:27:24.814606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cthe state(5) to be set 00:25:34.244 dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.244 [2024-11-30 04:27:24.814619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814623] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 [2024-11-30 04:27:24.814632] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.244 [2024-11-30 04:27:24.814644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29824 len:128[2024-11-30 04:27:24.814657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 c[2024-11-30 04:27:24.814671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with dw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.244 the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c3c80 is same with the state(5) to be set 00:25:34.244 [2024-11-30 04:27:24.814689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 [2024-11-30 04:27:24.814703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.244 [2024-11-30 04:27:24.814719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 [2024-11-30 04:27:24.814733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.244 [2024-11-30 04:27:24.814749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.244 [2024-11-30 04:27:24.814762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.814778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.814791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.814807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.814820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.814836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.814849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.814864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.814884] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.814901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.814915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.814931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.814945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.814969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.814986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815002] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815537] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815643] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815673] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:19 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815864] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.245 [2024-11-30 04:27:24.815969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.245 [2024-11-30 04:27:24.815985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816017] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816111] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816140] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816227] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816295] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.246 [2024-11-30 04:27:24.816384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816380] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816400] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c4a210 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816417] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816433] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816446] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816457] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816469] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816481] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816492] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816495] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1c4a210 was disconnected and freed. reset controller. 00:25:34.246 [2024-11-30 04:27:24.816504] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816517] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816528] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816540] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816551] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816563] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816574] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816586] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816597] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816609] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816626] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816640] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4130 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.816928] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.816951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.816976] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.816991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.817005] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.817022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.817041] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.817054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.817067] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad6d30 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.817113] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.817133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.817148] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.817161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.817175] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.817188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.817202] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.817215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.817227] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeba30 is same with the state(5) to be set 00:25:34.246 [2024-11-30 04:27:24.817270] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.817290] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.817305] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.817319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.817342] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.246 [2024-11-30 04:27:24.817366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.246 [2024-11-30 04:27:24.817382] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.247 [2024-11-30 04:27:24.817395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.247 [2024-11-30 04:27:24.817408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c90100 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817449] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.247 [2024-11-30 04:27:24.817468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.247 [2024-11-30 04:27:24.817483] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.247 [2024-11-30 04:27:24.817497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.247 [2024-11-30 04:27:24.817516] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.247 [2024-11-30 04:27:24.817531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.247 [2024-11-30 04:27:24.817545] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.247 [2024-11-30 04:27:24.817558] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.247 [2024-11-30 04:27:24.817559] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with [2024-11-30 04:27:24.817570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c6ac80 is same the state(5) to be set 00:25:34.247 with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817591] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817606] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817607] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c8ec50 (9): Bad file descriptor 00:25:34.247 [2024-11-30 04:27:24.817618] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817631] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817662] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817675] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817746] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817758] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817770] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.817817] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c44b0 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.818892] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.818927] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.818942] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.818954] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.818976] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.818989] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819023] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819046] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819057] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819073] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819116] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819139] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819161] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819174] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819187] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819190] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:34.247 [2024-11-30 04:27:24.819206] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819225] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c90100 (9): Bad file descriptor 00:25:34.247 [2024-11-30 04:27:24.819229] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819251] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819295] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819307] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819320] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819332] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819349] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819362] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819374] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819386] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819398] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819410] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819422] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819435] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819447] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819458] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819470] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819482] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.247 [2024-11-30 04:27:24.819494] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819555] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819578] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819602] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819620] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819645] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819657] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819673] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819686] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819698] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819709] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819722] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819734] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819750] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819762] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819774] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819786] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819798] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819822] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819834] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.819846] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4960 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.820492] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:34.248 [2024-11-30 04:27:24.820977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821015] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821029] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821033] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:34.248 [2024-11-30 04:27:24.821041] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821056] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821068] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821080] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821104] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821102] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:34.248 [2024-11-30 04:27:24.821117] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821142] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821154] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821165] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821189] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821207] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821220] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821232] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821244] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821256] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821296] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821310] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821322] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821351] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821377] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821389] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821401] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821412] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821424] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821448] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821461] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821473] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821485] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821498] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821510] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821538] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821552] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821564] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821576] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821604] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821635] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821647] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821659] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821684] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821696] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821708] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821720] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821744] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821773] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821789] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821801] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.248 [2024-11-30 04:27:24.821813] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.821825] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.821838] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.821849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.821862] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.821874] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c4df0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.821903] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:34.249 [2024-11-30 04:27:24.822671] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822702] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822716] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822728] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822740] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822752] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822769] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822782] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822794] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822806] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822818] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822830] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822842] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822854] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822877] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822889] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822900] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.822923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x10c52a0 is same with the state(5) to be set 00:25:34.249 [2024-11-30 04:27:24.823011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823218] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823411] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823532] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823562] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823611] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.249 [2024-11-30 04:27:24.823642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.249 [2024-11-30 04:27:24.823656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823687] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823745] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:52 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.823980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.823996] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824199] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824230] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824274] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:28 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824431] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824477] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.250 [2024-11-30 04:27:24.824676] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.250 [2024-11-30 04:27:24.824692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.824707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.824723] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.824737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.824752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.824767] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.824786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.824801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.824817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.824832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.824847] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.824862] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.824878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.824893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.824909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.824923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.824938] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:36 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.824953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.824977] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.824993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.825013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.825027] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.825042] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ab5160 is same with the state(5) to be set 00:25:34.251 [2024-11-30 04:27:24.825116] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x1ab5160 was disconnected and freed. reset controller. 00:25:34.251 [2024-11-30 04:27:24.825241] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:3 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:25:34.251 [2024-11-30 04:27:24.825273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.825288] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ac96b0 is same with the state(5) to be set 00:25:34.251 [2024-11-30 04:27:24.825308] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ac96b0 (9): Bad file descriptor 00:25:34.251 [2024-11-30 04:27:24.826528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:34.251 [2024-11-30 04:27:24.826596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b1e070 (9): Bad file descriptor 00:25:34.251 [2024-11-30 04:27:24.826771] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:34.251 [2024-11-30 04:27:24.826794] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:34.251 [2024-11-30 04:27:24.826817] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:34.251 [2024-11-30 04:27:24.827198] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.251 [2024-11-30 04:27:24.827363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.251 [2024-11-30 04:27:24.827470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.251 [2024-11-30 04:27:24.827497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b1e070 with addr=10.0.0.2, port=4420 00:25:34.251 [2024-11-30 04:27:24.827514] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b1e070 is same with the state(5) to be set 00:25:34.251 [2024-11-30 04:27:24.827533] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c90100 (9): Bad file descriptor 00:25:34.251 [2024-11-30 04:27:24.827577] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.827621] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.827641] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.827654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.827668] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.827681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.827695] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.827707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.827720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c7f700 is same with the state(5) to be set 00:25:34.251 [2024-11-30 04:27:24.827769] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.827789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.827804] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.827818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.827832] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.827845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.827859] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.827872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.827884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c7a660 is same with the state(5) to be set 00:25:34.251 [2024-11-30 04:27:24.827911] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ad6d30 (9): Bad file descriptor 00:25:34.251 [2024-11-30 04:27:24.827940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1aeba30 (9): Bad file descriptor 00:25:34.251 [2024-11-30 04:27:24.827985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c6ac80 (9): Bad file descriptor 00:25:34.251 [2024-11-30 04:27:24.828051] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.828071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.828086] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.828099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.828114] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.828127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.828140] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:25:34.251 [2024-11-30 04:27:24.828153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.828165] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b20650 is same with the state(5) to be set 00:25:34.251 [2024-11-30 04:27:24.828300] nvme_tcp.c:1159:nvme_tcp_pdu_ch_handle: *ERROR*: Unexpected PDU type 0x00 00:25:34.251 [2024-11-30 04:27:24.828350] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b1e070 (9): Bad file descriptor 00:25:34.251 [2024-11-30 04:27:24.828373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:34.251 [2024-11-30 04:27:24.828385] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:34.251 [2024-11-30 04:27:24.828398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:34.251 [2024-11-30 04:27:24.828507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.828528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.828549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.828564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.828580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.251 [2024-11-30 04:27:24.828594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.251 [2024-11-30 04:27:24.828610] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828670] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828809] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828884] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828956] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.828980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.828995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829011] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829040] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829414] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829429] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829491] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829505] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829521] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829534] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.252 [2024-11-30 04:27:24.829550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.252 [2024-11-30 04:27:24.829563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829623] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829639] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829668] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829726] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829755] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829784] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829889] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.829968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.829984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830029] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830130] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:54 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830301] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830360] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.253 [2024-11-30 04:27:24.830432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.253 [2024-11-30 04:27:24.830446] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ab7d20 is same with the state(5) to be set 00:25:34.253 [2024-11-30 04:27:24.832128] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.253 [2024-11-30 04:27:24.832155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:34.253 [2024-11-30 04:27:24.832188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:34.253 [2024-11-30 04:27:24.832204] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:34.253 [2024-11-30 04:27:24.832218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:34.253 [2024-11-30 04:27:24.832329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.253 [2024-11-30 04:27:24.832464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.253 [2024-11-30 04:27:24.832563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.253 [2024-11-30 04:27:24.832587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c8ec50 with addr=10.0.0.2, port=4420 00:25:34.253 [2024-11-30 04:27:24.832604] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c8ec50 is same with the state(5) to be set 00:25:34.253 [2024-11-30 04:27:24.832928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:34.253 [2024-11-30 04:27:24.832974] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c8ec50 (9): Bad file descriptor 00:25:34.253 [2024-11-30 04:27:24.833124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.253 [2024-11-30 04:27:24.833248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.253 [2024-11-30 04:27:24.833277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c90100 with addr=10.0.0.2, port=4420 00:25:34.253 [2024-11-30 04:27:24.833293] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c90100 is same with the state(5) to be set 00:25:34.253 [2024-11-30 04:27:24.833308] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:34.253 [2024-11-30 04:27:24.833320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:34.253 [2024-11-30 04:27:24.833333] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:34.253 [2024-11-30 04:27:24.833399] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.253 [2024-11-30 04:27:24.833421] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c90100 (9): Bad file descriptor 00:25:34.253 [2024-11-30 04:27:24.833473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:34.253 [2024-11-30 04:27:24.833490] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:34.253 [2024-11-30 04:27:24.833504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:34.253 [2024-11-30 04:27:24.833556] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.254 [2024-11-30 04:27:24.835331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:34.254 [2024-11-30 04:27:24.835487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.254 [2024-11-30 04:27:24.835586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.254 [2024-11-30 04:27:24.835610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ac96b0 with addr=10.0.0.2, port=4420 00:25:34.254 [2024-11-30 04:27:24.835627] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ac96b0 is same with the state(5) to be set 00:25:34.254 [2024-11-30 04:27:24.835681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ac96b0 (9): Bad file descriptor 00:25:34.254 [2024-11-30 04:27:24.835734] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:34.254 [2024-11-30 04:27:24.835751] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:34.254 [2024-11-30 04:27:24.835764] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:34.254 [2024-11-30 04:27:24.835818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.254 [2024-11-30 04:27:24.836873] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:34.254 [2024-11-30 04:27:24.837015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.254 [2024-11-30 04:27:24.837118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.254 [2024-11-30 04:27:24.837144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b1e070 with addr=10.0.0.2, port=4420 00:25:34.254 [2024-11-30 04:27:24.837162] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b1e070 is same with the state(5) to be set 00:25:34.254 [2024-11-30 04:27:24.837217] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b1e070 (9): Bad file descriptor 00:25:34.254 [2024-11-30 04:27:24.837279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:34.254 [2024-11-30 04:27:24.837296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:34.254 [2024-11-30 04:27:24.837309] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:34.254 [2024-11-30 04:27:24.837334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c7f700 (9): Bad file descriptor 00:25:34.254 [2024-11-30 04:27:24.837367] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c7a660 (9): Bad file descriptor 00:25:34.254 [2024-11-30 04:27:24.837420] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b20650 (9): Bad file descriptor 00:25:34.254 [2024-11-30 04:27:24.837496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.254 [2024-11-30 04:27:24.837581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29312 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837648] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29568 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837711] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837741] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24320 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837771] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24448 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:24576 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837831] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837846] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837912] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:30080 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837942] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:24960 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.837955] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.837987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:25088 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838002] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838017] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:25600 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838047] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:25984 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:30208 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838107] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:30336 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838137] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30464 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838212] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838229] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:30848 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30976 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838293] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:31104 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31232 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:31360 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:27 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:31616 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:31744 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.254 [2024-11-30 04:27:24.838457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.254 [2024-11-30 04:27:24.838473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:32000 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838533] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:32128 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838563] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:58 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:32384 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838686] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838776] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:33152 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:33280 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:33536 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838926] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:26496 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838940] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838962] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:26624 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.838978] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.838995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:26880 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:27008 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:27392 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:27520 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33792 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:34048 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:34176 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:27776 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:34432 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:27904 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:28288 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:28416 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:28672 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:28800 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:28928 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:26 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.839555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.255 [2024-11-30 04:27:24.839569] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c3de10 is same with the state(5) to be set 00:25:34.255 [2024-11-30 04:27:24.840814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.255 [2024-11-30 04:27:24.840838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.840858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.840874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.840890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.840904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.840921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.840936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.840952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.840975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.840991] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841280] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841415] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841582] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841612] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.256 [2024-11-30 04:27:24.841730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.256 [2024-11-30 04:27:24.841746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.841760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.841775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.841789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.841805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.841819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.841839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.841853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.841869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.841883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.841899] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.841913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.841928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.841941] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.841963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.841979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.841995] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842084] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842098] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842143] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842173] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842187] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842203] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842237] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:24 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842250] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842266] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:25 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842356] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842385] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:41 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842443] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842456] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842485] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842544] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842559] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:61 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842591] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.257 [2024-11-30 04:27:24.842606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.257 [2024-11-30 04:27:24.842621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.842635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.842650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.842664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.842680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.842693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.842709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.842722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.842738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.842752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.842766] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aafa70 is same with the state(5) to be set 00:25:34.258 [2024-11-30 04:27:24.843992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844308] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844426] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844455] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844485] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844544] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.258 [2024-11-30 04:27:24.844622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.258 [2024-11-30 04:27:24.844637] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ab0fc0 is same with the state(5) to be set 00:25:34.258 [2024-11-30 04:27:24.845684] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:34.258 [2024-11-30 04:27:24.845713] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:34.258 [2024-11-30 04:27:24.845730] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:34.258 [2024-11-30 04:27:24.846133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.846245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.846270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad6d30 with addr=10.0.0.2, port=4420 00:25:34.258 [2024-11-30 04:27:24.846287] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad6d30 is same with the state(5) to be set 00:25:34.258 [2024-11-30 04:27:24.846379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.846466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.846491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1aeba30 with addr=10.0.0.2, port=4420 00:25:34.258 [2024-11-30 04:27:24.846507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeba30 is same with the state(5) to be set 00:25:34.258 [2024-11-30 04:27:24.846591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.846684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.846708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c6ac80 with addr=10.0.0.2, port=4420 00:25:34.258 [2024-11-30 04:27:24.846724] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c6ac80 is same with the state(5) to be set 00:25:34.258 [2024-11-30 04:27:24.847542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:34.258 [2024-11-30 04:27:24.847570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:34.258 [2024-11-30 04:27:24.847589] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:34.258 [2024-11-30 04:27:24.847632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ad6d30 (9): Bad file descriptor 00:25:34.258 [2024-11-30 04:27:24.847654] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1aeba30 (9): Bad file descriptor 00:25:34.258 [2024-11-30 04:27:24.847672] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c6ac80 (9): Bad file descriptor 00:25:34.258 [2024-11-30 04:27:24.847876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.848020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.848047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c8ec50 with addr=10.0.0.2, port=4420 00:25:34.258 [2024-11-30 04:27:24.848074] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c8ec50 is same with the state(5) to be set 00:25:34.258 [2024-11-30 04:27:24.848155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.848249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.848277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c90100 with addr=10.0.0.2, port=4420 00:25:34.258 [2024-11-30 04:27:24.848292] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c90100 is same with the state(5) to be set 00:25:34.258 [2024-11-30 04:27:24.848371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.848457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.258 [2024-11-30 04:27:24.848483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ac96b0 with addr=10.0.0.2, port=4420 00:25:34.259 [2024-11-30 04:27:24.848499] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ac96b0 is same with the state(5) to be set 00:25:34.259 [2024-11-30 04:27:24.848514] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:34.259 [2024-11-30 04:27:24.848526] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:34.259 [2024-11-30 04:27:24.848542] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:34.259 [2024-11-30 04:27:24.848561] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:34.259 [2024-11-30 04:27:24.848575] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:34.259 [2024-11-30 04:27:24.848588] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:34.259 [2024-11-30 04:27:24.848605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:34.259 [2024-11-30 04:27:24.848619] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:34.259 [2024-11-30 04:27:24.848631] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:34.259 [2024-11-30 04:27:24.848717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.848738] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.848760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.848776] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.848792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.848806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.848822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.848836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.848851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.848865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.848887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.848902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.848917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.848931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.848947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.848968] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.848986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849000] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849059] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849088] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849118] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849134] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849269] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.849360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.849374] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ab25a0 is same with the state(5) to be set 00:25:34.259 [2024-11-30 04:27:24.850427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:34816 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.850452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.850472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:5 nsid:1 lba:34944 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.850488] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.850505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:35072 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.850519] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.850534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:35200 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.850548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.850564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.850578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.850594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.850608] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.850624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.850638] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.850654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.850668] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.850683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.850702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.259 [2024-11-30 04:27:24.850718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.259 [2024-11-30 04:27:24.850732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.850748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.850762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.850777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.850791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.850807] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.850820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.850836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.850849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.850865] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.850879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.850894] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.850908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.850924] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.850937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.850953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.850979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.850996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851088] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:35328 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:35456 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:9 nsid:1 lba:35584 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:35712 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:35840 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:35968 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851373] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:36096 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851402] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:36224 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:36352 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:42 nsid:1 lba:36480 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:36608 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:36736 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851571] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:36864 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:36992 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.260 [2024-11-30 04:27:24.851631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:37120 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.260 [2024-11-30 04:27:24.851645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:37248 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:37376 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:37504 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851734] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:37632 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:37760 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:43 nsid:1 lba:37888 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:63 nsid:1 lba:38016 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851857] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:38144 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:38272 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851933] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:38400 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.851968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:38528 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.851984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:38656 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:38784 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:38912 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:39040 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:39168 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:39296 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:59 nsid:1 lba:39424 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:39552 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852241] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:39680 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852256] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:39808 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852302] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:39936 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852331] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:40064 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:40192 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.852375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.852389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ab3b80 is same with the state(5) to be set 00:25:34.261 [2024-11-30 04:27:24.853583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:29184 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.853605] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.853625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:29440 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.853640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.853657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:29696 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.853672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.853687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:29824 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.853702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.853718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:29952 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.853732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.261 [2024-11-30 04:27:24.853747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:30592 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.261 [2024-11-30 04:27:24.853761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.853777] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:30720 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.853795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.853812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:31488 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.853827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.853842] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:31872 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.853856] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.853872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:32256 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.853886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.853902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:32512 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.853916] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.853931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:32640 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.853946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.853975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:32768 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.853991] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.854007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:32896 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.854023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.854039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:33024 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.854054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.854070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:33408 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.854084] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.854099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:33664 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.854113] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.854129] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:33920 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.854143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.854159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:34304 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.854173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.854188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:34560 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.854206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.854223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:34688 len:128 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:25:34.262 [2024-11-30 04:27:24.854237] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:25:34.262 [2024-11-30 04:27:24.854252] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ab6740 is same with the state(5) to be set 00:25:34.525 [2024-11-30 04:27:24.855621] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode8] resetting controller 00:25:34.525 [2024-11-30 04:27:24.855654] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.525 [2024-11-30 04:27:24.855670] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.525 [2024-11-30 04:27:24.855682] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.525 [2024-11-30 04:27:24.855694] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode6] resetting controller 00:25:34.525 [2024-11-30 04:27:24.855710] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode7] resetting controller 00:25:34.525 [2024-11-30 04:27:24.855775] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c8ec50 (9): Bad file descriptor 00:25:34.525 [2024-11-30 04:27:24.855800] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c90100 (9): Bad file descriptor 00:25:34.525 [2024-11-30 04:27:24.855819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ac96b0 (9): Bad file descriptor 00:25:34.525 task offset: 34816 on job bdev=Nvme1n1 fails 00:25:34.525 00:25:34.525 Latency(us) 00:25:34.525 [2024-11-30T03:27:25.156Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:34.525 [2024-11-30T03:27:25.156Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:34.525 [2024-11-30T03:27:25.156Z] Job: Nvme1n1 ended in about 0.77 seconds with error 00:25:34.525 Verification LBA range: start 0x0 length 0x400 00:25:34.525 Nvme1n1 : 0.77 325.83 20.36 83.08 0.00 155475.59 46409.20 138256.69 00:25:34.525 [2024-11-30T03:27:25.156Z] Job: Nvme2n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:34.525 [2024-11-30T03:27:25.156Z] Job: Nvme2n1 ended in about 0.81 seconds with error 00:25:34.525 Verification LBA range: start 0x0 length 0x400 00:25:34.525 Nvme2n1 : 0.81 256.80 16.05 79.01 0.00 187621.43 104857.60 177869.56 00:25:34.525 [2024-11-30T03:27:25.156Z] Job: Nvme3n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:34.525 [2024-11-30T03:27:25.156Z] Job: Nvme3n1 ended in about 0.79 seconds with error 00:25:34.525 Verification LBA range: start 0x0 length 0x400 00:25:34.525 Nvme3n1 : 0.79 318.49 19.91 81.21 0.00 156051.66 53205.52 135926.52 00:25:34.525 [2024-11-30T03:27:25.156Z] Job: Nvme4n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:34.525 [2024-11-30T03:27:25.156Z] Job: Nvme4n1 ended in about 0.81 seconds with error 00:25:34.525 Verification LBA range: start 0x0 length 0x400 00:25:34.526 Nvme4n1 : 0.81 308.67 19.29 78.71 0.00 159572.18 68351.62 135149.80 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme5n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme5n1 ended in about 0.81 seconds with error 00:25:34.526 Verification LBA range: start 0x0 length 0x400 00:25:34.526 Nvme5n1 : 0.81 308.04 19.25 25.77 0.00 177986.28 34758.35 168548.88 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme6n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme6n1 ended in about 0.82 seconds with error 00:25:34.526 Verification LBA range: start 0x0 length 0x400 00:25:34.526 Nvme6n1 : 0.82 306.26 19.14 25.62 0.00 176017.35 43690.67 147577.36 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme7n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme7n1 ended in about 0.82 seconds with error 00:25:34.526 Verification LBA range: start 0x0 length 0x400 00:25:34.526 Nvme7n1 : 0.82 305.08 19.07 77.79 0.00 157063.25 67574.90 134373.07 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme8n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme8n1 ended in about 0.80 seconds with error 00:25:34.526 Verification LBA range: start 0x0 length 0x400 00:25:34.526 Nvme8n1 : 0.80 315.42 19.71 80.43 0.00 150099.25 30680.56 147577.36 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme9n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme9n1 ended in about 0.82 seconds with error 00:25:34.526 Verification LBA range: start 0x0 length 0x400 00:25:34.526 Nvme9n1 : 0.82 304.45 19.03 25.47 0.00 172417.15 40777.96 141363.58 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme10n1 (Core Mask 0x1, workload: verify, depth: 64, IO size: 65536) 00:25:34.526 [2024-11-30T03:27:25.157Z] Job: Nvme10n1 ended in about 0.80 seconds with error 00:25:34.526 Verification LBA range: start 0x0 length 0x400 00:25:34.526 Nvme10n1 : 0.80 262.22 16.39 79.91 0.00 170297.57 14175.19 139810.13 00:25:34.526 [2024-11-30T03:27:25.157Z] =================================================================================================================== 00:25:34.526 [2024-11-30T03:27:25.157Z] Total : 3011.26 188.20 637.01 0.00 165486.39 14175.19 177869.56 00:25:34.526 [2024-11-30 04:27:24.884541] app.c: 910:spdk_app_stop: *WARNING*: spdk_app_stop'd on non-zero 00:25:34.526 [2024-11-30 04:27:24.884622] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode9] resetting controller 00:25:34.526 [2024-11-30 04:27:24.884908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.885063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.885091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b1e070 with addr=10.0.0.2, port=4420 00:25:34.526 [2024-11-30 04:27:24.885111] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b1e070 is same with the state(5) to be set 00:25:34.526 [2024-11-30 04:27:24.885255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.885344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.885370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c7a660 with addr=10.0.0.2, port=4420 00:25:34.526 [2024-11-30 04:27:24.885386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c7a660 is same with the state(5) to be set 00:25:34.526 [2024-11-30 04:27:24.885478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.885570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.885596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c7f700 with addr=10.0.0.2, port=4420 00:25:34.526 [2024-11-30 04:27:24.885612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c7f700 is same with the state(5) to be set 00:25:34.526 [2024-11-30 04:27:24.885628] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.885641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.885657] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:34.526 [2024-11-30 04:27:24.885684] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.885699] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.885713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:34.526 [2024-11-30 04:27:24.885731] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.885745] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.885771] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:34.526 [2024-11-30 04:27:24.886691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.886719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.886732] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.886867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.886973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.887007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1b20650 with addr=10.0.0.2, port=4420 00:25:34.526 [2024-11-30 04:27:24.887024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1b20650 is same with the state(5) to be set 00:25:34.526 [2024-11-30 04:27:24.887050] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b1e070 (9): Bad file descriptor 00:25:34.526 [2024-11-30 04:27:24.887073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c7a660 (9): Bad file descriptor 00:25:34.526 [2024-11-30 04:27:24.887092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c7f700 (9): Bad file descriptor 00:25:34.526 [2024-11-30 04:27:24.887156] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:34.526 [2024-11-30 04:27:24.887181] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:34.526 [2024-11-30 04:27:24.887200] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:34.526 [2024-11-30 04:27:24.887219] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:34.526 [2024-11-30 04:27:24.887238] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:34.526 [2024-11-30 04:27:24.887257] bdev_nvme.c:2867:bdev_nvme_failover_ctrlr_unsafe: *NOTICE*: Unable to perform failover, already in progress. 00:25:34.526 [2024-11-30 04:27:24.887316] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode5] resetting controller 00:25:34.526 [2024-11-30 04:27:24.887340] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode4] resetting controller 00:25:34.526 [2024-11-30 04:27:24.887356] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode2] resetting controller 00:25:34.526 [2024-11-30 04:27:24.887425] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1b20650 (9): Bad file descriptor 00:25:34.526 [2024-11-30 04:27:24.887447] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode8] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.887460] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode8] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.887474] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode8] in failed state. 00:25:34.526 [2024-11-30 04:27:24.887490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode6] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.887504] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode6] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.887517] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode6] in failed state. 00:25:34.526 [2024-11-30 04:27:24.887535] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode7] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.887548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode7] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.887561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode7] in failed state. 00:25:34.526 [2024-11-30 04:27:24.887633] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:25:34.526 [2024-11-30 04:27:24.887663] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode3] resetting controller 00:25:34.526 [2024-11-30 04:27:24.887680] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode10] resetting controller 00:25:34.526 [2024-11-30 04:27:24.887695] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.887708] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.887719] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.887825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.887914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.887938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c6ac80 with addr=10.0.0.2, port=4420 00:25:34.526 [2024-11-30 04:27:24.887954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c6ac80 is same with the state(5) to be set 00:25:34.526 [2024-11-30 04:27:24.888062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.888147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.888173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1aeba30 with addr=10.0.0.2, port=4420 00:25:34.526 [2024-11-30 04:27:24.888189] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1aeba30 is same with the state(5) to be set 00:25:34.526 [2024-11-30 04:27:24.888285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.888380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.888406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ad6d30 with addr=10.0.0.2, port=4420 00:25:34.526 [2024-11-30 04:27:24.888421] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ad6d30 is same with the state(5) to be set 00:25:34.526 [2024-11-30 04:27:24.888435] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode9] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.888448] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode9] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.888461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode9] in failed state. 00:25:34.526 [2024-11-30 04:27:24.888500] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.888589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.888671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.888697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ac96b0 with addr=10.0.0.2, port=4420 00:25:34.526 [2024-11-30 04:27:24.888713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ac96b0 is same with the state(5) to be set 00:25:34.526 [2024-11-30 04:27:24.888802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.888895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.888921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c90100 with addr=10.0.0.2, port=4420 00:25:34.526 [2024-11-30 04:27:24.888937] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c90100 is same with the state(5) to be set 00:25:34.526 [2024-11-30 04:27:24.889033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.889124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:25:34.526 [2024-11-30 04:27:24.889149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1c8ec50 with addr=10.0.0.2, port=4420 00:25:34.526 [2024-11-30 04:27:24.889169] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1c8ec50 is same with the state(5) to be set 00:25:34.526 [2024-11-30 04:27:24.889189] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c6ac80 (9): Bad file descriptor 00:25:34.526 [2024-11-30 04:27:24.889208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1aeba30 (9): Bad file descriptor 00:25:34.526 [2024-11-30 04:27:24.889233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ad6d30 (9): Bad file descriptor 00:25:34.526 [2024-11-30 04:27:24.889286] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ac96b0 (9): Bad file descriptor 00:25:34.526 [2024-11-30 04:27:24.889309] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c90100 (9): Bad file descriptor 00:25:34.526 [2024-11-30 04:27:24.889327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1c8ec50 (9): Bad file descriptor 00:25:34.526 [2024-11-30 04:27:24.889342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode5] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.889354] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode5] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.889368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode5] in failed state. 00:25:34.526 [2024-11-30 04:27:24.889384] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode4] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.889398] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode4] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.889410] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode4] in failed state. 00:25:34.526 [2024-11-30 04:27:24.889424] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode2] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.889438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode2] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.889450] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode2] in failed state. 00:25:34.526 [2024-11-30 04:27:24.889488] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.889505] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.889517] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.889529] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.889541] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.889554] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:25:34.526 [2024-11-30 04:27:24.889569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode3] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.889582] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode3] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.889595] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode3] in failed state. 00:25:34.526 [2024-11-30 04:27:24.889610] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode10] Ctrlr is in error state 00:25:34.526 [2024-11-30 04:27:24.889623] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode10] controller reinitialization failed 00:25:34.526 [2024-11-30 04:27:24.889636] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode10] in failed state. 00:25:34.526 [2024-11-30 04:27:24.889671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.889688] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.526 [2024-11-30 04:27:24.889704] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:25:34.784 04:27:25 -- target/shutdown.sh@135 -- # nvmfpid= 00:25:34.784 04:27:25 -- target/shutdown.sh@138 -- # sleep 1 00:25:35.718 04:27:26 -- target/shutdown.sh@141 -- # kill -9 2439268 00:25:35.718 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/shutdown.sh: line 141: kill: (2439268) - No such process 00:25:35.718 04:27:26 -- target/shutdown.sh@141 -- # true 00:25:35.718 04:27:26 -- target/shutdown.sh@143 -- # stoptarget 00:25:35.718 04:27:26 -- target/shutdown.sh@41 -- # rm -f ./local-job0-0-verify.state 00:25:35.718 04:27:26 -- target/shutdown.sh@42 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/bdevperf.conf 00:25:35.718 04:27:26 -- target/shutdown.sh@43 -- # rm -rf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/rpcs.txt 00:25:35.718 04:27:26 -- target/shutdown.sh@45 -- # nvmftestfini 00:25:35.718 04:27:26 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:35.718 04:27:26 -- nvmf/common.sh@116 -- # sync 00:25:35.977 04:27:26 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:35.977 04:27:26 -- nvmf/common.sh@119 -- # set +e 00:25:35.977 04:27:26 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:35.977 04:27:26 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:35.977 rmmod nvme_tcp 00:25:35.977 rmmod nvme_fabrics 00:25:35.977 rmmod nvme_keyring 00:25:35.977 04:27:26 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:35.977 04:27:26 -- nvmf/common.sh@123 -- # set -e 00:25:35.977 04:27:26 -- nvmf/common.sh@124 -- # return 0 00:25:35.977 04:27:26 -- nvmf/common.sh@477 -- # '[' -n '' ']' 00:25:35.977 04:27:26 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:35.977 04:27:26 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:35.977 04:27:26 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:35.977 04:27:26 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:35.977 04:27:26 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:35.977 04:27:26 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:35.977 04:27:26 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:35.977 04:27:26 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:37.877 04:27:28 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:37.877 00:25:37.877 real 0m8.045s 00:25:37.877 user 0m21.104s 00:25:37.877 sys 0m1.499s 00:25:37.877 04:27:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:37.878 04:27:28 -- common/autotest_common.sh@10 -- # set +x 00:25:37.878 ************************************ 00:25:37.878 END TEST nvmf_shutdown_tc3 00:25:37.878 ************************************ 00:25:37.878 04:27:28 -- target/shutdown.sh@150 -- # trap - SIGINT SIGTERM EXIT 00:25:37.878 00:25:37.878 real 0m28.508s 00:25:37.878 user 1m21.711s 00:25:37.878 sys 0m6.341s 00:25:37.878 04:27:28 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:37.878 04:27:28 -- common/autotest_common.sh@10 -- # set +x 00:25:37.878 ************************************ 00:25:37.878 END TEST nvmf_shutdown 00:25:37.878 ************************************ 00:25:37.878 04:27:28 -- nvmf/nvmf.sh@86 -- # timing_exit target 00:25:37.878 04:27:28 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:37.878 04:27:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.136 04:27:28 -- nvmf/nvmf.sh@88 -- # timing_enter host 00:25:38.136 04:27:28 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:38.136 04:27:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.136 04:27:28 -- nvmf/nvmf.sh@90 -- # [[ 0 -eq 0 ]] 00:25:38.136 04:27:28 -- nvmf/nvmf.sh@91 -- # run_test nvmf_multicontroller /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:38.136 04:27:28 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:38.136 04:27:28 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:38.136 04:27:28 -- common/autotest_common.sh@10 -- # set +x 00:25:38.136 ************************************ 00:25:38.136 START TEST nvmf_multicontroller 00:25:38.136 ************************************ 00:25:38.136 04:27:28 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/multicontroller.sh --transport=tcp 00:25:38.136 * Looking for test storage... 00:25:38.136 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:38.136 04:27:28 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:38.136 04:27:28 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:38.136 04:27:28 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:38.136 04:27:28 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:38.136 04:27:28 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:38.136 04:27:28 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:38.136 04:27:28 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:38.136 04:27:28 -- scripts/common.sh@335 -- # IFS=.-: 00:25:38.136 04:27:28 -- scripts/common.sh@335 -- # read -ra ver1 00:25:38.136 04:27:28 -- scripts/common.sh@336 -- # IFS=.-: 00:25:38.136 04:27:28 -- scripts/common.sh@336 -- # read -ra ver2 00:25:38.136 04:27:28 -- scripts/common.sh@337 -- # local 'op=<' 00:25:38.136 04:27:28 -- scripts/common.sh@339 -- # ver1_l=2 00:25:38.136 04:27:28 -- scripts/common.sh@340 -- # ver2_l=1 00:25:38.136 04:27:28 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:38.136 04:27:28 -- scripts/common.sh@343 -- # case "$op" in 00:25:38.136 04:27:28 -- scripts/common.sh@344 -- # : 1 00:25:38.136 04:27:28 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:38.136 04:27:28 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:38.136 04:27:28 -- scripts/common.sh@364 -- # decimal 1 00:25:38.136 04:27:28 -- scripts/common.sh@352 -- # local d=1 00:25:38.136 04:27:28 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:38.136 04:27:28 -- scripts/common.sh@354 -- # echo 1 00:25:38.136 04:27:28 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:38.136 04:27:28 -- scripts/common.sh@365 -- # decimal 2 00:25:38.136 04:27:28 -- scripts/common.sh@352 -- # local d=2 00:25:38.136 04:27:28 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:38.136 04:27:28 -- scripts/common.sh@354 -- # echo 2 00:25:38.136 04:27:28 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:38.136 04:27:28 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:38.136 04:27:28 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:38.136 04:27:28 -- scripts/common.sh@367 -- # return 0 00:25:38.136 04:27:28 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:38.136 04:27:28 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:38.136 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.136 --rc genhtml_branch_coverage=1 00:25:38.136 --rc genhtml_function_coverage=1 00:25:38.136 --rc genhtml_legend=1 00:25:38.136 --rc geninfo_all_blocks=1 00:25:38.136 --rc geninfo_unexecuted_blocks=1 00:25:38.136 00:25:38.136 ' 00:25:38.136 04:27:28 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:38.136 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.136 --rc genhtml_branch_coverage=1 00:25:38.136 --rc genhtml_function_coverage=1 00:25:38.136 --rc genhtml_legend=1 00:25:38.136 --rc geninfo_all_blocks=1 00:25:38.136 --rc geninfo_unexecuted_blocks=1 00:25:38.136 00:25:38.136 ' 00:25:38.136 04:27:28 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:38.136 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.136 --rc genhtml_branch_coverage=1 00:25:38.136 --rc genhtml_function_coverage=1 00:25:38.136 --rc genhtml_legend=1 00:25:38.136 --rc geninfo_all_blocks=1 00:25:38.136 --rc geninfo_unexecuted_blocks=1 00:25:38.136 00:25:38.136 ' 00:25:38.136 04:27:28 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:38.136 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:38.136 --rc genhtml_branch_coverage=1 00:25:38.136 --rc genhtml_function_coverage=1 00:25:38.136 --rc genhtml_legend=1 00:25:38.136 --rc geninfo_all_blocks=1 00:25:38.136 --rc geninfo_unexecuted_blocks=1 00:25:38.136 00:25:38.136 ' 00:25:38.136 04:27:28 -- host/multicontroller.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:38.136 04:27:28 -- nvmf/common.sh@7 -- # uname -s 00:25:38.136 04:27:28 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:38.136 04:27:28 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:38.136 04:27:28 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:38.136 04:27:28 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:38.136 04:27:28 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:38.136 04:27:28 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:38.136 04:27:28 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:38.136 04:27:28 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:38.136 04:27:28 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:38.136 04:27:28 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:38.136 04:27:28 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:38.136 04:27:28 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:38.136 04:27:28 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:38.136 04:27:28 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:38.136 04:27:28 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:38.136 04:27:28 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:38.136 04:27:28 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:38.136 04:27:28 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:38.136 04:27:28 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:38.136 04:27:28 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.136 04:27:28 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.136 04:27:28 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.136 04:27:28 -- paths/export.sh@5 -- # export PATH 00:25:38.136 04:27:28 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:38.136 04:27:28 -- nvmf/common.sh@46 -- # : 0 00:25:38.136 04:27:28 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:38.136 04:27:28 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:38.136 04:27:28 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:38.136 04:27:28 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:38.136 04:27:28 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:38.136 04:27:28 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:38.137 04:27:28 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:38.137 04:27:28 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:38.137 04:27:28 -- host/multicontroller.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:38.137 04:27:28 -- host/multicontroller.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:38.137 04:27:28 -- host/multicontroller.sh@13 -- # NVMF_HOST_FIRST_PORT=60000 00:25:38.137 04:27:28 -- host/multicontroller.sh@14 -- # NVMF_HOST_SECOND_PORT=60001 00:25:38.137 04:27:28 -- host/multicontroller.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:25:38.137 04:27:28 -- host/multicontroller.sh@18 -- # '[' tcp == rdma ']' 00:25:38.137 04:27:28 -- host/multicontroller.sh@23 -- # nvmftestinit 00:25:38.137 04:27:28 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:38.137 04:27:28 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:38.137 04:27:28 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:38.137 04:27:28 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:38.137 04:27:28 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:38.137 04:27:28 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:38.137 04:27:28 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:38.137 04:27:28 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:38.137 04:27:28 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:38.137 04:27:28 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:38.137 04:27:28 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:38.137 04:27:28 -- common/autotest_common.sh@10 -- # set +x 00:25:40.049 04:27:30 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:40.049 04:27:30 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:40.049 04:27:30 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:40.049 04:27:30 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:40.049 04:27:30 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:40.049 04:27:30 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:40.049 04:27:30 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:40.049 04:27:30 -- nvmf/common.sh@294 -- # net_devs=() 00:25:40.049 04:27:30 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:40.049 04:27:30 -- nvmf/common.sh@295 -- # e810=() 00:25:40.049 04:27:30 -- nvmf/common.sh@295 -- # local -ga e810 00:25:40.049 04:27:30 -- nvmf/common.sh@296 -- # x722=() 00:25:40.049 04:27:30 -- nvmf/common.sh@296 -- # local -ga x722 00:25:40.049 04:27:30 -- nvmf/common.sh@297 -- # mlx=() 00:25:40.049 04:27:30 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:40.049 04:27:30 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:40.049 04:27:30 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:40.049 04:27:30 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:40.049 04:27:30 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:40.049 04:27:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.049 04:27:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:40.049 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:40.049 04:27:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:40.049 04:27:30 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:40.049 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:40.049 04:27:30 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:40.049 04:27:30 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.049 04:27:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.049 04:27:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.049 04:27:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.049 04:27:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:40.049 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:40.049 04:27:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.049 04:27:30 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:40.049 04:27:30 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:40.049 04:27:30 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:40.049 04:27:30 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:40.049 04:27:30 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:40.049 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:40.049 04:27:30 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:40.049 04:27:30 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:40.049 04:27:30 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:40.049 04:27:30 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:40.049 04:27:30 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:40.049 04:27:30 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:40.049 04:27:30 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:40.049 04:27:30 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:40.049 04:27:30 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:40.049 04:27:30 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:40.049 04:27:30 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:40.049 04:27:30 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:40.049 04:27:30 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:40.049 04:27:30 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:40.049 04:27:30 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:40.049 04:27:30 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:40.049 04:27:30 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:40.049 04:27:30 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:40.307 04:27:30 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:40.307 04:27:30 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:40.307 04:27:30 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:40.307 04:27:30 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:40.307 04:27:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:40.307 04:27:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:40.307 04:27:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:40.307 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:40.307 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.373 ms 00:25:40.307 00:25:40.307 --- 10.0.0.2 ping statistics --- 00:25:40.307 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:40.307 rtt min/avg/max/mdev = 0.373/0.373/0.373/0.000 ms 00:25:40.307 04:27:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:40.307 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:40.307 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.119 ms 00:25:40.307 00:25:40.307 --- 10.0.0.1 ping statistics --- 00:25:40.307 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:40.308 rtt min/avg/max/mdev = 0.119/0.119/0.119/0.000 ms 00:25:40.308 04:27:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:40.308 04:27:30 -- nvmf/common.sh@410 -- # return 0 00:25:40.308 04:27:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:40.308 04:27:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:40.308 04:27:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:40.308 04:27:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:40.308 04:27:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:40.308 04:27:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:40.308 04:27:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:40.308 04:27:30 -- host/multicontroller.sh@25 -- # nvmfappstart -m 0xE 00:25:40.308 04:27:30 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:40.308 04:27:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:40.308 04:27:30 -- common/autotest_common.sh@10 -- # set +x 00:25:40.308 04:27:30 -- nvmf/common.sh@469 -- # nvmfpid=2441821 00:25:40.308 04:27:30 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:25:40.308 04:27:30 -- nvmf/common.sh@470 -- # waitforlisten 2441821 00:25:40.308 04:27:30 -- common/autotest_common.sh@829 -- # '[' -z 2441821 ']' 00:25:40.308 04:27:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:40.308 04:27:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:40.308 04:27:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:40.308 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:40.308 04:27:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:40.308 04:27:30 -- common/autotest_common.sh@10 -- # set +x 00:25:40.308 [2024-11-30 04:27:30.860535] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:40.308 [2024-11-30 04:27:30.860617] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:40.308 EAL: No free 2048 kB hugepages reported on node 1 00:25:40.308 [2024-11-30 04:27:30.923326] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:25:40.565 [2024-11-30 04:27:31.007863] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:40.566 [2024-11-30 04:27:31.008038] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:40.566 [2024-11-30 04:27:31.008058] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:40.566 [2024-11-30 04:27:31.008071] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:40.566 [2024-11-30 04:27:31.008124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:40.566 [2024-11-30 04:27:31.008151] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:40.566 [2024-11-30 04:27:31.008154] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:41.498 04:27:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:41.498 04:27:31 -- common/autotest_common.sh@862 -- # return 0 00:25:41.498 04:27:31 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:41.498 04:27:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:41.498 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.498 04:27:31 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:41.498 04:27:31 -- host/multicontroller.sh@27 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:41.498 04:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.498 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.498 [2024-11-30 04:27:31.894742] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:41.498 04:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.498 04:27:31 -- host/multicontroller.sh@29 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:25:41.498 04:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.498 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.498 Malloc0 00:25:41.498 04:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.498 04:27:31 -- host/multicontroller.sh@30 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:25:41.498 04:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.498 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.498 04:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.498 04:27:31 -- host/multicontroller.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:41.498 04:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.498 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.498 04:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.498 04:27:31 -- host/multicontroller.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:41.498 04:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.498 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.498 [2024-11-30 04:27:31.965284] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:41.498 04:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.498 04:27:31 -- host/multicontroller.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:25:41.498 04:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.498 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.498 [2024-11-30 04:27:31.973129] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:41.498 04:27:31 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.498 04:27:31 -- host/multicontroller.sh@36 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc1 00:25:41.498 04:27:31 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.498 04:27:31 -- common/autotest_common.sh@10 -- # set +x 00:25:41.498 Malloc1 00:25:41.498 04:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.498 04:27:32 -- host/multicontroller.sh@37 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000002 00:25:41.498 04:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.498 04:27:32 -- common/autotest_common.sh@10 -- # set +x 00:25:41.498 04:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.498 04:27:32 -- host/multicontroller.sh@38 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 Malloc1 00:25:41.498 04:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.499 04:27:32 -- common/autotest_common.sh@10 -- # set +x 00:25:41.499 04:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.499 04:27:32 -- host/multicontroller.sh@40 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:25:41.499 04:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.499 04:27:32 -- common/autotest_common.sh@10 -- # set +x 00:25:41.499 04:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.499 04:27:32 -- host/multicontroller.sh@41 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4421 00:25:41.499 04:27:32 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:41.499 04:27:32 -- common/autotest_common.sh@10 -- # set +x 00:25:41.499 04:27:32 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:41.499 04:27:32 -- host/multicontroller.sh@44 -- # bdevperf_pid=2441978 00:25:41.499 04:27:32 -- host/multicontroller.sh@46 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; pap "$testdir/try.txt"; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:25:41.499 04:27:32 -- host/multicontroller.sh@47 -- # waitforlisten 2441978 /var/tmp/bdevperf.sock 00:25:41.499 04:27:32 -- common/autotest_common.sh@829 -- # '[' -z 2441978 ']' 00:25:41.499 04:27:32 -- host/multicontroller.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w write -t 1 -f 00:25:41.499 04:27:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:25:41.499 04:27:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:41.499 04:27:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:25:41.499 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:25:41.499 04:27:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:41.499 04:27:32 -- common/autotest_common.sh@10 -- # set +x 00:25:42.431 04:27:33 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:42.431 04:27:33 -- common/autotest_common.sh@862 -- # return 0 00:25:42.432 04:27:33 -- host/multicontroller.sh@50 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:42.432 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.432 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.689 NVMe0n1 00:25:42.689 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.689 04:27:33 -- host/multicontroller.sh@54 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:42.689 04:27:33 -- host/multicontroller.sh@54 -- # grep -c NVMe 00:25:42.689 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.689 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.689 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.689 1 00:25:42.689 04:27:33 -- host/multicontroller.sh@60 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:42.690 04:27:33 -- common/autotest_common.sh@650 -- # local es=0 00:25:42.690 04:27:33 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:42.690 04:27:33 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:42.690 04:27:33 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -q nqn.2021-09-7.io.spdk:00001 00:25:42.690 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.690 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.690 request: 00:25:42.690 { 00:25:42.690 "name": "NVMe0", 00:25:42.690 "trtype": "tcp", 00:25:42.690 "traddr": "10.0.0.2", 00:25:42.690 "hostnqn": "nqn.2021-09-7.io.spdk:00001", 00:25:42.690 "hostaddr": "10.0.0.2", 00:25:42.690 "hostsvcid": "60000", 00:25:42.690 "adrfam": "ipv4", 00:25:42.690 "trsvcid": "4420", 00:25:42.690 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:42.690 "method": "bdev_nvme_attach_controller", 00:25:42.690 "req_id": 1 00:25:42.690 } 00:25:42.690 Got JSON-RPC error response 00:25:42.690 response: 00:25:42.690 { 00:25:42.690 "code": -114, 00:25:42.690 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:42.690 } 00:25:42.690 04:27:33 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:42.690 04:27:33 -- common/autotest_common.sh@653 -- # es=1 00:25:42.690 04:27:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:42.690 04:27:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:42.690 04:27:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:42.690 04:27:33 -- host/multicontroller.sh@65 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:42.690 04:27:33 -- common/autotest_common.sh@650 -- # local es=0 00:25:42.690 04:27:33 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:42.690 04:27:33 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:42.690 04:27:33 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode2 -i 10.0.0.2 -c 60000 00:25:42.690 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.690 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.690 request: 00:25:42.690 { 00:25:42.690 "name": "NVMe0", 00:25:42.690 "trtype": "tcp", 00:25:42.690 "traddr": "10.0.0.2", 00:25:42.690 "hostaddr": "10.0.0.2", 00:25:42.690 "hostsvcid": "60000", 00:25:42.690 "adrfam": "ipv4", 00:25:42.690 "trsvcid": "4420", 00:25:42.690 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:25:42.690 "method": "bdev_nvme_attach_controller", 00:25:42.690 "req_id": 1 00:25:42.690 } 00:25:42.690 Got JSON-RPC error response 00:25:42.690 response: 00:25:42.690 { 00:25:42.690 "code": -114, 00:25:42.690 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:42.690 } 00:25:42.690 04:27:33 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:42.690 04:27:33 -- common/autotest_common.sh@653 -- # es=1 00:25:42.690 04:27:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:42.690 04:27:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:42.690 04:27:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:42.690 04:27:33 -- host/multicontroller.sh@69 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:42.690 04:27:33 -- common/autotest_common.sh@650 -- # local es=0 00:25:42.690 04:27:33 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:42.690 04:27:33 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:42.690 04:27:33 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x disable 00:25:42.690 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.690 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.690 request: 00:25:42.690 { 00:25:42.690 "name": "NVMe0", 00:25:42.690 "trtype": "tcp", 00:25:42.690 "traddr": "10.0.0.2", 00:25:42.690 "hostaddr": "10.0.0.2", 00:25:42.690 "hostsvcid": "60000", 00:25:42.690 "adrfam": "ipv4", 00:25:42.690 "trsvcid": "4420", 00:25:42.690 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:42.690 "multipath": "disable", 00:25:42.690 "method": "bdev_nvme_attach_controller", 00:25:42.690 "req_id": 1 00:25:42.690 } 00:25:42.690 Got JSON-RPC error response 00:25:42.690 response: 00:25:42.690 { 00:25:42.690 "code": -114, 00:25:42.690 "message": "A controller named NVMe0 already exists and multipath is disabled\n" 00:25:42.690 } 00:25:42.690 04:27:33 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:42.690 04:27:33 -- common/autotest_common.sh@653 -- # es=1 00:25:42.690 04:27:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:42.690 04:27:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:42.690 04:27:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:42.690 04:27:33 -- host/multicontroller.sh@74 -- # NOT rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:42.690 04:27:33 -- common/autotest_common.sh@650 -- # local es=0 00:25:42.690 04:27:33 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:42.690 04:27:33 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:25:42.690 04:27:33 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:25:42.690 04:27:33 -- common/autotest_common.sh@653 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 -x failover 00:25:42.690 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.690 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.690 request: 00:25:42.690 { 00:25:42.690 "name": "NVMe0", 00:25:42.690 "trtype": "tcp", 00:25:42.690 "traddr": "10.0.0.2", 00:25:42.690 "hostaddr": "10.0.0.2", 00:25:42.690 "hostsvcid": "60000", 00:25:42.690 "adrfam": "ipv4", 00:25:42.690 "trsvcid": "4420", 00:25:42.690 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:25:42.690 "multipath": "failover", 00:25:42.690 "method": "bdev_nvme_attach_controller", 00:25:42.690 "req_id": 1 00:25:42.690 } 00:25:42.690 Got JSON-RPC error response 00:25:42.690 response: 00:25:42.690 { 00:25:42.690 "code": -114, 00:25:42.690 "message": "A controller named NVMe0 already exists with the specified network path\n" 00:25:42.690 } 00:25:42.690 04:27:33 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:25:42.690 04:27:33 -- common/autotest_common.sh@653 -- # es=1 00:25:42.690 04:27:33 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:25:42.690 04:27:33 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:25:42.690 04:27:33 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:25:42.690 04:27:33 -- host/multicontroller.sh@79 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:42.690 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.690 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.690 00:25:42.690 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.690 04:27:33 -- host/multicontroller.sh@83 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:25:42.690 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.690 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.948 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.948 04:27:33 -- host/multicontroller.sh@87 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe1 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -i 10.0.0.2 -c 60000 00:25:42.948 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.948 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.948 00:25:42.948 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.948 04:27:33 -- host/multicontroller.sh@90 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:25:42.948 04:27:33 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:42.948 04:27:33 -- host/multicontroller.sh@90 -- # grep -c NVMe 00:25:42.948 04:27:33 -- common/autotest_common.sh@10 -- # set +x 00:25:42.948 04:27:33 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:42.948 04:27:33 -- host/multicontroller.sh@90 -- # '[' 2 '!=' 2 ']' 00:25:42.948 04:27:33 -- host/multicontroller.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:25:44.321 0 00:25:44.321 04:27:34 -- host/multicontroller.sh@98 -- # rpc_cmd -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe1 00:25:44.321 04:27:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.321 04:27:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.321 04:27:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.321 04:27:34 -- host/multicontroller.sh@100 -- # killprocess 2441978 00:25:44.321 04:27:34 -- common/autotest_common.sh@936 -- # '[' -z 2441978 ']' 00:25:44.321 04:27:34 -- common/autotest_common.sh@940 -- # kill -0 2441978 00:25:44.321 04:27:34 -- common/autotest_common.sh@941 -- # uname 00:25:44.321 04:27:34 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:44.321 04:27:34 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2441978 00:25:44.321 04:27:34 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:44.321 04:27:34 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:44.321 04:27:34 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2441978' 00:25:44.321 killing process with pid 2441978 00:25:44.321 04:27:34 -- common/autotest_common.sh@955 -- # kill 2441978 00:25:44.321 04:27:34 -- common/autotest_common.sh@960 -- # wait 2441978 00:25:44.579 04:27:34 -- host/multicontroller.sh@102 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:44.579 04:27:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.579 04:27:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.579 04:27:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.579 04:27:34 -- host/multicontroller.sh@103 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:25:44.579 04:27:34 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:44.579 04:27:34 -- common/autotest_common.sh@10 -- # set +x 00:25:44.579 04:27:34 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:44.579 04:27:34 -- host/multicontroller.sh@105 -- # trap - SIGINT SIGTERM EXIT 00:25:44.579 04:27:34 -- host/multicontroller.sh@107 -- # pap /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:44.579 04:27:34 -- common/autotest_common.sh@1607 -- # read -r file 00:25:44.579 04:27:34 -- common/autotest_common.sh@1606 -- # find /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt -type f 00:25:44.579 04:27:34 -- common/autotest_common.sh@1606 -- # sort -u 00:25:44.579 04:27:34 -- common/autotest_common.sh@1608 -- # cat 00:25:44.579 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:44.579 [2024-11-30 04:27:32.074892] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:44.579 [2024-11-30 04:27:32.074990] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2441978 ] 00:25:44.579 EAL: No free 2048 kB hugepages reported on node 1 00:25:44.579 [2024-11-30 04:27:32.134901] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:44.579 [2024-11-30 04:27:32.218800] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:44.579 [2024-11-30 04:27:33.547018] bdev.c:4553:bdev_name_add: *ERROR*: Bdev name e7ff6845-0108-472a-ad6c-e1ec9dcdc935 already exists 00:25:44.579 [2024-11-30 04:27:33.547059] bdev.c:7603:bdev_register: *ERROR*: Unable to add uuid:e7ff6845-0108-472a-ad6c-e1ec9dcdc935 alias for bdev NVMe1n1 00:25:44.579 [2024-11-30 04:27:33.547095] bdev_nvme.c:4236:nvme_bdev_create: *ERROR*: spdk_bdev_register() failed 00:25:44.579 Running I/O for 1 seconds... 00:25:44.579 00:25:44.579 Latency(us) 00:25:44.579 [2024-11-30T03:27:35.210Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:44.579 [2024-11-30T03:27:35.210Z] Job: NVMe0n1 (Core Mask 0x1, workload: write, depth: 128, IO size: 4096) 00:25:44.579 NVMe0n1 : 1.00 19874.26 77.63 0.00 0.00 6431.05 5388.52 16796.63 00:25:44.579 [2024-11-30T03:27:35.210Z] =================================================================================================================== 00:25:44.579 [2024-11-30T03:27:35.210Z] Total : 19874.26 77.63 0.00 0.00 6431.05 5388.52 16796.63 00:25:44.579 Received shutdown signal, test time was about 1.000000 seconds 00:25:44.579 00:25:44.579 Latency(us) 00:25:44.579 [2024-11-30T03:27:35.210Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:25:44.579 [2024-11-30T03:27:35.210Z] =================================================================================================================== 00:25:44.579 [2024-11-30T03:27:35.210Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:25:44.579 --- /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt --- 00:25:44.579 04:27:34 -- common/autotest_common.sh@1613 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:25:44.579 04:27:34 -- common/autotest_common.sh@1607 -- # read -r file 00:25:44.579 04:27:34 -- host/multicontroller.sh@108 -- # nvmftestfini 00:25:44.579 04:27:34 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:44.579 04:27:34 -- nvmf/common.sh@116 -- # sync 00:25:44.579 04:27:34 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:44.579 04:27:34 -- nvmf/common.sh@119 -- # set +e 00:25:44.579 04:27:34 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:44.579 04:27:34 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:44.579 rmmod nvme_tcp 00:25:44.579 rmmod nvme_fabrics 00:25:44.579 rmmod nvme_keyring 00:25:44.579 04:27:35 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:44.579 04:27:35 -- nvmf/common.sh@123 -- # set -e 00:25:44.579 04:27:35 -- nvmf/common.sh@124 -- # return 0 00:25:44.579 04:27:35 -- nvmf/common.sh@477 -- # '[' -n 2441821 ']' 00:25:44.579 04:27:35 -- nvmf/common.sh@478 -- # killprocess 2441821 00:25:44.579 04:27:35 -- common/autotest_common.sh@936 -- # '[' -z 2441821 ']' 00:25:44.579 04:27:35 -- common/autotest_common.sh@940 -- # kill -0 2441821 00:25:44.579 04:27:35 -- common/autotest_common.sh@941 -- # uname 00:25:44.579 04:27:35 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:44.579 04:27:35 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2441821 00:25:44.579 04:27:35 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:25:44.579 04:27:35 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:25:44.579 04:27:35 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2441821' 00:25:44.579 killing process with pid 2441821 00:25:44.579 04:27:35 -- common/autotest_common.sh@955 -- # kill 2441821 00:25:44.579 04:27:35 -- common/autotest_common.sh@960 -- # wait 2441821 00:25:44.837 04:27:35 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:44.837 04:27:35 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:44.837 04:27:35 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:44.837 04:27:35 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:44.837 04:27:35 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:44.838 04:27:35 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:44.838 04:27:35 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:44.838 04:27:35 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:47.366 04:27:37 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:47.366 00:25:47.366 real 0m8.903s 00:25:47.366 user 0m17.294s 00:25:47.366 sys 0m2.249s 00:25:47.366 04:27:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:47.366 04:27:37 -- common/autotest_common.sh@10 -- # set +x 00:25:47.366 ************************************ 00:25:47.366 END TEST nvmf_multicontroller 00:25:47.366 ************************************ 00:25:47.366 04:27:37 -- nvmf/nvmf.sh@92 -- # run_test nvmf_aer /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:47.366 04:27:37 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:47.366 04:27:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:47.366 04:27:37 -- common/autotest_common.sh@10 -- # set +x 00:25:47.366 ************************************ 00:25:47.366 START TEST nvmf_aer 00:25:47.366 ************************************ 00:25:47.366 04:27:37 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/aer.sh --transport=tcp 00:25:47.367 * Looking for test storage... 00:25:47.367 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:47.367 04:27:37 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:47.367 04:27:37 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:47.367 04:27:37 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:47.367 04:27:37 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:47.367 04:27:37 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:47.367 04:27:37 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:47.367 04:27:37 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:47.367 04:27:37 -- scripts/common.sh@335 -- # IFS=.-: 00:25:47.367 04:27:37 -- scripts/common.sh@335 -- # read -ra ver1 00:25:47.367 04:27:37 -- scripts/common.sh@336 -- # IFS=.-: 00:25:47.367 04:27:37 -- scripts/common.sh@336 -- # read -ra ver2 00:25:47.367 04:27:37 -- scripts/common.sh@337 -- # local 'op=<' 00:25:47.367 04:27:37 -- scripts/common.sh@339 -- # ver1_l=2 00:25:47.367 04:27:37 -- scripts/common.sh@340 -- # ver2_l=1 00:25:47.367 04:27:37 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:47.367 04:27:37 -- scripts/common.sh@343 -- # case "$op" in 00:25:47.367 04:27:37 -- scripts/common.sh@344 -- # : 1 00:25:47.367 04:27:37 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:47.367 04:27:37 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:47.367 04:27:37 -- scripts/common.sh@364 -- # decimal 1 00:25:47.367 04:27:37 -- scripts/common.sh@352 -- # local d=1 00:25:47.367 04:27:37 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:47.367 04:27:37 -- scripts/common.sh@354 -- # echo 1 00:25:47.367 04:27:37 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:47.367 04:27:37 -- scripts/common.sh@365 -- # decimal 2 00:25:47.367 04:27:37 -- scripts/common.sh@352 -- # local d=2 00:25:47.367 04:27:37 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:47.367 04:27:37 -- scripts/common.sh@354 -- # echo 2 00:25:47.367 04:27:37 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:47.367 04:27:37 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:47.367 04:27:37 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:47.367 04:27:37 -- scripts/common.sh@367 -- # return 0 00:25:47.367 04:27:37 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:47.367 04:27:37 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:47.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.367 --rc genhtml_branch_coverage=1 00:25:47.367 --rc genhtml_function_coverage=1 00:25:47.367 --rc genhtml_legend=1 00:25:47.367 --rc geninfo_all_blocks=1 00:25:47.367 --rc geninfo_unexecuted_blocks=1 00:25:47.367 00:25:47.367 ' 00:25:47.367 04:27:37 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:47.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.367 --rc genhtml_branch_coverage=1 00:25:47.367 --rc genhtml_function_coverage=1 00:25:47.367 --rc genhtml_legend=1 00:25:47.367 --rc geninfo_all_blocks=1 00:25:47.367 --rc geninfo_unexecuted_blocks=1 00:25:47.367 00:25:47.367 ' 00:25:47.367 04:27:37 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:47.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.367 --rc genhtml_branch_coverage=1 00:25:47.367 --rc genhtml_function_coverage=1 00:25:47.367 --rc genhtml_legend=1 00:25:47.367 --rc geninfo_all_blocks=1 00:25:47.367 --rc geninfo_unexecuted_blocks=1 00:25:47.367 00:25:47.367 ' 00:25:47.367 04:27:37 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:47.367 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:47.367 --rc genhtml_branch_coverage=1 00:25:47.367 --rc genhtml_function_coverage=1 00:25:47.367 --rc genhtml_legend=1 00:25:47.367 --rc geninfo_all_blocks=1 00:25:47.367 --rc geninfo_unexecuted_blocks=1 00:25:47.367 00:25:47.367 ' 00:25:47.367 04:27:37 -- host/aer.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:47.367 04:27:37 -- nvmf/common.sh@7 -- # uname -s 00:25:47.367 04:27:37 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:47.367 04:27:37 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:47.367 04:27:37 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:47.367 04:27:37 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:47.367 04:27:37 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:47.367 04:27:37 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:47.367 04:27:37 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:47.367 04:27:37 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:47.367 04:27:37 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:47.367 04:27:37 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:47.367 04:27:37 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:47.367 04:27:37 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:47.367 04:27:37 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:47.367 04:27:37 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:47.367 04:27:37 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:47.367 04:27:37 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:47.367 04:27:37 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:47.367 04:27:37 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:47.367 04:27:37 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:47.367 04:27:37 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.367 04:27:37 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.367 04:27:37 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.367 04:27:37 -- paths/export.sh@5 -- # export PATH 00:25:47.367 04:27:37 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:47.367 04:27:37 -- nvmf/common.sh@46 -- # : 0 00:25:47.367 04:27:37 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:47.367 04:27:37 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:47.367 04:27:37 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:47.367 04:27:37 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:47.367 04:27:37 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:47.367 04:27:37 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:47.367 04:27:37 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:47.367 04:27:37 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:47.367 04:27:37 -- host/aer.sh@11 -- # nvmftestinit 00:25:47.367 04:27:37 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:47.367 04:27:37 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:47.367 04:27:37 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:47.367 04:27:37 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:47.367 04:27:37 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:47.367 04:27:37 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:47.367 04:27:37 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:47.367 04:27:37 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:47.367 04:27:37 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:47.367 04:27:37 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:47.367 04:27:37 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:47.367 04:27:37 -- common/autotest_common.sh@10 -- # set +x 00:25:49.264 04:27:39 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:49.264 04:27:39 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:49.264 04:27:39 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:49.264 04:27:39 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:49.264 04:27:39 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:49.264 04:27:39 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:49.264 04:27:39 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:49.264 04:27:39 -- nvmf/common.sh@294 -- # net_devs=() 00:25:49.264 04:27:39 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:49.264 04:27:39 -- nvmf/common.sh@295 -- # e810=() 00:25:49.264 04:27:39 -- nvmf/common.sh@295 -- # local -ga e810 00:25:49.264 04:27:39 -- nvmf/common.sh@296 -- # x722=() 00:25:49.264 04:27:39 -- nvmf/common.sh@296 -- # local -ga x722 00:25:49.264 04:27:39 -- nvmf/common.sh@297 -- # mlx=() 00:25:49.264 04:27:39 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:49.264 04:27:39 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:49.264 04:27:39 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:49.264 04:27:39 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:49.265 04:27:39 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:49.265 04:27:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.265 04:27:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:49.265 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:49.265 04:27:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:49.265 04:27:39 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:49.265 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:49.265 04:27:39 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:49.265 04:27:39 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.265 04:27:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.265 04:27:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.265 04:27:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.265 04:27:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:49.265 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:49.265 04:27:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.265 04:27:39 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:49.265 04:27:39 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:49.265 04:27:39 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:49.265 04:27:39 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:49.265 04:27:39 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:49.265 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:49.265 04:27:39 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:49.265 04:27:39 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:49.265 04:27:39 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:49.265 04:27:39 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:49.265 04:27:39 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:49.265 04:27:39 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:49.265 04:27:39 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:49.265 04:27:39 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:49.265 04:27:39 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:49.265 04:27:39 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:49.265 04:27:39 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:49.265 04:27:39 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:49.265 04:27:39 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:49.265 04:27:39 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:49.265 04:27:39 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:49.265 04:27:39 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:49.265 04:27:39 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:49.265 04:27:39 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:49.265 04:27:39 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:49.265 04:27:39 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:49.265 04:27:39 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:49.265 04:27:39 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:49.265 04:27:39 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:49.265 04:27:39 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:49.265 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:49.265 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.222 ms 00:25:49.265 00:25:49.265 --- 10.0.0.2 ping statistics --- 00:25:49.265 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:49.265 rtt min/avg/max/mdev = 0.222/0.222/0.222/0.000 ms 00:25:49.265 04:27:39 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:49.265 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:49.265 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.139 ms 00:25:49.265 00:25:49.265 --- 10.0.0.1 ping statistics --- 00:25:49.265 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:49.265 rtt min/avg/max/mdev = 0.139/0.139/0.139/0.000 ms 00:25:49.265 04:27:39 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:49.265 04:27:39 -- nvmf/common.sh@410 -- # return 0 00:25:49.265 04:27:39 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:49.265 04:27:39 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:49.265 04:27:39 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:49.265 04:27:39 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:49.265 04:27:39 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:49.265 04:27:39 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:49.265 04:27:39 -- host/aer.sh@12 -- # nvmfappstart -m 0xF 00:25:49.265 04:27:39 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:49.265 04:27:39 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:49.265 04:27:39 -- common/autotest_common.sh@10 -- # set +x 00:25:49.265 04:27:39 -- nvmf/common.sh@469 -- # nvmfpid=2444344 00:25:49.265 04:27:39 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:25:49.265 04:27:39 -- nvmf/common.sh@470 -- # waitforlisten 2444344 00:25:49.265 04:27:39 -- common/autotest_common.sh@829 -- # '[' -z 2444344 ']' 00:25:49.265 04:27:39 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:49.265 04:27:39 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:49.265 04:27:39 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:49.265 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:49.265 04:27:39 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:49.265 04:27:39 -- common/autotest_common.sh@10 -- # set +x 00:25:49.265 [2024-11-30 04:27:39.720523] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:49.265 [2024-11-30 04:27:39.720591] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:49.265 EAL: No free 2048 kB hugepages reported on node 1 00:25:49.265 [2024-11-30 04:27:39.789828] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:25:49.265 [2024-11-30 04:27:39.880633] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:49.265 [2024-11-30 04:27:39.880799] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:49.265 [2024-11-30 04:27:39.880816] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:49.265 [2024-11-30 04:27:39.880832] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:49.265 [2024-11-30 04:27:39.883980] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:25:49.265 [2024-11-30 04:27:39.884030] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:25:49.265 [2024-11-30 04:27:39.884115] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:25:49.265 [2024-11-30 04:27:39.884119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:50.198 04:27:40 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:50.198 04:27:40 -- common/autotest_common.sh@862 -- # return 0 00:25:50.198 04:27:40 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:50.198 04:27:40 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:50.198 04:27:40 -- common/autotest_common.sh@10 -- # set +x 00:25:50.198 04:27:40 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:50.198 04:27:40 -- host/aer.sh@14 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:25:50.198 04:27:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.198 04:27:40 -- common/autotest_common.sh@10 -- # set +x 00:25:50.198 [2024-11-30 04:27:40.770835] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:50.198 04:27:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.198 04:27:40 -- host/aer.sh@16 -- # rpc_cmd bdev_malloc_create 64 512 --name Malloc0 00:25:50.198 04:27:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.198 04:27:40 -- common/autotest_common.sh@10 -- # set +x 00:25:50.198 Malloc0 00:25:50.198 04:27:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.198 04:27:40 -- host/aer.sh@17 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 2 00:25:50.198 04:27:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.198 04:27:40 -- common/autotest_common.sh@10 -- # set +x 00:25:50.198 04:27:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.198 04:27:40 -- host/aer.sh@18 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:25:50.198 04:27:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.198 04:27:40 -- common/autotest_common.sh@10 -- # set +x 00:25:50.198 04:27:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.198 04:27:40 -- host/aer.sh@19 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:25:50.198 04:27:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.198 04:27:40 -- common/autotest_common.sh@10 -- # set +x 00:25:50.198 [2024-11-30 04:27:40.824480] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:50.198 04:27:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.198 04:27:40 -- host/aer.sh@21 -- # rpc_cmd nvmf_get_subsystems 00:25:50.198 04:27:40 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.198 04:27:40 -- common/autotest_common.sh@10 -- # set +x 00:25:50.456 [2024-11-30 04:27:40.832147] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:25:50.456 [ 00:25:50.456 { 00:25:50.456 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:50.456 "subtype": "Discovery", 00:25:50.456 "listen_addresses": [], 00:25:50.456 "allow_any_host": true, 00:25:50.456 "hosts": [] 00:25:50.456 }, 00:25:50.456 { 00:25:50.456 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:50.456 "subtype": "NVMe", 00:25:50.456 "listen_addresses": [ 00:25:50.456 { 00:25:50.456 "transport": "TCP", 00:25:50.456 "trtype": "TCP", 00:25:50.456 "adrfam": "IPv4", 00:25:50.456 "traddr": "10.0.0.2", 00:25:50.456 "trsvcid": "4420" 00:25:50.456 } 00:25:50.456 ], 00:25:50.456 "allow_any_host": true, 00:25:50.456 "hosts": [], 00:25:50.456 "serial_number": "SPDK00000000000001", 00:25:50.456 "model_number": "SPDK bdev Controller", 00:25:50.456 "max_namespaces": 2, 00:25:50.456 "min_cntlid": 1, 00:25:50.456 "max_cntlid": 65519, 00:25:50.456 "namespaces": [ 00:25:50.456 { 00:25:50.456 "nsid": 1, 00:25:50.456 "bdev_name": "Malloc0", 00:25:50.456 "name": "Malloc0", 00:25:50.456 "nguid": "53A95349AB9E416B8D6A7758D3E25216", 00:25:50.456 "uuid": "53a95349-ab9e-416b-8d6a-7758d3e25216" 00:25:50.456 } 00:25:50.456 ] 00:25:50.456 } 00:25:50.456 ] 00:25:50.456 04:27:40 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.456 04:27:40 -- host/aer.sh@23 -- # AER_TOUCH_FILE=/tmp/aer_touch_file 00:25:50.456 04:27:40 -- host/aer.sh@24 -- # rm -f /tmp/aer_touch_file 00:25:50.456 04:27:40 -- host/aer.sh@33 -- # aerpid=2444503 00:25:50.456 04:27:40 -- host/aer.sh@36 -- # waitforfile /tmp/aer_touch_file 00:25:50.456 04:27:40 -- host/aer.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvme/aer/aer -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -n 2 -t /tmp/aer_touch_file 00:25:50.456 04:27:40 -- common/autotest_common.sh@1254 -- # local i=0 00:25:50.456 04:27:40 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:50.456 04:27:40 -- common/autotest_common.sh@1256 -- # '[' 0 -lt 200 ']' 00:25:50.456 04:27:40 -- common/autotest_common.sh@1257 -- # i=1 00:25:50.456 04:27:40 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:50.456 EAL: No free 2048 kB hugepages reported on node 1 00:25:50.456 04:27:40 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:50.456 04:27:40 -- common/autotest_common.sh@1256 -- # '[' 1 -lt 200 ']' 00:25:50.456 04:27:40 -- common/autotest_common.sh@1257 -- # i=2 00:25:50.456 04:27:40 -- common/autotest_common.sh@1258 -- # sleep 0.1 00:25:50.456 04:27:41 -- common/autotest_common.sh@1255 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:50.456 04:27:41 -- common/autotest_common.sh@1261 -- # '[' '!' -e /tmp/aer_touch_file ']' 00:25:50.456 04:27:41 -- common/autotest_common.sh@1265 -- # return 0 00:25:50.456 04:27:41 -- host/aer.sh@39 -- # rpc_cmd bdev_malloc_create 64 4096 --name Malloc1 00:25:50.456 04:27:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.456 04:27:41 -- common/autotest_common.sh@10 -- # set +x 00:25:50.456 Malloc1 00:25:50.456 04:27:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.456 04:27:41 -- host/aer.sh@40 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 -n 2 00:25:50.456 04:27:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.456 04:27:41 -- common/autotest_common.sh@10 -- # set +x 00:25:50.714 04:27:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.714 04:27:41 -- host/aer.sh@41 -- # rpc_cmd nvmf_get_subsystems 00:25:50.714 04:27:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.714 04:27:41 -- common/autotest_common.sh@10 -- # set +x 00:25:50.714 Asynchronous Event Request test 00:25:50.714 Attaching to 10.0.0.2 00:25:50.714 Attached to 10.0.0.2 00:25:50.714 Registering asynchronous event callbacks... 00:25:50.714 Starting namespace attribute notice tests for all controllers... 00:25:50.714 10.0.0.2: aer_cb for log page 4, aen_event_type: 0x02, aen_event_info: 0x00 00:25:50.714 aer_cb - Changed Namespace 00:25:50.714 Cleaning up... 00:25:50.714 [ 00:25:50.714 { 00:25:50.714 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:25:50.714 "subtype": "Discovery", 00:25:50.714 "listen_addresses": [], 00:25:50.714 "allow_any_host": true, 00:25:50.714 "hosts": [] 00:25:50.714 }, 00:25:50.714 { 00:25:50.714 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:25:50.714 "subtype": "NVMe", 00:25:50.714 "listen_addresses": [ 00:25:50.714 { 00:25:50.714 "transport": "TCP", 00:25:50.714 "trtype": "TCP", 00:25:50.714 "adrfam": "IPv4", 00:25:50.714 "traddr": "10.0.0.2", 00:25:50.714 "trsvcid": "4420" 00:25:50.714 } 00:25:50.714 ], 00:25:50.714 "allow_any_host": true, 00:25:50.714 "hosts": [], 00:25:50.714 "serial_number": "SPDK00000000000001", 00:25:50.714 "model_number": "SPDK bdev Controller", 00:25:50.714 "max_namespaces": 2, 00:25:50.714 "min_cntlid": 1, 00:25:50.714 "max_cntlid": 65519, 00:25:50.714 "namespaces": [ 00:25:50.714 { 00:25:50.714 "nsid": 1, 00:25:50.714 "bdev_name": "Malloc0", 00:25:50.714 "name": "Malloc0", 00:25:50.714 "nguid": "53A95349AB9E416B8D6A7758D3E25216", 00:25:50.714 "uuid": "53a95349-ab9e-416b-8d6a-7758d3e25216" 00:25:50.714 }, 00:25:50.714 { 00:25:50.714 "nsid": 2, 00:25:50.714 "bdev_name": "Malloc1", 00:25:50.714 "name": "Malloc1", 00:25:50.714 "nguid": "C7F9A92A1A0447BEB8FE056EE8958368", 00:25:50.714 "uuid": "c7f9a92a-1a04-47be-b8fe-056ee8958368" 00:25:50.714 } 00:25:50.714 ] 00:25:50.714 } 00:25:50.714 ] 00:25:50.714 04:27:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.714 04:27:41 -- host/aer.sh@43 -- # wait 2444503 00:25:50.714 04:27:41 -- host/aer.sh@45 -- # rpc_cmd bdev_malloc_delete Malloc0 00:25:50.714 04:27:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.714 04:27:41 -- common/autotest_common.sh@10 -- # set +x 00:25:50.714 04:27:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.714 04:27:41 -- host/aer.sh@46 -- # rpc_cmd bdev_malloc_delete Malloc1 00:25:50.714 04:27:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.714 04:27:41 -- common/autotest_common.sh@10 -- # set +x 00:25:50.714 04:27:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.714 04:27:41 -- host/aer.sh@47 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:25:50.714 04:27:41 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:50.714 04:27:41 -- common/autotest_common.sh@10 -- # set +x 00:25:50.714 04:27:41 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:50.714 04:27:41 -- host/aer.sh@49 -- # trap - SIGINT SIGTERM EXIT 00:25:50.714 04:27:41 -- host/aer.sh@51 -- # nvmftestfini 00:25:50.714 04:27:41 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:50.714 04:27:41 -- nvmf/common.sh@116 -- # sync 00:25:50.714 04:27:41 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:50.714 04:27:41 -- nvmf/common.sh@119 -- # set +e 00:25:50.714 04:27:41 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:50.714 04:27:41 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:50.714 rmmod nvme_tcp 00:25:50.714 rmmod nvme_fabrics 00:25:50.714 rmmod nvme_keyring 00:25:50.714 04:27:41 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:50.714 04:27:41 -- nvmf/common.sh@123 -- # set -e 00:25:50.714 04:27:41 -- nvmf/common.sh@124 -- # return 0 00:25:50.714 04:27:41 -- nvmf/common.sh@477 -- # '[' -n 2444344 ']' 00:25:50.714 04:27:41 -- nvmf/common.sh@478 -- # killprocess 2444344 00:25:50.714 04:27:41 -- common/autotest_common.sh@936 -- # '[' -z 2444344 ']' 00:25:50.714 04:27:41 -- common/autotest_common.sh@940 -- # kill -0 2444344 00:25:50.714 04:27:41 -- common/autotest_common.sh@941 -- # uname 00:25:50.714 04:27:41 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:50.714 04:27:41 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2444344 00:25:50.714 04:27:41 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:50.714 04:27:41 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:50.714 04:27:41 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2444344' 00:25:50.714 killing process with pid 2444344 00:25:50.714 04:27:41 -- common/autotest_common.sh@955 -- # kill 2444344 00:25:50.714 [2024-11-30 04:27:41.268362] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:25:50.714 04:27:41 -- common/autotest_common.sh@960 -- # wait 2444344 00:25:50.972 04:27:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:50.972 04:27:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:50.972 04:27:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:50.972 04:27:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:50.972 04:27:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:50.972 04:27:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:50.972 04:27:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:50.972 04:27:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:53.505 04:27:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:53.505 00:25:53.505 real 0m6.044s 00:25:53.505 user 0m7.294s 00:25:53.505 sys 0m1.895s 00:25:53.505 04:27:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:53.505 04:27:43 -- common/autotest_common.sh@10 -- # set +x 00:25:53.505 ************************************ 00:25:53.505 END TEST nvmf_aer 00:25:53.505 ************************************ 00:25:53.505 04:27:43 -- nvmf/nvmf.sh@93 -- # run_test nvmf_async_init /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:53.505 04:27:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:53.505 04:27:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:53.505 04:27:43 -- common/autotest_common.sh@10 -- # set +x 00:25:53.505 ************************************ 00:25:53.505 START TEST nvmf_async_init 00:25:53.505 ************************************ 00:25:53.505 04:27:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/async_init.sh --transport=tcp 00:25:53.505 * Looking for test storage... 00:25:53.505 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:53.505 04:27:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:53.505 04:27:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:53.505 04:27:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:53.505 04:27:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:53.505 04:27:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:53.505 04:27:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:53.505 04:27:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:53.505 04:27:43 -- scripts/common.sh@335 -- # IFS=.-: 00:25:53.505 04:27:43 -- scripts/common.sh@335 -- # read -ra ver1 00:25:53.505 04:27:43 -- scripts/common.sh@336 -- # IFS=.-: 00:25:53.505 04:27:43 -- scripts/common.sh@336 -- # read -ra ver2 00:25:53.505 04:27:43 -- scripts/common.sh@337 -- # local 'op=<' 00:25:53.505 04:27:43 -- scripts/common.sh@339 -- # ver1_l=2 00:25:53.505 04:27:43 -- scripts/common.sh@340 -- # ver2_l=1 00:25:53.505 04:27:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:53.505 04:27:43 -- scripts/common.sh@343 -- # case "$op" in 00:25:53.505 04:27:43 -- scripts/common.sh@344 -- # : 1 00:25:53.505 04:27:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:53.505 04:27:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:53.505 04:27:43 -- scripts/common.sh@364 -- # decimal 1 00:25:53.505 04:27:43 -- scripts/common.sh@352 -- # local d=1 00:25:53.505 04:27:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:53.505 04:27:43 -- scripts/common.sh@354 -- # echo 1 00:25:53.505 04:27:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:53.505 04:27:43 -- scripts/common.sh@365 -- # decimal 2 00:25:53.505 04:27:43 -- scripts/common.sh@352 -- # local d=2 00:25:53.505 04:27:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:53.505 04:27:43 -- scripts/common.sh@354 -- # echo 2 00:25:53.505 04:27:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:53.505 04:27:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:53.505 04:27:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:53.505 04:27:43 -- scripts/common.sh@367 -- # return 0 00:25:53.505 04:27:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:53.505 04:27:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:53.505 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:53.505 --rc genhtml_branch_coverage=1 00:25:53.505 --rc genhtml_function_coverage=1 00:25:53.505 --rc genhtml_legend=1 00:25:53.505 --rc geninfo_all_blocks=1 00:25:53.505 --rc geninfo_unexecuted_blocks=1 00:25:53.505 00:25:53.505 ' 00:25:53.505 04:27:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:53.505 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:53.505 --rc genhtml_branch_coverage=1 00:25:53.505 --rc genhtml_function_coverage=1 00:25:53.505 --rc genhtml_legend=1 00:25:53.505 --rc geninfo_all_blocks=1 00:25:53.505 --rc geninfo_unexecuted_blocks=1 00:25:53.505 00:25:53.505 ' 00:25:53.505 04:27:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:53.505 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:53.505 --rc genhtml_branch_coverage=1 00:25:53.505 --rc genhtml_function_coverage=1 00:25:53.505 --rc genhtml_legend=1 00:25:53.505 --rc geninfo_all_blocks=1 00:25:53.505 --rc geninfo_unexecuted_blocks=1 00:25:53.505 00:25:53.505 ' 00:25:53.505 04:27:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:53.505 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:53.505 --rc genhtml_branch_coverage=1 00:25:53.505 --rc genhtml_function_coverage=1 00:25:53.505 --rc genhtml_legend=1 00:25:53.505 --rc geninfo_all_blocks=1 00:25:53.506 --rc geninfo_unexecuted_blocks=1 00:25:53.506 00:25:53.506 ' 00:25:53.506 04:27:43 -- host/async_init.sh@11 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:53.506 04:27:43 -- nvmf/common.sh@7 -- # uname -s 00:25:53.506 04:27:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:53.506 04:27:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:53.506 04:27:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:53.506 04:27:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:53.506 04:27:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:53.506 04:27:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:53.506 04:27:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:53.506 04:27:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:53.506 04:27:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:53.506 04:27:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:53.506 04:27:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:53.506 04:27:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:53.506 04:27:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:53.506 04:27:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:53.506 04:27:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:53.506 04:27:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:53.506 04:27:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:53.506 04:27:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:53.506 04:27:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:53.506 04:27:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.506 04:27:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.506 04:27:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.506 04:27:43 -- paths/export.sh@5 -- # export PATH 00:25:53.506 04:27:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:53.506 04:27:43 -- nvmf/common.sh@46 -- # : 0 00:25:53.506 04:27:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:53.506 04:27:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:53.506 04:27:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:53.506 04:27:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:53.506 04:27:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:53.506 04:27:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:53.506 04:27:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:53.506 04:27:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:53.506 04:27:43 -- host/async_init.sh@13 -- # null_bdev_size=1024 00:25:53.506 04:27:43 -- host/async_init.sh@14 -- # null_block_size=512 00:25:53.506 04:27:43 -- host/async_init.sh@15 -- # null_bdev=null0 00:25:53.506 04:27:43 -- host/async_init.sh@16 -- # nvme_bdev=nvme0 00:25:53.506 04:27:43 -- host/async_init.sh@20 -- # uuidgen 00:25:53.506 04:27:43 -- host/async_init.sh@20 -- # tr -d - 00:25:53.506 04:27:43 -- host/async_init.sh@20 -- # nguid=f742ad68f842424e8703b8dbcadeb132 00:25:53.506 04:27:43 -- host/async_init.sh@22 -- # nvmftestinit 00:25:53.506 04:27:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:53.506 04:27:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:53.506 04:27:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:53.506 04:27:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:53.506 04:27:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:53.506 04:27:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:53.506 04:27:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:53.506 04:27:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:53.506 04:27:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:53.506 04:27:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:53.506 04:27:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:53.506 04:27:43 -- common/autotest_common.sh@10 -- # set +x 00:25:55.407 04:27:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:25:55.407 04:27:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:25:55.407 04:27:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:25:55.407 04:27:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:25:55.407 04:27:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:25:55.407 04:27:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:25:55.407 04:27:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:25:55.407 04:27:45 -- nvmf/common.sh@294 -- # net_devs=() 00:25:55.407 04:27:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:25:55.407 04:27:45 -- nvmf/common.sh@295 -- # e810=() 00:25:55.407 04:27:45 -- nvmf/common.sh@295 -- # local -ga e810 00:25:55.407 04:27:45 -- nvmf/common.sh@296 -- # x722=() 00:25:55.407 04:27:45 -- nvmf/common.sh@296 -- # local -ga x722 00:25:55.407 04:27:45 -- nvmf/common.sh@297 -- # mlx=() 00:25:55.407 04:27:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:25:55.407 04:27:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:25:55.407 04:27:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:25:55.407 04:27:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:25:55.407 04:27:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:25:55.407 04:27:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:55.407 04:27:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:25:55.407 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:25:55.407 04:27:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:25:55.407 04:27:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:25:55.407 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:25:55.407 04:27:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:25:55.407 04:27:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:55.407 04:27:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:55.407 04:27:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:55.407 04:27:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:55.407 04:27:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:25:55.407 Found net devices under 0000:0a:00.0: cvl_0_0 00:25:55.407 04:27:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:55.407 04:27:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:25:55.407 04:27:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:25:55.407 04:27:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:25:55.407 04:27:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:25:55.407 04:27:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:25:55.407 Found net devices under 0000:0a:00.1: cvl_0_1 00:25:55.407 04:27:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:25:55.407 04:27:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:25:55.407 04:27:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:25:55.407 04:27:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:25:55.407 04:27:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:25:55.407 04:27:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:25:55.407 04:27:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:25:55.407 04:27:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:25:55.407 04:27:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:25:55.407 04:27:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:25:55.407 04:27:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:25:55.407 04:27:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:25:55.407 04:27:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:25:55.407 04:27:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:25:55.407 04:27:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:25:55.407 04:27:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:25:55.407 04:27:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:25:55.407 04:27:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:25:55.407 04:27:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:25:55.407 04:27:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:25:55.407 04:27:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:25:55.407 04:27:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:25:55.407 04:27:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:25:55.407 04:27:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:25:55.407 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:25:55.407 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.360 ms 00:25:55.407 00:25:55.407 --- 10.0.0.2 ping statistics --- 00:25:55.407 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:55.407 rtt min/avg/max/mdev = 0.360/0.360/0.360/0.000 ms 00:25:55.407 04:27:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:25:55.407 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:25:55.407 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.143 ms 00:25:55.407 00:25:55.407 --- 10.0.0.1 ping statistics --- 00:25:55.407 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:25:55.407 rtt min/avg/max/mdev = 0.143/0.143/0.143/0.000 ms 00:25:55.407 04:27:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:25:55.407 04:27:45 -- nvmf/common.sh@410 -- # return 0 00:25:55.407 04:27:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:25:55.407 04:27:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:25:55.407 04:27:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:25:55.407 04:27:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:25:55.407 04:27:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:25:55.407 04:27:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:25:55.407 04:27:45 -- host/async_init.sh@23 -- # nvmfappstart -m 0x1 00:25:55.407 04:27:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:25:55.407 04:27:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:25:55.407 04:27:45 -- common/autotest_common.sh@10 -- # set +x 00:25:55.407 04:27:45 -- nvmf/common.sh@469 -- # nvmfpid=2446455 00:25:55.407 04:27:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x1 00:25:55.407 04:27:45 -- nvmf/common.sh@470 -- # waitforlisten 2446455 00:25:55.407 04:27:45 -- common/autotest_common.sh@829 -- # '[' -z 2446455 ']' 00:25:55.407 04:27:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:25:55.407 04:27:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:25:55.407 04:27:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:25:55.407 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:25:55.407 04:27:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:25:55.407 04:27:45 -- common/autotest_common.sh@10 -- # set +x 00:25:55.407 [2024-11-30 04:27:45.922035] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:25:55.408 [2024-11-30 04:27:45.922132] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:25:55.408 EAL: No free 2048 kB hugepages reported on node 1 00:25:55.408 [2024-11-30 04:27:45.986680] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:25:55.666 [2024-11-30 04:27:46.074529] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:25:55.666 [2024-11-30 04:27:46.074679] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:25:55.666 [2024-11-30 04:27:46.074694] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:25:55.666 [2024-11-30 04:27:46.074707] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:25:55.666 [2024-11-30 04:27:46.074741] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:25:56.599 04:27:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:25:56.599 04:27:46 -- common/autotest_common.sh@862 -- # return 0 00:25:56.599 04:27:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:25:56.599 04:27:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:25:56.599 04:27:46 -- common/autotest_common.sh@10 -- # set +x 00:25:56.599 04:27:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:25:56.599 04:27:46 -- host/async_init.sh@26 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:25:56.599 04:27:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.599 04:27:46 -- common/autotest_common.sh@10 -- # set +x 00:25:56.599 [2024-11-30 04:27:46.916367] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:25:56.599 04:27:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.599 04:27:46 -- host/async_init.sh@27 -- # rpc_cmd bdev_null_create null0 1024 512 00:25:56.599 04:27:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.599 04:27:46 -- common/autotest_common.sh@10 -- # set +x 00:25:56.599 null0 00:25:56.599 04:27:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.599 04:27:46 -- host/async_init.sh@28 -- # rpc_cmd bdev_wait_for_examine 00:25:56.599 04:27:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.599 04:27:46 -- common/autotest_common.sh@10 -- # set +x 00:25:56.599 04:27:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.599 04:27:46 -- host/async_init.sh@29 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 -a 00:25:56.599 04:27:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.599 04:27:46 -- common/autotest_common.sh@10 -- # set +x 00:25:56.599 04:27:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.599 04:27:46 -- host/async_init.sh@30 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 -g f742ad68f842424e8703b8dbcadeb132 00:25:56.599 04:27:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.599 04:27:46 -- common/autotest_common.sh@10 -- # set +x 00:25:56.599 04:27:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.599 04:27:46 -- host/async_init.sh@31 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:25:56.599 04:27:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.599 04:27:46 -- common/autotest_common.sh@10 -- # set +x 00:25:56.599 [2024-11-30 04:27:46.956638] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:25:56.599 04:27:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.599 04:27:46 -- host/async_init.sh@37 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4420 -n nqn.2016-06.io.spdk:cnode0 00:25:56.599 04:27:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.599 04:27:46 -- common/autotest_common.sh@10 -- # set +x 00:25:56.599 nvme0n1 00:25:56.599 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.599 04:27:47 -- host/async_init.sh@41 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:56.599 04:27:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.599 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:25:56.599 [ 00:25:56.599 { 00:25:56.599 "name": "nvme0n1", 00:25:56.599 "aliases": [ 00:25:56.599 "f742ad68-f842-424e-8703-b8dbcadeb132" 00:25:56.599 ], 00:25:56.599 "product_name": "NVMe disk", 00:25:56.599 "block_size": 512, 00:25:56.599 "num_blocks": 2097152, 00:25:56.599 "uuid": "f742ad68-f842-424e-8703-b8dbcadeb132", 00:25:56.599 "assigned_rate_limits": { 00:25:56.599 "rw_ios_per_sec": 0, 00:25:56.599 "rw_mbytes_per_sec": 0, 00:25:56.599 "r_mbytes_per_sec": 0, 00:25:56.599 "w_mbytes_per_sec": 0 00:25:56.599 }, 00:25:56.599 "claimed": false, 00:25:56.599 "zoned": false, 00:25:56.599 "supported_io_types": { 00:25:56.599 "read": true, 00:25:56.599 "write": true, 00:25:56.599 "unmap": false, 00:25:56.599 "write_zeroes": true, 00:25:56.599 "flush": true, 00:25:56.599 "reset": true, 00:25:56.599 "compare": true, 00:25:56.599 "compare_and_write": true, 00:25:56.599 "abort": true, 00:25:56.599 "nvme_admin": true, 00:25:56.599 "nvme_io": true 00:25:56.599 }, 00:25:56.599 "driver_specific": { 00:25:56.599 "nvme": [ 00:25:56.599 { 00:25:56.599 "trid": { 00:25:56.599 "trtype": "TCP", 00:25:56.599 "adrfam": "IPv4", 00:25:56.599 "traddr": "10.0.0.2", 00:25:56.599 "trsvcid": "4420", 00:25:56.599 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:56.599 }, 00:25:56.599 "ctrlr_data": { 00:25:56.599 "cntlid": 1, 00:25:56.599 "vendor_id": "0x8086", 00:25:56.599 "model_number": "SPDK bdev Controller", 00:25:56.599 "serial_number": "00000000000000000000", 00:25:56.599 "firmware_revision": "24.01.1", 00:25:56.599 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:56.599 "oacs": { 00:25:56.599 "security": 0, 00:25:56.599 "format": 0, 00:25:56.599 "firmware": 0, 00:25:56.599 "ns_manage": 0 00:25:56.599 }, 00:25:56.599 "multi_ctrlr": true, 00:25:56.599 "ana_reporting": false 00:25:56.599 }, 00:25:56.599 "vs": { 00:25:56.599 "nvme_version": "1.3" 00:25:56.599 }, 00:25:56.599 "ns_data": { 00:25:56.599 "id": 1, 00:25:56.599 "can_share": true 00:25:56.599 } 00:25:56.599 } 00:25:56.599 ], 00:25:56.599 "mp_policy": "active_passive" 00:25:56.599 } 00:25:56.599 } 00:25:56.599 ] 00:25:56.599 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.599 04:27:47 -- host/async_init.sh@44 -- # rpc_cmd bdev_nvme_reset_controller nvme0 00:25:56.599 04:27:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.599 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:25:56.599 [2024-11-30 04:27:47.205352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:25:56.599 [2024-11-30 04:27:47.205453] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0xa203f0 (9): Bad file descriptor 00:25:56.857 [2024-11-30 04:27:47.338111] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:25:56.857 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.857 04:27:47 -- host/async_init.sh@47 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:56.857 04:27:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.857 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:25:56.857 [ 00:25:56.857 { 00:25:56.857 "name": "nvme0n1", 00:25:56.857 "aliases": [ 00:25:56.857 "f742ad68-f842-424e-8703-b8dbcadeb132" 00:25:56.857 ], 00:25:56.857 "product_name": "NVMe disk", 00:25:56.857 "block_size": 512, 00:25:56.857 "num_blocks": 2097152, 00:25:56.857 "uuid": "f742ad68-f842-424e-8703-b8dbcadeb132", 00:25:56.857 "assigned_rate_limits": { 00:25:56.857 "rw_ios_per_sec": 0, 00:25:56.857 "rw_mbytes_per_sec": 0, 00:25:56.857 "r_mbytes_per_sec": 0, 00:25:56.857 "w_mbytes_per_sec": 0 00:25:56.857 }, 00:25:56.857 "claimed": false, 00:25:56.857 "zoned": false, 00:25:56.857 "supported_io_types": { 00:25:56.857 "read": true, 00:25:56.857 "write": true, 00:25:56.857 "unmap": false, 00:25:56.857 "write_zeroes": true, 00:25:56.857 "flush": true, 00:25:56.857 "reset": true, 00:25:56.857 "compare": true, 00:25:56.857 "compare_and_write": true, 00:25:56.857 "abort": true, 00:25:56.857 "nvme_admin": true, 00:25:56.857 "nvme_io": true 00:25:56.857 }, 00:25:56.857 "driver_specific": { 00:25:56.857 "nvme": [ 00:25:56.857 { 00:25:56.857 "trid": { 00:25:56.857 "trtype": "TCP", 00:25:56.857 "adrfam": "IPv4", 00:25:56.858 "traddr": "10.0.0.2", 00:25:56.858 "trsvcid": "4420", 00:25:56.858 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:56.858 }, 00:25:56.858 "ctrlr_data": { 00:25:56.858 "cntlid": 2, 00:25:56.858 "vendor_id": "0x8086", 00:25:56.858 "model_number": "SPDK bdev Controller", 00:25:56.858 "serial_number": "00000000000000000000", 00:25:56.858 "firmware_revision": "24.01.1", 00:25:56.858 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:56.858 "oacs": { 00:25:56.858 "security": 0, 00:25:56.858 "format": 0, 00:25:56.858 "firmware": 0, 00:25:56.858 "ns_manage": 0 00:25:56.858 }, 00:25:56.858 "multi_ctrlr": true, 00:25:56.858 "ana_reporting": false 00:25:56.858 }, 00:25:56.858 "vs": { 00:25:56.858 "nvme_version": "1.3" 00:25:56.858 }, 00:25:56.858 "ns_data": { 00:25:56.858 "id": 1, 00:25:56.858 "can_share": true 00:25:56.858 } 00:25:56.858 } 00:25:56.858 ], 00:25:56.858 "mp_policy": "active_passive" 00:25:56.858 } 00:25:56.858 } 00:25:56.858 ] 00:25:56.858 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.858 04:27:47 -- host/async_init.sh@50 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:56.858 04:27:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.858 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:25:56.858 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.858 04:27:47 -- host/async_init.sh@53 -- # mktemp 00:25:56.858 04:27:47 -- host/async_init.sh@53 -- # key_path=/tmp/tmp.5vJeKhmLvC 00:25:56.858 04:27:47 -- host/async_init.sh@54 -- # echo -n NVMeTLSkey-1:01:MDAxMTIyMzM0NDU1NjY3Nzg4OTlhYWJiY2NkZGVlZmZwJEiQ: 00:25:56.858 04:27:47 -- host/async_init.sh@55 -- # chmod 0600 /tmp/tmp.5vJeKhmLvC 00:25:56.858 04:27:47 -- host/async_init.sh@56 -- # rpc_cmd nvmf_subsystem_allow_any_host nqn.2016-06.io.spdk:cnode0 --disable 00:25:56.858 04:27:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.858 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:25:56.858 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.858 04:27:47 -- host/async_init.sh@57 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 --secure-channel 00:25:56.858 04:27:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.858 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:25:56.858 [2024-11-30 04:27:47.385972] tcp.c: 914:nvmf_tcp_listen: *NOTICE*: TLS support is considered experimental 00:25:56.858 [2024-11-30 04:27:47.386117] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:25:56.858 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.858 04:27:47 -- host/async_init.sh@59 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.5vJeKhmLvC 00:25:56.858 04:27:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.858 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:25:56.858 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.858 04:27:47 -- host/async_init.sh@65 -- # rpc_cmd bdev_nvme_attach_controller -b nvme0 -t tcp -a 10.0.0.2 -f ipv4 -s 4421 -n nqn.2016-06.io.spdk:cnode0 -q nqn.2016-06.io.spdk:host1 --psk /tmp/tmp.5vJeKhmLvC 00:25:56.858 04:27:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.858 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:25:56.858 [2024-11-30 04:27:47.401994] bdev_nvme_rpc.c: 477:rpc_bdev_nvme_attach_controller: *NOTICE*: TLS support is considered experimental 00:25:56.858 nvme0n1 00:25:56.858 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:56.858 04:27:47 -- host/async_init.sh@69 -- # rpc_cmd bdev_get_bdevs -b nvme0n1 00:25:56.858 04:27:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:56.858 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:25:56.858 [ 00:25:56.858 { 00:25:56.858 "name": "nvme0n1", 00:25:56.858 "aliases": [ 00:25:56.858 "f742ad68-f842-424e-8703-b8dbcadeb132" 00:25:56.858 ], 00:25:56.858 "product_name": "NVMe disk", 00:25:56.858 "block_size": 512, 00:25:56.858 "num_blocks": 2097152, 00:25:56.858 "uuid": "f742ad68-f842-424e-8703-b8dbcadeb132", 00:25:56.858 "assigned_rate_limits": { 00:25:56.858 "rw_ios_per_sec": 0, 00:25:56.858 "rw_mbytes_per_sec": 0, 00:25:56.858 "r_mbytes_per_sec": 0, 00:25:56.858 "w_mbytes_per_sec": 0 00:25:56.858 }, 00:25:56.858 "claimed": false, 00:25:56.858 "zoned": false, 00:25:56.858 "supported_io_types": { 00:25:56.858 "read": true, 00:25:56.858 "write": true, 00:25:56.858 "unmap": false, 00:25:56.858 "write_zeroes": true, 00:25:56.858 "flush": true, 00:25:56.858 "reset": true, 00:25:56.858 "compare": true, 00:25:56.858 "compare_and_write": true, 00:25:56.858 "abort": true, 00:25:56.858 "nvme_admin": true, 00:25:56.858 "nvme_io": true 00:25:56.858 }, 00:25:56.858 "driver_specific": { 00:25:56.858 "nvme": [ 00:25:56.858 { 00:25:56.858 "trid": { 00:25:56.858 "trtype": "TCP", 00:25:56.858 "adrfam": "IPv4", 00:25:56.858 "traddr": "10.0.0.2", 00:25:56.858 "trsvcid": "4421", 00:25:56.858 "subnqn": "nqn.2016-06.io.spdk:cnode0" 00:25:56.858 }, 00:25:56.858 "ctrlr_data": { 00:25:56.858 "cntlid": 3, 00:25:56.858 "vendor_id": "0x8086", 00:25:56.858 "model_number": "SPDK bdev Controller", 00:25:56.858 "serial_number": "00000000000000000000", 00:25:56.858 "firmware_revision": "24.01.1", 00:25:56.858 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:25:56.858 "oacs": { 00:25:56.858 "security": 0, 00:25:56.858 "format": 0, 00:25:56.858 "firmware": 0, 00:25:56.858 "ns_manage": 0 00:25:56.858 }, 00:25:56.858 "multi_ctrlr": true, 00:25:56.858 "ana_reporting": false 00:25:56.858 }, 00:25:56.858 "vs": { 00:25:56.858 "nvme_version": "1.3" 00:25:56.858 }, 00:25:56.858 "ns_data": { 00:25:56.858 "id": 1, 00:25:56.858 "can_share": true 00:25:56.858 } 00:25:56.858 } 00:25:56.858 ], 00:25:56.858 "mp_policy": "active_passive" 00:25:56.858 } 00:25:56.858 } 00:25:56.858 ] 00:25:57.116 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:57.116 04:27:47 -- host/async_init.sh@72 -- # rpc_cmd bdev_nvme_detach_controller nvme0 00:25:57.116 04:27:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:25:57.116 04:27:47 -- common/autotest_common.sh@10 -- # set +x 00:25:57.116 04:27:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:25:57.116 04:27:47 -- host/async_init.sh@75 -- # rm -f /tmp/tmp.5vJeKhmLvC 00:25:57.116 04:27:47 -- host/async_init.sh@77 -- # trap - SIGINT SIGTERM EXIT 00:25:57.116 04:27:47 -- host/async_init.sh@78 -- # nvmftestfini 00:25:57.116 04:27:47 -- nvmf/common.sh@476 -- # nvmfcleanup 00:25:57.116 04:27:47 -- nvmf/common.sh@116 -- # sync 00:25:57.116 04:27:47 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:25:57.116 04:27:47 -- nvmf/common.sh@119 -- # set +e 00:25:57.116 04:27:47 -- nvmf/common.sh@120 -- # for i in {1..20} 00:25:57.116 04:27:47 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:25:57.116 rmmod nvme_tcp 00:25:57.116 rmmod nvme_fabrics 00:25:57.116 rmmod nvme_keyring 00:25:57.116 04:27:47 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:25:57.116 04:27:47 -- nvmf/common.sh@123 -- # set -e 00:25:57.116 04:27:47 -- nvmf/common.sh@124 -- # return 0 00:25:57.116 04:27:47 -- nvmf/common.sh@477 -- # '[' -n 2446455 ']' 00:25:57.116 04:27:47 -- nvmf/common.sh@478 -- # killprocess 2446455 00:25:57.116 04:27:47 -- common/autotest_common.sh@936 -- # '[' -z 2446455 ']' 00:25:57.116 04:27:47 -- common/autotest_common.sh@940 -- # kill -0 2446455 00:25:57.116 04:27:47 -- common/autotest_common.sh@941 -- # uname 00:25:57.116 04:27:47 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:25:57.116 04:27:47 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2446455 00:25:57.116 04:27:47 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:25:57.116 04:27:47 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:25:57.116 04:27:47 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2446455' 00:25:57.116 killing process with pid 2446455 00:25:57.116 04:27:47 -- common/autotest_common.sh@955 -- # kill 2446455 00:25:57.116 04:27:47 -- common/autotest_common.sh@960 -- # wait 2446455 00:25:57.374 04:27:47 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:25:57.374 04:27:47 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:25:57.374 04:27:47 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:25:57.374 04:27:47 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:25:57.374 04:27:47 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:25:57.374 04:27:47 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:57.374 04:27:47 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:57.374 04:27:47 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:59.343 04:27:49 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:25:59.343 00:25:59.343 real 0m6.331s 00:25:59.343 user 0m3.077s 00:25:59.343 sys 0m1.893s 00:25:59.343 04:27:49 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:59.343 04:27:49 -- common/autotest_common.sh@10 -- # set +x 00:25:59.343 ************************************ 00:25:59.343 END TEST nvmf_async_init 00:25:59.343 ************************************ 00:25:59.343 04:27:49 -- nvmf/nvmf.sh@94 -- # run_test dma /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:59.343 04:27:49 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:59.343 04:27:49 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:59.343 04:27:49 -- common/autotest_common.sh@10 -- # set +x 00:25:59.343 ************************************ 00:25:59.343 START TEST dma 00:25:59.343 ************************************ 00:25:59.343 04:27:49 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/dma.sh --transport=tcp 00:25:59.343 * Looking for test storage... 00:25:59.343 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:59.343 04:27:49 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:59.343 04:27:49 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:59.343 04:27:49 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:59.602 04:27:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:59.602 04:27:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:59.602 04:27:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:59.602 04:27:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:59.602 04:27:50 -- scripts/common.sh@335 -- # IFS=.-: 00:25:59.602 04:27:50 -- scripts/common.sh@335 -- # read -ra ver1 00:25:59.602 04:27:50 -- scripts/common.sh@336 -- # IFS=.-: 00:25:59.602 04:27:50 -- scripts/common.sh@336 -- # read -ra ver2 00:25:59.602 04:27:50 -- scripts/common.sh@337 -- # local 'op=<' 00:25:59.602 04:27:50 -- scripts/common.sh@339 -- # ver1_l=2 00:25:59.602 04:27:50 -- scripts/common.sh@340 -- # ver2_l=1 00:25:59.602 04:27:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:59.602 04:27:50 -- scripts/common.sh@343 -- # case "$op" in 00:25:59.602 04:27:50 -- scripts/common.sh@344 -- # : 1 00:25:59.602 04:27:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:59.602 04:27:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:59.602 04:27:50 -- scripts/common.sh@364 -- # decimal 1 00:25:59.602 04:27:50 -- scripts/common.sh@352 -- # local d=1 00:25:59.602 04:27:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:59.602 04:27:50 -- scripts/common.sh@354 -- # echo 1 00:25:59.602 04:27:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:59.602 04:27:50 -- scripts/common.sh@365 -- # decimal 2 00:25:59.602 04:27:50 -- scripts/common.sh@352 -- # local d=2 00:25:59.602 04:27:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:59.602 04:27:50 -- scripts/common.sh@354 -- # echo 2 00:25:59.602 04:27:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:59.602 04:27:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:59.602 04:27:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:59.602 04:27:50 -- scripts/common.sh@367 -- # return 0 00:25:59.602 04:27:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:59.602 04:27:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:59.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:59.602 --rc genhtml_branch_coverage=1 00:25:59.602 --rc genhtml_function_coverage=1 00:25:59.602 --rc genhtml_legend=1 00:25:59.602 --rc geninfo_all_blocks=1 00:25:59.602 --rc geninfo_unexecuted_blocks=1 00:25:59.602 00:25:59.602 ' 00:25:59.602 04:27:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:59.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:59.602 --rc genhtml_branch_coverage=1 00:25:59.602 --rc genhtml_function_coverage=1 00:25:59.602 --rc genhtml_legend=1 00:25:59.602 --rc geninfo_all_blocks=1 00:25:59.602 --rc geninfo_unexecuted_blocks=1 00:25:59.602 00:25:59.602 ' 00:25:59.602 04:27:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:59.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:59.602 --rc genhtml_branch_coverage=1 00:25:59.602 --rc genhtml_function_coverage=1 00:25:59.602 --rc genhtml_legend=1 00:25:59.602 --rc geninfo_all_blocks=1 00:25:59.602 --rc geninfo_unexecuted_blocks=1 00:25:59.602 00:25:59.602 ' 00:25:59.602 04:27:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:59.602 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:59.602 --rc genhtml_branch_coverage=1 00:25:59.602 --rc genhtml_function_coverage=1 00:25:59.602 --rc genhtml_legend=1 00:25:59.602 --rc geninfo_all_blocks=1 00:25:59.602 --rc geninfo_unexecuted_blocks=1 00:25:59.602 00:25:59.602 ' 00:25:59.602 04:27:50 -- host/dma.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:59.602 04:27:50 -- nvmf/common.sh@7 -- # uname -s 00:25:59.602 04:27:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:59.602 04:27:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:59.602 04:27:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:59.602 04:27:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:59.602 04:27:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:59.602 04:27:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:59.602 04:27:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:59.602 04:27:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:59.602 04:27:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:59.602 04:27:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:59.602 04:27:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:59.602 04:27:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:59.602 04:27:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:59.602 04:27:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:59.602 04:27:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:59.602 04:27:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:59.602 04:27:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:59.602 04:27:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:59.602 04:27:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:59.602 04:27:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.602 04:27:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.602 04:27:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.602 04:27:50 -- paths/export.sh@5 -- # export PATH 00:25:59.602 04:27:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.602 04:27:50 -- nvmf/common.sh@46 -- # : 0 00:25:59.602 04:27:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:59.602 04:27:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:59.602 04:27:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:59.602 04:27:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:59.602 04:27:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:59.602 04:27:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:59.602 04:27:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:59.602 04:27:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:59.602 04:27:50 -- host/dma.sh@12 -- # '[' tcp '!=' rdma ']' 00:25:59.602 04:27:50 -- host/dma.sh@13 -- # exit 0 00:25:59.602 00:25:59.602 real 0m0.171s 00:25:59.602 user 0m0.117s 00:25:59.602 sys 0m0.062s 00:25:59.602 04:27:50 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:25:59.602 04:27:50 -- common/autotest_common.sh@10 -- # set +x 00:25:59.602 ************************************ 00:25:59.602 END TEST dma 00:25:59.602 ************************************ 00:25:59.602 04:27:50 -- nvmf/nvmf.sh@97 -- # run_test nvmf_identify /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:59.602 04:27:50 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:25:59.602 04:27:50 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:25:59.602 04:27:50 -- common/autotest_common.sh@10 -- # set +x 00:25:59.602 ************************************ 00:25:59.602 START TEST nvmf_identify 00:25:59.602 ************************************ 00:25:59.602 04:27:50 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/identify.sh --transport=tcp 00:25:59.602 * Looking for test storage... 00:25:59.602 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:25:59.602 04:27:50 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:25:59.602 04:27:50 -- common/autotest_common.sh@1690 -- # lcov --version 00:25:59.603 04:27:50 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:25:59.878 04:27:50 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:25:59.878 04:27:50 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:25:59.878 04:27:50 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:25:59.878 04:27:50 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:25:59.878 04:27:50 -- scripts/common.sh@335 -- # IFS=.-: 00:25:59.878 04:27:50 -- scripts/common.sh@335 -- # read -ra ver1 00:25:59.878 04:27:50 -- scripts/common.sh@336 -- # IFS=.-: 00:25:59.878 04:27:50 -- scripts/common.sh@336 -- # read -ra ver2 00:25:59.878 04:27:50 -- scripts/common.sh@337 -- # local 'op=<' 00:25:59.878 04:27:50 -- scripts/common.sh@339 -- # ver1_l=2 00:25:59.878 04:27:50 -- scripts/common.sh@340 -- # ver2_l=1 00:25:59.878 04:27:50 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:25:59.878 04:27:50 -- scripts/common.sh@343 -- # case "$op" in 00:25:59.878 04:27:50 -- scripts/common.sh@344 -- # : 1 00:25:59.878 04:27:50 -- scripts/common.sh@363 -- # (( v = 0 )) 00:25:59.878 04:27:50 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:25:59.878 04:27:50 -- scripts/common.sh@364 -- # decimal 1 00:25:59.878 04:27:50 -- scripts/common.sh@352 -- # local d=1 00:25:59.878 04:27:50 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:25:59.878 04:27:50 -- scripts/common.sh@354 -- # echo 1 00:25:59.878 04:27:50 -- scripts/common.sh@364 -- # ver1[v]=1 00:25:59.878 04:27:50 -- scripts/common.sh@365 -- # decimal 2 00:25:59.878 04:27:50 -- scripts/common.sh@352 -- # local d=2 00:25:59.878 04:27:50 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:25:59.878 04:27:50 -- scripts/common.sh@354 -- # echo 2 00:25:59.878 04:27:50 -- scripts/common.sh@365 -- # ver2[v]=2 00:25:59.878 04:27:50 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:25:59.878 04:27:50 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:25:59.878 04:27:50 -- scripts/common.sh@367 -- # return 0 00:25:59.878 04:27:50 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:25:59.878 04:27:50 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:25:59.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:59.878 --rc genhtml_branch_coverage=1 00:25:59.878 --rc genhtml_function_coverage=1 00:25:59.878 --rc genhtml_legend=1 00:25:59.878 --rc geninfo_all_blocks=1 00:25:59.878 --rc geninfo_unexecuted_blocks=1 00:25:59.878 00:25:59.878 ' 00:25:59.878 04:27:50 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:25:59.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:59.878 --rc genhtml_branch_coverage=1 00:25:59.878 --rc genhtml_function_coverage=1 00:25:59.878 --rc genhtml_legend=1 00:25:59.878 --rc geninfo_all_blocks=1 00:25:59.878 --rc geninfo_unexecuted_blocks=1 00:25:59.878 00:25:59.878 ' 00:25:59.878 04:27:50 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:25:59.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:59.878 --rc genhtml_branch_coverage=1 00:25:59.878 --rc genhtml_function_coverage=1 00:25:59.878 --rc genhtml_legend=1 00:25:59.878 --rc geninfo_all_blocks=1 00:25:59.878 --rc geninfo_unexecuted_blocks=1 00:25:59.878 00:25:59.878 ' 00:25:59.878 04:27:50 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:25:59.878 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:25:59.878 --rc genhtml_branch_coverage=1 00:25:59.878 --rc genhtml_function_coverage=1 00:25:59.878 --rc genhtml_legend=1 00:25:59.878 --rc geninfo_all_blocks=1 00:25:59.878 --rc geninfo_unexecuted_blocks=1 00:25:59.878 00:25:59.878 ' 00:25:59.878 04:27:50 -- host/identify.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:25:59.878 04:27:50 -- nvmf/common.sh@7 -- # uname -s 00:25:59.878 04:27:50 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:25:59.878 04:27:50 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:25:59.878 04:27:50 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:25:59.878 04:27:50 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:25:59.878 04:27:50 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:25:59.878 04:27:50 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:25:59.878 04:27:50 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:25:59.878 04:27:50 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:25:59.878 04:27:50 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:25:59.878 04:27:50 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:25:59.878 04:27:50 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:25:59.878 04:27:50 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:25:59.878 04:27:50 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:25:59.878 04:27:50 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:25:59.878 04:27:50 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:25:59.878 04:27:50 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:25:59.878 04:27:50 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:25:59.878 04:27:50 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:25:59.878 04:27:50 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:25:59.878 04:27:50 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.878 04:27:50 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.878 04:27:50 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.878 04:27:50 -- paths/export.sh@5 -- # export PATH 00:25:59.878 04:27:50 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:25:59.878 04:27:50 -- nvmf/common.sh@46 -- # : 0 00:25:59.878 04:27:50 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:25:59.878 04:27:50 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:25:59.878 04:27:50 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:25:59.878 04:27:50 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:25:59.878 04:27:50 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:25:59.878 04:27:50 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:25:59.878 04:27:50 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:25:59.878 04:27:50 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:25:59.878 04:27:50 -- host/identify.sh@11 -- # MALLOC_BDEV_SIZE=64 00:25:59.878 04:27:50 -- host/identify.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:25:59.878 04:27:50 -- host/identify.sh@14 -- # nvmftestinit 00:25:59.878 04:27:50 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:25:59.879 04:27:50 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:25:59.879 04:27:50 -- nvmf/common.sh@436 -- # prepare_net_devs 00:25:59.879 04:27:50 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:25:59.879 04:27:50 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:25:59.879 04:27:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:25:59.879 04:27:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:25:59.879 04:27:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:25:59.879 04:27:50 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:25:59.879 04:27:50 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:25:59.879 04:27:50 -- nvmf/common.sh@284 -- # xtrace_disable 00:25:59.879 04:27:50 -- common/autotest_common.sh@10 -- # set +x 00:26:01.779 04:27:52 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:01.779 04:27:52 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:01.779 04:27:52 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:01.779 04:27:52 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:01.779 04:27:52 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:01.779 04:27:52 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:01.779 04:27:52 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:01.779 04:27:52 -- nvmf/common.sh@294 -- # net_devs=() 00:26:01.779 04:27:52 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:01.779 04:27:52 -- nvmf/common.sh@295 -- # e810=() 00:26:01.779 04:27:52 -- nvmf/common.sh@295 -- # local -ga e810 00:26:01.779 04:27:52 -- nvmf/common.sh@296 -- # x722=() 00:26:01.779 04:27:52 -- nvmf/common.sh@296 -- # local -ga x722 00:26:01.779 04:27:52 -- nvmf/common.sh@297 -- # mlx=() 00:26:01.779 04:27:52 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:01.779 04:27:52 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:01.779 04:27:52 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:01.779 04:27:52 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:01.779 04:27:52 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:01.779 04:27:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:01.779 04:27:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:01.779 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:01.779 04:27:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:01.779 04:27:52 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:01.779 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:01.779 04:27:52 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:01.779 04:27:52 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:01.779 04:27:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:01.779 04:27:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:01.779 04:27:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:01.779 04:27:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:01.779 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:01.779 04:27:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:01.779 04:27:52 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:01.779 04:27:52 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:01.779 04:27:52 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:01.779 04:27:52 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:01.779 04:27:52 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:01.779 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:01.779 04:27:52 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:01.779 04:27:52 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:01.779 04:27:52 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:01.779 04:27:52 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:01.779 04:27:52 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:01.779 04:27:52 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:01.779 04:27:52 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:01.779 04:27:52 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:01.779 04:27:52 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:01.779 04:27:52 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:01.779 04:27:52 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:01.779 04:27:52 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:01.779 04:27:52 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:01.779 04:27:52 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:01.779 04:27:52 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:01.779 04:27:52 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:01.779 04:27:52 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:01.779 04:27:52 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:01.779 04:27:52 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:01.779 04:27:52 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:01.779 04:27:52 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:01.779 04:27:52 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:01.779 04:27:52 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:01.779 04:27:52 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:01.779 04:27:52 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:01.779 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:01.779 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.303 ms 00:26:01.779 00:26:01.780 --- 10.0.0.2 ping statistics --- 00:26:01.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:01.780 rtt min/avg/max/mdev = 0.303/0.303/0.303/0.000 ms 00:26:01.780 04:27:52 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:01.780 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:01.780 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.100 ms 00:26:01.780 00:26:01.780 --- 10.0.0.1 ping statistics --- 00:26:01.780 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:01.780 rtt min/avg/max/mdev = 0.100/0.100/0.100/0.000 ms 00:26:01.780 04:27:52 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:01.780 04:27:52 -- nvmf/common.sh@410 -- # return 0 00:26:01.780 04:27:52 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:01.780 04:27:52 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:01.780 04:27:52 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:01.780 04:27:52 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:01.780 04:27:52 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:01.780 04:27:52 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:01.780 04:27:52 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:02.038 04:27:52 -- host/identify.sh@16 -- # timing_enter start_nvmf_tgt 00:26:02.038 04:27:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:02.038 04:27:52 -- common/autotest_common.sh@10 -- # set +x 00:26:02.038 04:27:52 -- host/identify.sh@19 -- # nvmfpid=2448760 00:26:02.038 04:27:52 -- host/identify.sh@18 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:02.038 04:27:52 -- host/identify.sh@21 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:26:02.038 04:27:52 -- host/identify.sh@23 -- # waitforlisten 2448760 00:26:02.038 04:27:52 -- common/autotest_common.sh@829 -- # '[' -z 2448760 ']' 00:26:02.038 04:27:52 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:02.038 04:27:52 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:02.038 04:27:52 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:02.038 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:02.038 04:27:52 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:02.038 04:27:52 -- common/autotest_common.sh@10 -- # set +x 00:26:02.038 [2024-11-30 04:27:52.475447] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:02.038 [2024-11-30 04:27:52.475531] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:02.038 EAL: No free 2048 kB hugepages reported on node 1 00:26:02.038 [2024-11-30 04:27:52.547627] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:02.038 [2024-11-30 04:27:52.640029] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:02.038 [2024-11-30 04:27:52.640183] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:02.038 [2024-11-30 04:27:52.640204] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:02.038 [2024-11-30 04:27:52.640219] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:02.038 [2024-11-30 04:27:52.640289] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:02.038 [2024-11-30 04:27:52.640360] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:02.038 [2024-11-30 04:27:52.640381] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:02.038 [2024-11-30 04:27:52.640385] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:02.971 04:27:53 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:02.971 04:27:53 -- common/autotest_common.sh@862 -- # return 0 00:26:02.971 04:27:53 -- host/identify.sh@24 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:26:02.971 04:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.971 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:26:02.971 [2024-11-30 04:27:53.484648] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:02.971 04:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.971 04:27:53 -- host/identify.sh@25 -- # timing_exit start_nvmf_tgt 00:26:02.971 04:27:53 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:02.971 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:26:02.971 04:27:53 -- host/identify.sh@27 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:26:02.971 04:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.971 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:26:02.971 Malloc0 00:26:02.971 04:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.971 04:27:53 -- host/identify.sh@28 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:02.971 04:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.971 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:26:02.971 04:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.971 04:27:53 -- host/identify.sh@31 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 --nguid ABCDEF0123456789ABCDEF0123456789 --eui64 ABCDEF0123456789 00:26:02.971 04:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.971 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:26:02.971 04:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.971 04:27:53 -- host/identify.sh@34 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:02.972 04:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.972 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:26:02.972 [2024-11-30 04:27:53.566461] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:02.972 04:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.972 04:27:53 -- host/identify.sh@35 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:02.972 04:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.972 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:26:02.972 04:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.972 04:27:53 -- host/identify.sh@37 -- # rpc_cmd nvmf_get_subsystems 00:26:02.972 04:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:02.972 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:26:02.972 [2024-11-30 04:27:53.582180] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:26:02.972 [ 00:26:02.972 { 00:26:02.972 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:26:02.972 "subtype": "Discovery", 00:26:02.972 "listen_addresses": [ 00:26:02.972 { 00:26:02.972 "transport": "TCP", 00:26:02.972 "trtype": "TCP", 00:26:02.972 "adrfam": "IPv4", 00:26:02.972 "traddr": "10.0.0.2", 00:26:02.972 "trsvcid": "4420" 00:26:02.972 } 00:26:02.972 ], 00:26:02.972 "allow_any_host": true, 00:26:02.972 "hosts": [] 00:26:02.972 }, 00:26:02.972 { 00:26:02.972 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:26:02.972 "subtype": "NVMe", 00:26:02.972 "listen_addresses": [ 00:26:02.972 { 00:26:02.972 "transport": "TCP", 00:26:02.972 "trtype": "TCP", 00:26:02.972 "adrfam": "IPv4", 00:26:02.972 "traddr": "10.0.0.2", 00:26:02.972 "trsvcid": "4420" 00:26:02.972 } 00:26:02.972 ], 00:26:02.972 "allow_any_host": true, 00:26:02.972 "hosts": [], 00:26:02.972 "serial_number": "SPDK00000000000001", 00:26:02.972 "model_number": "SPDK bdev Controller", 00:26:02.972 "max_namespaces": 32, 00:26:02.972 "min_cntlid": 1, 00:26:02.972 "max_cntlid": 65519, 00:26:02.972 "namespaces": [ 00:26:02.972 { 00:26:02.972 "nsid": 1, 00:26:02.972 "bdev_name": "Malloc0", 00:26:02.972 "name": "Malloc0", 00:26:02.972 "nguid": "ABCDEF0123456789ABCDEF0123456789", 00:26:02.972 "eui64": "ABCDEF0123456789", 00:26:02.972 "uuid": "d06adef5-c600-40f5-8d63-839a284b950a" 00:26:02.972 } 00:26:02.972 ] 00:26:02.972 } 00:26:02.972 ] 00:26:02.972 04:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:02.972 04:27:53 -- host/identify.sh@39 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2014-08.org.nvmexpress.discovery' -L all 00:26:03.233 [2024-11-30 04:27:53.609018] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:03.233 [2024-11-30 04:27:53.609061] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2448918 ] 00:26:03.233 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.233 [2024-11-30 04:27:53.643361] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to connect adminq (no timeout) 00:26:03.233 [2024-11-30 04:27:53.643419] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:03.233 [2024-11-30 04:27:53.643429] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:03.233 [2024-11-30 04:27:53.643446] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:03.233 [2024-11-30 04:27:53.643460] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:03.233 [2024-11-30 04:27:53.649023] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for connect adminq (no timeout) 00:26:03.233 [2024-11-30 04:27:53.649086] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0xee3420 0 00:26:03.233 [2024-11-30 04:27:53.659976] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:03.233 [2024-11-30 04:27:53.659997] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:03.233 [2024-11-30 04:27:53.660006] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:03.233 [2024-11-30 04:27:53.660012] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:03.233 [2024-11-30 04:27:53.660080] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.660095] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.660102] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xee3420) 00:26:03.233 [2024-11-30 04:27:53.660121] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:03.233 [2024-11-30 04:27:53.660147] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48b00, cid 0, qid 0 00:26:03.233 [2024-11-30 04:27:53.666985] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.233 [2024-11-30 04:27:53.667004] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.233 [2024-11-30 04:27:53.667011] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.667018] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48b00) on tqpair=0xee3420 00:26:03.233 [2024-11-30 04:27:53.667040] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:03.233 [2024-11-30 04:27:53.667052] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs (no timeout) 00:26:03.233 [2024-11-30 04:27:53.667061] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read vs wait for vs (no timeout) 00:26:03.233 [2024-11-30 04:27:53.667079] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.667091] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.667097] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xee3420) 00:26:03.233 [2024-11-30 04:27:53.667108] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.233 [2024-11-30 04:27:53.667131] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48b00, cid 0, qid 0 00:26:03.233 [2024-11-30 04:27:53.667255] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.233 [2024-11-30 04:27:53.667270] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.233 [2024-11-30 04:27:53.667277] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.667284] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48b00) on tqpair=0xee3420 00:26:03.233 [2024-11-30 04:27:53.667293] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap (no timeout) 00:26:03.233 [2024-11-30 04:27:53.667308] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to read cap wait for cap (no timeout) 00:26:03.233 [2024-11-30 04:27:53.667322] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.667329] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.667336] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xee3420) 00:26:03.233 [2024-11-30 04:27:53.667346] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.233 [2024-11-30 04:27:53.667368] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48b00, cid 0, qid 0 00:26:03.233 [2024-11-30 04:27:53.667450] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.233 [2024-11-30 04:27:53.667465] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.233 [2024-11-30 04:27:53.667472] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.667478] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48b00) on tqpair=0xee3420 00:26:03.233 [2024-11-30 04:27:53.667490] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en (no timeout) 00:26:03.233 [2024-11-30 04:27:53.667505] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to check en wait for cc (timeout 15000 ms) 00:26:03.233 [2024-11-30 04:27:53.667521] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.667530] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.233 [2024-11-30 04:27:53.667539] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.667550] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.234 [2024-11-30 04:27:53.667572] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48b00, cid 0, qid 0 00:26:03.234 [2024-11-30 04:27:53.667653] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.234 [2024-11-30 04:27:53.667668] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.234 [2024-11-30 04:27:53.667675] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.667681] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48b00) on tqpair=0xee3420 00:26:03.234 [2024-11-30 04:27:53.667691] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:03.234 [2024-11-30 04:27:53.667709] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.667719] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.667725] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.667736] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.234 [2024-11-30 04:27:53.667756] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48b00, cid 0, qid 0 00:26:03.234 [2024-11-30 04:27:53.667843] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.234 [2024-11-30 04:27:53.667857] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.234 [2024-11-30 04:27:53.667864] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.667871] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48b00) on tqpair=0xee3420 00:26:03.234 [2024-11-30 04:27:53.667879] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 0 && CSTS.RDY = 0 00:26:03.234 [2024-11-30 04:27:53.667887] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to controller is disabled (timeout 15000 ms) 00:26:03.234 [2024-11-30 04:27:53.667902] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:03.234 [2024-11-30 04:27:53.668013] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Setting CC.EN = 1 00:26:03.234 [2024-11-30 04:27:53.668022] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:03.234 [2024-11-30 04:27:53.668036] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668044] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668050] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.668061] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.234 [2024-11-30 04:27:53.668082] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48b00, cid 0, qid 0 00:26:03.234 [2024-11-30 04:27:53.668180] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.234 [2024-11-30 04:27:53.668194] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.234 [2024-11-30 04:27:53.668201] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668207] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48b00) on tqpair=0xee3420 00:26:03.234 [2024-11-30 04:27:53.668220] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:03.234 [2024-11-30 04:27:53.668240] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668250] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668256] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.668267] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.234 [2024-11-30 04:27:53.668288] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48b00, cid 0, qid 0 00:26:03.234 [2024-11-30 04:27:53.668373] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.234 [2024-11-30 04:27:53.668388] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.234 [2024-11-30 04:27:53.668394] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668401] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48b00) on tqpair=0xee3420 00:26:03.234 [2024-11-30 04:27:53.668409] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:03.234 [2024-11-30 04:27:53.668417] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to reset admin queue (timeout 30000 ms) 00:26:03.234 [2024-11-30 04:27:53.668433] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to identify controller (no timeout) 00:26:03.234 [2024-11-30 04:27:53.668448] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for identify controller (timeout 30000 ms) 00:26:03.234 [2024-11-30 04:27:53.668463] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668470] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668476] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.668488] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.234 [2024-11-30 04:27:53.668509] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48b00, cid 0, qid 0 00:26:03.234 [2024-11-30 04:27:53.668679] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.234 [2024-11-30 04:27:53.668710] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.234 [2024-11-30 04:27:53.668717] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668723] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xee3420): datao=0, datal=4096, cccid=0 00:26:03.234 [2024-11-30 04:27:53.668731] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xf48b00) on tqpair(0xee3420): expected_datao=0, payload_size=4096 00:26:03.234 [2024-11-30 04:27:53.668761] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668773] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668786] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.234 [2024-11-30 04:27:53.668796] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.234 [2024-11-30 04:27:53.668803] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668809] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48b00) on tqpair=0xee3420 00:26:03.234 [2024-11-30 04:27:53.668821] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_xfer_size 4294967295 00:26:03.234 [2024-11-30 04:27:53.668830] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] MDTS max_xfer_size 131072 00:26:03.234 [2024-11-30 04:27:53.668837] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] CNTLID 0x0001 00:26:03.234 [2024-11-30 04:27:53.668850] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] transport max_sges 16 00:26:03.234 [2024-11-30 04:27:53.668857] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] fuses compare and write: 1 00:26:03.234 [2024-11-30 04:27:53.668865] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to configure AER (timeout 30000 ms) 00:26:03.234 [2024-11-30 04:27:53.668887] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for configure aer (timeout 30000 ms) 00:26:03.234 [2024-11-30 04:27:53.668901] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668909] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.668915] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.668926] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:03.234 [2024-11-30 04:27:53.668948] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48b00, cid 0, qid 0 00:26:03.234 [2024-11-30 04:27:53.669064] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.234 [2024-11-30 04:27:53.669079] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.234 [2024-11-30 04:27:53.669086] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669093] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48b00) on tqpair=0xee3420 00:26:03.234 [2024-11-30 04:27:53.669105] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669112] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669119] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.669129] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.234 [2024-11-30 04:27:53.669139] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669146] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669152] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.669161] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.234 [2024-11-30 04:27:53.669170] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669177] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669183] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.669192] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.234 [2024-11-30 04:27:53.669201] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669208] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669214] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.669222] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.234 [2024-11-30 04:27:53.669231] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to set keep alive timeout (timeout 30000 ms) 00:26:03.234 [2024-11-30 04:27:53.669252] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:03.234 [2024-11-30 04:27:53.669266] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669288] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.234 [2024-11-30 04:27:53.669297] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xee3420) 00:26:03.234 [2024-11-30 04:27:53.669308] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.234 [2024-11-30 04:27:53.669331] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48b00, cid 0, qid 0 00:26:03.235 [2024-11-30 04:27:53.669357] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48c60, cid 1, qid 0 00:26:03.235 [2024-11-30 04:27:53.669364] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48dc0, cid 2, qid 0 00:26:03.235 [2024-11-30 04:27:53.669371] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.235 [2024-11-30 04:27:53.669378] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf49080, cid 4, qid 0 00:26:03.235 [2024-11-30 04:27:53.669524] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.235 [2024-11-30 04:27:53.669539] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.235 [2024-11-30 04:27:53.669546] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.669552] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf49080) on tqpair=0xee3420 00:26:03.235 [2024-11-30 04:27:53.669561] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Sending keep alive every 5000000 us 00:26:03.235 [2024-11-30 04:27:53.669570] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] setting state to ready (no timeout) 00:26:03.235 [2024-11-30 04:27:53.669590] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.669600] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.669606] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xee3420) 00:26:03.235 [2024-11-30 04:27:53.669616] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.235 [2024-11-30 04:27:53.669637] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf49080, cid 4, qid 0 00:26:03.235 [2024-11-30 04:27:53.669755] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.235 [2024-11-30 04:27:53.669770] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.235 [2024-11-30 04:27:53.669777] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.669783] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xee3420): datao=0, datal=4096, cccid=4 00:26:03.235 [2024-11-30 04:27:53.669790] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xf49080) on tqpair(0xee3420): expected_datao=0, payload_size=4096 00:26:03.235 [2024-11-30 04:27:53.669801] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.669809] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.710045] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.235 [2024-11-30 04:27:53.710064] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.235 [2024-11-30 04:27:53.710073] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.710079] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf49080) on tqpair=0xee3420 00:26:03.235 [2024-11-30 04:27:53.710101] nvme_ctrlr.c:4024:nvme_ctrlr_process_init: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Ctrlr already in ready state 00:26:03.235 [2024-11-30 04:27:53.710139] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.710150] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.710157] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xee3420) 00:26:03.235 [2024-11-30 04:27:53.710169] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.235 [2024-11-30 04:27:53.710185] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.710193] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.710200] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0xee3420) 00:26:03.235 [2024-11-30 04:27:53.710209] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.235 [2024-11-30 04:27:53.710237] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf49080, cid 4, qid 0 00:26:03.235 [2024-11-30 04:27:53.710249] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf491e0, cid 5, qid 0 00:26:03.235 [2024-11-30 04:27:53.710411] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.235 [2024-11-30 04:27:53.710427] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.235 [2024-11-30 04:27:53.710435] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.710441] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xee3420): datao=0, datal=1024, cccid=4 00:26:03.235 [2024-11-30 04:27:53.710449] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xf49080) on tqpair(0xee3420): expected_datao=0, payload_size=1024 00:26:03.235 [2024-11-30 04:27:53.710460] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.710467] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.710475] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.235 [2024-11-30 04:27:53.710484] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.235 [2024-11-30 04:27:53.710491] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.710497] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf491e0) on tqpair=0xee3420 00:26:03.235 [2024-11-30 04:27:53.751991] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.235 [2024-11-30 04:27:53.752010] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.235 [2024-11-30 04:27:53.752017] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752024] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf49080) on tqpair=0xee3420 00:26:03.235 [2024-11-30 04:27:53.752042] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752050] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752057] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xee3420) 00:26:03.235 [2024-11-30 04:27:53.752068] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:02ff0070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.235 [2024-11-30 04:27:53.752100] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf49080, cid 4, qid 0 00:26:03.235 [2024-11-30 04:27:53.752241] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.235 [2024-11-30 04:27:53.752256] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.235 [2024-11-30 04:27:53.752263] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752289] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xee3420): datao=0, datal=3072, cccid=4 00:26:03.235 [2024-11-30 04:27:53.752297] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xf49080) on tqpair(0xee3420): expected_datao=0, payload_size=3072 00:26:03.235 [2024-11-30 04:27:53.752309] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752316] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752329] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.235 [2024-11-30 04:27:53.752339] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.235 [2024-11-30 04:27:53.752345] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752352] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf49080) on tqpair=0xee3420 00:26:03.235 [2024-11-30 04:27:53.752372] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752381] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752388] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0xee3420) 00:26:03.235 [2024-11-30 04:27:53.752399] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:0 cdw10:00010070 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.235 [2024-11-30 04:27:53.752430] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf49080, cid 4, qid 0 00:26:03.235 [2024-11-30 04:27:53.752533] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.235 [2024-11-30 04:27:53.752548] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.235 [2024-11-30 04:27:53.752555] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752561] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0xee3420): datao=0, datal=8, cccid=4 00:26:03.235 [2024-11-30 04:27:53.752568] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0xf49080) on tqpair(0xee3420): expected_datao=0, payload_size=8 00:26:03.235 [2024-11-30 04:27:53.752579] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.752586] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.793975] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.235 [2024-11-30 04:27:53.793994] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.235 [2024-11-30 04:27:53.794017] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.235 [2024-11-30 04:27:53.794024] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf49080) on tqpair=0xee3420 00:26:03.235 ===================================================== 00:26:03.235 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2014-08.org.nvmexpress.discovery 00:26:03.235 ===================================================== 00:26:03.235 Controller Capabilities/Features 00:26:03.235 ================================ 00:26:03.235 Vendor ID: 0000 00:26:03.235 Subsystem Vendor ID: 0000 00:26:03.235 Serial Number: .................... 00:26:03.235 Model Number: ........................................ 00:26:03.235 Firmware Version: 24.01.1 00:26:03.235 Recommended Arb Burst: 0 00:26:03.235 IEEE OUI Identifier: 00 00 00 00:26:03.235 Multi-path I/O 00:26:03.235 May have multiple subsystem ports: No 00:26:03.235 May have multiple controllers: No 00:26:03.235 Associated with SR-IOV VF: No 00:26:03.235 Max Data Transfer Size: 131072 00:26:03.235 Max Number of Namespaces: 0 00:26:03.235 Max Number of I/O Queues: 1024 00:26:03.235 NVMe Specification Version (VS): 1.3 00:26:03.235 NVMe Specification Version (Identify): 1.3 00:26:03.235 Maximum Queue Entries: 128 00:26:03.235 Contiguous Queues Required: Yes 00:26:03.235 Arbitration Mechanisms Supported 00:26:03.235 Weighted Round Robin: Not Supported 00:26:03.235 Vendor Specific: Not Supported 00:26:03.235 Reset Timeout: 15000 ms 00:26:03.235 Doorbell Stride: 4 bytes 00:26:03.235 NVM Subsystem Reset: Not Supported 00:26:03.235 Command Sets Supported 00:26:03.235 NVM Command Set: Supported 00:26:03.235 Boot Partition: Not Supported 00:26:03.235 Memory Page Size Minimum: 4096 bytes 00:26:03.235 Memory Page Size Maximum: 4096 bytes 00:26:03.235 Persistent Memory Region: Not Supported 00:26:03.235 Optional Asynchronous Events Supported 00:26:03.235 Namespace Attribute Notices: Not Supported 00:26:03.235 Firmware Activation Notices: Not Supported 00:26:03.236 ANA Change Notices: Not Supported 00:26:03.236 PLE Aggregate Log Change Notices: Not Supported 00:26:03.236 LBA Status Info Alert Notices: Not Supported 00:26:03.236 EGE Aggregate Log Change Notices: Not Supported 00:26:03.236 Normal NVM Subsystem Shutdown event: Not Supported 00:26:03.236 Zone Descriptor Change Notices: Not Supported 00:26:03.236 Discovery Log Change Notices: Supported 00:26:03.236 Controller Attributes 00:26:03.236 128-bit Host Identifier: Not Supported 00:26:03.236 Non-Operational Permissive Mode: Not Supported 00:26:03.236 NVM Sets: Not Supported 00:26:03.236 Read Recovery Levels: Not Supported 00:26:03.236 Endurance Groups: Not Supported 00:26:03.236 Predictable Latency Mode: Not Supported 00:26:03.236 Traffic Based Keep ALive: Not Supported 00:26:03.236 Namespace Granularity: Not Supported 00:26:03.236 SQ Associations: Not Supported 00:26:03.236 UUID List: Not Supported 00:26:03.236 Multi-Domain Subsystem: Not Supported 00:26:03.236 Fixed Capacity Management: Not Supported 00:26:03.236 Variable Capacity Management: Not Supported 00:26:03.236 Delete Endurance Group: Not Supported 00:26:03.236 Delete NVM Set: Not Supported 00:26:03.236 Extended LBA Formats Supported: Not Supported 00:26:03.236 Flexible Data Placement Supported: Not Supported 00:26:03.236 00:26:03.236 Controller Memory Buffer Support 00:26:03.236 ================================ 00:26:03.236 Supported: No 00:26:03.236 00:26:03.236 Persistent Memory Region Support 00:26:03.236 ================================ 00:26:03.236 Supported: No 00:26:03.236 00:26:03.236 Admin Command Set Attributes 00:26:03.236 ============================ 00:26:03.236 Security Send/Receive: Not Supported 00:26:03.236 Format NVM: Not Supported 00:26:03.236 Firmware Activate/Download: Not Supported 00:26:03.236 Namespace Management: Not Supported 00:26:03.236 Device Self-Test: Not Supported 00:26:03.236 Directives: Not Supported 00:26:03.236 NVMe-MI: Not Supported 00:26:03.236 Virtualization Management: Not Supported 00:26:03.236 Doorbell Buffer Config: Not Supported 00:26:03.236 Get LBA Status Capability: Not Supported 00:26:03.236 Command & Feature Lockdown Capability: Not Supported 00:26:03.236 Abort Command Limit: 1 00:26:03.236 Async Event Request Limit: 4 00:26:03.236 Number of Firmware Slots: N/A 00:26:03.236 Firmware Slot 1 Read-Only: N/A 00:26:03.236 Firmware Activation Without Reset: N/A 00:26:03.236 Multiple Update Detection Support: N/A 00:26:03.236 Firmware Update Granularity: No Information Provided 00:26:03.236 Per-Namespace SMART Log: No 00:26:03.236 Asymmetric Namespace Access Log Page: Not Supported 00:26:03.236 Subsystem NQN: nqn.2014-08.org.nvmexpress.discovery 00:26:03.236 Command Effects Log Page: Not Supported 00:26:03.236 Get Log Page Extended Data: Supported 00:26:03.236 Telemetry Log Pages: Not Supported 00:26:03.236 Persistent Event Log Pages: Not Supported 00:26:03.236 Supported Log Pages Log Page: May Support 00:26:03.236 Commands Supported & Effects Log Page: Not Supported 00:26:03.236 Feature Identifiers & Effects Log Page:May Support 00:26:03.236 NVMe-MI Commands & Effects Log Page: May Support 00:26:03.236 Data Area 4 for Telemetry Log: Not Supported 00:26:03.236 Error Log Page Entries Supported: 128 00:26:03.236 Keep Alive: Not Supported 00:26:03.236 00:26:03.236 NVM Command Set Attributes 00:26:03.236 ========================== 00:26:03.236 Submission Queue Entry Size 00:26:03.236 Max: 1 00:26:03.236 Min: 1 00:26:03.236 Completion Queue Entry Size 00:26:03.236 Max: 1 00:26:03.236 Min: 1 00:26:03.236 Number of Namespaces: 0 00:26:03.236 Compare Command: Not Supported 00:26:03.236 Write Uncorrectable Command: Not Supported 00:26:03.236 Dataset Management Command: Not Supported 00:26:03.236 Write Zeroes Command: Not Supported 00:26:03.236 Set Features Save Field: Not Supported 00:26:03.236 Reservations: Not Supported 00:26:03.236 Timestamp: Not Supported 00:26:03.236 Copy: Not Supported 00:26:03.236 Volatile Write Cache: Not Present 00:26:03.236 Atomic Write Unit (Normal): 1 00:26:03.236 Atomic Write Unit (PFail): 1 00:26:03.236 Atomic Compare & Write Unit: 1 00:26:03.236 Fused Compare & Write: Supported 00:26:03.236 Scatter-Gather List 00:26:03.236 SGL Command Set: Supported 00:26:03.236 SGL Keyed: Supported 00:26:03.236 SGL Bit Bucket Descriptor: Not Supported 00:26:03.236 SGL Metadata Pointer: Not Supported 00:26:03.236 Oversized SGL: Not Supported 00:26:03.236 SGL Metadata Address: Not Supported 00:26:03.236 SGL Offset: Supported 00:26:03.236 Transport SGL Data Block: Not Supported 00:26:03.236 Replay Protected Memory Block: Not Supported 00:26:03.236 00:26:03.236 Firmware Slot Information 00:26:03.236 ========================= 00:26:03.236 Active slot: 0 00:26:03.236 00:26:03.236 00:26:03.236 Error Log 00:26:03.236 ========= 00:26:03.236 00:26:03.236 Active Namespaces 00:26:03.236 ================= 00:26:03.236 Discovery Log Page 00:26:03.236 ================== 00:26:03.236 Generation Counter: 2 00:26:03.236 Number of Records: 2 00:26:03.236 Record Format: 0 00:26:03.236 00:26:03.236 Discovery Log Entry 0 00:26:03.236 ---------------------- 00:26:03.236 Transport Type: 3 (TCP) 00:26:03.236 Address Family: 1 (IPv4) 00:26:03.236 Subsystem Type: 3 (Current Discovery Subsystem) 00:26:03.236 Entry Flags: 00:26:03.236 Duplicate Returned Information: 1 00:26:03.236 Explicit Persistent Connection Support for Discovery: 1 00:26:03.236 Transport Requirements: 00:26:03.236 Secure Channel: Not Required 00:26:03.236 Port ID: 0 (0x0000) 00:26:03.236 Controller ID: 65535 (0xffff) 00:26:03.236 Admin Max SQ Size: 128 00:26:03.236 Transport Service Identifier: 4420 00:26:03.236 NVM Subsystem Qualified Name: nqn.2014-08.org.nvmexpress.discovery 00:26:03.236 Transport Address: 10.0.0.2 00:26:03.236 Discovery Log Entry 1 00:26:03.236 ---------------------- 00:26:03.236 Transport Type: 3 (TCP) 00:26:03.236 Address Family: 1 (IPv4) 00:26:03.236 Subsystem Type: 2 (NVM Subsystem) 00:26:03.236 Entry Flags: 00:26:03.236 Duplicate Returned Information: 0 00:26:03.236 Explicit Persistent Connection Support for Discovery: 0 00:26:03.236 Transport Requirements: 00:26:03.236 Secure Channel: Not Required 00:26:03.236 Port ID: 0 (0x0000) 00:26:03.236 Controller ID: 65535 (0xffff) 00:26:03.236 Admin Max SQ Size: 128 00:26:03.236 Transport Service Identifier: 4420 00:26:03.236 NVM Subsystem Qualified Name: nqn.2016-06.io.spdk:cnode1 00:26:03.236 Transport Address: 10.0.0.2 [2024-11-30 04:27:53.794140] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] Prepare to destruct SSD 00:26:03.236 [2024-11-30 04:27:53.794167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.236 [2024-11-30 04:27:53.794181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.236 [2024-11-30 04:27:53.794190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.236 [2024-11-30 04:27:53.794200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.236 [2024-11-30 04:27:53.794213] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.236 [2024-11-30 04:27:53.794221] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.236 [2024-11-30 04:27:53.794228] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.236 [2024-11-30 04:27:53.794239] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.236 [2024-11-30 04:27:53.794279] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.236 [2024-11-30 04:27:53.794378] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.236 [2024-11-30 04:27:53.794394] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.236 [2024-11-30 04:27:53.794401] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.236 [2024-11-30 04:27:53.794408] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.236 [2024-11-30 04:27:53.794420] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.236 [2024-11-30 04:27:53.794428] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.236 [2024-11-30 04:27:53.794434] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.236 [2024-11-30 04:27:53.794445] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.236 [2024-11-30 04:27:53.794475] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.236 [2024-11-30 04:27:53.794591] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.236 [2024-11-30 04:27:53.794606] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.236 [2024-11-30 04:27:53.794613] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.236 [2024-11-30 04:27:53.794619] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.236 [2024-11-30 04:27:53.794628] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] RTD3E = 0 us 00:26:03.237 [2024-11-30 04:27:53.794636] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown timeout = 10000 ms 00:26:03.237 [2024-11-30 04:27:53.794654] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.794663] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.794670] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.794680] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.794702] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.794791] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.794806] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.794813] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.794819] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.794839] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.794849] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.794855] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.794866] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.794886] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.794981] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.794997] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.795007] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795013] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.795030] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795040] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795046] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.795060] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.795082] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.795167] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.795182] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.795189] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795195] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.795215] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795224] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795231] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.795245] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.795271] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.795355] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.795370] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.795376] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795383] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.795401] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795411] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795418] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.795428] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.795449] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.795535] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.795550] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.795557] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795566] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.795583] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795592] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795599] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.795609] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.795633] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.795719] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.795734] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.795740] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795750] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.795766] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795776] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795782] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.795792] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.795816] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.795903] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.795918] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.795925] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795934] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.795951] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795970] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.795978] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.795991] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.796018] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.796108] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.796123] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.796129] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796139] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.796156] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796165] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796172] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.796182] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.796207] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.796291] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.796306] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.796313] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796320] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.796339] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796349] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796355] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.796365] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.796389] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.796475] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.796490] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.796497] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796503] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.796522] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796532] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796538] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.796549] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.237 [2024-11-30 04:27:53.796569] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.237 [2024-11-30 04:27:53.796654] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.237 [2024-11-30 04:27:53.796669] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.237 [2024-11-30 04:27:53.796676] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796682] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.237 [2024-11-30 04:27:53.796701] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796711] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.237 [2024-11-30 04:27:53.796717] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.237 [2024-11-30 04:27:53.796728] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.238 [2024-11-30 04:27:53.796748] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.238 [2024-11-30 04:27:53.796833] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.238 [2024-11-30 04:27:53.796848] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.238 [2024-11-30 04:27:53.796855] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.796861] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.238 [2024-11-30 04:27:53.796880] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.796890] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.796896] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.238 [2024-11-30 04:27:53.796907] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.238 [2024-11-30 04:27:53.796927] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.238 [2024-11-30 04:27:53.797025] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.238 [2024-11-30 04:27:53.797040] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.238 [2024-11-30 04:27:53.797047] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.797053] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.238 [2024-11-30 04:27:53.797072] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.797082] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.797088] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.238 [2024-11-30 04:27:53.797099] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.238 [2024-11-30 04:27:53.797120] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.238 [2024-11-30 04:27:53.797205] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.238 [2024-11-30 04:27:53.797219] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.238 [2024-11-30 04:27:53.797226] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.797235] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.238 [2024-11-30 04:27:53.797252] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.797262] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.797268] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.238 [2024-11-30 04:27:53.797278] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.238 [2024-11-30 04:27:53.797302] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.238 [2024-11-30 04:27:53.797384] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.238 [2024-11-30 04:27:53.797399] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.238 [2024-11-30 04:27:53.797405] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.797412] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.238 [2024-11-30 04:27:53.797431] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.797441] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.797447] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.238 [2024-11-30 04:27:53.797458] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.238 [2024-11-30 04:27:53.797479] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.238 [2024-11-30 04:27:53.800975] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.238 [2024-11-30 04:27:53.800996] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.238 [2024-11-30 04:27:53.801003] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.801010] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.238 [2024-11-30 04:27:53.801029] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.801039] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.801045] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0xee3420) 00:26:03.238 [2024-11-30 04:27:53.801055] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.238 [2024-11-30 04:27:53.801077] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0xf48f20, cid 3, qid 0 00:26:03.238 [2024-11-30 04:27:53.801181] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.238 [2024-11-30 04:27:53.801196] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.238 [2024-11-30 04:27:53.801203] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.238 [2024-11-30 04:27:53.801210] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0xf48f20) on tqpair=0xee3420 00:26:03.238 [2024-11-30 04:27:53.801226] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2014-08.org.nvmexpress.discovery] shutdown complete in 6 milliseconds 00:26:03.238 00:26:03.238 04:27:53 -- host/identify.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' -L all 00:26:03.238 [2024-11-30 04:27:53.830300] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:03.238 [2024-11-30 04:27:53.830341] [ DPDK EAL parameters: identify --no-shconf -c 0x1 -n 1 -m 0 --no-pci --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2448920 ] 00:26:03.238 EAL: No free 2048 kB hugepages reported on node 1 00:26:03.498 [2024-11-30 04:27:53.862180] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to connect adminq (no timeout) 00:26:03.498 [2024-11-30 04:27:53.862231] nvme_tcp.c:2244:nvme_tcp_qpair_connect_sock: *DEBUG*: adrfam 1 ai_family 2 00:26:03.498 [2024-11-30 04:27:53.862242] nvme_tcp.c:2248:nvme_tcp_qpair_connect_sock: *DEBUG*: trsvcid is 4420 00:26:03.498 [2024-11-30 04:27:53.862256] nvme_tcp.c:2266:nvme_tcp_qpair_connect_sock: *DEBUG*: sock_impl_name is (null) 00:26:03.498 [2024-11-30 04:27:53.862269] sock.c: 334:spdk_sock_connect_ext: *DEBUG*: Creating a client socket using impl posix 00:26:03.498 [2024-11-30 04:27:53.866006] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for connect adminq (no timeout) 00:26:03.498 [2024-11-30 04:27:53.866068] nvme_tcp.c:1487:nvme_tcp_send_icreq_complete: *DEBUG*: Complete the icreq send for tqpair=0x15de420 0 00:26:03.498 [2024-11-30 04:27:53.873977] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 1 00:26:03.498 [2024-11-30 04:27:53.873997] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =1 00:26:03.498 [2024-11-30 04:27:53.874005] nvme_tcp.c:1533:nvme_tcp_icresp_handle: *DEBUG*: host_hdgst_enable: 0 00:26:03.498 [2024-11-30 04:27:53.874012] nvme_tcp.c:1534:nvme_tcp_icresp_handle: *DEBUG*: host_ddgst_enable: 0 00:26:03.498 [2024-11-30 04:27:53.874052] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.874066] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.874073] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15de420) 00:26:03.498 [2024-11-30 04:27:53.874087] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC CONNECT qid:0 cid:0 SGL DATA BLOCK OFFSET 0x0 len:0x400 00:26:03.498 [2024-11-30 04:27:53.874118] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643b00, cid 0, qid 0 00:26:03.498 [2024-11-30 04:27:53.881973] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.498 [2024-11-30 04:27:53.881991] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.498 [2024-11-30 04:27:53.881999] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882006] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643b00) on tqpair=0x15de420 00:26:03.498 [2024-11-30 04:27:53.882027] nvme_fabric.c: 620:nvme_fabric_qpair_connect_poll: *DEBUG*: CNTLID 0x0001 00:26:03.498 [2024-11-30 04:27:53.882040] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs (no timeout) 00:26:03.498 [2024-11-30 04:27:53.882049] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read vs wait for vs (no timeout) 00:26:03.498 [2024-11-30 04:27:53.882066] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882077] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882085] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15de420) 00:26:03.498 [2024-11-30 04:27:53.882096] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.498 [2024-11-30 04:27:53.882120] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643b00, cid 0, qid 0 00:26:03.498 [2024-11-30 04:27:53.882235] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.498 [2024-11-30 04:27:53.882251] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.498 [2024-11-30 04:27:53.882258] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882264] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643b00) on tqpair=0x15de420 00:26:03.498 [2024-11-30 04:27:53.882276] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap (no timeout) 00:26:03.498 [2024-11-30 04:27:53.882292] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to read cap wait for cap (no timeout) 00:26:03.498 [2024-11-30 04:27:53.882305] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882313] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882320] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15de420) 00:26:03.498 [2024-11-30 04:27:53.882334] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.498 [2024-11-30 04:27:53.882357] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643b00, cid 0, qid 0 00:26:03.498 [2024-11-30 04:27:53.882448] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.498 [2024-11-30 04:27:53.882464] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.498 [2024-11-30 04:27:53.882471] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882481] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643b00) on tqpair=0x15de420 00:26:03.498 [2024-11-30 04:27:53.882491] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en (no timeout) 00:26:03.498 [2024-11-30 04:27:53.882506] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to check en wait for cc (timeout 15000 ms) 00:26:03.498 [2024-11-30 04:27:53.882519] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882529] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882536] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15de420) 00:26:03.498 [2024-11-30 04:27:53.882547] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.498 [2024-11-30 04:27:53.882574] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643b00, cid 0, qid 0 00:26:03.498 [2024-11-30 04:27:53.882656] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.498 [2024-11-30 04:27:53.882672] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.498 [2024-11-30 04:27:53.882679] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882686] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643b00) on tqpair=0x15de420 00:26:03.498 [2024-11-30 04:27:53.882699] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to disable and wait for CSTS.RDY = 0 (timeout 15000 ms) 00:26:03.498 [2024-11-30 04:27:53.882718] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882727] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882734] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15de420) 00:26:03.498 [2024-11-30 04:27:53.882747] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.498 [2024-11-30 04:27:53.882770] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643b00, cid 0, qid 0 00:26:03.498 [2024-11-30 04:27:53.882859] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.498 [2024-11-30 04:27:53.882874] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.498 [2024-11-30 04:27:53.882881] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.882888] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643b00) on tqpair=0x15de420 00:26:03.498 [2024-11-30 04:27:53.882897] nvme_ctrlr.c:3737:nvme_ctrlr_process_init_wait_for_ready_0: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 0 && CSTS.RDY = 0 00:26:03.498 [2024-11-30 04:27:53.882906] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to controller is disabled (timeout 15000 ms) 00:26:03.498 [2024-11-30 04:27:53.882920] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 (timeout 15000 ms) 00:26:03.498 [2024-11-30 04:27:53.883033] nvme_ctrlr.c:3930:nvme_ctrlr_process_init: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Setting CC.EN = 1 00:26:03.498 [2024-11-30 04:27:53.883044] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to enable controller by writing CC.EN = 1 reg (timeout 15000 ms) 00:26:03.498 [2024-11-30 04:27:53.883057] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883065] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883071] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15de420) 00:26:03.498 [2024-11-30 04:27:53.883082] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.498 [2024-11-30 04:27:53.883119] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643b00, cid 0, qid 0 00:26:03.498 [2024-11-30 04:27:53.883229] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.498 [2024-11-30 04:27:53.883245] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.498 [2024-11-30 04:27:53.883252] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883259] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643b00) on tqpair=0x15de420 00:26:03.498 [2024-11-30 04:27:53.883272] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for CSTS.RDY = 1 (timeout 15000 ms) 00:26:03.498 [2024-11-30 04:27:53.883290] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883300] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883306] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15de420) 00:26:03.498 [2024-11-30 04:27:53.883320] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:0 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.498 [2024-11-30 04:27:53.883348] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643b00, cid 0, qid 0 00:26:03.498 [2024-11-30 04:27:53.883436] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.498 [2024-11-30 04:27:53.883451] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.498 [2024-11-30 04:27:53.883458] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883464] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643b00) on tqpair=0x15de420 00:26:03.498 [2024-11-30 04:27:53.883473] nvme_ctrlr.c:3772:nvme_ctrlr_process_init_enable_wait_for_ready_1: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CC.EN = 1 && CSTS.RDY = 1 - controller is ready 00:26:03.498 [2024-11-30 04:27:53.883482] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to reset admin queue (timeout 30000 ms) 00:26:03.498 [2024-11-30 04:27:53.883497] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller (no timeout) 00:26:03.498 [2024-11-30 04:27:53.883514] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify controller (timeout 30000 ms) 00:26:03.498 [2024-11-30 04:27:53.883528] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883536] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883542] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15de420) 00:26:03.498 [2024-11-30 04:27:53.883553] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:0 nsid:0 cdw10:00000001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.498 [2024-11-30 04:27:53.883575] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643b00, cid 0, qid 0 00:26:03.498 [2024-11-30 04:27:53.883729] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.498 [2024-11-30 04:27:53.883761] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.498 [2024-11-30 04:27:53.883769] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883776] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15de420): datao=0, datal=4096, cccid=0 00:26:03.498 [2024-11-30 04:27:53.883783] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1643b00) on tqpair(0x15de420): expected_datao=0, payload_size=4096 00:26:03.498 [2024-11-30 04:27:53.883796] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883808] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883826] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.498 [2024-11-30 04:27:53.883837] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.498 [2024-11-30 04:27:53.883843] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883850] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643b00) on tqpair=0x15de420 00:26:03.498 [2024-11-30 04:27:53.883862] nvme_ctrlr.c:1972:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_xfer_size 4294967295 00:26:03.498 [2024-11-30 04:27:53.883871] nvme_ctrlr.c:1976:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] MDTS max_xfer_size 131072 00:26:03.498 [2024-11-30 04:27:53.883878] nvme_ctrlr.c:1979:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] CNTLID 0x0001 00:26:03.498 [2024-11-30 04:27:53.883885] nvme_ctrlr.c:2003:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] transport max_sges 16 00:26:03.498 [2024-11-30 04:27:53.883892] nvme_ctrlr.c:2018:nvme_ctrlr_identify_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] fuses compare and write: 1 00:26:03.498 [2024-11-30 04:27:53.883900] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to configure AER (timeout 30000 ms) 00:26:03.498 [2024-11-30 04:27:53.883921] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for configure aer (timeout 30000 ms) 00:26:03.498 [2024-11-30 04:27:53.883940] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883948] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.883955] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15de420) 00:26:03.498 [2024-11-30 04:27:53.883975] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES ASYNC EVENT CONFIGURATION cid:0 cdw10:0000000b SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:03.498 [2024-11-30 04:27:53.883999] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643b00, cid 0, qid 0 00:26:03.498 [2024-11-30 04:27:53.884103] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.498 [2024-11-30 04:27:53.884119] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.498 [2024-11-30 04:27:53.884126] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.498 [2024-11-30 04:27:53.884133] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643b00) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.884148] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884156] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884163] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=0 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.884173] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.499 [2024-11-30 04:27:53.884183] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884190] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884197] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=1 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.884206] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.499 [2024-11-30 04:27:53.884215] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884222] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884229] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=2 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.884238] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.499 [2024-11-30 04:27:53.884247] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884254] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884260] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.884269] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.499 [2024-11-30 04:27:53.884278] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set keep alive timeout (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.884314] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set keep alive timeout (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.884328] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884335] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884341] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.884352] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES KEEP ALIVE TIMER cid:4 cdw10:0000000f SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.884389] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643b00, cid 0, qid 0 00:26:03.499 [2024-11-30 04:27:53.884400] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643c60, cid 1, qid 0 00:26:03.499 [2024-11-30 04:27:53.884407] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643dc0, cid 2, qid 0 00:26:03.499 [2024-11-30 04:27:53.884418] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643f20, cid 3, qid 0 00:26:03.499 [2024-11-30 04:27:53.884425] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1644080, cid 4, qid 0 00:26:03.499 [2024-11-30 04:27:53.884570] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.499 [2024-11-30 04:27:53.884588] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.499 [2024-11-30 04:27:53.884596] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884602] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1644080) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.884612] nvme_ctrlr.c:2890:nvme_ctrlr_set_keep_alive_timeout_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Sending keep alive every 5000000 us 00:26:03.499 [2024-11-30 04:27:53.884621] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify controller iocs specific (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.884636] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set number of queues (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.884654] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for set number of queues (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.884666] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884674] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884680] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.884691] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: SET FEATURES NUMBER OF QUEUES cid:4 cdw10:00000007 SGL DATA BLOCK OFFSET 0x0 len:0x0 00:26:03.499 [2024-11-30 04:27:53.884713] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1644080, cid 4, qid 0 00:26:03.499 [2024-11-30 04:27:53.884806] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.499 [2024-11-30 04:27:53.884822] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.499 [2024-11-30 04:27:53.884829] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884836] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1644080) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.884905] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify active ns (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.884930] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify active ns (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.884946] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884954] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.884970] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.884982] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:0 cdw10:00000002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.885005] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1644080, cid 4, qid 0 00:26:03.499 [2024-11-30 04:27:53.885115] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.499 [2024-11-30 04:27:53.885130] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.499 [2024-11-30 04:27:53.885137] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885144] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15de420): datao=0, datal=4096, cccid=4 00:26:03.499 [2024-11-30 04:27:53.885151] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1644080) on tqpair(0x15de420): expected_datao=0, payload_size=4096 00:26:03.499 [2024-11-30 04:27:53.885191] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885204] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885252] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.499 [2024-11-30 04:27:53.885267] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.499 [2024-11-30 04:27:53.885274] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885281] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1644080) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.885309] nvme_ctrlr.c:4556:spdk_nvme_ctrlr_get_ns: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Namespace 1 was added 00:26:03.499 [2024-11-30 04:27:53.885327] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.885346] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify ns (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.885361] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885369] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885376] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.885387] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000000 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.885409] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1644080, cid 4, qid 0 00:26:03.499 [2024-11-30 04:27:53.885540] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.499 [2024-11-30 04:27:53.885559] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.499 [2024-11-30 04:27:53.885585] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885591] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15de420): datao=0, datal=4096, cccid=4 00:26:03.499 [2024-11-30 04:27:53.885599] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1644080) on tqpair(0x15de420): expected_datao=0, payload_size=4096 00:26:03.499 [2024-11-30 04:27:53.885618] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885629] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885650] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.499 [2024-11-30 04:27:53.885663] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.499 [2024-11-30 04:27:53.885670] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885677] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1644080) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.885701] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify namespace id descriptors (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.885722] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to wait for identify namespace id descriptors (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.885738] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885746] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885752] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.885763] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: IDENTIFY (06) qid:0 cid:4 nsid:1 cdw10:00000003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.885786] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1644080, cid 4, qid 0 00:26:03.499 [2024-11-30 04:27:53.885896] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.499 [2024-11-30 04:27:53.885912] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.499 [2024-11-30 04:27:53.885919] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.885929] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15de420): datao=0, datal=4096, cccid=4 00:26:03.499 [2024-11-30 04:27:53.885947] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1644080) on tqpair(0x15de420): expected_datao=0, payload_size=4096 00:26:03.499 [2024-11-30 04:27:53.889974] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.889985] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.889998] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.499 [2024-11-30 04:27:53.890008] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.499 [2024-11-30 04:27:53.890014] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890021] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1644080) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.890035] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to identify ns iocs specific (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.890050] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported log pages (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.890069] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set supported features (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.890080] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set doorbell buffer config (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.890088] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to set host ID (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.890096] nvme_ctrlr.c:2978:nvme_ctrlr_set_host_id: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] NVMe-oF transport - not sending Set Features - Host ID 00:26:03.499 [2024-11-30 04:27:53.890104] nvme_ctrlr.c:1472:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to transport ready (timeout 30000 ms) 00:26:03.499 [2024-11-30 04:27:53.890112] nvme_ctrlr.c:1478:_nvme_ctrlr_set_state: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] setting state to ready (no timeout) 00:26:03.499 [2024-11-30 04:27:53.890130] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890139] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890145] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.890156] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ARBITRATION cid:4 cdw10:00000001 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.890167] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890173] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890180] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.890189] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:5 nsid:0 cdw10:00000000 cdw11:00000000 00:26:03.499 [2024-11-30 04:27:53.890215] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1644080, cid 4, qid 0 00:26:03.499 [2024-11-30 04:27:53.890242] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16441e0, cid 5, qid 0 00:26:03.499 [2024-11-30 04:27:53.890381] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.499 [2024-11-30 04:27:53.890399] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.499 [2024-11-30 04:27:53.890409] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890416] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1644080) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.890428] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.499 [2024-11-30 04:27:53.890437] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.499 [2024-11-30 04:27:53.890444] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890451] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16441e0) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.890474] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890485] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890492] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.890503] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES POWER MANAGEMENT cid:5 cdw10:00000002 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.890541] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16441e0, cid 5, qid 0 00:26:03.499 [2024-11-30 04:27:53.890650] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.499 [2024-11-30 04:27:53.890666] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.499 [2024-11-30 04:27:53.890673] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890679] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16441e0) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.890698] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890709] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890716] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.890726] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES TEMPERATURE THRESHOLD cid:5 cdw10:00000004 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.890748] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16441e0, cid 5, qid 0 00:26:03.499 [2024-11-30 04:27:53.890857] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.499 [2024-11-30 04:27:53.890872] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.499 [2024-11-30 04:27:53.890879] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890885] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16441e0) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.890904] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890915] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.890922] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.890932] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES NUMBER OF QUEUES cid:5 cdw10:00000007 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.890954] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16441e0, cid 5, qid 0 00:26:03.499 [2024-11-30 04:27:53.891049] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.499 [2024-11-30 04:27:53.891065] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.499 [2024-11-30 04:27:53.891071] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891079] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16441e0) on tqpair=0x15de420 00:26:03.499 [2024-11-30 04:27:53.891103] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891114] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891120] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=5 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.891132] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:5 nsid:ffffffff cdw10:07ff0001 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.891147] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891155] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891162] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=4 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.891172] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:4 nsid:ffffffff cdw10:007f0002 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.891187] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891195] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891202] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=6 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.891211] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:6 nsid:ffffffff cdw10:007f0003 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.891223] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891230] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891237] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x15de420) 00:26:03.499 [2024-11-30 04:27:53.891246] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: GET LOG PAGE (02) qid:0 cid:7 nsid:ffffffff cdw10:03ff0005 cdw11:00000000 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.499 [2024-11-30 04:27:53.891269] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16441e0, cid 5, qid 0 00:26:03.499 [2024-11-30 04:27:53.891280] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1644080, cid 4, qid 0 00:26:03.499 [2024-11-30 04:27:53.891288] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1644340, cid 6, qid 0 00:26:03.499 [2024-11-30 04:27:53.891295] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16444a0, cid 7, qid 0 00:26:03.499 [2024-11-30 04:27:53.891480] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.499 [2024-11-30 04:27:53.891499] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.499 [2024-11-30 04:27:53.891512] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891525] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15de420): datao=0, datal=8192, cccid=5 00:26:03.499 [2024-11-30 04:27:53.891538] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16441e0) on tqpair(0x15de420): expected_datao=0, payload_size=8192 00:26:03.499 [2024-11-30 04:27:53.891569] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891582] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891595] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.499 [2024-11-30 04:27:53.891606] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.499 [2024-11-30 04:27:53.891616] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891627] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15de420): datao=0, datal=512, cccid=4 00:26:03.499 [2024-11-30 04:27:53.891638] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1644080) on tqpair(0x15de420): expected_datao=0, payload_size=512 00:26:03.499 [2024-11-30 04:27:53.891650] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891657] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891665] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.499 [2024-11-30 04:27:53.891674] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.499 [2024-11-30 04:27:53.891681] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.499 [2024-11-30 04:27:53.891687] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15de420): datao=0, datal=512, cccid=6 00:26:03.499 [2024-11-30 04:27:53.891694] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x1644340) on tqpair(0x15de420): expected_datao=0, payload_size=512 00:26:03.500 [2024-11-30 04:27:53.891704] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.891711] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.891720] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 7 00:26:03.500 [2024-11-30 04:27:53.891728] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =7 00:26:03.500 [2024-11-30 04:27:53.891735] nvme_tcp.c:1650:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.891741] nvme_tcp.c:1651:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: c2h_data info on tqpair(0x15de420): datao=0, datal=4096, cccid=7 00:26:03.500 [2024-11-30 04:27:53.891752] nvme_tcp.c:1662:nvme_tcp_c2h_data_hdr_handle: *DEBUG*: tcp_req(0x16444a0) on tqpair(0x15de420): expected_datao=0, payload_size=4096 00:26:03.500 [2024-11-30 04:27:53.891763] nvme_tcp.c:1453:nvme_tcp_pdu_payload_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.891771] nvme_tcp.c:1237:nvme_tcp_c2h_data_payload_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.891783] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.500 [2024-11-30 04:27:53.891792] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.500 [2024-11-30 04:27:53.891799] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.891805] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16441e0) on tqpair=0x15de420 00:26:03.500 [2024-11-30 04:27:53.891826] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.500 [2024-11-30 04:27:53.891852] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.500 [2024-11-30 04:27:53.891860] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.891866] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1644080) on tqpair=0x15de420 00:26:03.500 [2024-11-30 04:27:53.891881] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.500 [2024-11-30 04:27:53.891891] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.500 [2024-11-30 04:27:53.891898] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.891919] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1644340) on tqpair=0x15de420 00:26:03.500 [2024-11-30 04:27:53.891930] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.500 [2024-11-30 04:27:53.891940] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.500 [2024-11-30 04:27:53.891946] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.891952] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16444a0) on tqpair=0x15de420 00:26:03.500 ===================================================== 00:26:03.500 NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:03.500 ===================================================== 00:26:03.500 Controller Capabilities/Features 00:26:03.500 ================================ 00:26:03.500 Vendor ID: 8086 00:26:03.500 Subsystem Vendor ID: 8086 00:26:03.500 Serial Number: SPDK00000000000001 00:26:03.500 Model Number: SPDK bdev Controller 00:26:03.500 Firmware Version: 24.01.1 00:26:03.500 Recommended Arb Burst: 6 00:26:03.500 IEEE OUI Identifier: e4 d2 5c 00:26:03.500 Multi-path I/O 00:26:03.500 May have multiple subsystem ports: Yes 00:26:03.500 May have multiple controllers: Yes 00:26:03.500 Associated with SR-IOV VF: No 00:26:03.500 Max Data Transfer Size: 131072 00:26:03.500 Max Number of Namespaces: 32 00:26:03.500 Max Number of I/O Queues: 127 00:26:03.500 NVMe Specification Version (VS): 1.3 00:26:03.500 NVMe Specification Version (Identify): 1.3 00:26:03.500 Maximum Queue Entries: 128 00:26:03.500 Contiguous Queues Required: Yes 00:26:03.500 Arbitration Mechanisms Supported 00:26:03.500 Weighted Round Robin: Not Supported 00:26:03.500 Vendor Specific: Not Supported 00:26:03.500 Reset Timeout: 15000 ms 00:26:03.500 Doorbell Stride: 4 bytes 00:26:03.500 NVM Subsystem Reset: Not Supported 00:26:03.500 Command Sets Supported 00:26:03.500 NVM Command Set: Supported 00:26:03.500 Boot Partition: Not Supported 00:26:03.500 Memory Page Size Minimum: 4096 bytes 00:26:03.500 Memory Page Size Maximum: 4096 bytes 00:26:03.500 Persistent Memory Region: Not Supported 00:26:03.500 Optional Asynchronous Events Supported 00:26:03.500 Namespace Attribute Notices: Supported 00:26:03.500 Firmware Activation Notices: Not Supported 00:26:03.500 ANA Change Notices: Not Supported 00:26:03.500 PLE Aggregate Log Change Notices: Not Supported 00:26:03.500 LBA Status Info Alert Notices: Not Supported 00:26:03.500 EGE Aggregate Log Change Notices: Not Supported 00:26:03.500 Normal NVM Subsystem Shutdown event: Not Supported 00:26:03.500 Zone Descriptor Change Notices: Not Supported 00:26:03.500 Discovery Log Change Notices: Not Supported 00:26:03.500 Controller Attributes 00:26:03.500 128-bit Host Identifier: Supported 00:26:03.500 Non-Operational Permissive Mode: Not Supported 00:26:03.500 NVM Sets: Not Supported 00:26:03.500 Read Recovery Levels: Not Supported 00:26:03.500 Endurance Groups: Not Supported 00:26:03.500 Predictable Latency Mode: Not Supported 00:26:03.500 Traffic Based Keep ALive: Not Supported 00:26:03.500 Namespace Granularity: Not Supported 00:26:03.500 SQ Associations: Not Supported 00:26:03.500 UUID List: Not Supported 00:26:03.500 Multi-Domain Subsystem: Not Supported 00:26:03.500 Fixed Capacity Management: Not Supported 00:26:03.500 Variable Capacity Management: Not Supported 00:26:03.500 Delete Endurance Group: Not Supported 00:26:03.500 Delete NVM Set: Not Supported 00:26:03.500 Extended LBA Formats Supported: Not Supported 00:26:03.500 Flexible Data Placement Supported: Not Supported 00:26:03.500 00:26:03.500 Controller Memory Buffer Support 00:26:03.500 ================================ 00:26:03.500 Supported: No 00:26:03.500 00:26:03.500 Persistent Memory Region Support 00:26:03.500 ================================ 00:26:03.500 Supported: No 00:26:03.500 00:26:03.500 Admin Command Set Attributes 00:26:03.500 ============================ 00:26:03.500 Security Send/Receive: Not Supported 00:26:03.500 Format NVM: Not Supported 00:26:03.500 Firmware Activate/Download: Not Supported 00:26:03.500 Namespace Management: Not Supported 00:26:03.500 Device Self-Test: Not Supported 00:26:03.500 Directives: Not Supported 00:26:03.500 NVMe-MI: Not Supported 00:26:03.500 Virtualization Management: Not Supported 00:26:03.500 Doorbell Buffer Config: Not Supported 00:26:03.500 Get LBA Status Capability: Not Supported 00:26:03.500 Command & Feature Lockdown Capability: Not Supported 00:26:03.500 Abort Command Limit: 4 00:26:03.500 Async Event Request Limit: 4 00:26:03.500 Number of Firmware Slots: N/A 00:26:03.500 Firmware Slot 1 Read-Only: N/A 00:26:03.500 Firmware Activation Without Reset: N/A 00:26:03.500 Multiple Update Detection Support: N/A 00:26:03.500 Firmware Update Granularity: No Information Provided 00:26:03.500 Per-Namespace SMART Log: No 00:26:03.500 Asymmetric Namespace Access Log Page: Not Supported 00:26:03.500 Subsystem NQN: nqn.2016-06.io.spdk:cnode1 00:26:03.500 Command Effects Log Page: Supported 00:26:03.500 Get Log Page Extended Data: Supported 00:26:03.500 Telemetry Log Pages: Not Supported 00:26:03.500 Persistent Event Log Pages: Not Supported 00:26:03.500 Supported Log Pages Log Page: May Support 00:26:03.500 Commands Supported & Effects Log Page: Not Supported 00:26:03.500 Feature Identifiers & Effects Log Page:May Support 00:26:03.500 NVMe-MI Commands & Effects Log Page: May Support 00:26:03.500 Data Area 4 for Telemetry Log: Not Supported 00:26:03.500 Error Log Page Entries Supported: 128 00:26:03.500 Keep Alive: Supported 00:26:03.500 Keep Alive Granularity: 10000 ms 00:26:03.500 00:26:03.500 NVM Command Set Attributes 00:26:03.500 ========================== 00:26:03.500 Submission Queue Entry Size 00:26:03.500 Max: 64 00:26:03.500 Min: 64 00:26:03.500 Completion Queue Entry Size 00:26:03.500 Max: 16 00:26:03.500 Min: 16 00:26:03.500 Number of Namespaces: 32 00:26:03.500 Compare Command: Supported 00:26:03.500 Write Uncorrectable Command: Not Supported 00:26:03.500 Dataset Management Command: Supported 00:26:03.500 Write Zeroes Command: Supported 00:26:03.500 Set Features Save Field: Not Supported 00:26:03.500 Reservations: Supported 00:26:03.500 Timestamp: Not Supported 00:26:03.500 Copy: Supported 00:26:03.500 Volatile Write Cache: Present 00:26:03.500 Atomic Write Unit (Normal): 1 00:26:03.500 Atomic Write Unit (PFail): 1 00:26:03.500 Atomic Compare & Write Unit: 1 00:26:03.500 Fused Compare & Write: Supported 00:26:03.500 Scatter-Gather List 00:26:03.500 SGL Command Set: Supported 00:26:03.500 SGL Keyed: Supported 00:26:03.500 SGL Bit Bucket Descriptor: Not Supported 00:26:03.500 SGL Metadata Pointer: Not Supported 00:26:03.500 Oversized SGL: Not Supported 00:26:03.500 SGL Metadata Address: Not Supported 00:26:03.500 SGL Offset: Supported 00:26:03.500 Transport SGL Data Block: Not Supported 00:26:03.500 Replay Protected Memory Block: Not Supported 00:26:03.500 00:26:03.500 Firmware Slot Information 00:26:03.500 ========================= 00:26:03.500 Active slot: 1 00:26:03.500 Slot 1 Firmware Revision: 24.01.1 00:26:03.500 00:26:03.500 00:26:03.500 Commands Supported and Effects 00:26:03.500 ============================== 00:26:03.500 Admin Commands 00:26:03.500 -------------- 00:26:03.500 Get Log Page (02h): Supported 00:26:03.500 Identify (06h): Supported 00:26:03.500 Abort (08h): Supported 00:26:03.500 Set Features (09h): Supported 00:26:03.500 Get Features (0Ah): Supported 00:26:03.500 Asynchronous Event Request (0Ch): Supported 00:26:03.500 Keep Alive (18h): Supported 00:26:03.500 I/O Commands 00:26:03.500 ------------ 00:26:03.500 Flush (00h): Supported LBA-Change 00:26:03.500 Write (01h): Supported LBA-Change 00:26:03.500 Read (02h): Supported 00:26:03.500 Compare (05h): Supported 00:26:03.500 Write Zeroes (08h): Supported LBA-Change 00:26:03.500 Dataset Management (09h): Supported LBA-Change 00:26:03.500 Copy (19h): Supported LBA-Change 00:26:03.500 Unknown (79h): Supported LBA-Change 00:26:03.500 Unknown (7Ah): Supported 00:26:03.500 00:26:03.500 Error Log 00:26:03.500 ========= 00:26:03.500 00:26:03.500 Arbitration 00:26:03.500 =========== 00:26:03.500 Arbitration Burst: 1 00:26:03.500 00:26:03.500 Power Management 00:26:03.500 ================ 00:26:03.500 Number of Power States: 1 00:26:03.500 Current Power State: Power State #0 00:26:03.500 Power State #0: 00:26:03.500 Max Power: 0.00 W 00:26:03.500 Non-Operational State: Operational 00:26:03.500 Entry Latency: Not Reported 00:26:03.500 Exit Latency: Not Reported 00:26:03.500 Relative Read Throughput: 0 00:26:03.500 Relative Read Latency: 0 00:26:03.500 Relative Write Throughput: 0 00:26:03.500 Relative Write Latency: 0 00:26:03.500 Idle Power: Not Reported 00:26:03.500 Active Power: Not Reported 00:26:03.500 Non-Operational Permissive Mode: Not Supported 00:26:03.500 00:26:03.500 Health Information 00:26:03.500 ================== 00:26:03.500 Critical Warnings: 00:26:03.500 Available Spare Space: OK 00:26:03.500 Temperature: OK 00:26:03.500 Device Reliability: OK 00:26:03.500 Read Only: No 00:26:03.500 Volatile Memory Backup: OK 00:26:03.500 Current Temperature: 0 Kelvin (-273 Celsius) 00:26:03.500 Temperature Threshold: [2024-11-30 04:27:53.892095] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892108] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892114] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=7 on tqpair(0x15de420) 00:26:03.500 [2024-11-30 04:27:53.892125] nvme_qpair.c: 213:nvme_admin_qpair_print_command: *NOTICE*: GET FEATURES ERROR_RECOVERY cid:7 cdw10:00000005 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.500 [2024-11-30 04:27:53.892147] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x16444a0, cid 7, qid 0 00:26:03.500 [2024-11-30 04:27:53.892258] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.500 [2024-11-30 04:27:53.892274] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.500 [2024-11-30 04:27:53.892281] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892287] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x16444a0) on tqpair=0x15de420 00:26:03.500 [2024-11-30 04:27:53.892329] nvme_ctrlr.c:4220:nvme_ctrlr_destruct_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] Prepare to destruct SSD 00:26:03.500 [2024-11-30 04:27:53.892353] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.500 [2024-11-30 04:27:53.892367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.500 [2024-11-30 04:27:53.892377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.500 [2024-11-30 04:27:53.892386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:26:03.500 [2024-11-30 04:27:53.892400] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892410] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892421] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15de420) 00:26:03.500 [2024-11-30 04:27:53.892433] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.500 [2024-11-30 04:27:53.892471] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643f20, cid 3, qid 0 00:26:03.500 [2024-11-30 04:27:53.892566] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.500 [2024-11-30 04:27:53.892582] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.500 [2024-11-30 04:27:53.892592] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892599] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643f20) on tqpair=0x15de420 00:26:03.500 [2024-11-30 04:27:53.892612] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892620] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892627] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15de420) 00:26:03.500 [2024-11-30 04:27:53.892637] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY SET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.500 [2024-11-30 04:27:53.892666] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643f20, cid 3, qid 0 00:26:03.500 [2024-11-30 04:27:53.892772] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.500 [2024-11-30 04:27:53.892787] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.500 [2024-11-30 04:27:53.892794] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892804] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643f20) on tqpair=0x15de420 00:26:03.500 [2024-11-30 04:27:53.892814] nvme_ctrlr.c:1070:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] RTD3E = 0 us 00:26:03.500 [2024-11-30 04:27:53.892822] nvme_ctrlr.c:1073:nvme_ctrlr_shutdown_set_cc_done: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown timeout = 10000 ms 00:26:03.500 [2024-11-30 04:27:53.892839] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892849] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.892858] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15de420) 00:26:03.500 [2024-11-30 04:27:53.892869] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.500 [2024-11-30 04:27:53.892890] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643f20, cid 3, qid 0 00:26:03.500 [2024-11-30 04:27:53.892993] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.500 [2024-11-30 04:27:53.893010] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.500 [2024-11-30 04:27:53.893017] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.893035] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643f20) on tqpair=0x15de420 00:26:03.500 [2024-11-30 04:27:53.893056] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.893066] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.893074] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15de420) 00:26:03.500 [2024-11-30 04:27:53.893087] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.500 [2024-11-30 04:27:53.893109] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643f20, cid 3, qid 0 00:26:03.500 [2024-11-30 04:27:53.896969] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.500 [2024-11-30 04:27:53.896987] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.500 [2024-11-30 04:27:53.896995] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.897001] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643f20) on tqpair=0x15de420 00:26:03.500 [2024-11-30 04:27:53.897026] nvme_tcp.c: 739:nvme_tcp_build_contig_request: *DEBUG*: enter 00:26:03.500 [2024-11-30 04:27:53.897038] nvme_tcp.c: 893:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: enter 00:26:03.501 [2024-11-30 04:27:53.897045] nvme_tcp.c: 902:nvme_tcp_qpair_capsule_cmd_send: *DEBUG*: capsule_cmd cid=3 on tqpair(0x15de420) 00:26:03.501 [2024-11-30 04:27:53.897056] nvme_qpair.c: 218:nvme_admin_qpair_print_command: *NOTICE*: FABRIC PROPERTY GET qid:0 cid:3 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:26:03.501 [2024-11-30 04:27:53.897078] nvme_tcp.c: 872:nvme_tcp_qpair_cmd_send_complete: *DEBUG*: tcp req 0x1643f20, cid 3, qid 0 00:26:03.501 [2024-11-30 04:27:53.897188] nvme_tcp.c:1105:nvme_tcp_pdu_ch_handle: *DEBUG*: pdu type = 5 00:26:03.501 [2024-11-30 04:27:53.897204] nvme_tcp.c:1888:nvme_tcp_pdu_psh_handle: *DEBUG*: enter: pdu type =5 00:26:03.501 [2024-11-30 04:27:53.897211] nvme_tcp.c:1580:nvme_tcp_capsule_resp_hdr_handle: *DEBUG*: enter 00:26:03.501 [2024-11-30 04:27:53.897218] nvme_tcp.c: 857:nvme_tcp_req_complete_safe: *DEBUG*: complete tcp_req(0x1643f20) on tqpair=0x15de420 00:26:03.501 [2024-11-30 04:27:53.897237] nvme_ctrlr.c:1192:nvme_ctrlr_shutdown_poll_async: *DEBUG*: [nqn.2016-06.io.spdk:cnode1] shutdown complete in 4 milliseconds 00:26:03.501 0 Kelvin (-273 Celsius) 00:26:03.501 Available Spare: 0% 00:26:03.501 Available Spare Threshold: 0% 00:26:03.501 Life Percentage Used: 0% 00:26:03.501 Data Units Read: 0 00:26:03.501 Data Units Written: 0 00:26:03.501 Host Read Commands: 0 00:26:03.501 Host Write Commands: 0 00:26:03.501 Controller Busy Time: 0 minutes 00:26:03.501 Power Cycles: 0 00:26:03.501 Power On Hours: 0 hours 00:26:03.501 Unsafe Shutdowns: 0 00:26:03.501 Unrecoverable Media Errors: 0 00:26:03.501 Lifetime Error Log Entries: 0 00:26:03.501 Warning Temperature Time: 0 minutes 00:26:03.501 Critical Temperature Time: 0 minutes 00:26:03.501 00:26:03.501 Number of Queues 00:26:03.501 ================ 00:26:03.501 Number of I/O Submission Queues: 127 00:26:03.501 Number of I/O Completion Queues: 127 00:26:03.501 00:26:03.501 Active Namespaces 00:26:03.501 ================= 00:26:03.501 Namespace ID:1 00:26:03.501 Error Recovery Timeout: Unlimited 00:26:03.501 Command Set Identifier: NVM (00h) 00:26:03.501 Deallocate: Supported 00:26:03.501 Deallocated/Unwritten Error: Not Supported 00:26:03.501 Deallocated Read Value: Unknown 00:26:03.501 Deallocate in Write Zeroes: Not Supported 00:26:03.501 Deallocated Guard Field: 0xFFFF 00:26:03.501 Flush: Supported 00:26:03.501 Reservation: Supported 00:26:03.501 Namespace Sharing Capabilities: Multiple Controllers 00:26:03.501 Size (in LBAs): 131072 (0GiB) 00:26:03.501 Capacity (in LBAs): 131072 (0GiB) 00:26:03.501 Utilization (in LBAs): 131072 (0GiB) 00:26:03.501 NGUID: ABCDEF0123456789ABCDEF0123456789 00:26:03.501 EUI64: ABCDEF0123456789 00:26:03.501 UUID: d06adef5-c600-40f5-8d63-839a284b950a 00:26:03.501 Thin Provisioning: Not Supported 00:26:03.501 Per-NS Atomic Units: Yes 00:26:03.501 Atomic Boundary Size (Normal): 0 00:26:03.501 Atomic Boundary Size (PFail): 0 00:26:03.501 Atomic Boundary Offset: 0 00:26:03.501 Maximum Single Source Range Length: 65535 00:26:03.501 Maximum Copy Length: 65535 00:26:03.501 Maximum Source Range Count: 1 00:26:03.501 NGUID/EUI64 Never Reused: No 00:26:03.501 Namespace Write Protected: No 00:26:03.501 Number of LBA Formats: 1 00:26:03.501 Current LBA Format: LBA Format #00 00:26:03.501 LBA Format #00: Data Size: 512 Metadata Size: 0 00:26:03.501 00:26:03.501 04:27:53 -- host/identify.sh@51 -- # sync 00:26:03.501 04:27:53 -- host/identify.sh@52 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:03.501 04:27:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:26:03.501 04:27:53 -- common/autotest_common.sh@10 -- # set +x 00:26:03.501 04:27:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:26:03.501 04:27:53 -- host/identify.sh@54 -- # trap - SIGINT SIGTERM EXIT 00:26:03.501 04:27:53 -- host/identify.sh@56 -- # nvmftestfini 00:26:03.501 04:27:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:26:03.501 04:27:53 -- nvmf/common.sh@116 -- # sync 00:26:03.501 04:27:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:26:03.501 04:27:53 -- nvmf/common.sh@119 -- # set +e 00:26:03.501 04:27:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:26:03.501 04:27:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:26:03.501 rmmod nvme_tcp 00:26:03.501 rmmod nvme_fabrics 00:26:03.501 rmmod nvme_keyring 00:26:03.501 04:27:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:26:03.501 04:27:53 -- nvmf/common.sh@123 -- # set -e 00:26:03.501 04:27:53 -- nvmf/common.sh@124 -- # return 0 00:26:03.501 04:27:53 -- nvmf/common.sh@477 -- # '[' -n 2448760 ']' 00:26:03.501 04:27:53 -- nvmf/common.sh@478 -- # killprocess 2448760 00:26:03.501 04:27:53 -- common/autotest_common.sh@936 -- # '[' -z 2448760 ']' 00:26:03.501 04:27:53 -- common/autotest_common.sh@940 -- # kill -0 2448760 00:26:03.501 04:27:53 -- common/autotest_common.sh@941 -- # uname 00:26:03.501 04:27:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:26:03.501 04:27:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2448760 00:26:03.501 04:27:54 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:26:03.501 04:27:54 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:26:03.501 04:27:54 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2448760' 00:26:03.501 killing process with pid 2448760 00:26:03.501 04:27:54 -- common/autotest_common.sh@955 -- # kill 2448760 00:26:03.501 [2024-11-30 04:27:54.014125] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:26:03.501 04:27:54 -- common/autotest_common.sh@960 -- # wait 2448760 00:26:03.759 04:27:54 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:26:03.759 04:27:54 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:26:03.759 04:27:54 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:26:03.759 04:27:54 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:26:03.759 04:27:54 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:26:03.759 04:27:54 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:03.759 04:27:54 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:03.759 04:27:54 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:05.674 04:27:56 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:26:05.674 00:26:05.674 real 0m6.193s 00:26:05.674 user 0m7.476s 00:26:05.674 sys 0m1.948s 00:26:05.932 04:27:56 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:26:05.932 04:27:56 -- common/autotest_common.sh@10 -- # set +x 00:26:05.932 ************************************ 00:26:05.932 END TEST nvmf_identify 00:26:05.932 ************************************ 00:26:05.932 04:27:56 -- nvmf/nvmf.sh@98 -- # run_test nvmf_perf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:05.932 04:27:56 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:26:05.932 04:27:56 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:26:05.932 04:27:56 -- common/autotest_common.sh@10 -- # set +x 00:26:05.932 ************************************ 00:26:05.932 START TEST nvmf_perf 00:26:05.932 ************************************ 00:26:05.932 04:27:56 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/perf.sh --transport=tcp 00:26:05.932 * Looking for test storage... 00:26:05.932 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:26:05.932 04:27:56 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:26:05.932 04:27:56 -- common/autotest_common.sh@1690 -- # lcov --version 00:26:05.932 04:27:56 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:26:05.932 04:27:56 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:26:05.932 04:27:56 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:26:05.932 04:27:56 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:26:05.932 04:27:56 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:26:05.932 04:27:56 -- scripts/common.sh@335 -- # IFS=.-: 00:26:05.932 04:27:56 -- scripts/common.sh@335 -- # read -ra ver1 00:26:05.932 04:27:56 -- scripts/common.sh@336 -- # IFS=.-: 00:26:05.932 04:27:56 -- scripts/common.sh@336 -- # read -ra ver2 00:26:05.932 04:27:56 -- scripts/common.sh@337 -- # local 'op=<' 00:26:05.932 04:27:56 -- scripts/common.sh@339 -- # ver1_l=2 00:26:05.932 04:27:56 -- scripts/common.sh@340 -- # ver2_l=1 00:26:05.932 04:27:56 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:26:05.932 04:27:56 -- scripts/common.sh@343 -- # case "$op" in 00:26:05.933 04:27:56 -- scripts/common.sh@344 -- # : 1 00:26:05.933 04:27:56 -- scripts/common.sh@363 -- # (( v = 0 )) 00:26:05.933 04:27:56 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:26:05.933 04:27:56 -- scripts/common.sh@364 -- # decimal 1 00:26:05.933 04:27:56 -- scripts/common.sh@352 -- # local d=1 00:26:05.933 04:27:56 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:26:05.933 04:27:56 -- scripts/common.sh@354 -- # echo 1 00:26:05.933 04:27:56 -- scripts/common.sh@364 -- # ver1[v]=1 00:26:05.933 04:27:56 -- scripts/common.sh@365 -- # decimal 2 00:26:05.933 04:27:56 -- scripts/common.sh@352 -- # local d=2 00:26:05.933 04:27:56 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:26:05.933 04:27:56 -- scripts/common.sh@354 -- # echo 2 00:26:05.933 04:27:56 -- scripts/common.sh@365 -- # ver2[v]=2 00:26:05.933 04:27:56 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:26:05.933 04:27:56 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:26:05.933 04:27:56 -- scripts/common.sh@367 -- # return 0 00:26:05.933 04:27:56 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:26:05.933 04:27:56 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:26:05.933 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:05.933 --rc genhtml_branch_coverage=1 00:26:05.933 --rc genhtml_function_coverage=1 00:26:05.933 --rc genhtml_legend=1 00:26:05.933 --rc geninfo_all_blocks=1 00:26:05.933 --rc geninfo_unexecuted_blocks=1 00:26:05.933 00:26:05.933 ' 00:26:05.933 04:27:56 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:26:05.933 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:05.933 --rc genhtml_branch_coverage=1 00:26:05.933 --rc genhtml_function_coverage=1 00:26:05.933 --rc genhtml_legend=1 00:26:05.933 --rc geninfo_all_blocks=1 00:26:05.933 --rc geninfo_unexecuted_blocks=1 00:26:05.933 00:26:05.933 ' 00:26:05.933 04:27:56 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:26:05.933 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:05.933 --rc genhtml_branch_coverage=1 00:26:05.933 --rc genhtml_function_coverage=1 00:26:05.933 --rc genhtml_legend=1 00:26:05.933 --rc geninfo_all_blocks=1 00:26:05.933 --rc geninfo_unexecuted_blocks=1 00:26:05.933 00:26:05.933 ' 00:26:05.933 04:27:56 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:26:05.933 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:26:05.933 --rc genhtml_branch_coverage=1 00:26:05.933 --rc genhtml_function_coverage=1 00:26:05.933 --rc genhtml_legend=1 00:26:05.933 --rc geninfo_all_blocks=1 00:26:05.933 --rc geninfo_unexecuted_blocks=1 00:26:05.933 00:26:05.933 ' 00:26:05.933 04:27:56 -- host/perf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:26:05.933 04:27:56 -- nvmf/common.sh@7 -- # uname -s 00:26:05.933 04:27:56 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:26:05.933 04:27:56 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:26:05.933 04:27:56 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:26:05.933 04:27:56 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:26:05.933 04:27:56 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:26:05.933 04:27:56 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:26:05.933 04:27:56 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:26:05.933 04:27:56 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:26:05.933 04:27:56 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:26:05.933 04:27:56 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:26:05.933 04:27:56 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:26:05.933 04:27:56 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:26:05.933 04:27:56 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:26:05.933 04:27:56 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:26:05.933 04:27:56 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:26:05.933 04:27:56 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:26:05.933 04:27:56 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:26:05.933 04:27:56 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:26:05.933 04:27:56 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:26:05.933 04:27:56 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:05.933 04:27:56 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:05.933 04:27:56 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:05.933 04:27:56 -- paths/export.sh@5 -- # export PATH 00:26:05.933 04:27:56 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:26:05.933 04:27:56 -- nvmf/common.sh@46 -- # : 0 00:26:05.933 04:27:56 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:26:05.933 04:27:56 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:26:05.933 04:27:56 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:26:05.933 04:27:56 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:26:05.933 04:27:56 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:26:05.933 04:27:56 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:26:05.933 04:27:56 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:26:05.933 04:27:56 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:26:05.933 04:27:56 -- host/perf.sh@12 -- # MALLOC_BDEV_SIZE=64 00:26:05.933 04:27:56 -- host/perf.sh@13 -- # MALLOC_BLOCK_SIZE=512 00:26:05.933 04:27:56 -- host/perf.sh@15 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:26:05.933 04:27:56 -- host/perf.sh@17 -- # nvmftestinit 00:26:05.933 04:27:56 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:26:05.933 04:27:56 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:26:05.933 04:27:56 -- nvmf/common.sh@436 -- # prepare_net_devs 00:26:05.933 04:27:56 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:26:05.933 04:27:56 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:26:05.933 04:27:56 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:26:05.933 04:27:56 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:26:05.933 04:27:56 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:26:05.933 04:27:56 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:26:05.933 04:27:56 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:26:05.933 04:27:56 -- nvmf/common.sh@284 -- # xtrace_disable 00:26:05.933 04:27:56 -- common/autotest_common.sh@10 -- # set +x 00:26:07.830 04:27:58 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:26:07.830 04:27:58 -- nvmf/common.sh@290 -- # pci_devs=() 00:26:07.830 04:27:58 -- nvmf/common.sh@290 -- # local -a pci_devs 00:26:07.830 04:27:58 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:26:07.830 04:27:58 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:26:07.830 04:27:58 -- nvmf/common.sh@292 -- # pci_drivers=() 00:26:07.830 04:27:58 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:26:07.830 04:27:58 -- nvmf/common.sh@294 -- # net_devs=() 00:26:07.830 04:27:58 -- nvmf/common.sh@294 -- # local -ga net_devs 00:26:07.830 04:27:58 -- nvmf/common.sh@295 -- # e810=() 00:26:07.830 04:27:58 -- nvmf/common.sh@295 -- # local -ga e810 00:26:07.830 04:27:58 -- nvmf/common.sh@296 -- # x722=() 00:26:07.830 04:27:58 -- nvmf/common.sh@296 -- # local -ga x722 00:26:07.830 04:27:58 -- nvmf/common.sh@297 -- # mlx=() 00:26:07.830 04:27:58 -- nvmf/common.sh@297 -- # local -ga mlx 00:26:07.830 04:27:58 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:26:07.830 04:27:58 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:26:07.830 04:27:58 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:26:07.830 04:27:58 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:26:07.830 04:27:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:07.830 04:27:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:26:07.830 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:26:07.830 04:27:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:26:07.830 04:27:58 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:26:07.830 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:26:07.830 04:27:58 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:26:07.830 04:27:58 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:26:07.830 04:27:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:07.830 04:27:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:07.830 04:27:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:07.830 04:27:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:07.830 04:27:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:26:07.830 Found net devices under 0000:0a:00.0: cvl_0_0 00:26:07.830 04:27:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:07.830 04:27:58 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:26:07.830 04:27:58 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:26:07.830 04:27:58 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:26:07.830 04:27:58 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:26:07.830 04:27:58 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:26:07.830 Found net devices under 0000:0a:00.1: cvl_0_1 00:26:07.830 04:27:58 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:26:08.088 04:27:58 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:26:08.088 04:27:58 -- nvmf/common.sh@402 -- # is_hw=yes 00:26:08.088 04:27:58 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:26:08.088 04:27:58 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:26:08.088 04:27:58 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:26:08.088 04:27:58 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:26:08.088 04:27:58 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:26:08.088 04:27:58 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:26:08.088 04:27:58 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:26:08.088 04:27:58 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:26:08.088 04:27:58 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:26:08.088 04:27:58 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:26:08.088 04:27:58 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:26:08.088 04:27:58 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:26:08.088 04:27:58 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:26:08.088 04:27:58 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:26:08.088 04:27:58 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:26:08.088 04:27:58 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:26:08.088 04:27:58 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:26:08.088 04:27:58 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:26:08.088 04:27:58 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:26:08.088 04:27:58 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:26:08.088 04:27:58 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:26:08.088 04:27:58 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:26:08.088 04:27:58 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:26:08.088 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:26:08.088 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.164 ms 00:26:08.088 00:26:08.088 --- 10.0.0.2 ping statistics --- 00:26:08.088 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:08.088 rtt min/avg/max/mdev = 0.164/0.164/0.164/0.000 ms 00:26:08.088 04:27:58 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:26:08.088 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:26:08.088 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.074 ms 00:26:08.088 00:26:08.088 --- 10.0.0.1 ping statistics --- 00:26:08.088 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:26:08.088 rtt min/avg/max/mdev = 0.074/0.074/0.074/0.000 ms 00:26:08.088 04:27:58 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:26:08.088 04:27:58 -- nvmf/common.sh@410 -- # return 0 00:26:08.088 04:27:58 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:26:08.089 04:27:58 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:26:08.089 04:27:58 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:26:08.089 04:27:58 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:26:08.089 04:27:58 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:26:08.089 04:27:58 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:26:08.089 04:27:58 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:26:08.089 04:27:58 -- host/perf.sh@18 -- # nvmfappstart -m 0xF 00:26:08.089 04:27:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:26:08.089 04:27:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:26:08.089 04:27:58 -- common/autotest_common.sh@10 -- # set +x 00:26:08.089 04:27:58 -- nvmf/common.sh@469 -- # nvmfpid=2450869 00:26:08.089 04:27:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:26:08.089 04:27:58 -- nvmf/common.sh@470 -- # waitforlisten 2450869 00:26:08.089 04:27:58 -- common/autotest_common.sh@829 -- # '[' -z 2450869 ']' 00:26:08.089 04:27:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:26:08.089 04:27:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:26:08.089 04:27:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:26:08.089 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:26:08.089 04:27:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:26:08.089 04:27:58 -- common/autotest_common.sh@10 -- # set +x 00:26:08.089 [2024-11-30 04:27:58.657374] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:26:08.089 [2024-11-30 04:27:58.657443] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:26:08.089 EAL: No free 2048 kB hugepages reported on node 1 00:26:08.346 [2024-11-30 04:27:58.728833] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:26:08.346 [2024-11-30 04:27:58.820491] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:26:08.346 [2024-11-30 04:27:58.820675] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:26:08.346 [2024-11-30 04:27:58.820696] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:26:08.346 [2024-11-30 04:27:58.820718] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:26:08.346 [2024-11-30 04:27:58.820801] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:26:08.346 [2024-11-30 04:27:58.820882] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:26:08.346 [2024-11-30 04:27:58.821039] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:26:08.346 [2024-11-30 04:27:58.821043] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:26:09.278 04:27:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:26:09.278 04:27:59 -- common/autotest_common.sh@862 -- # return 0 00:26:09.278 04:27:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:26:09.278 04:27:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:26:09.278 04:27:59 -- common/autotest_common.sh@10 -- # set +x 00:26:09.278 04:27:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:26:09.278 04:27:59 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:26:09.278 04:27:59 -- host/perf.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py load_subsystem_config 00:26:12.556 04:28:02 -- host/perf.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py framework_get_config bdev 00:26:12.556 04:28:02 -- host/perf.sh@30 -- # jq -r '.[].params | select(.name=="Nvme0").traddr' 00:26:12.556 04:28:03 -- host/perf.sh@30 -- # local_nvme_trid=0000:88:00.0 00:26:12.556 04:28:03 -- host/perf.sh@31 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 00:26:12.814 04:28:03 -- host/perf.sh@31 -- # bdevs=' Malloc0' 00:26:12.814 04:28:03 -- host/perf.sh@33 -- # '[' -n 0000:88:00.0 ']' 00:26:12.814 04:28:03 -- host/perf.sh@34 -- # bdevs=' Malloc0 Nvme0n1' 00:26:12.814 04:28:03 -- host/perf.sh@37 -- # '[' tcp == rdma ']' 00:26:12.814 04:28:03 -- host/perf.sh@42 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o 00:26:13.071 [2024-11-30 04:28:03.618180] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:26:13.071 04:28:03 -- host/perf.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:13.328 04:28:03 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:13.328 04:28:03 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:26:13.585 04:28:04 -- host/perf.sh@45 -- # for bdev in $bdevs 00:26:13.585 04:28:04 -- host/perf.sh@46 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:26:13.842 04:28:04 -- host/perf.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:14.099 [2024-11-30 04:28:04.626026] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:26:14.099 04:28:04 -- host/perf.sh@49 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:26:14.355 04:28:04 -- host/perf.sh@52 -- # '[' -n 0000:88:00.0 ']' 00:26:14.355 04:28:04 -- host/perf.sh@53 -- # perf_app -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:14.355 04:28:04 -- host/perf.sh@21 -- # '[' 0 -eq 1 ']' 00:26:14.355 04:28:04 -- host/perf.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -i 0 -q 32 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:PCIe traddr:0000:88:00.0' 00:26:15.727 Initializing NVMe Controllers 00:26:15.727 Attached to NVMe Controller at 0000:88:00.0 [8086:0a54] 00:26:15.727 Associating PCIE (0000:88:00.0) NSID 1 with lcore 0 00:26:15.727 Initialization complete. Launching workers. 00:26:15.727 ======================================================== 00:26:15.727 Latency(us) 00:26:15.727 Device Information : IOPS MiB/s Average min max 00:26:15.727 PCIE (0000:88:00.0) NSID 1 from core 0: 86985.87 339.79 367.34 15.46 6229.43 00:26:15.727 ======================================================== 00:26:15.727 Total : 86985.87 339.79 367.34 15.46 6229.43 00:26:15.727 00:26:15.727 04:28:06 -- host/perf.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 4096 -w randrw -M 50 -t 1 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:15.727 EAL: No free 2048 kB hugepages reported on node 1 00:26:17.102 Initializing NVMe Controllers 00:26:17.102 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:17.102 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:17.102 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:17.102 Initialization complete. Launching workers. 00:26:17.102 ======================================================== 00:26:17.102 Latency(us) 00:26:17.102 Device Information : IOPS MiB/s Average min max 00:26:17.102 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 92.67 0.36 10802.55 142.72 45946.18 00:26:17.102 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 54.81 0.21 18825.71 5025.54 47897.84 00:26:17.103 ======================================================== 00:26:17.103 Total : 147.48 0.58 13784.13 142.72 47897.84 00:26:17.103 00:26:17.103 04:28:07 -- host/perf.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 4096 -w randrw -M 50 -t 1 -HI -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:17.103 EAL: No free 2048 kB hugepages reported on node 1 00:26:18.476 Initializing NVMe Controllers 00:26:18.476 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:18.476 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:18.476 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:18.476 Initialization complete. Launching workers. 00:26:18.476 ======================================================== 00:26:18.476 Latency(us) 00:26:18.476 Device Information : IOPS MiB/s Average min max 00:26:18.476 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 8473.84 33.10 3776.36 573.04 7890.31 00:26:18.476 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 4005.58 15.65 8001.80 5350.07 18284.85 00:26:18.476 ======================================================== 00:26:18.476 Total : 12479.42 48.75 5132.62 573.04 18284.85 00:26:18.476 00:26:18.476 04:28:08 -- host/perf.sh@59 -- # [[ e810 == \e\8\1\0 ]] 00:26:18.476 04:28:08 -- host/perf.sh@59 -- # [[ tcp == \r\d\m\a ]] 00:26:18.476 04:28:08 -- host/perf.sh@60 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -O 16384 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:18.476 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.007 Initializing NVMe Controllers 00:26:21.007 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:21.007 Controller IO queue size 128, less than required. 00:26:21.007 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:21.007 Controller IO queue size 128, less than required. 00:26:21.007 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:21.007 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:21.007 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:21.007 Initialization complete. Launching workers. 00:26:21.007 ======================================================== 00:26:21.007 Latency(us) 00:26:21.007 Device Information : IOPS MiB/s Average min max 00:26:21.007 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1740.22 435.06 75254.62 46963.66 117838.33 00:26:21.007 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 567.41 141.85 233291.80 78518.40 376595.94 00:26:21.007 ======================================================== 00:26:21.007 Total : 2307.63 576.91 114113.42 46963.66 376595.94 00:26:21.007 00:26:21.007 04:28:11 -- host/perf.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 36964 -O 4096 -w randrw -M 50 -t 5 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' -c 0xf -P 4 00:26:21.007 EAL: No free 2048 kB hugepages reported on node 1 00:26:21.007 No valid NVMe controllers or AIO or URING devices found 00:26:21.007 Initializing NVMe Controllers 00:26:21.007 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:21.007 Controller IO queue size 128, less than required. 00:26:21.007 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:21.007 WARNING: IO size 36964 (-o) is not a multiple of nsid 1 sector size 512. Removing this ns from test 00:26:21.007 Controller IO queue size 128, less than required. 00:26:21.007 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:21.007 WARNING: IO size 36964 (-o) is not a multiple of nsid 2 sector size 512. Removing this ns from test 00:26:21.007 WARNING: Some requested NVMe devices were skipped 00:26:21.007 04:28:11 -- host/perf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 262144 -w randrw -M 50 -t 2 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' --transport-stat 00:26:21.007 EAL: No free 2048 kB hugepages reported on node 1 00:26:23.537 Initializing NVMe Controllers 00:26:23.537 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:23.537 Controller IO queue size 128, less than required. 00:26:23.537 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:23.537 Controller IO queue size 128, less than required. 00:26:23.537 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:26:23.537 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:23.537 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 with lcore 0 00:26:23.537 Initialization complete. Launching workers. 00:26:23.537 00:26:23.537 ==================== 00:26:23.537 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 statistics: 00:26:23.537 TCP transport: 00:26:23.537 polls: 8213 00:26:23.537 idle_polls: 5461 00:26:23.537 sock_completions: 2752 00:26:23.537 nvme_completions: 5089 00:26:23.537 submitted_requests: 7790 00:26:23.537 queued_requests: 1 00:26:23.537 00:26:23.537 ==================== 00:26:23.537 lcore 0, ns TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 statistics: 00:26:23.537 TCP transport: 00:26:23.537 polls: 11570 00:26:23.537 idle_polls: 8711 00:26:23.537 sock_completions: 2859 00:26:23.537 nvme_completions: 5236 00:26:23.537 submitted_requests: 8038 00:26:23.537 queued_requests: 1 00:26:23.537 ======================================================== 00:26:23.537 Latency(us) 00:26:23.537 Device Information : IOPS MiB/s Average min max 00:26:23.537 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1335.97 333.99 98327.28 62038.02 145175.52 00:26:23.537 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 2 from core 0: 1372.47 343.12 95442.47 41867.32 145049.48 00:26:23.537 ======================================================== 00:26:23.537 Total : 2708.44 677.11 96865.43 41867.32 145175.52 00:26:23.537 00:26:23.537 04:28:13 -- host/perf.sh@66 -- # sync 00:26:23.537 04:28:13 -- host/perf.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:26:23.537 04:28:14 -- host/perf.sh@69 -- # '[' 1 -eq 1 ']' 00:26:23.537 04:28:14 -- host/perf.sh@71 -- # '[' -n 0000:88:00.0 ']' 00:26:23.537 04:28:14 -- host/perf.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore Nvme0n1 lvs_0 00:26:26.814 04:28:17 -- host/perf.sh@72 -- # ls_guid=23a52ac4-34b3-4843-b4a9-e92a95fd226b 00:26:26.814 04:28:17 -- host/perf.sh@73 -- # get_lvs_free_mb 23a52ac4-34b3-4843-b4a9-e92a95fd226b 00:26:26.814 04:28:17 -- common/autotest_common.sh@1353 -- # local lvs_uuid=23a52ac4-34b3-4843-b4a9-e92a95fd226b 00:26:26.814 04:28:17 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:26.814 04:28:17 -- common/autotest_common.sh@1355 -- # local fc 00:26:26.814 04:28:17 -- common/autotest_common.sh@1356 -- # local cs 00:26:26.814 04:28:17 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:27.071 04:28:17 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:27.071 { 00:26:27.071 "uuid": "23a52ac4-34b3-4843-b4a9-e92a95fd226b", 00:26:27.071 "name": "lvs_0", 00:26:27.071 "base_bdev": "Nvme0n1", 00:26:27.071 "total_data_clusters": 238234, 00:26:27.071 "free_clusters": 238234, 00:26:27.071 "block_size": 512, 00:26:27.071 "cluster_size": 4194304 00:26:27.071 } 00:26:27.071 ]' 00:26:27.071 04:28:17 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="23a52ac4-34b3-4843-b4a9-e92a95fd226b") .free_clusters' 00:26:27.329 04:28:17 -- common/autotest_common.sh@1358 -- # fc=238234 00:26:27.329 04:28:17 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="23a52ac4-34b3-4843-b4a9-e92a95fd226b") .cluster_size' 00:26:27.329 04:28:17 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:27.329 04:28:17 -- common/autotest_common.sh@1362 -- # free_mb=952936 00:26:27.329 04:28:17 -- common/autotest_common.sh@1363 -- # echo 952936 00:26:27.329 952936 00:26:27.329 04:28:17 -- host/perf.sh@77 -- # '[' 952936 -gt 20480 ']' 00:26:27.329 04:28:17 -- host/perf.sh@78 -- # free_mb=20480 00:26:27.329 04:28:17 -- host/perf.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 23a52ac4-34b3-4843-b4a9-e92a95fd226b lbd_0 20480 00:26:27.587 04:28:18 -- host/perf.sh@80 -- # lb_guid=7e5bbda1-8170-4317-b893-521a44954397 00:26:27.587 04:28:18 -- host/perf.sh@83 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore 7e5bbda1-8170-4317-b893-521a44954397 lvs_n_0 00:26:28.521 04:28:18 -- host/perf.sh@83 -- # ls_nested_guid=677cc83b-b24b-4501-b4b9-4ed6cc7a9e5f 00:26:28.521 04:28:18 -- host/perf.sh@84 -- # get_lvs_free_mb 677cc83b-b24b-4501-b4b9-4ed6cc7a9e5f 00:26:28.521 04:28:18 -- common/autotest_common.sh@1353 -- # local lvs_uuid=677cc83b-b24b-4501-b4b9-4ed6cc7a9e5f 00:26:28.521 04:28:18 -- common/autotest_common.sh@1354 -- # local lvs_info 00:26:28.522 04:28:18 -- common/autotest_common.sh@1355 -- # local fc 00:26:28.522 04:28:18 -- common/autotest_common.sh@1356 -- # local cs 00:26:28.522 04:28:18 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:26:28.779 04:28:19 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:26:28.779 { 00:26:28.779 "uuid": "23a52ac4-34b3-4843-b4a9-e92a95fd226b", 00:26:28.779 "name": "lvs_0", 00:26:28.779 "base_bdev": "Nvme0n1", 00:26:28.779 "total_data_clusters": 238234, 00:26:28.779 "free_clusters": 233114, 00:26:28.779 "block_size": 512, 00:26:28.779 "cluster_size": 4194304 00:26:28.779 }, 00:26:28.779 { 00:26:28.779 "uuid": "677cc83b-b24b-4501-b4b9-4ed6cc7a9e5f", 00:26:28.779 "name": "lvs_n_0", 00:26:28.779 "base_bdev": "7e5bbda1-8170-4317-b893-521a44954397", 00:26:28.779 "total_data_clusters": 5114, 00:26:28.779 "free_clusters": 5114, 00:26:28.779 "block_size": 512, 00:26:28.779 "cluster_size": 4194304 00:26:28.779 } 00:26:28.779 ]' 00:26:28.779 04:28:19 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="677cc83b-b24b-4501-b4b9-4ed6cc7a9e5f") .free_clusters' 00:26:28.779 04:28:19 -- common/autotest_common.sh@1358 -- # fc=5114 00:26:28.779 04:28:19 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="677cc83b-b24b-4501-b4b9-4ed6cc7a9e5f") .cluster_size' 00:26:28.779 04:28:19 -- common/autotest_common.sh@1359 -- # cs=4194304 00:26:28.779 04:28:19 -- common/autotest_common.sh@1362 -- # free_mb=20456 00:26:28.779 04:28:19 -- common/autotest_common.sh@1363 -- # echo 20456 00:26:28.779 20456 00:26:28.779 04:28:19 -- host/perf.sh@85 -- # '[' 20456 -gt 20480 ']' 00:26:28.779 04:28:19 -- host/perf.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -u 677cc83b-b24b-4501-b4b9-4ed6cc7a9e5f lbd_nest_0 20456 00:26:29.038 04:28:19 -- host/perf.sh@88 -- # lb_nested_guid=cb4ef110-daca-4c34-b7ce-752181aa4d73 00:26:29.038 04:28:19 -- host/perf.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:26:29.318 04:28:19 -- host/perf.sh@90 -- # for bdev in $lb_nested_guid 00:26:29.318 04:28:19 -- host/perf.sh@91 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 cb4ef110-daca-4c34-b7ce-752181aa4d73 00:26:29.654 04:28:20 -- host/perf.sh@93 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:26:29.911 04:28:20 -- host/perf.sh@95 -- # qd_depth=("1" "32" "128") 00:26:29.911 04:28:20 -- host/perf.sh@96 -- # io_size=("512" "131072") 00:26:29.911 04:28:20 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:29.911 04:28:20 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:29.911 04:28:20 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:29.911 EAL: No free 2048 kB hugepages reported on node 1 00:26:42.115 Initializing NVMe Controllers 00:26:42.115 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:42.115 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:42.115 Initialization complete. Launching workers. 00:26:42.115 ======================================================== 00:26:42.115 Latency(us) 00:26:42.115 Device Information : IOPS MiB/s Average min max 00:26:42.115 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 47.39 0.02 21102.37 171.65 45890.32 00:26:42.115 ======================================================== 00:26:42.115 Total : 47.39 0.02 21102.37 171.65 45890.32 00:26:42.115 00:26:42.115 04:28:30 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:42.115 04:28:30 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 1 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:42.115 EAL: No free 2048 kB hugepages reported on node 1 00:26:52.081 Initializing NVMe Controllers 00:26:52.081 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:26:52.081 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:26:52.081 Initialization complete. Launching workers. 00:26:52.081 ======================================================== 00:26:52.081 Latency(us) 00:26:52.081 Device Information : IOPS MiB/s Average min max 00:26:52.081 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 76.20 9.53 13139.18 4975.94 55827.41 00:26:52.081 ======================================================== 00:26:52.081 Total : 76.20 9.53 13139.18 4975.94 55827.41 00:26:52.081 00:26:52.081 04:28:41 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:26:52.081 04:28:41 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:26:52.081 04:28:41 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:26:52.081 EAL: No free 2048 kB hugepages reported on node 1 00:27:02.055 Initializing NVMe Controllers 00:27:02.055 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:02.055 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:02.055 Initialization complete. Launching workers. 00:27:02.055 ======================================================== 00:27:02.055 Latency(us) 00:27:02.055 Device Information : IOPS MiB/s Average min max 00:27:02.055 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 7717.93 3.77 4146.68 291.58 11149.76 00:27:02.055 ======================================================== 00:27:02.055 Total : 7717.93 3.77 4146.68 291.58 11149.76 00:27:02.055 00:27:02.055 04:28:51 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:02.055 04:28:51 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 32 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:02.055 EAL: No free 2048 kB hugepages reported on node 1 00:27:12.039 Initializing NVMe Controllers 00:27:12.039 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:12.039 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:12.039 Initialization complete. Launching workers. 00:27:12.039 ======================================================== 00:27:12.039 Latency(us) 00:27:12.039 Device Information : IOPS MiB/s Average min max 00:27:12.039 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 4021.47 502.68 7958.00 579.31 16379.81 00:27:12.039 ======================================================== 00:27:12.039 Total : 4021.47 502.68 7958.00 579.31 16379.81 00:27:12.039 00:27:12.039 04:29:01 -- host/perf.sh@97 -- # for qd in "${qd_depth[@]}" 00:27:12.039 04:29:01 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:12.039 04:29:01 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 512 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:12.039 EAL: No free 2048 kB hugepages reported on node 1 00:27:21.998 Initializing NVMe Controllers 00:27:21.998 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:21.998 Controller IO queue size 128, less than required. 00:27:21.998 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:21.998 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:21.998 Initialization complete. Launching workers. 00:27:21.998 ======================================================== 00:27:21.998 Latency(us) 00:27:21.998 Device Information : IOPS MiB/s Average min max 00:27:21.998 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 12025.04 5.87 10645.74 1768.82 30754.53 00:27:21.998 ======================================================== 00:27:21.998 Total : 12025.04 5.87 10645.74 1768.82 30754.53 00:27:21.998 00:27:21.998 04:29:11 -- host/perf.sh@98 -- # for o in "${io_size[@]}" 00:27:21.998 04:29:11 -- host/perf.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_perf -q 128 -o 131072 -w randrw -M 50 -t 10 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:27:21.998 EAL: No free 2048 kB hugepages reported on node 1 00:27:31.974 Initializing NVMe Controllers 00:27:31.974 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:27:31.974 Controller IO queue size 128, less than required. 00:27:31.974 Consider using lower queue depth or smaller IO size, because IO requests may be queued at the NVMe driver. 00:27:31.974 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 with lcore 0 00:27:31.974 Initialization complete. Launching workers. 00:27:31.974 ======================================================== 00:27:31.974 Latency(us) 00:27:31.974 Device Information : IOPS MiB/s Average min max 00:27:31.974 TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) NSID 1 from core 0: 1183.70 147.96 108439.55 15850.42 234742.39 00:27:31.974 ======================================================== 00:27:31.974 Total : 1183.70 147.96 108439.55 15850.42 234742.39 00:27:31.974 00:27:31.974 04:29:22 -- host/perf.sh@104 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:31.974 04:29:22 -- host/perf.sh@105 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete cb4ef110-daca-4c34-b7ce-752181aa4d73 00:27:32.540 04:29:23 -- host/perf.sh@106 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:27:32.798 04:29:23 -- host/perf.sh@107 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete 7e5bbda1-8170-4317-b893-521a44954397 00:27:33.364 04:29:23 -- host/perf.sh@108 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:27:33.364 04:29:23 -- host/perf.sh@112 -- # trap - SIGINT SIGTERM EXIT 00:27:33.364 04:29:23 -- host/perf.sh@114 -- # nvmftestfini 00:27:33.364 04:29:23 -- nvmf/common.sh@476 -- # nvmfcleanup 00:27:33.364 04:29:23 -- nvmf/common.sh@116 -- # sync 00:27:33.364 04:29:23 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:27:33.364 04:29:23 -- nvmf/common.sh@119 -- # set +e 00:27:33.364 04:29:23 -- nvmf/common.sh@120 -- # for i in {1..20} 00:27:33.364 04:29:23 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:27:33.364 rmmod nvme_tcp 00:27:33.364 rmmod nvme_fabrics 00:27:33.623 rmmod nvme_keyring 00:27:33.623 04:29:24 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:27:33.623 04:29:24 -- nvmf/common.sh@123 -- # set -e 00:27:33.623 04:29:24 -- nvmf/common.sh@124 -- # return 0 00:27:33.623 04:29:24 -- nvmf/common.sh@477 -- # '[' -n 2450869 ']' 00:27:33.623 04:29:24 -- nvmf/common.sh@478 -- # killprocess 2450869 00:27:33.623 04:29:24 -- common/autotest_common.sh@936 -- # '[' -z 2450869 ']' 00:27:33.623 04:29:24 -- common/autotest_common.sh@940 -- # kill -0 2450869 00:27:33.623 04:29:24 -- common/autotest_common.sh@941 -- # uname 00:27:33.623 04:29:24 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:27:33.623 04:29:24 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2450869 00:27:33.623 04:29:24 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:27:33.623 04:29:24 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:27:33.623 04:29:24 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2450869' 00:27:33.623 killing process with pid 2450869 00:27:33.623 04:29:24 -- common/autotest_common.sh@955 -- # kill 2450869 00:27:33.623 04:29:24 -- common/autotest_common.sh@960 -- # wait 2450869 00:27:35.521 04:29:25 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:27:35.521 04:29:25 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:27:35.521 04:29:25 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:27:35.521 04:29:25 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:27:35.521 04:29:25 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:27:35.521 04:29:25 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:35.521 04:29:25 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:35.521 04:29:25 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:37.452 04:29:27 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:27:37.452 00:27:37.452 real 1m31.395s 00:27:37.452 user 5m37.769s 00:27:37.452 sys 0m15.418s 00:27:37.452 04:29:27 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:27:37.452 04:29:27 -- common/autotest_common.sh@10 -- # set +x 00:27:37.452 ************************************ 00:27:37.452 END TEST nvmf_perf 00:27:37.452 ************************************ 00:27:37.452 04:29:27 -- nvmf/nvmf.sh@99 -- # run_test nvmf_fio_host /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:37.452 04:29:27 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:27:37.452 04:29:27 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:27:37.452 04:29:27 -- common/autotest_common.sh@10 -- # set +x 00:27:37.452 ************************************ 00:27:37.452 START TEST nvmf_fio_host 00:27:37.452 ************************************ 00:27:37.452 04:29:27 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/fio.sh --transport=tcp 00:27:37.452 * Looking for test storage... 00:27:37.452 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:27:37.453 04:29:27 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:27:37.453 04:29:27 -- common/autotest_common.sh@1690 -- # lcov --version 00:27:37.453 04:29:27 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:27:37.453 04:29:27 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:27:37.453 04:29:27 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:27:37.453 04:29:27 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:27:37.453 04:29:27 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:27:37.453 04:29:27 -- scripts/common.sh@335 -- # IFS=.-: 00:27:37.453 04:29:27 -- scripts/common.sh@335 -- # read -ra ver1 00:27:37.453 04:29:27 -- scripts/common.sh@336 -- # IFS=.-: 00:27:37.453 04:29:27 -- scripts/common.sh@336 -- # read -ra ver2 00:27:37.453 04:29:27 -- scripts/common.sh@337 -- # local 'op=<' 00:27:37.453 04:29:27 -- scripts/common.sh@339 -- # ver1_l=2 00:27:37.453 04:29:27 -- scripts/common.sh@340 -- # ver2_l=1 00:27:37.453 04:29:27 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:27:37.453 04:29:27 -- scripts/common.sh@343 -- # case "$op" in 00:27:37.453 04:29:27 -- scripts/common.sh@344 -- # : 1 00:27:37.453 04:29:27 -- scripts/common.sh@363 -- # (( v = 0 )) 00:27:37.453 04:29:27 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:27:37.453 04:29:27 -- scripts/common.sh@364 -- # decimal 1 00:27:37.453 04:29:27 -- scripts/common.sh@352 -- # local d=1 00:27:37.453 04:29:27 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:27:37.453 04:29:27 -- scripts/common.sh@354 -- # echo 1 00:27:37.453 04:29:27 -- scripts/common.sh@364 -- # ver1[v]=1 00:27:37.453 04:29:27 -- scripts/common.sh@365 -- # decimal 2 00:27:37.453 04:29:27 -- scripts/common.sh@352 -- # local d=2 00:27:37.453 04:29:27 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:27:37.453 04:29:27 -- scripts/common.sh@354 -- # echo 2 00:27:37.453 04:29:27 -- scripts/common.sh@365 -- # ver2[v]=2 00:27:37.453 04:29:27 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:27:37.453 04:29:27 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:27:37.453 04:29:27 -- scripts/common.sh@367 -- # return 0 00:27:37.453 04:29:27 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:27:37.453 04:29:27 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:27:37.453 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:37.453 --rc genhtml_branch_coverage=1 00:27:37.453 --rc genhtml_function_coverage=1 00:27:37.453 --rc genhtml_legend=1 00:27:37.453 --rc geninfo_all_blocks=1 00:27:37.453 --rc geninfo_unexecuted_blocks=1 00:27:37.453 00:27:37.453 ' 00:27:37.453 04:29:27 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:27:37.453 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:37.453 --rc genhtml_branch_coverage=1 00:27:37.453 --rc genhtml_function_coverage=1 00:27:37.453 --rc genhtml_legend=1 00:27:37.453 --rc geninfo_all_blocks=1 00:27:37.453 --rc geninfo_unexecuted_blocks=1 00:27:37.453 00:27:37.453 ' 00:27:37.453 04:29:27 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:27:37.453 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:37.453 --rc genhtml_branch_coverage=1 00:27:37.453 --rc genhtml_function_coverage=1 00:27:37.453 --rc genhtml_legend=1 00:27:37.453 --rc geninfo_all_blocks=1 00:27:37.453 --rc geninfo_unexecuted_blocks=1 00:27:37.453 00:27:37.453 ' 00:27:37.453 04:29:27 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:27:37.453 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:27:37.453 --rc genhtml_branch_coverage=1 00:27:37.453 --rc genhtml_function_coverage=1 00:27:37.453 --rc genhtml_legend=1 00:27:37.453 --rc geninfo_all_blocks=1 00:27:37.453 --rc geninfo_unexecuted_blocks=1 00:27:37.453 00:27:37.453 ' 00:27:37.453 04:29:27 -- host/fio.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:37.453 04:29:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:37.453 04:29:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:37.453 04:29:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:37.453 04:29:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.453 04:29:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.453 04:29:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.453 04:29:27 -- paths/export.sh@5 -- # export PATH 00:27:37.453 04:29:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.453 04:29:27 -- host/fio.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:27:37.453 04:29:27 -- nvmf/common.sh@7 -- # uname -s 00:27:37.453 04:29:27 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:27:37.453 04:29:27 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:27:37.453 04:29:27 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:27:37.453 04:29:27 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:27:37.453 04:29:27 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:27:37.453 04:29:27 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:27:37.453 04:29:27 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:27:37.453 04:29:27 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:27:37.453 04:29:27 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:27:37.453 04:29:27 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:27:37.453 04:29:27 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:27:37.453 04:29:27 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:27:37.453 04:29:27 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:27:37.453 04:29:27 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:27:37.453 04:29:27 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:27:37.453 04:29:27 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:27:37.453 04:29:27 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:27:37.453 04:29:27 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:27:37.453 04:29:27 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:27:37.454 04:29:27 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.454 04:29:27 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.454 04:29:27 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.454 04:29:27 -- paths/export.sh@5 -- # export PATH 00:27:37.454 04:29:27 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:27:37.454 04:29:27 -- nvmf/common.sh@46 -- # : 0 00:27:37.454 04:29:27 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:27:37.454 04:29:27 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:27:37.454 04:29:27 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:27:37.454 04:29:27 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:27:37.454 04:29:27 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:27:37.454 04:29:27 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:27:37.454 04:29:27 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:27:37.454 04:29:27 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:27:37.454 04:29:27 -- host/fio.sh@12 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:27:37.454 04:29:27 -- host/fio.sh@14 -- # nvmftestinit 00:27:37.454 04:29:27 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:27:37.454 04:29:27 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:27:37.454 04:29:27 -- nvmf/common.sh@436 -- # prepare_net_devs 00:27:37.454 04:29:27 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:27:37.454 04:29:27 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:27:37.454 04:29:27 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:27:37.454 04:29:27 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:27:37.454 04:29:27 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:27:37.454 04:29:27 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:27:37.454 04:29:27 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:27:37.454 04:29:27 -- nvmf/common.sh@284 -- # xtrace_disable 00:27:37.454 04:29:27 -- common/autotest_common.sh@10 -- # set +x 00:27:39.384 04:29:29 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:27:39.384 04:29:29 -- nvmf/common.sh@290 -- # pci_devs=() 00:27:39.384 04:29:29 -- nvmf/common.sh@290 -- # local -a pci_devs 00:27:39.384 04:29:29 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:27:39.384 04:29:29 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:27:39.384 04:29:29 -- nvmf/common.sh@292 -- # pci_drivers=() 00:27:39.384 04:29:29 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:27:39.384 04:29:29 -- nvmf/common.sh@294 -- # net_devs=() 00:27:39.384 04:29:29 -- nvmf/common.sh@294 -- # local -ga net_devs 00:27:39.384 04:29:29 -- nvmf/common.sh@295 -- # e810=() 00:27:39.384 04:29:29 -- nvmf/common.sh@295 -- # local -ga e810 00:27:39.384 04:29:29 -- nvmf/common.sh@296 -- # x722=() 00:27:39.384 04:29:29 -- nvmf/common.sh@296 -- # local -ga x722 00:27:39.384 04:29:29 -- nvmf/common.sh@297 -- # mlx=() 00:27:39.384 04:29:29 -- nvmf/common.sh@297 -- # local -ga mlx 00:27:39.384 04:29:29 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:27:39.384 04:29:29 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:27:39.384 04:29:29 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:27:39.384 04:29:29 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:27:39.384 04:29:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:39.384 04:29:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:27:39.384 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:27:39.384 04:29:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:27:39.384 04:29:29 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:27:39.384 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:27:39.384 04:29:29 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:27:39.384 04:29:29 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:39.384 04:29:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:39.384 04:29:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:39.384 04:29:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:39.384 04:29:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:27:39.384 Found net devices under 0000:0a:00.0: cvl_0_0 00:27:39.384 04:29:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:39.384 04:29:29 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:27:39.384 04:29:29 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:27:39.384 04:29:29 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:27:39.384 04:29:29 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:27:39.384 04:29:29 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:27:39.384 Found net devices under 0000:0a:00.1: cvl_0_1 00:27:39.384 04:29:29 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:27:39.384 04:29:29 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:27:39.384 04:29:29 -- nvmf/common.sh@402 -- # is_hw=yes 00:27:39.384 04:29:29 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:27:39.384 04:29:29 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:27:39.384 04:29:29 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:27:39.384 04:29:29 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:27:39.384 04:29:29 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:27:39.384 04:29:29 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:27:39.384 04:29:29 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:27:39.384 04:29:29 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:27:39.384 04:29:29 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:27:39.384 04:29:29 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:27:39.384 04:29:29 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:27:39.384 04:29:29 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:27:39.384 04:29:29 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:27:39.384 04:29:29 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:27:39.384 04:29:29 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:27:39.384 04:29:29 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:27:39.384 04:29:29 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:27:39.384 04:29:29 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:27:39.384 04:29:29 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:27:39.384 04:29:30 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:27:39.384 04:29:30 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:27:39.384 04:29:30 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:27:39.384 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:27:39.384 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.182 ms 00:27:39.384 00:27:39.384 --- 10.0.0.2 ping statistics --- 00:27:39.384 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:39.384 rtt min/avg/max/mdev = 0.182/0.182/0.182/0.000 ms 00:27:39.643 04:29:30 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:27:39.643 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:27:39.643 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.107 ms 00:27:39.643 00:27:39.643 --- 10.0.0.1 ping statistics --- 00:27:39.643 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:27:39.643 rtt min/avg/max/mdev = 0.107/0.107/0.107/0.000 ms 00:27:39.643 04:29:30 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:27:39.643 04:29:30 -- nvmf/common.sh@410 -- # return 0 00:27:39.643 04:29:30 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:27:39.643 04:29:30 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:27:39.643 04:29:30 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:27:39.643 04:29:30 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:27:39.643 04:29:30 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:27:39.643 04:29:30 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:27:39.643 04:29:30 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:27:39.643 04:29:30 -- host/fio.sh@16 -- # [[ y != y ]] 00:27:39.643 04:29:30 -- host/fio.sh@21 -- # timing_enter start_nvmf_tgt 00:27:39.643 04:29:30 -- common/autotest_common.sh@722 -- # xtrace_disable 00:27:39.643 04:29:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.643 04:29:30 -- host/fio.sh@24 -- # nvmfpid=2463303 00:27:39.643 04:29:30 -- host/fio.sh@23 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF 00:27:39.643 04:29:30 -- host/fio.sh@26 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:27:39.643 04:29:30 -- host/fio.sh@28 -- # waitforlisten 2463303 00:27:39.643 04:29:30 -- common/autotest_common.sh@829 -- # '[' -z 2463303 ']' 00:27:39.643 04:29:30 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:27:39.643 04:29:30 -- common/autotest_common.sh@834 -- # local max_retries=100 00:27:39.643 04:29:30 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:27:39.643 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:27:39.643 04:29:30 -- common/autotest_common.sh@838 -- # xtrace_disable 00:27:39.643 04:29:30 -- common/autotest_common.sh@10 -- # set +x 00:27:39.643 [2024-11-30 04:29:30.095188] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:27:39.643 [2024-11-30 04:29:30.095289] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:27:39.643 EAL: No free 2048 kB hugepages reported on node 1 00:27:39.643 [2024-11-30 04:29:30.162422] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:27:39.643 [2024-11-30 04:29:30.258981] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:27:39.643 [2024-11-30 04:29:30.259141] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:27:39.643 [2024-11-30 04:29:30.259160] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:27:39.643 [2024-11-30 04:29:30.259173] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:27:39.643 [2024-11-30 04:29:30.259241] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:27:39.643 [2024-11-30 04:29:30.259314] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:27:39.643 [2024-11-30 04:29:30.259353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:27:39.643 [2024-11-30 04:29:30.259355] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:27:40.577 04:29:31 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:27:40.577 04:29:31 -- common/autotest_common.sh@862 -- # return 0 00:27:40.577 04:29:31 -- host/fio.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:27:40.835 [2024-11-30 04:29:31.374590] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:27:40.835 04:29:31 -- host/fio.sh@30 -- # timing_exit start_nvmf_tgt 00:27:40.835 04:29:31 -- common/autotest_common.sh@728 -- # xtrace_disable 00:27:40.835 04:29:31 -- common/autotest_common.sh@10 -- # set +x 00:27:40.835 04:29:31 -- host/fio.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc1 00:27:41.093 Malloc1 00:27:41.093 04:29:31 -- host/fio.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:27:41.350 04:29:31 -- host/fio.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc1 00:27:41.608 04:29:32 -- host/fio.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:27:41.866 [2024-11-30 04:29:32.420911] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:27:41.866 04:29:32 -- host/fio.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:27:42.125 04:29:32 -- host/fio.sh@38 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:27:42.125 04:29:32 -- host/fio.sh@41 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:42.125 04:29:32 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:42.125 04:29:32 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:42.125 04:29:32 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:42.125 04:29:32 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:42.125 04:29:32 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:42.125 04:29:32 -- common/autotest_common.sh@1330 -- # shift 00:27:42.125 04:29:32 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:42.125 04:29:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:42.125 04:29:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:42.125 04:29:32 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:42.125 04:29:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:42.125 04:29:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:42.125 04:29:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:42.125 04:29:32 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:42.125 04:29:32 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:42.125 04:29:32 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:42.125 04:29:32 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:42.125 04:29:32 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:42.125 04:29:32 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:42.125 04:29:32 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:42.125 04:29:32 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:42.383 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:42.383 fio-3.35 00:27:42.383 Starting 1 thread 00:27:42.383 EAL: No free 2048 kB hugepages reported on node 1 00:27:44.906 [2024-11-30 04:29:35.263093] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1787fe0 is same with the state(5) to be set 00:27:44.906 [2024-11-30 04:29:35.263184] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1787fe0 is same with the state(5) to be set 00:27:44.906 [2024-11-30 04:29:35.263212] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1787fe0 is same with the state(5) to be set 00:27:44.906 00:27:44.906 test: (groupid=0, jobs=1): err= 0: pid=2463804: Sat Nov 30 04:29:35 2024 00:27:44.906 read: IOPS=9488, BW=37.1MiB/s (38.9MB/s)(74.4MiB/2007msec) 00:27:44.906 slat (nsec): min=1817, max=112245, avg=2331.51, stdev=1435.11 00:27:44.906 clat (usec): min=2267, max=12917, avg=7460.12, stdev=570.39 00:27:44.906 lat (usec): min=2286, max=12920, avg=7462.45, stdev=570.33 00:27:44.906 clat percentiles (usec): 00:27:44.906 | 1.00th=[ 6194], 5.00th=[ 6587], 10.00th=[ 6783], 20.00th=[ 7046], 00:27:44.906 | 30.00th=[ 7177], 40.00th=[ 7308], 50.00th=[ 7439], 60.00th=[ 7570], 00:27:44.906 | 70.00th=[ 7767], 80.00th=[ 7898], 90.00th=[ 8094], 95.00th=[ 8356], 00:27:44.906 | 99.00th=[ 8717], 99.50th=[ 8979], 99.90th=[10945], 99.95th=[11600], 00:27:44.906 | 99.99th=[12911] 00:27:44.906 bw ( KiB/s): min=37080, max=38616, per=100.00%, avg=37962.00, stdev=643.14, samples=4 00:27:44.906 iops : min= 9270, max= 9654, avg=9490.50, stdev=160.78, samples=4 00:27:44.906 write: IOPS=9497, BW=37.1MiB/s (38.9MB/s)(74.5MiB/2007msec); 0 zone resets 00:27:44.906 slat (nsec): min=1914, max=87097, avg=2400.21, stdev=1118.30 00:27:44.906 clat (usec): min=934, max=12232, avg=5991.34, stdev=508.15 00:27:44.906 lat (usec): min=941, max=12234, avg=5993.74, stdev=508.11 00:27:44.906 clat percentiles (usec): 00:27:44.906 | 1.00th=[ 4883], 5.00th=[ 5276], 10.00th=[ 5407], 20.00th=[ 5604], 00:27:44.906 | 30.00th=[ 5735], 40.00th=[ 5866], 50.00th=[ 5997], 60.00th=[ 6128], 00:27:44.906 | 70.00th=[ 6194], 80.00th=[ 6390], 90.00th=[ 6521], 95.00th=[ 6718], 00:27:44.906 | 99.00th=[ 7046], 99.50th=[ 7177], 99.90th=[10159], 99.95th=[11469], 00:27:44.906 | 99.99th=[12256] 00:27:44.906 bw ( KiB/s): min=37744, max=38224, per=100.00%, avg=37994.00, stdev=198.49, samples=4 00:27:44.906 iops : min= 9436, max= 9556, avg=9498.50, stdev=49.62, samples=4 00:27:44.906 lat (usec) : 1000=0.01% 00:27:44.906 lat (msec) : 2=0.02%, 4=0.11%, 10=99.74%, 20=0.13% 00:27:44.906 cpu : usr=61.12%, sys=36.59%, ctx=75, majf=0, minf=41 00:27:44.906 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.8% 00:27:44.906 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:44.906 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:44.906 issued rwts: total=19043,19062,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:44.906 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:44.906 00:27:44.906 Run status group 0 (all jobs): 00:27:44.906 READ: bw=37.1MiB/s (38.9MB/s), 37.1MiB/s-37.1MiB/s (38.9MB/s-38.9MB/s), io=74.4MiB (78.0MB), run=2007-2007msec 00:27:44.906 WRITE: bw=37.1MiB/s (38.9MB/s), 37.1MiB/s-37.1MiB/s (38.9MB/s-38.9MB/s), io=74.5MiB (78.1MB), run=2007-2007msec 00:27:44.906 04:29:35 -- host/fio.sh@45 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:44.906 04:29:35 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:44.906 04:29:35 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:44.906 04:29:35 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:44.906 04:29:35 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:44.906 04:29:35 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:44.906 04:29:35 -- common/autotest_common.sh@1330 -- # shift 00:27:44.906 04:29:35 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:44.906 04:29:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:44.906 04:29:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:44.906 04:29:35 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:44.906 04:29:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:44.906 04:29:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:44.906 04:29:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:44.906 04:29:35 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:44.906 04:29:35 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:44.906 04:29:35 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:44.906 04:29:35 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:44.906 04:29:35 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:44.906 04:29:35 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:44.906 04:29:35 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:44.906 04:29:35 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/mock_sgl_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' 00:27:44.906 test: (g=0): rw=randrw, bs=(R) 16.0KiB-16.0KiB, (W) 16.0KiB-16.0KiB, (T) 16.0KiB-16.0KiB, ioengine=spdk, iodepth=128 00:27:44.906 fio-3.35 00:27:44.906 Starting 1 thread 00:27:45.163 EAL: No free 2048 kB hugepages reported on node 1 00:27:47.688 00:27:47.688 test: (groupid=0, jobs=1): err= 0: pid=2464147: Sat Nov 30 04:29:37 2024 00:27:47.688 read: IOPS=9046, BW=141MiB/s (148MB/s)(283MiB/2002msec) 00:27:47.688 slat (usec): min=2, max=120, avg= 3.59, stdev= 1.81 00:27:47.688 clat (usec): min=1996, max=16766, avg=8261.71, stdev=2001.61 00:27:47.688 lat (usec): min=2000, max=16769, avg=8265.30, stdev=2001.73 00:27:47.688 clat percentiles (usec): 00:27:47.688 | 1.00th=[ 4293], 5.00th=[ 5145], 10.00th=[ 5800], 20.00th=[ 6521], 00:27:47.688 | 30.00th=[ 7111], 40.00th=[ 7701], 50.00th=[ 8225], 60.00th=[ 8717], 00:27:47.688 | 70.00th=[ 9241], 80.00th=[ 9765], 90.00th=[10814], 95.00th=[11731], 00:27:47.688 | 99.00th=[13566], 99.50th=[14484], 99.90th=[16581], 99.95th=[16581], 00:27:47.688 | 99.99th=[16712] 00:27:47.688 bw ( KiB/s): min=65792, max=80448, per=49.04%, avg=70992.00, stdev=6474.58, samples=4 00:27:47.688 iops : min= 4112, max= 5028, avg=4437.00, stdev=404.66, samples=4 00:27:47.688 write: IOPS=5216, BW=81.5MiB/s (85.5MB/s)(144MiB/1771msec); 0 zone resets 00:27:47.688 slat (usec): min=30, max=197, avg=33.45, stdev= 5.74 00:27:47.688 clat (usec): min=3968, max=18521, avg=10624.84, stdev=1852.78 00:27:47.688 lat (usec): min=3998, max=18552, avg=10658.29, stdev=1853.45 00:27:47.688 clat percentiles (usec): 00:27:47.688 | 1.00th=[ 7177], 5.00th=[ 8094], 10.00th=[ 8455], 20.00th=[ 9110], 00:27:47.688 | 30.00th=[ 9503], 40.00th=[ 9896], 50.00th=[10421], 60.00th=[10814], 00:27:47.688 | 70.00th=[11469], 80.00th=[12125], 90.00th=[13304], 95.00th=[14091], 00:27:47.688 | 99.00th=[15533], 99.50th=[16319], 99.90th=[17695], 99.95th=[18220], 00:27:47.688 | 99.99th=[18482] 00:27:47.688 bw ( KiB/s): min=68736, max=82944, per=88.55%, avg=73904.00, stdev=6238.19, samples=4 00:27:47.688 iops : min= 4296, max= 5184, avg=4619.00, stdev=389.89, samples=4 00:27:47.688 lat (msec) : 2=0.01%, 4=0.44%, 10=68.65%, 20=30.91% 00:27:47.688 cpu : usr=77.97%, sys=20.43%, ctx=37, majf=0, minf=64 00:27:47.688 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.2%, 16=0.4%, 32=0.7%, >=64=98.6% 00:27:47.688 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:47.688 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:47.688 issued rwts: total=18112,9238,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:47.688 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:47.688 00:27:47.688 Run status group 0 (all jobs): 00:27:47.688 READ: bw=141MiB/s (148MB/s), 141MiB/s-141MiB/s (148MB/s-148MB/s), io=283MiB (297MB), run=2002-2002msec 00:27:47.688 WRITE: bw=81.5MiB/s (85.5MB/s), 81.5MiB/s-81.5MiB/s (85.5MB/s-85.5MB/s), io=144MiB (151MB), run=1771-1771msec 00:27:47.688 04:29:37 -- host/fio.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:27:47.688 04:29:38 -- host/fio.sh@49 -- # '[' 1 -eq 1 ']' 00:27:47.688 04:29:38 -- host/fio.sh@51 -- # bdfs=($(get_nvme_bdfs)) 00:27:47.688 04:29:38 -- host/fio.sh@51 -- # get_nvme_bdfs 00:27:47.688 04:29:38 -- common/autotest_common.sh@1508 -- # bdfs=() 00:27:47.688 04:29:38 -- common/autotest_common.sh@1508 -- # local bdfs 00:27:47.688 04:29:38 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:27:47.688 04:29:38 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:27:47.688 04:29:38 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:27:47.688 04:29:38 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:27:47.688 04:29:38 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:27:47.688 04:29:38 -- host/fio.sh@52 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 -i 10.0.0.2 00:27:50.967 Nvme0n1 00:27:50.967 04:29:41 -- host/fio.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore -c 1073741824 Nvme0n1 lvs_0 00:27:54.247 04:29:44 -- host/fio.sh@53 -- # ls_guid=0271eb7f-cbd6-40fd-bd2c-5a87594f6b55 00:27:54.247 04:29:44 -- host/fio.sh@54 -- # get_lvs_free_mb 0271eb7f-cbd6-40fd-bd2c-5a87594f6b55 00:27:54.247 04:29:44 -- common/autotest_common.sh@1353 -- # local lvs_uuid=0271eb7f-cbd6-40fd-bd2c-5a87594f6b55 00:27:54.247 04:29:44 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:54.247 04:29:44 -- common/autotest_common.sh@1355 -- # local fc 00:27:54.247 04:29:44 -- common/autotest_common.sh@1356 -- # local cs 00:27:54.247 04:29:44 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:54.247 04:29:44 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:54.247 { 00:27:54.247 "uuid": "0271eb7f-cbd6-40fd-bd2c-5a87594f6b55", 00:27:54.247 "name": "lvs_0", 00:27:54.247 "base_bdev": "Nvme0n1", 00:27:54.247 "total_data_clusters": 930, 00:27:54.247 "free_clusters": 930, 00:27:54.247 "block_size": 512, 00:27:54.247 "cluster_size": 1073741824 00:27:54.247 } 00:27:54.247 ]' 00:27:54.247 04:29:44 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="0271eb7f-cbd6-40fd-bd2c-5a87594f6b55") .free_clusters' 00:27:54.247 04:29:44 -- common/autotest_common.sh@1358 -- # fc=930 00:27:54.247 04:29:44 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="0271eb7f-cbd6-40fd-bd2c-5a87594f6b55") .cluster_size' 00:27:54.247 04:29:44 -- common/autotest_common.sh@1359 -- # cs=1073741824 00:27:54.247 04:29:44 -- common/autotest_common.sh@1362 -- # free_mb=952320 00:27:54.247 04:29:44 -- common/autotest_common.sh@1363 -- # echo 952320 00:27:54.247 952320 00:27:54.247 04:29:44 -- host/fio.sh@55 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_0 lbd_0 952320 00:27:54.247 2aa9e3b2-1b74-4a4e-8d94-0731d73adbbd 00:27:54.504 04:29:44 -- host/fio.sh@56 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 -a -s SPDK00000000000001 00:27:54.504 04:29:45 -- host/fio.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 lvs_0/lbd_0 00:27:55.066 04:29:45 -- host/fio.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:27:55.066 04:29:45 -- host/fio.sh@59 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:55.066 04:29:45 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:55.066 04:29:45 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:27:55.066 04:29:45 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:27:55.066 04:29:45 -- common/autotest_common.sh@1328 -- # local sanitizers 00:27:55.066 04:29:45 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:55.066 04:29:45 -- common/autotest_common.sh@1330 -- # shift 00:27:55.066 04:29:45 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:27:55.066 04:29:45 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:55.066 04:29:45 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:55.066 04:29:45 -- common/autotest_common.sh@1334 -- # grep libasan 00:27:55.066 04:29:45 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:55.066 04:29:45 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:55.066 04:29:45 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:55.066 04:29:45 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:27:55.066 04:29:45 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:27:55.066 04:29:45 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:27:55.066 04:29:45 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:27:55.066 04:29:45 -- common/autotest_common.sh@1334 -- # asan_lib= 00:27:55.066 04:29:45 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:27:55.066 04:29:45 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:27:55.066 04:29:45 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:27:55.324 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:27:55.324 fio-3.35 00:27:55.324 Starting 1 thread 00:27:55.324 EAL: No free 2048 kB hugepages reported on node 1 00:27:57.852 00:27:57.852 test: (groupid=0, jobs=1): err= 0: pid=2465462: Sat Nov 30 04:29:48 2024 00:27:57.852 read: IOPS=6095, BW=23.8MiB/s (25.0MB/s)(47.8MiB/2008msec) 00:27:57.852 slat (nsec): min=1824, max=136201, avg=2451.73, stdev=1970.64 00:27:57.852 clat (usec): min=919, max=170730, avg=11515.09, stdev=11550.02 00:27:57.852 lat (usec): min=921, max=170765, avg=11517.54, stdev=11550.26 00:27:57.852 clat percentiles (msec): 00:27:57.852 | 1.00th=[ 9], 5.00th=[ 10], 10.00th=[ 10], 20.00th=[ 10], 00:27:57.852 | 30.00th=[ 11], 40.00th=[ 11], 50.00th=[ 11], 60.00th=[ 11], 00:27:57.852 | 70.00th=[ 12], 80.00th=[ 12], 90.00th=[ 12], 95.00th=[ 13], 00:27:57.852 | 99.00th=[ 13], 99.50th=[ 157], 99.90th=[ 171], 99.95th=[ 171], 00:27:57.852 | 99.99th=[ 171] 00:27:57.852 bw ( KiB/s): min=16832, max=27136, per=99.82%, avg=24338.00, stdev=5008.40, samples=4 00:27:57.852 iops : min= 4208, max= 6784, avg=6084.50, stdev=1252.10, samples=4 00:27:57.852 write: IOPS=6074, BW=23.7MiB/s (24.9MB/s)(47.6MiB/2008msec); 0 zone resets 00:27:57.852 slat (nsec): min=1882, max=94710, avg=2522.32, stdev=1480.15 00:27:57.852 clat (usec): min=301, max=168972, avg=9343.55, stdev=10841.99 00:27:57.852 lat (usec): min=303, max=168977, avg=9346.07, stdev=10842.20 00:27:57.852 clat percentiles (msec): 00:27:57.852 | 1.00th=[ 7], 5.00th=[ 8], 10.00th=[ 8], 20.00th=[ 9], 00:27:57.852 | 30.00th=[ 9], 40.00th=[ 9], 50.00th=[ 9], 60.00th=[ 9], 00:27:57.852 | 70.00th=[ 9], 80.00th=[ 10], 90.00th=[ 10], 95.00th=[ 10], 00:27:57.852 | 99.00th=[ 11], 99.50th=[ 16], 99.90th=[ 169], 99.95th=[ 169], 00:27:57.852 | 99.99th=[ 169] 00:27:57.852 bw ( KiB/s): min=17832, max=26496, per=99.94%, avg=24282.00, stdev=4300.32, samples=4 00:27:57.852 iops : min= 4458, max= 6624, avg=6070.50, stdev=1075.08, samples=4 00:27:57.852 lat (usec) : 500=0.01%, 750=0.01%, 1000=0.01% 00:27:57.852 lat (msec) : 2=0.03%, 4=0.09%, 10=59.12%, 20=40.21%, 250=0.52% 00:27:57.852 cpu : usr=59.39%, sys=38.71%, ctx=57, majf=0, minf=41 00:27:57.852 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:27:57.852 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:27:57.852 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:27:57.852 issued rwts: total=12240,12197,0,0 short=0,0,0,0 dropped=0,0,0,0 00:27:57.852 latency : target=0, window=0, percentile=100.00%, depth=128 00:27:57.852 00:27:57.852 Run status group 0 (all jobs): 00:27:57.852 READ: bw=23.8MiB/s (25.0MB/s), 23.8MiB/s-23.8MiB/s (25.0MB/s-25.0MB/s), io=47.8MiB (50.1MB), run=2008-2008msec 00:27:57.852 WRITE: bw=23.7MiB/s (24.9MB/s), 23.7MiB/s-23.7MiB/s (24.9MB/s-24.9MB/s), io=47.6MiB (50.0MB), run=2008-2008msec 00:27:57.852 04:29:48 -- host/fio.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:27:57.852 04:29:48 -- host/fio.sh@64 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create_lvstore --clear-method none lvs_0/lbd_0 lvs_n_0 00:27:59.225 04:29:49 -- host/fio.sh@64 -- # ls_nested_guid=c7c6dbcb-9ffb-486a-80b9-0a70d018e079 00:27:59.225 04:29:49 -- host/fio.sh@65 -- # get_lvs_free_mb c7c6dbcb-9ffb-486a-80b9-0a70d018e079 00:27:59.225 04:29:49 -- common/autotest_common.sh@1353 -- # local lvs_uuid=c7c6dbcb-9ffb-486a-80b9-0a70d018e079 00:27:59.225 04:29:49 -- common/autotest_common.sh@1354 -- # local lvs_info 00:27:59.225 04:29:49 -- common/autotest_common.sh@1355 -- # local fc 00:27:59.225 04:29:49 -- common/autotest_common.sh@1356 -- # local cs 00:27:59.225 04:29:49 -- common/autotest_common.sh@1357 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_get_lvstores 00:27:59.225 04:29:49 -- common/autotest_common.sh@1357 -- # lvs_info='[ 00:27:59.225 { 00:27:59.225 "uuid": "0271eb7f-cbd6-40fd-bd2c-5a87594f6b55", 00:27:59.225 "name": "lvs_0", 00:27:59.225 "base_bdev": "Nvme0n1", 00:27:59.225 "total_data_clusters": 930, 00:27:59.225 "free_clusters": 0, 00:27:59.225 "block_size": 512, 00:27:59.225 "cluster_size": 1073741824 00:27:59.225 }, 00:27:59.225 { 00:27:59.225 "uuid": "c7c6dbcb-9ffb-486a-80b9-0a70d018e079", 00:27:59.225 "name": "lvs_n_0", 00:27:59.225 "base_bdev": "2aa9e3b2-1b74-4a4e-8d94-0731d73adbbd", 00:27:59.225 "total_data_clusters": 237847, 00:27:59.225 "free_clusters": 237847, 00:27:59.225 "block_size": 512, 00:27:59.225 "cluster_size": 4194304 00:27:59.225 } 00:27:59.225 ]' 00:27:59.225 04:29:49 -- common/autotest_common.sh@1358 -- # jq '.[] | select(.uuid=="c7c6dbcb-9ffb-486a-80b9-0a70d018e079") .free_clusters' 00:27:59.483 04:29:49 -- common/autotest_common.sh@1358 -- # fc=237847 00:27:59.483 04:29:49 -- common/autotest_common.sh@1359 -- # jq '.[] | select(.uuid=="c7c6dbcb-9ffb-486a-80b9-0a70d018e079") .cluster_size' 00:27:59.483 04:29:49 -- common/autotest_common.sh@1359 -- # cs=4194304 00:27:59.483 04:29:49 -- common/autotest_common.sh@1362 -- # free_mb=951388 00:27:59.483 04:29:49 -- common/autotest_common.sh@1363 -- # echo 951388 00:27:59.483 951388 00:27:59.483 04:29:49 -- host/fio.sh@66 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_create -l lvs_n_0 lbd_nest_0 951388 00:28:00.049 1e7a5d98-28d8-461d-b3f0-a3346c4288d3 00:28:00.049 04:29:50 -- host/fio.sh@67 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode3 -a -s SPDK00000000000001 00:28:00.307 04:29:50 -- host/fio.sh@68 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode3 lvs_n_0/lbd_nest_0 00:28:00.564 04:29:51 -- host/fio.sh@69 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode3 -t tcp -a 10.0.0.2 -s 4420 00:28:00.823 04:29:51 -- host/fio.sh@70 -- # fio_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:00.823 04:29:51 -- common/autotest_common.sh@1349 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:00.823 04:29:51 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:28:00.823 04:29:51 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:28:00.823 04:29:51 -- common/autotest_common.sh@1328 -- # local sanitizers 00:28:00.823 04:29:51 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:00.823 04:29:51 -- common/autotest_common.sh@1330 -- # shift 00:28:00.823 04:29:51 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:28:00.823 04:29:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:00.823 04:29:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:00.823 04:29:51 -- common/autotest_common.sh@1334 -- # grep libasan 00:28:00.823 04:29:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:00.823 04:29:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:00.823 04:29:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:00.823 04:29:51 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:28:00.823 04:29:51 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme 00:28:00.823 04:29:51 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:28:00.823 04:29:51 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:28:00.823 04:29:51 -- common/autotest_common.sh@1334 -- # asan_lib= 00:28:00.823 04:29:51 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:28:00.823 04:29:51 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_nvme' 00:28:00.823 04:29:51 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme/example_config.fio '--filename=trtype=tcp adrfam=IPv4 traddr=10.0.0.2 trsvcid=4420 ns=1' --bs=4096 00:28:01.081 test: (g=0): rw=randrw, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk, iodepth=128 00:28:01.081 fio-3.35 00:28:01.081 Starting 1 thread 00:28:01.081 EAL: No free 2048 kB hugepages reported on node 1 00:28:03.609 00:28:03.609 test: (groupid=0, jobs=1): err= 0: pid=2466221: Sat Nov 30 04:29:54 2024 00:28:03.609 read: IOPS=6090, BW=23.8MiB/s (24.9MB/s)(47.7MiB/2007msec) 00:28:03.609 slat (nsec): min=1943, max=165691, avg=2682.57, stdev=2382.80 00:28:03.609 clat (usec): min=3955, max=18334, avg=11569.01, stdev=996.82 00:28:03.609 lat (usec): min=3989, max=18336, avg=11571.69, stdev=996.70 00:28:03.609 clat percentiles (usec): 00:28:03.609 | 1.00th=[ 9110], 5.00th=[10028], 10.00th=[10421], 20.00th=[10814], 00:28:03.609 | 30.00th=[11076], 40.00th=[11338], 50.00th=[11600], 60.00th=[11863], 00:28:03.609 | 70.00th=[12125], 80.00th=[12387], 90.00th=[12780], 95.00th=[13042], 00:28:03.609 | 99.00th=[13698], 99.50th=[13960], 99.90th=[17171], 99.95th=[17433], 00:28:03.609 | 99.99th=[18220] 00:28:03.609 bw ( KiB/s): min=22928, max=24856, per=99.74%, avg=24298.00, stdev=916.72, samples=4 00:28:03.609 iops : min= 5732, max= 6214, avg=6074.50, stdev=229.18, samples=4 00:28:03.609 write: IOPS=6069, BW=23.7MiB/s (24.9MB/s)(47.6MiB/2007msec); 0 zone resets 00:28:03.609 slat (usec): min=2, max=122, avg= 2.75, stdev= 1.82 00:28:03.609 clat (usec): min=2753, max=15817, avg=9299.92, stdev=843.92 00:28:03.609 lat (usec): min=2762, max=15819, avg=9302.68, stdev=843.92 00:28:03.609 clat percentiles (usec): 00:28:03.609 | 1.00th=[ 7373], 5.00th=[ 8029], 10.00th=[ 8291], 20.00th=[ 8717], 00:28:03.609 | 30.00th=[ 8848], 40.00th=[ 9110], 50.00th=[ 9241], 60.00th=[ 9503], 00:28:03.609 | 70.00th=[ 9765], 80.00th=[ 9896], 90.00th=[10290], 95.00th=[10552], 00:28:03.609 | 99.00th=[11076], 99.50th=[11338], 99.90th=[14484], 99.95th=[14746], 00:28:03.609 | 99.99th=[15795] 00:28:03.609 bw ( KiB/s): min=23872, max=24384, per=99.91%, avg=24256.00, stdev=256.00, samples=4 00:28:03.609 iops : min= 5968, max= 6096, avg=6064.00, stdev=64.00, samples=4 00:28:03.609 lat (msec) : 4=0.05%, 10=43.28%, 20=56.67% 00:28:03.609 cpu : usr=56.95%, sys=41.06%, ctx=96, majf=0, minf=41 00:28:03.609 IO depths : 1=0.1%, 2=0.1%, 4=0.1%, 8=0.1%, 16=0.1%, 32=0.1%, >=64=99.7% 00:28:03.609 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:28:03.609 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.1% 00:28:03.610 issued rwts: total=12223,12181,0,0 short=0,0,0,0 dropped=0,0,0,0 00:28:03.610 latency : target=0, window=0, percentile=100.00%, depth=128 00:28:03.610 00:28:03.610 Run status group 0 (all jobs): 00:28:03.610 READ: bw=23.8MiB/s (24.9MB/s), 23.8MiB/s-23.8MiB/s (24.9MB/s-24.9MB/s), io=47.7MiB (50.1MB), run=2007-2007msec 00:28:03.610 WRITE: bw=23.7MiB/s (24.9MB/s), 23.7MiB/s-23.7MiB/s (24.9MB/s-24.9MB/s), io=47.6MiB (49.9MB), run=2007-2007msec 00:28:03.610 04:29:54 -- host/fio.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode3 00:28:03.867 04:29:54 -- host/fio.sh@74 -- # sync 00:28:03.867 04:29:54 -- host/fio.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -t 120 bdev_lvol_delete lvs_n_0/lbd_nest_0 00:28:08.047 04:29:58 -- host/fio.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_n_0 00:28:08.047 04:29:58 -- host/fio.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete lvs_0/lbd_0 00:28:11.328 04:30:01 -- host/fio.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_lvol_delete_lvstore -l lvs_0 00:28:11.328 04:30:01 -- host/fio.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_nvme_detach_controller Nvme0 00:28:13.290 04:30:03 -- host/fio.sh@83 -- # trap - SIGINT SIGTERM EXIT 00:28:13.290 04:30:03 -- host/fio.sh@85 -- # rm -f ./local-test-0-verify.state 00:28:13.290 04:30:03 -- host/fio.sh@86 -- # nvmftestfini 00:28:13.290 04:30:03 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:13.290 04:30:03 -- nvmf/common.sh@116 -- # sync 00:28:13.290 04:30:03 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:13.290 04:30:03 -- nvmf/common.sh@119 -- # set +e 00:28:13.290 04:30:03 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:13.290 04:30:03 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:13.290 rmmod nvme_tcp 00:28:13.290 rmmod nvme_fabrics 00:28:13.290 rmmod nvme_keyring 00:28:13.290 04:30:03 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:13.290 04:30:03 -- nvmf/common.sh@123 -- # set -e 00:28:13.290 04:30:03 -- nvmf/common.sh@124 -- # return 0 00:28:13.290 04:30:03 -- nvmf/common.sh@477 -- # '[' -n 2463303 ']' 00:28:13.290 04:30:03 -- nvmf/common.sh@478 -- # killprocess 2463303 00:28:13.290 04:30:03 -- common/autotest_common.sh@936 -- # '[' -z 2463303 ']' 00:28:13.290 04:30:03 -- common/autotest_common.sh@940 -- # kill -0 2463303 00:28:13.290 04:30:03 -- common/autotest_common.sh@941 -- # uname 00:28:13.290 04:30:03 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:13.290 04:30:03 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2463303 00:28:13.290 04:30:03 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:13.290 04:30:03 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:13.290 04:30:03 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2463303' 00:28:13.290 killing process with pid 2463303 00:28:13.290 04:30:03 -- common/autotest_common.sh@955 -- # kill 2463303 00:28:13.290 04:30:03 -- common/autotest_common.sh@960 -- # wait 2463303 00:28:13.290 04:30:03 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:13.290 04:30:03 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:13.290 04:30:03 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:13.290 04:30:03 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:13.290 04:30:03 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:13.290 04:30:03 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:13.290 04:30:03 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:13.290 04:30:03 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:15.192 04:30:05 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:15.192 00:28:15.192 real 0m38.046s 00:28:15.192 user 2m25.401s 00:28:15.192 sys 0m7.487s 00:28:15.192 04:30:05 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:15.192 04:30:05 -- common/autotest_common.sh@10 -- # set +x 00:28:15.192 ************************************ 00:28:15.192 END TEST nvmf_fio_host 00:28:15.192 ************************************ 00:28:15.450 04:30:05 -- nvmf/nvmf.sh@100 -- # run_test nvmf_failover /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:15.450 04:30:05 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:15.450 04:30:05 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:15.450 04:30:05 -- common/autotest_common.sh@10 -- # set +x 00:28:15.450 ************************************ 00:28:15.450 START TEST nvmf_failover 00:28:15.450 ************************************ 00:28:15.450 04:30:05 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/failover.sh --transport=tcp 00:28:15.450 * Looking for test storage... 00:28:15.450 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:15.450 04:30:05 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:15.450 04:30:05 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:15.450 04:30:05 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:15.450 04:30:05 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:15.450 04:30:05 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:15.450 04:30:05 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:15.450 04:30:05 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:15.450 04:30:05 -- scripts/common.sh@335 -- # IFS=.-: 00:28:15.450 04:30:05 -- scripts/common.sh@335 -- # read -ra ver1 00:28:15.450 04:30:05 -- scripts/common.sh@336 -- # IFS=.-: 00:28:15.450 04:30:05 -- scripts/common.sh@336 -- # read -ra ver2 00:28:15.450 04:30:05 -- scripts/common.sh@337 -- # local 'op=<' 00:28:15.450 04:30:05 -- scripts/common.sh@339 -- # ver1_l=2 00:28:15.450 04:30:05 -- scripts/common.sh@340 -- # ver2_l=1 00:28:15.450 04:30:05 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:15.450 04:30:05 -- scripts/common.sh@343 -- # case "$op" in 00:28:15.450 04:30:05 -- scripts/common.sh@344 -- # : 1 00:28:15.450 04:30:05 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:15.450 04:30:05 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:15.450 04:30:05 -- scripts/common.sh@364 -- # decimal 1 00:28:15.450 04:30:05 -- scripts/common.sh@352 -- # local d=1 00:28:15.450 04:30:05 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:15.450 04:30:05 -- scripts/common.sh@354 -- # echo 1 00:28:15.450 04:30:05 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:15.450 04:30:05 -- scripts/common.sh@365 -- # decimal 2 00:28:15.450 04:30:05 -- scripts/common.sh@352 -- # local d=2 00:28:15.450 04:30:05 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:15.450 04:30:05 -- scripts/common.sh@354 -- # echo 2 00:28:15.450 04:30:05 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:15.450 04:30:05 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:15.450 04:30:05 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:15.450 04:30:05 -- scripts/common.sh@367 -- # return 0 00:28:15.450 04:30:05 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:15.450 04:30:05 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:15.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:15.450 --rc genhtml_branch_coverage=1 00:28:15.450 --rc genhtml_function_coverage=1 00:28:15.450 --rc genhtml_legend=1 00:28:15.450 --rc geninfo_all_blocks=1 00:28:15.450 --rc geninfo_unexecuted_blocks=1 00:28:15.450 00:28:15.450 ' 00:28:15.450 04:30:05 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:15.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:15.450 --rc genhtml_branch_coverage=1 00:28:15.450 --rc genhtml_function_coverage=1 00:28:15.450 --rc genhtml_legend=1 00:28:15.450 --rc geninfo_all_blocks=1 00:28:15.450 --rc geninfo_unexecuted_blocks=1 00:28:15.450 00:28:15.450 ' 00:28:15.450 04:30:05 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:15.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:15.450 --rc genhtml_branch_coverage=1 00:28:15.450 --rc genhtml_function_coverage=1 00:28:15.450 --rc genhtml_legend=1 00:28:15.450 --rc geninfo_all_blocks=1 00:28:15.450 --rc geninfo_unexecuted_blocks=1 00:28:15.450 00:28:15.450 ' 00:28:15.450 04:30:05 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:15.450 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:15.450 --rc genhtml_branch_coverage=1 00:28:15.450 --rc genhtml_function_coverage=1 00:28:15.450 --rc genhtml_legend=1 00:28:15.450 --rc geninfo_all_blocks=1 00:28:15.450 --rc geninfo_unexecuted_blocks=1 00:28:15.450 00:28:15.450 ' 00:28:15.450 04:30:05 -- host/failover.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:15.450 04:30:05 -- nvmf/common.sh@7 -- # uname -s 00:28:15.450 04:30:05 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:15.450 04:30:05 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:15.450 04:30:05 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:15.450 04:30:05 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:15.450 04:30:05 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:15.450 04:30:05 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:15.450 04:30:05 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:15.450 04:30:05 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:15.450 04:30:05 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:15.450 04:30:05 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:15.450 04:30:05 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:15.450 04:30:05 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:15.450 04:30:05 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:15.450 04:30:05 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:15.450 04:30:05 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:15.450 04:30:05 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:15.450 04:30:05 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:15.450 04:30:05 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:15.450 04:30:05 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:15.450 04:30:05 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:15.450 04:30:05 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:15.450 04:30:05 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:15.450 04:30:05 -- paths/export.sh@5 -- # export PATH 00:28:15.451 04:30:05 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:15.451 04:30:05 -- nvmf/common.sh@46 -- # : 0 00:28:15.451 04:30:05 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:15.451 04:30:05 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:15.451 04:30:05 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:15.451 04:30:05 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:15.451 04:30:05 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:15.451 04:30:05 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:15.451 04:30:05 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:15.451 04:30:05 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:15.451 04:30:05 -- host/failover.sh@11 -- # MALLOC_BDEV_SIZE=64 00:28:15.451 04:30:05 -- host/failover.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:28:15.451 04:30:05 -- host/failover.sh@14 -- # rpc_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py 00:28:15.451 04:30:05 -- host/failover.sh@16 -- # bdevperf_rpc_sock=/var/tmp/bdevperf.sock 00:28:15.451 04:30:05 -- host/failover.sh@18 -- # nvmftestinit 00:28:15.451 04:30:05 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:15.451 04:30:05 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:15.451 04:30:05 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:15.451 04:30:05 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:15.451 04:30:05 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:15.451 04:30:05 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:15.451 04:30:05 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:15.451 04:30:05 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:15.451 04:30:05 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:15.451 04:30:05 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:15.451 04:30:05 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:15.451 04:30:05 -- common/autotest_common.sh@10 -- # set +x 00:28:17.354 04:30:07 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:17.354 04:30:07 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:17.354 04:30:07 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:17.354 04:30:07 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:17.354 04:30:07 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:17.354 04:30:07 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:17.354 04:30:07 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:17.354 04:30:07 -- nvmf/common.sh@294 -- # net_devs=() 00:28:17.354 04:30:07 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:17.354 04:30:07 -- nvmf/common.sh@295 -- # e810=() 00:28:17.354 04:30:07 -- nvmf/common.sh@295 -- # local -ga e810 00:28:17.354 04:30:07 -- nvmf/common.sh@296 -- # x722=() 00:28:17.354 04:30:07 -- nvmf/common.sh@296 -- # local -ga x722 00:28:17.354 04:30:07 -- nvmf/common.sh@297 -- # mlx=() 00:28:17.354 04:30:07 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:17.354 04:30:07 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:17.354 04:30:07 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:17.354 04:30:07 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:17.354 04:30:07 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:17.354 04:30:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:17.354 04:30:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:17.354 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:17.354 04:30:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:17.354 04:30:07 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:17.354 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:17.354 04:30:07 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:17.354 04:30:07 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:17.354 04:30:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:17.354 04:30:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:17.354 04:30:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:17.354 04:30:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:17.354 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:17.354 04:30:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:17.354 04:30:07 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:17.354 04:30:07 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:17.354 04:30:07 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:17.354 04:30:07 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:17.354 04:30:07 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:17.354 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:17.354 04:30:07 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:17.354 04:30:07 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:17.354 04:30:07 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:17.354 04:30:07 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:17.354 04:30:07 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:17.354 04:30:07 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:17.354 04:30:07 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:17.354 04:30:07 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:17.354 04:30:07 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:17.354 04:30:07 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:17.354 04:30:07 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:17.354 04:30:07 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:17.354 04:30:07 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:17.354 04:30:07 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:17.354 04:30:07 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:17.354 04:30:07 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:17.614 04:30:07 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:17.614 04:30:07 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:17.614 04:30:08 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:17.614 04:30:08 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:17.614 04:30:08 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:17.614 04:30:08 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:17.614 04:30:08 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:17.614 04:30:08 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:17.614 04:30:08 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:17.614 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:17.614 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.333 ms 00:28:17.614 00:28:17.614 --- 10.0.0.2 ping statistics --- 00:28:17.614 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:17.614 rtt min/avg/max/mdev = 0.333/0.333/0.333/0.000 ms 00:28:17.614 04:30:08 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:17.614 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:17.614 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.175 ms 00:28:17.614 00:28:17.614 --- 10.0.0.1 ping statistics --- 00:28:17.614 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:17.614 rtt min/avg/max/mdev = 0.175/0.175/0.175/0.000 ms 00:28:17.614 04:30:08 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:17.614 04:30:08 -- nvmf/common.sh@410 -- # return 0 00:28:17.614 04:30:08 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:17.614 04:30:08 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:17.614 04:30:08 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:17.614 04:30:08 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:17.614 04:30:08 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:17.614 04:30:08 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:17.614 04:30:08 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:17.614 04:30:08 -- host/failover.sh@20 -- # nvmfappstart -m 0xE 00:28:17.614 04:30:08 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:17.614 04:30:08 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:17.614 04:30:08 -- common/autotest_common.sh@10 -- # set +x 00:28:17.614 04:30:08 -- nvmf/common.sh@469 -- # nvmfpid=2470122 00:28:17.614 04:30:08 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:28:17.614 04:30:08 -- nvmf/common.sh@470 -- # waitforlisten 2470122 00:28:17.614 04:30:08 -- common/autotest_common.sh@829 -- # '[' -z 2470122 ']' 00:28:17.614 04:30:08 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:17.614 04:30:08 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:17.614 04:30:08 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:17.614 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:17.614 04:30:08 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:17.614 04:30:08 -- common/autotest_common.sh@10 -- # set +x 00:28:17.614 [2024-11-30 04:30:08.220803] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:17.614 [2024-11-30 04:30:08.220886] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:17.872 EAL: No free 2048 kB hugepages reported on node 1 00:28:17.872 [2024-11-30 04:30:08.286586] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:28:17.872 [2024-11-30 04:30:08.374445] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:17.872 [2024-11-30 04:30:08.374593] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:17.872 [2024-11-30 04:30:08.374610] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:17.872 [2024-11-30 04:30:08.374622] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:17.872 [2024-11-30 04:30:08.374707] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:28:17.872 [2024-11-30 04:30:08.374770] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:28:17.872 [2024-11-30 04:30:08.374773] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:18.803 04:30:09 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:18.803 04:30:09 -- common/autotest_common.sh@862 -- # return 0 00:28:18.803 04:30:09 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:18.803 04:30:09 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:18.803 04:30:09 -- common/autotest_common.sh@10 -- # set +x 00:28:18.803 04:30:09 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:18.803 04:30:09 -- host/failover.sh@22 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_transport -t tcp -o -u 8192 00:28:19.061 [2024-11-30 04:30:09.465302] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:19.061 04:30:09 -- host/failover.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py bdev_malloc_create 64 512 -b Malloc0 00:28:19.319 Malloc0 00:28:19.319 04:30:09 -- host/failover.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:28:19.577 04:30:10 -- host/failover.sh@25 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:28:19.834 04:30:10 -- host/failover.sh@26 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:20.091 [2024-11-30 04:30:10.505427] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:20.091 04:30:10 -- host/failover.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:20.348 [2024-11-30 04:30:10.762179] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:20.348 04:30:10 -- host/failover.sh@28 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:20.606 [2024-11-30 04:30:11.019056] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:20.606 04:30:11 -- host/failover.sh@31 -- # bdevperf_pid=2470581 00:28:20.606 04:30:11 -- host/failover.sh@30 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 15 -f 00:28:20.606 04:30:11 -- host/failover.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; cat $testdir/try.txt; rm -f $testdir/try.txt; killprocess $bdevperf_pid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:20.606 04:30:11 -- host/failover.sh@34 -- # waitforlisten 2470581 /var/tmp/bdevperf.sock 00:28:20.606 04:30:11 -- common/autotest_common.sh@829 -- # '[' -z 2470581 ']' 00:28:20.606 04:30:11 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:20.606 04:30:11 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:20.606 04:30:11 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:20.606 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:20.606 04:30:11 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:20.606 04:30:11 -- common/autotest_common.sh@10 -- # set +x 00:28:21.539 04:30:12 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:21.539 04:30:12 -- common/autotest_common.sh@862 -- # return 0 00:28:21.539 04:30:12 -- host/failover.sh@35 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:21.797 NVMe0n1 00:28:21.797 04:30:12 -- host/failover.sh@36 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:22.361 00:28:22.361 04:30:12 -- host/failover.sh@39 -- # run_test_pid=2470842 00:28:22.361 04:30:12 -- host/failover.sh@38 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:22.361 04:30:12 -- host/failover.sh@41 -- # sleep 1 00:28:23.292 04:30:13 -- host/failover.sh@43 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:23.550 [2024-11-30 04:30:14.123436] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123505] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123531] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123544] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123581] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123605] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123616] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123628] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123639] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123650] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123661] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123687] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123699] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123710] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123721] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123732] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123743] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.550 [2024-11-30 04:30:14.123755] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123766] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123777] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123788] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123810] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123821] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123832] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123843] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123853] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123865] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123876] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123886] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123901] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123912] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123923] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123935] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123973] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123987] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.123998] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124010] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124021] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124034] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124047] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124059] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124071] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124084] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124096] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124107] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124119] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 [2024-11-30 04:30:14.124130] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5a930 is same with the state(5) to be set 00:28:23.551 04:30:14 -- host/failover.sh@45 -- # sleep 3 00:28:26.824 04:30:17 -- host/failover.sh@47 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:27.082 00:28:27.082 04:30:17 -- host/failover.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:27.341 [2024-11-30 04:30:17.801102] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801162] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801177] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801190] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801201] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801213] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801241] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801254] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801267] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801279] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801292] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801304] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801316] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801328] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801340] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801352] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801365] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801378] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801391] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801403] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801414] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801427] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801439] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801451] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801464] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801475] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801487] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801499] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801511] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801522] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801534] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801546] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801575] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801594] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801607] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801619] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801646] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801660] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801672] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801685] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801697] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801711] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801723] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801735] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801747] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801776] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801787] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801799] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801811] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801837] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801849] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801860] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801871] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801882] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801893] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801904] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801915] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801926] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801937] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 [2024-11-30 04:30:17.801977] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5b7c0 is same with the state(5) to be set 00:28:27.341 04:30:17 -- host/failover.sh@50 -- # sleep 3 00:28:30.632 04:30:20 -- host/failover.sh@53 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:28:30.632 [2024-11-30 04:30:21.073176] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:30.632 04:30:21 -- host/failover.sh@55 -- # sleep 1 00:28:31.566 04:30:22 -- host/failover.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:31.825 [2024-11-30 04:30:22.333443] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333500] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333525] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333537] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333549] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333561] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333572] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333600] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333611] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333622] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333633] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333644] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333656] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333668] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333679] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333692] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333703] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 [2024-11-30 04:30:22.333715] tcp.c:1576:nvmf_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0xf5c310 is same with the state(5) to be set 00:28:31.825 04:30:22 -- host/failover.sh@59 -- # wait 2470842 00:28:38.391 0 00:28:38.391 04:30:28 -- host/failover.sh@61 -- # killprocess 2470581 00:28:38.391 04:30:28 -- common/autotest_common.sh@936 -- # '[' -z 2470581 ']' 00:28:38.391 04:30:28 -- common/autotest_common.sh@940 -- # kill -0 2470581 00:28:38.391 04:30:28 -- common/autotest_common.sh@941 -- # uname 00:28:38.391 04:30:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:38.391 04:30:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2470581 00:28:38.391 04:30:28 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:38.391 04:30:28 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:38.391 04:30:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2470581' 00:28:38.391 killing process with pid 2470581 00:28:38.391 04:30:28 -- common/autotest_common.sh@955 -- # kill 2470581 00:28:38.391 04:30:28 -- common/autotest_common.sh@960 -- # wait 2470581 00:28:38.391 04:30:28 -- host/failover.sh@63 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:38.391 [2024-11-30 04:30:11.075282] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:38.391 [2024-11-30 04:30:11.075379] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2470581 ] 00:28:38.391 EAL: No free 2048 kB hugepages reported on node 1 00:28:38.391 [2024-11-30 04:30:11.138649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:38.391 [2024-11-30 04:30:11.225693] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:38.391 Running I/O for 15 seconds... 00:28:38.391 [2024-11-30 04:30:14.124230] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.391 [2024-11-30 04:30:14.124283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124301] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.391 [2024-11-30 04:30:14.124316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124330] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.391 [2024-11-30 04:30:14.124343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124358] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.391 [2024-11-30 04:30:14.124371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2047000 is same with the state(5) to be set 00:28:38.391 [2024-11-30 04:30:14.124447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:112168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:112176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:112224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124543] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:112232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124573] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124588] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:112240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:112256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:112288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:112296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:112304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:112312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:112336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124822] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:112352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.391 [2024-11-30 04:30:14.124852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:112360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.391 [2024-11-30 04:30:14.124865] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.124895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:112376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.124909] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.124923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:111560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.124951] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.124976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:111568 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.124992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:111576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:111592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:111600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:111632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125132] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:111640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125147] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125162] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:111672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:111680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:111688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125236] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:111720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:111728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125325] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:111736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125359] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:111752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:111760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125448] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:111768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:110 nsid:1 lba:112392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.392 [2024-11-30 04:30:14.125494] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:112400 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.392 [2024-11-30 04:30:14.125528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:112408 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.392 [2024-11-30 04:30:14.125559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125574] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:112416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.392 [2024-11-30 04:30:14.125588] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:112424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.392 [2024-11-30 04:30:14.125617] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125632] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:112432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:112440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125689] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:112448 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.392 [2024-11-30 04:30:14.125703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:112456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.392 [2024-11-30 04:30:14.125732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:112464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:112472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.392 [2024-11-30 04:30:14.125789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:112480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.392 [2024-11-30 04:30:14.125817] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:112488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.392 [2024-11-30 04:30:14.125851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.392 [2024-11-30 04:30:14.125867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:112496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.125881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.125904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:112504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.125919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.125949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:112512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.125979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.125996] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:112520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126009] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:60 nsid:1 lba:112528 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.393 [2024-11-30 04:30:14.126041] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126057] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:112536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126071] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:112544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:68 nsid:1 lba:112552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.393 [2024-11-30 04:30:14.126131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:111792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:111816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:111856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126235] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:111864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126284] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:111880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:111904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:111912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126360] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126375] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:111920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:111928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126440] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:111936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:111952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126497] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:111960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126511] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:111984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126540] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:111992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126569] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126585] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:112000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126599] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:112048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:112560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126671] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:96 nsid:1 lba:112568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.393 [2024-11-30 04:30:14.126684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:112576 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.393 [2024-11-30 04:30:14.126716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126732] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:112584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.393 [2024-11-30 04:30:14.126746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:67 nsid:1 lba:112592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.393 [2024-11-30 04:30:14.126775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:77 nsid:1 lba:112600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.393 [2024-11-30 04:30:14.126804] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:71 nsid:1 lba:112608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.393 [2024-11-30 04:30:14.126833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:112616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.393 [2024-11-30 04:30:14.126867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.393 [2024-11-30 04:30:14.126883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:112624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.394 [2024-11-30 04:30:14.126897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.126917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:112056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.126931] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.126953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:112064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.126990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:112096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:112112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:112120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127081] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:112128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127130] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:112136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:112144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127191] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:112632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:112640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127259] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:112648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:13 nsid:1 lba:112656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.394 [2024-11-30 04:30:14.127326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:112664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127355] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127370] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:112672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127384] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:112680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127435] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:112688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.394 [2024-11-30 04:30:14.127449] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:112696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.394 [2024-11-30 04:30:14.127484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:112704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.394 [2024-11-30 04:30:14.127512] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:112712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.394 [2024-11-30 04:30:14.127546] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:112720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.394 [2024-11-30 04:30:14.127576] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:112728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127604] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:112736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127648] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:112744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.394 [2024-11-30 04:30:14.127662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:112752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.394 [2024-11-30 04:30:14.127691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:112152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:112160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127748] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:112184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127777] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:112192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:112200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:112208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:112216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.394 [2024-11-30 04:30:14.127894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.394 [2024-11-30 04:30:14.127913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:112248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.127927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.127965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:112760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.395 [2024-11-30 04:30:14.127982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.127998] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:112768 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.395 [2024-11-30 04:30:14.128012] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:82 nsid:1 lba:112776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.395 [2024-11-30 04:30:14.128043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128058] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:112784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:112792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:20 nsid:1 lba:112800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.395 [2024-11-30 04:30:14.128133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:112808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.395 [2024-11-30 04:30:14.128163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:112816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.395 [2024-11-30 04:30:14.128193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:92 nsid:1 lba:112824 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.395 [2024-11-30 04:30:14.128223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:112832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:112840 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.395 [2024-11-30 04:30:14.128304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:112848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:112264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128368] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:112272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:112280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128428] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:112320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128458] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:112328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128487] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128502] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:112344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128516] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128531] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:112368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:14.128545] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128559] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2065c60 is same with the state(5) to be set 00:28:38.395 [2024-11-30 04:30:14.128575] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:38.395 [2024-11-30 04:30:14.128586] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:38.395 [2024-11-30 04:30:14.128597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:112384 len:8 PRP1 0x0 PRP2 0x0 00:28:38.395 [2024-11-30 04:30:14.128610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:14.128671] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2065c60 was disconnected and freed. reset controller. 00:28:38.395 [2024-11-30 04:30:14.128697] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:38.395 [2024-11-30 04:30:14.128714] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:38.395 [2024-11-30 04:30:14.130839] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:38.395 [2024-11-30 04:30:14.130876] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2047000 (9): Bad file descriptor 00:28:38.395 [2024-11-30 04:30:14.158981] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:38.395 [2024-11-30 04:30:17.801225] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.395 [2024-11-30 04:30:17.801278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:17.801298] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.395 [2024-11-30 04:30:17.801313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:17.801328] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.395 [2024-11-30 04:30:17.801342] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:17.801357] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.395 [2024-11-30 04:30:17.801371] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:17.801384] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2047000 is same with the state(5) to be set 00:28:38.395 [2024-11-30 04:30:17.802097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:110024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:17.802122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:17.802150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:110032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:17.802167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:17.802185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:110040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.395 [2024-11-30 04:30:17.802200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.395 [2024-11-30 04:30:17.802216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:110048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802261] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:110056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:110064 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802319] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:110072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:110080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:110088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:110104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802440] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:110112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:110120 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:109544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802525] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:109552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:109560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:107 nsid:1 lba:109584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:109616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802637] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:109624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:109680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:109704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:110128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:110136 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802791] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:110144 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:110152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:110160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802882] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:110184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802928] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:110192 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.802983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:110208 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.396 [2024-11-30 04:30:17.802998] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.396 [2024-11-30 04:30:17.803015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:110216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803029] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:110240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:110272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803087] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803102] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:110280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:110312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:110320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:91 nsid:1 lba:110352 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:110360 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:106 nsid:1 lba:110368 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:110376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:110384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:110392 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803376] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:110400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803404] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:110408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:35 nsid:1 lba:110416 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:114 nsid:1 lba:110424 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803472] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:84 nsid:1 lba:110432 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:110440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803549] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:110448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:80 nsid:1 lba:110456 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:66 nsid:1 lba:110464 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803622] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803637] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:110472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803650] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:110480 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:110488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803705] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803719] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:62 nsid:1 lba:110496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.397 [2024-11-30 04:30:17.803733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:109736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:109744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:109760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803830] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:109768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:109784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803871] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:109792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803898] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803917] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:109800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.803950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:109808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.397 [2024-11-30 04:30:17.803988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.397 [2024-11-30 04:30:17.804005] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:109816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804019] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:109840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804048] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804063] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:109848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:109856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:109864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:109872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:109880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:109896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:110504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:50 nsid:1 lba:110512 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.398 [2024-11-30 04:30:17.804291] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:110520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.398 [2024-11-30 04:30:17.804322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:110528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804352] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:110536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:73 nsid:1 lba:110544 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.398 [2024-11-30 04:30:17.804407] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:110552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:110560 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.398 [2024-11-30 04:30:17.804468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:48 nsid:1 lba:110568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.398 [2024-11-30 04:30:17.804496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:110576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.398 [2024-11-30 04:30:17.804524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804539] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:14 nsid:1 lba:110584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.398 [2024-11-30 04:30:17.804557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:110592 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:110600 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:110608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:109912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:109920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:109944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:109952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:109968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804799] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:109976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:109984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:110008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:110016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:110096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.398 [2024-11-30 04:30:17.804929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.398 [2024-11-30 04:30:17.804968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:110168 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.804985] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805001] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:110176 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:18 nsid:1 lba:110200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:110224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805101] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:110232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805131] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:110248 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:110616 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.399 [2024-11-30 04:30:17.805175] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:110624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:110632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:3 nsid:1 lba:110640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.399 [2024-11-30 04:30:17.805278] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:110648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805335] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:7 nsid:1 lba:110656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.399 [2024-11-30 04:30:17.805348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:12 nsid:1 lba:110664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.399 [2024-11-30 04:30:17.805376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:110672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:110680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:110688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805466] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:110696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.399 [2024-11-30 04:30:17.805498] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:110704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:110712 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.399 [2024-11-30 04:30:17.805555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:110720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:110728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805625] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:76 nsid:1 lba:110736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.399 [2024-11-30 04:30:17.805639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:118 nsid:1 lba:110744 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.399 [2024-11-30 04:30:17.805666] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:93 nsid:1 lba:110752 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.399 [2024-11-30 04:30:17.805695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:110760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805723] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:53 nsid:1 lba:110768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805750] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:110776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805792] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:110256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:110264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805833] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:110288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:110296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:110304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.399 [2024-11-30 04:30:17.805927] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.399 [2024-11-30 04:30:17.805963] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:110328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:17.805979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:17.805994] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:110336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:17.806008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:17.806022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x20534b0 is same with the state(5) to be set 00:28:38.400 [2024-11-30 04:30:17.806038] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:38.400 [2024-11-30 04:30:17.806049] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:38.400 [2024-11-30 04:30:17.806061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:110344 len:8 PRP1 0x0 PRP2 0x0 00:28:38.400 [2024-11-30 04:30:17.806073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:17.806133] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x20534b0 was disconnected and freed. reset controller. 00:28:38.400 [2024-11-30 04:30:17.806152] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4421 to 10.0.0.2:4422 00:28:38.400 [2024-11-30 04:30:17.806167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:38.400 [2024-11-30 04:30:17.808415] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:38.400 [2024-11-30 04:30:17.808455] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2047000 (9): Bad file descriptor 00:28:38.400 [2024-11-30 04:30:17.881161] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:38.400 [2024-11-30 04:30:22.333829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:75264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.333869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.333898] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:75272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.333914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.333932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:75280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.333970] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.333999] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:75296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:75304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:75328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:75368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:74720 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:74744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334178] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:74752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:74760 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:74792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334252] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:74800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334311] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:74808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:74840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:75376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334419] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:75384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:75400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334463] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334478] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:75448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:70 nsid:1 lba:75472 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.400 [2024-11-30 04:30:22.334520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:75480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:99 nsid:1 lba:75488 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.400 [2024-11-30 04:30:22.334581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:23 nsid:1 lba:75496 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.400 [2024-11-30 04:30:22.334613] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:75504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:75512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.400 [2024-11-30 04:30:22.334671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:75520 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.400 [2024-11-30 04:30:22.334699] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.400 [2024-11-30 04:30:22.334714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:75528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.334727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.334742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:37 nsid:1 lba:75536 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.401 [2024-11-30 04:30:22.334755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.334774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:75544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.334789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.334805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:75552 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.401 [2024-11-30 04:30:22.334819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.334834] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:75560 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.334847] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.334863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:75568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.401 [2024-11-30 04:30:22.334876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.334891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:112 nsid:1 lba:75576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.401 [2024-11-30 04:30:22.334905] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.334920] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:75584 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.334934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.334949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:8 nsid:1 lba:75592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.401 [2024-11-30 04:30:22.334989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335007] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:10 nsid:1 lba:75600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.401 [2024-11-30 04:30:22.335021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:45 nsid:1 lba:75608 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.401 [2024-11-30 04:30:22.335050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335066] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:108 nsid:1 lba:75616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335080] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335096] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:74856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:74864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:74880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335173] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:97 nsid:1 lba:74888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:74896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335249] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:74920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335263] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:74936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335308] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:74944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:74952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:74960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335409] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:74968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:74976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:74992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335496] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:75008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335524] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:75016 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335553] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:44 nsid:1 lba:75024 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335570] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:75624 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:75632 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.401 [2024-11-30 04:30:22.335629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:75640 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335658] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:75648 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.401 [2024-11-30 04:30:22.335686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.401 [2024-11-30 04:30:22.335701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:75040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.401 [2024-11-30 04:30:22.335715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.335737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:75048 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.335752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.335767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:79 nsid:1 lba:75056 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.335781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.335796] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:75080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.335810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.335824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:75088 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.335838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.335853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:75096 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.335867] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.335883] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:75104 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.335896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.335911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:75112 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.335925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.335944] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:21 nsid:1 lba:75656 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.402 [2024-11-30 04:30:22.335981] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:47 nsid:1 lba:75664 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.402 [2024-11-30 04:30:22.336015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336031] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:22 nsid:1 lba:75672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:75680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:75688 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336104] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:75696 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:75704 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.402 [2024-11-30 04:30:22.336163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:75712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:72 nsid:1 lba:75720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.402 [2024-11-30 04:30:22.336223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:75728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:75736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336303] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336318] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:75128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:75152 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:75160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:75184 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:75200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336455] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:75216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.402 [2024-11-30 04:30:22.336499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:75224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.402 [2024-11-30 04:30:22.336513] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336528] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:75240 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336542] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:75744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:126 nsid:1 lba:75752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:75760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.403 [2024-11-30 04:30:22.336629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:75768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:90 nsid:1 lba:75776 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.403 [2024-11-30 04:30:22.336686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:75784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336715] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:75792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:75800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:75808 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336821] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:75816 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336850] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:16 nsid:1 lba:75824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:75256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:75288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:75312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.336975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.336993] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:75320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:75336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337037] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:75344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:75352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337112] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:75360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337129] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:75832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:75840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337205] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:75848 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:30 nsid:1 lba:75856 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.403 [2024-11-30 04:30:22.337249] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337264] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:75864 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337293] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337309] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:75872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337338] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:75880 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337351] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337366] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:75888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337395] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:57 nsid:1 lba:75896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337409] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337424] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:75904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337453] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:75912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.403 [2024-11-30 04:30:22.337467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:38 nsid:1 lba:75920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.403 [2024-11-30 04:30:22.337495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.403 [2024-11-30 04:30:22.337510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:75928 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:28:38.404 [2024-11-30 04:30:22.337527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:75936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.404 [2024-11-30 04:30:22.337557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337572] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:75944 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.404 [2024-11-30 04:30:22.337586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337600] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:75952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.404 [2024-11-30 04:30:22.337614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:122 nsid:1 lba:75392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.404 [2024-11-30 04:30:22.337642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:75408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.404 [2024-11-30 04:30:22.337672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:75416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.404 [2024-11-30 04:30:22.337700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:75424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.404 [2024-11-30 04:30:22.337729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:75432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.404 [2024-11-30 04:30:22.337757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337772] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:75440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.404 [2024-11-30 04:30:22.337785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337801] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:75456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:28:38.404 [2024-11-30 04:30:22.337815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337829] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x2067c10 is same with the state(5) to be set 00:28:38.404 [2024-11-30 04:30:22.337845] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:28:38.404 [2024-11-30 04:30:22.337856] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:28:38.404 [2024-11-30 04:30:22.337868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:75464 len:8 PRP1 0x0 PRP2 0x0 00:28:38.404 [2024-11-30 04:30:22.337885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.337963] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x2067c10 was disconnected and freed. reset controller. 00:28:38.404 [2024-11-30 04:30:22.337984] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4422 to 10.0.0.2:4420 00:28:38.404 [2024-11-30 04:30:22.338019] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.404 [2024-11-30 04:30:22.338038] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.338053] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.404 [2024-11-30 04:30:22.338067] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.338081] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.404 [2024-11-30 04:30:22.338094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.338107] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:38.404 [2024-11-30 04:30:22.338121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:38.404 [2024-11-30 04:30:22.338135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:38.404 [2024-11-30 04:30:22.340287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:38.404 [2024-11-30 04:30:22.340327] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x2047000 (9): Bad file descriptor 00:28:38.404 [2024-11-30 04:30:22.493054] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:38.404 00:28:38.404 Latency(us) 00:28:38.404 [2024-11-30T03:30:29.035Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:38.404 [2024-11-30T03:30:29.035Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:38.404 Verification LBA range: start 0x0 length 0x4000 00:28:38.404 NVMe0n1 : 15.05 12611.71 49.26 988.19 0.00 9372.05 725.14 43108.12 00:28:38.404 [2024-11-30T03:30:29.035Z] =================================================================================================================== 00:28:38.404 [2024-11-30T03:30:29.035Z] Total : 12611.71 49.26 988.19 0.00 9372.05 725.14 43108.12 00:28:38.404 Received shutdown signal, test time was about 15.000000 seconds 00:28:38.404 00:28:38.404 Latency(us) 00:28:38.404 [2024-11-30T03:30:29.035Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:38.404 [2024-11-30T03:30:29.035Z] =================================================================================================================== 00:28:38.404 [2024-11-30T03:30:29.035Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:28:38.404 04:30:28 -- host/failover.sh@65 -- # grep -c 'Resetting controller successful' 00:28:38.404 04:30:28 -- host/failover.sh@65 -- # count=3 00:28:38.404 04:30:28 -- host/failover.sh@67 -- # (( count != 3 )) 00:28:38.404 04:30:28 -- host/failover.sh@73 -- # bdevperf_pid=2472742 00:28:38.404 04:30:28 -- host/failover.sh@72 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -z -r /var/tmp/bdevperf.sock -q 128 -o 4096 -w verify -t 1 -f 00:28:38.404 04:30:28 -- host/failover.sh@75 -- # waitforlisten 2472742 /var/tmp/bdevperf.sock 00:28:38.404 04:30:28 -- common/autotest_common.sh@829 -- # '[' -z 2472742 ']' 00:28:38.404 04:30:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bdevperf.sock 00:28:38.404 04:30:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:38.404 04:30:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock...' 00:28:38.404 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bdevperf.sock... 00:28:38.404 04:30:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:38.404 04:30:28 -- common/autotest_common.sh@10 -- # set +x 00:28:38.969 04:30:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:38.969 04:30:29 -- common/autotest_common.sh@862 -- # return 0 00:28:38.969 04:30:29 -- host/failover.sh@76 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4421 00:28:38.969 [2024-11-30 04:30:29.558167] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:38.969 04:30:29 -- host/failover.sh@77 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4422 00:28:39.226 [2024-11-30 04:30:29.802838] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4422 *** 00:28:39.226 04:30:29 -- host/failover.sh@78 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:39.791 NVMe0n1 00:28:39.791 04:30:30 -- host/failover.sh@79 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:40.048 00:28:40.048 04:30:30 -- host/failover.sh@80 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_attach_controller -b NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:40.614 00:28:40.614 04:30:31 -- host/failover.sh@82 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:40.614 04:30:31 -- host/failover.sh@82 -- # grep -q NVMe0 00:28:40.871 04:30:31 -- host/failover.sh@84 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:41.129 04:30:31 -- host/failover.sh@87 -- # sleep 3 00:28:44.407 04:30:34 -- host/failover.sh@88 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:44.407 04:30:34 -- host/failover.sh@88 -- # grep -q NVMe0 00:28:44.407 04:30:34 -- host/failover.sh@90 -- # run_test_pid=2473444 00:28:44.407 04:30:34 -- host/failover.sh@89 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bdevperf.sock perform_tests 00:28:44.407 04:30:34 -- host/failover.sh@92 -- # wait 2473444 00:28:45.350 0 00:28:45.350 04:30:35 -- host/failover.sh@94 -- # cat /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:45.350 [2024-11-30 04:30:28.353046] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:45.350 [2024-11-30 04:30:28.353130] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2472742 ] 00:28:45.350 EAL: No free 2048 kB hugepages reported on node 1 00:28:45.350 [2024-11-30 04:30:28.411500] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:45.350 [2024-11-30 04:30:28.492858] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:45.350 [2024-11-30 04:30:31.535421] bdev_nvme.c:1843:bdev_nvme_failover_trid: *NOTICE*: Start failover from 10.0.0.2:4420 to 10.0.0.2:4421 00:28:45.350 [2024-11-30 04:30:31.535526] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:28:45.350 [2024-11-30 04:30:31.535549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:45.350 [2024-11-30 04:30:31.535565] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:28:45.350 [2024-11-30 04:30:31.535580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:45.350 [2024-11-30 04:30:31.535594] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:28:45.350 [2024-11-30 04:30:31.535609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:45.350 [2024-11-30 04:30:31.535633] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:28:45.351 [2024-11-30 04:30:31.535646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:28:45.351 [2024-11-30 04:30:31.535661] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:28:45.351 [2024-11-30 04:30:31.535700] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:28:45.351 [2024-11-30 04:30:31.535731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1eec000 (9): Bad file descriptor 00:28:45.351 [2024-11-30 04:30:31.585171] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:28:45.351 Running I/O for 1 seconds... 00:28:45.351 00:28:45.351 Latency(us) 00:28:45.351 [2024-11-30T03:30:35.982Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:28:45.351 [2024-11-30T03:30:35.982Z] Job: NVMe0n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:28:45.351 Verification LBA range: start 0x0 length 0x4000 00:28:45.351 NVMe0n1 : 1.01 12750.29 49.81 0.00 0.00 9994.54 1468.49 11213.94 00:28:45.351 [2024-11-30T03:30:35.982Z] =================================================================================================================== 00:28:45.351 [2024-11-30T03:30:35.982Z] Total : 12750.29 49.81 0.00 0.00 9994.54 1468.49 11213.94 00:28:45.351 04:30:35 -- host/failover.sh@95 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:45.351 04:30:35 -- host/failover.sh@95 -- # grep -q NVMe0 00:28:45.610 04:30:36 -- host/failover.sh@98 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4422 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:46.238 04:30:36 -- host/failover.sh@99 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:46.238 04:30:36 -- host/failover.sh@99 -- # grep -q NVMe0 00:28:46.238 04:30:36 -- host/failover.sh@100 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_detach_controller NVMe0 -t tcp -a 10.0.0.2 -s 4421 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 00:28:46.495 04:30:37 -- host/failover.sh@101 -- # sleep 3 00:28:49.774 04:30:40 -- host/failover.sh@103 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bdevperf.sock bdev_nvme_get_controllers 00:28:49.774 04:30:40 -- host/failover.sh@103 -- # grep -q NVMe0 00:28:49.774 04:30:40 -- host/failover.sh@108 -- # killprocess 2472742 00:28:49.774 04:30:40 -- common/autotest_common.sh@936 -- # '[' -z 2472742 ']' 00:28:49.774 04:30:40 -- common/autotest_common.sh@940 -- # kill -0 2472742 00:28:49.774 04:30:40 -- common/autotest_common.sh@941 -- # uname 00:28:49.774 04:30:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:49.774 04:30:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2472742 00:28:49.774 04:30:40 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:28:49.774 04:30:40 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:28:49.774 04:30:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2472742' 00:28:49.774 killing process with pid 2472742 00:28:49.774 04:30:40 -- common/autotest_common.sh@955 -- # kill 2472742 00:28:49.774 04:30:40 -- common/autotest_common.sh@960 -- # wait 2472742 00:28:50.032 04:30:40 -- host/failover.sh@110 -- # sync 00:28:50.032 04:30:40 -- host/failover.sh@111 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:28:50.289 04:30:40 -- host/failover.sh@113 -- # trap - SIGINT SIGTERM EXIT 00:28:50.289 04:30:40 -- host/failover.sh@115 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/try.txt 00:28:50.289 04:30:40 -- host/failover.sh@116 -- # nvmftestfini 00:28:50.289 04:30:40 -- nvmf/common.sh@476 -- # nvmfcleanup 00:28:50.289 04:30:40 -- nvmf/common.sh@116 -- # sync 00:28:50.289 04:30:40 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:28:50.289 04:30:40 -- nvmf/common.sh@119 -- # set +e 00:28:50.289 04:30:40 -- nvmf/common.sh@120 -- # for i in {1..20} 00:28:50.289 04:30:40 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:28:50.289 rmmod nvme_tcp 00:28:50.289 rmmod nvme_fabrics 00:28:50.289 rmmod nvme_keyring 00:28:50.289 04:30:40 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:28:50.289 04:30:40 -- nvmf/common.sh@123 -- # set -e 00:28:50.289 04:30:40 -- nvmf/common.sh@124 -- # return 0 00:28:50.289 04:30:40 -- nvmf/common.sh@477 -- # '[' -n 2470122 ']' 00:28:50.289 04:30:40 -- nvmf/common.sh@478 -- # killprocess 2470122 00:28:50.289 04:30:40 -- common/autotest_common.sh@936 -- # '[' -z 2470122 ']' 00:28:50.289 04:30:40 -- common/autotest_common.sh@940 -- # kill -0 2470122 00:28:50.289 04:30:40 -- common/autotest_common.sh@941 -- # uname 00:28:50.289 04:30:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:28:50.289 04:30:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2470122 00:28:50.547 04:30:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:28:50.547 04:30:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:28:50.547 04:30:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2470122' 00:28:50.547 killing process with pid 2470122 00:28:50.547 04:30:40 -- common/autotest_common.sh@955 -- # kill 2470122 00:28:50.547 04:30:40 -- common/autotest_common.sh@960 -- # wait 2470122 00:28:50.806 04:30:41 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:28:50.806 04:30:41 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:28:50.806 04:30:41 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:28:50.806 04:30:41 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:28:50.806 04:30:41 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:28:50.806 04:30:41 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:50.806 04:30:41 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:50.806 04:30:41 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:52.709 04:30:43 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:28:52.709 00:28:52.709 real 0m37.397s 00:28:52.709 user 2m11.664s 00:28:52.709 sys 0m6.406s 00:28:52.709 04:30:43 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:28:52.709 04:30:43 -- common/autotest_common.sh@10 -- # set +x 00:28:52.709 ************************************ 00:28:52.709 END TEST nvmf_failover 00:28:52.709 ************************************ 00:28:52.709 04:30:43 -- nvmf/nvmf.sh@101 -- # run_test nvmf_discovery /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:52.709 04:30:43 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:28:52.709 04:30:43 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:28:52.709 04:30:43 -- common/autotest_common.sh@10 -- # set +x 00:28:52.709 ************************************ 00:28:52.709 START TEST nvmf_discovery 00:28:52.709 ************************************ 00:28:52.709 04:30:43 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery.sh --transport=tcp 00:28:52.709 * Looking for test storage... 00:28:52.709 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:28:52.709 04:30:43 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:28:52.709 04:30:43 -- common/autotest_common.sh@1690 -- # lcov --version 00:28:52.709 04:30:43 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:28:52.968 04:30:43 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:28:52.968 04:30:43 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:28:52.968 04:30:43 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:28:52.968 04:30:43 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:28:52.968 04:30:43 -- scripts/common.sh@335 -- # IFS=.-: 00:28:52.968 04:30:43 -- scripts/common.sh@335 -- # read -ra ver1 00:28:52.968 04:30:43 -- scripts/common.sh@336 -- # IFS=.-: 00:28:52.968 04:30:43 -- scripts/common.sh@336 -- # read -ra ver2 00:28:52.968 04:30:43 -- scripts/common.sh@337 -- # local 'op=<' 00:28:52.968 04:30:43 -- scripts/common.sh@339 -- # ver1_l=2 00:28:52.968 04:30:43 -- scripts/common.sh@340 -- # ver2_l=1 00:28:52.968 04:30:43 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:28:52.968 04:30:43 -- scripts/common.sh@343 -- # case "$op" in 00:28:52.968 04:30:43 -- scripts/common.sh@344 -- # : 1 00:28:52.968 04:30:43 -- scripts/common.sh@363 -- # (( v = 0 )) 00:28:52.968 04:30:43 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:28:52.968 04:30:43 -- scripts/common.sh@364 -- # decimal 1 00:28:52.968 04:30:43 -- scripts/common.sh@352 -- # local d=1 00:28:52.968 04:30:43 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:28:52.968 04:30:43 -- scripts/common.sh@354 -- # echo 1 00:28:52.968 04:30:43 -- scripts/common.sh@364 -- # ver1[v]=1 00:28:52.968 04:30:43 -- scripts/common.sh@365 -- # decimal 2 00:28:52.968 04:30:43 -- scripts/common.sh@352 -- # local d=2 00:28:52.968 04:30:43 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:28:52.968 04:30:43 -- scripts/common.sh@354 -- # echo 2 00:28:52.968 04:30:43 -- scripts/common.sh@365 -- # ver2[v]=2 00:28:52.968 04:30:43 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:28:52.968 04:30:43 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:28:52.968 04:30:43 -- scripts/common.sh@367 -- # return 0 00:28:52.968 04:30:43 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:28:52.968 04:30:43 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:28:52.968 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:52.968 --rc genhtml_branch_coverage=1 00:28:52.968 --rc genhtml_function_coverage=1 00:28:52.968 --rc genhtml_legend=1 00:28:52.968 --rc geninfo_all_blocks=1 00:28:52.968 --rc geninfo_unexecuted_blocks=1 00:28:52.968 00:28:52.968 ' 00:28:52.968 04:30:43 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:28:52.968 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:52.968 --rc genhtml_branch_coverage=1 00:28:52.968 --rc genhtml_function_coverage=1 00:28:52.968 --rc genhtml_legend=1 00:28:52.968 --rc geninfo_all_blocks=1 00:28:52.968 --rc geninfo_unexecuted_blocks=1 00:28:52.968 00:28:52.968 ' 00:28:52.968 04:30:43 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:28:52.968 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:52.968 --rc genhtml_branch_coverage=1 00:28:52.968 --rc genhtml_function_coverage=1 00:28:52.968 --rc genhtml_legend=1 00:28:52.968 --rc geninfo_all_blocks=1 00:28:52.968 --rc geninfo_unexecuted_blocks=1 00:28:52.968 00:28:52.968 ' 00:28:52.968 04:30:43 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:28:52.968 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:28:52.968 --rc genhtml_branch_coverage=1 00:28:52.968 --rc genhtml_function_coverage=1 00:28:52.968 --rc genhtml_legend=1 00:28:52.968 --rc geninfo_all_blocks=1 00:28:52.968 --rc geninfo_unexecuted_blocks=1 00:28:52.968 00:28:52.968 ' 00:28:52.968 04:30:43 -- host/discovery.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:28:52.968 04:30:43 -- nvmf/common.sh@7 -- # uname -s 00:28:52.968 04:30:43 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:28:52.968 04:30:43 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:28:52.968 04:30:43 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:28:52.968 04:30:43 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:28:52.968 04:30:43 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:28:52.968 04:30:43 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:28:52.968 04:30:43 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:28:52.968 04:30:43 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:28:52.968 04:30:43 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:28:52.968 04:30:43 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:28:52.968 04:30:43 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:28:52.968 04:30:43 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:28:52.968 04:30:43 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:28:52.968 04:30:43 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:28:52.968 04:30:43 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:28:52.968 04:30:43 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:28:52.968 04:30:43 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:28:52.968 04:30:43 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:28:52.968 04:30:43 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:28:52.968 04:30:43 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.968 04:30:43 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.968 04:30:43 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.968 04:30:43 -- paths/export.sh@5 -- # export PATH 00:28:52.968 04:30:43 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:28:52.968 04:30:43 -- nvmf/common.sh@46 -- # : 0 00:28:52.968 04:30:43 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:28:52.968 04:30:43 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:28:52.968 04:30:43 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:28:52.968 04:30:43 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:28:52.968 04:30:43 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:28:52.968 04:30:43 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:28:52.968 04:30:43 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:28:52.968 04:30:43 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:28:52.968 04:30:43 -- host/discovery.sh@11 -- # '[' tcp == rdma ']' 00:28:52.968 04:30:43 -- host/discovery.sh@16 -- # DISCOVERY_PORT=8009 00:28:52.968 04:30:43 -- host/discovery.sh@17 -- # DISCOVERY_NQN=nqn.2014-08.org.nvmexpress.discovery 00:28:52.968 04:30:43 -- host/discovery.sh@20 -- # NQN=nqn.2016-06.io.spdk:cnode 00:28:52.969 04:30:43 -- host/discovery.sh@22 -- # HOST_NQN=nqn.2021-12.io.spdk:test 00:28:52.969 04:30:43 -- host/discovery.sh@23 -- # HOST_SOCK=/tmp/host.sock 00:28:52.969 04:30:43 -- host/discovery.sh@25 -- # nvmftestinit 00:28:52.969 04:30:43 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:28:52.969 04:30:43 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:28:52.969 04:30:43 -- nvmf/common.sh@436 -- # prepare_net_devs 00:28:52.969 04:30:43 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:28:52.969 04:30:43 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:28:52.969 04:30:43 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:28:52.969 04:30:43 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:28:52.969 04:30:43 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:28:52.969 04:30:43 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:28:52.969 04:30:43 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:28:52.969 04:30:43 -- nvmf/common.sh@284 -- # xtrace_disable 00:28:52.969 04:30:43 -- common/autotest_common.sh@10 -- # set +x 00:28:54.873 04:30:45 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:28:54.873 04:30:45 -- nvmf/common.sh@290 -- # pci_devs=() 00:28:54.873 04:30:45 -- nvmf/common.sh@290 -- # local -a pci_devs 00:28:54.873 04:30:45 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:28:54.873 04:30:45 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:28:54.873 04:30:45 -- nvmf/common.sh@292 -- # pci_drivers=() 00:28:54.873 04:30:45 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:28:54.873 04:30:45 -- nvmf/common.sh@294 -- # net_devs=() 00:28:54.873 04:30:45 -- nvmf/common.sh@294 -- # local -ga net_devs 00:28:54.873 04:30:45 -- nvmf/common.sh@295 -- # e810=() 00:28:54.873 04:30:45 -- nvmf/common.sh@295 -- # local -ga e810 00:28:54.873 04:30:45 -- nvmf/common.sh@296 -- # x722=() 00:28:54.873 04:30:45 -- nvmf/common.sh@296 -- # local -ga x722 00:28:54.873 04:30:45 -- nvmf/common.sh@297 -- # mlx=() 00:28:54.873 04:30:45 -- nvmf/common.sh@297 -- # local -ga mlx 00:28:54.873 04:30:45 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:28:54.873 04:30:45 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:28:54.873 04:30:45 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:28:54.873 04:30:45 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:28:54.873 04:30:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:54.873 04:30:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:28:54.873 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:28:54.873 04:30:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:28:54.873 04:30:45 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:28:54.873 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:28:54.873 04:30:45 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:28:54.873 04:30:45 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:54.873 04:30:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:54.873 04:30:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:54.873 04:30:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:54.873 04:30:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:28:54.873 Found net devices under 0000:0a:00.0: cvl_0_0 00:28:54.873 04:30:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:54.873 04:30:45 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:28:54.873 04:30:45 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:28:54.873 04:30:45 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:28:54.873 04:30:45 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:28:54.873 04:30:45 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:28:54.873 Found net devices under 0000:0a:00.1: cvl_0_1 00:28:54.873 04:30:45 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:28:54.873 04:30:45 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:28:54.873 04:30:45 -- nvmf/common.sh@402 -- # is_hw=yes 00:28:54.873 04:30:45 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:28:54.873 04:30:45 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:28:54.873 04:30:45 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:28:54.873 04:30:45 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:28:54.873 04:30:45 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:28:54.873 04:30:45 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:28:54.873 04:30:45 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:28:54.873 04:30:45 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:28:54.873 04:30:45 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:28:54.873 04:30:45 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:28:54.873 04:30:45 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:28:54.873 04:30:45 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:28:54.873 04:30:45 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:28:54.873 04:30:45 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:28:54.873 04:30:45 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:28:54.873 04:30:45 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:28:54.873 04:30:45 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:28:54.873 04:30:45 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:28:54.873 04:30:45 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:28:54.873 04:30:45 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:28:54.873 04:30:45 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:28:54.873 04:30:45 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:28:54.873 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:28:54.873 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.314 ms 00:28:54.873 00:28:54.873 --- 10.0.0.2 ping statistics --- 00:28:54.873 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:54.873 rtt min/avg/max/mdev = 0.314/0.314/0.314/0.000 ms 00:28:54.873 04:30:45 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:28:54.873 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:28:54.873 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.090 ms 00:28:54.873 00:28:54.873 --- 10.0.0.1 ping statistics --- 00:28:54.873 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:28:54.873 rtt min/avg/max/mdev = 0.090/0.090/0.090/0.000 ms 00:28:54.874 04:30:45 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:28:54.874 04:30:45 -- nvmf/common.sh@410 -- # return 0 00:28:54.874 04:30:45 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:28:54.874 04:30:45 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:28:54.874 04:30:45 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:28:54.874 04:30:45 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:28:54.874 04:30:45 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:28:54.874 04:30:45 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:28:54.874 04:30:45 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:28:54.874 04:30:45 -- host/discovery.sh@30 -- # nvmfappstart -m 0x2 00:28:54.874 04:30:45 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:28:54.874 04:30:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:28:54.874 04:30:45 -- common/autotest_common.sh@10 -- # set +x 00:28:54.874 04:30:45 -- nvmf/common.sh@469 -- # nvmfpid=2476205 00:28:54.874 04:30:45 -- nvmf/common.sh@470 -- # waitforlisten 2476205 00:28:54.874 04:30:45 -- common/autotest_common.sh@829 -- # '[' -z 2476205 ']' 00:28:54.874 04:30:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:28:54.874 04:30:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:54.874 04:30:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:28:54.874 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:28:54.874 04:30:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:54.874 04:30:45 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:28:54.874 04:30:45 -- common/autotest_common.sh@10 -- # set +x 00:28:54.874 [2024-11-30 04:30:45.421031] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:54.874 [2024-11-30 04:30:45.421131] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:28:54.874 EAL: No free 2048 kB hugepages reported on node 1 00:28:54.874 [2024-11-30 04:30:45.489868] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:55.131 [2024-11-30 04:30:45.578916] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:55.131 [2024-11-30 04:30:45.579100] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:28:55.131 [2024-11-30 04:30:45.579119] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:28:55.131 [2024-11-30 04:30:45.579132] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:28:55.131 [2024-11-30 04:30:45.579159] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:28:56.066 04:30:46 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:56.066 04:30:46 -- common/autotest_common.sh@862 -- # return 0 00:28:56.066 04:30:46 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:28:56.066 04:30:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:28:56.066 04:30:46 -- common/autotest_common.sh@10 -- # set +x 00:28:56.066 04:30:46 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:28:56.066 04:30:46 -- host/discovery.sh@32 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:28:56.066 04:30:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.066 04:30:46 -- common/autotest_common.sh@10 -- # set +x 00:28:56.066 [2024-11-30 04:30:46.419641] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:28:56.066 04:30:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.066 04:30:46 -- host/discovery.sh@33 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2014-08.org.nvmexpress.discovery -t tcp -a 10.0.0.2 -s 8009 00:28:56.066 04:30:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.066 04:30:46 -- common/autotest_common.sh@10 -- # set +x 00:28:56.066 [2024-11-30 04:30:46.427840] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:28:56.066 04:30:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.066 04:30:46 -- host/discovery.sh@35 -- # rpc_cmd bdev_null_create null0 1000 512 00:28:56.066 04:30:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.066 04:30:46 -- common/autotest_common.sh@10 -- # set +x 00:28:56.066 null0 00:28:56.066 04:30:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.066 04:30:46 -- host/discovery.sh@36 -- # rpc_cmd bdev_null_create null1 1000 512 00:28:56.066 04:30:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.066 04:30:46 -- common/autotest_common.sh@10 -- # set +x 00:28:56.066 null1 00:28:56.066 04:30:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.066 04:30:46 -- host/discovery.sh@37 -- # rpc_cmd bdev_wait_for_examine 00:28:56.066 04:30:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:56.066 04:30:46 -- common/autotest_common.sh@10 -- # set +x 00:28:56.066 04:30:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:56.066 04:30:46 -- host/discovery.sh@45 -- # hostpid=2476364 00:28:56.066 04:30:46 -- host/discovery.sh@46 -- # waitforlisten 2476364 /tmp/host.sock 00:28:56.066 04:30:46 -- host/discovery.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock 00:28:56.066 04:30:46 -- common/autotest_common.sh@829 -- # '[' -z 2476364 ']' 00:28:56.066 04:30:46 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:28:56.066 04:30:46 -- common/autotest_common.sh@834 -- # local max_retries=100 00:28:56.066 04:30:46 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:28:56.066 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:28:56.066 04:30:46 -- common/autotest_common.sh@838 -- # xtrace_disable 00:28:56.066 04:30:46 -- common/autotest_common.sh@10 -- # set +x 00:28:56.066 [2024-11-30 04:30:46.502174] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:28:56.066 [2024-11-30 04:30:46.502249] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2476364 ] 00:28:56.066 EAL: No free 2048 kB hugepages reported on node 1 00:28:56.066 [2024-11-30 04:30:46.569611] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:28:56.066 [2024-11-30 04:30:46.657164] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:28:56.066 [2024-11-30 04:30:46.657353] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:28:57.000 04:30:47 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:28:57.000 04:30:47 -- common/autotest_common.sh@862 -- # return 0 00:28:57.000 04:30:47 -- host/discovery.sh@48 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; kill $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:28:57.000 04:30:47 -- host/discovery.sh@50 -- # rpc_cmd -s /tmp/host.sock log_set_flag bdev_nvme 00:28:57.000 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.000 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.000 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.000 04:30:47 -- host/discovery.sh@51 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test 00:28:57.000 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.000 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.000 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.000 04:30:47 -- host/discovery.sh@72 -- # notify_id=0 00:28:57.000 04:30:47 -- host/discovery.sh@78 -- # get_subsystem_names 00:28:57.000 04:30:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:57.000 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.000 04:30:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:57.000 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.000 04:30:47 -- host/discovery.sh@59 -- # sort 00:28:57.000 04:30:47 -- host/discovery.sh@59 -- # xargs 00:28:57.000 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.000 04:30:47 -- host/discovery.sh@78 -- # [[ '' == '' ]] 00:28:57.000 04:30:47 -- host/discovery.sh@79 -- # get_bdev_list 00:28:57.000 04:30:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.000 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.000 04:30:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:57.000 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.000 04:30:47 -- host/discovery.sh@55 -- # sort 00:28:57.000 04:30:47 -- host/discovery.sh@55 -- # xargs 00:28:57.000 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.000 04:30:47 -- host/discovery.sh@79 -- # [[ '' == '' ]] 00:28:57.000 04:30:47 -- host/discovery.sh@81 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 00:28:57.000 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.000 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.000 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.000 04:30:47 -- host/discovery.sh@82 -- # get_subsystem_names 00:28:57.000 04:30:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:57.000 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.000 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.000 04:30:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:57.000 04:30:47 -- host/discovery.sh@59 -- # sort 00:28:57.000 04:30:47 -- host/discovery.sh@59 -- # xargs 00:28:57.000 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.000 04:30:47 -- host/discovery.sh@82 -- # [[ '' == '' ]] 00:28:57.000 04:30:47 -- host/discovery.sh@83 -- # get_bdev_list 00:28:57.000 04:30:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.000 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.000 04:30:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:57.000 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.000 04:30:47 -- host/discovery.sh@55 -- # sort 00:28:57.000 04:30:47 -- host/discovery.sh@55 -- # xargs 00:28:57.258 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.259 04:30:47 -- host/discovery.sh@83 -- # [[ '' == '' ]] 00:28:57.259 04:30:47 -- host/discovery.sh@85 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null0 00:28:57.259 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.259 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.259 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.259 04:30:47 -- host/discovery.sh@86 -- # get_subsystem_names 00:28:57.259 04:30:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:57.259 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.259 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.259 04:30:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:57.259 04:30:47 -- host/discovery.sh@59 -- # sort 00:28:57.259 04:30:47 -- host/discovery.sh@59 -- # xargs 00:28:57.259 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.259 04:30:47 -- host/discovery.sh@86 -- # [[ '' == '' ]] 00:28:57.259 04:30:47 -- host/discovery.sh@87 -- # get_bdev_list 00:28:57.259 04:30:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.259 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.259 04:30:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:57.259 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.259 04:30:47 -- host/discovery.sh@55 -- # sort 00:28:57.259 04:30:47 -- host/discovery.sh@55 -- # xargs 00:28:57.259 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.259 04:30:47 -- host/discovery.sh@87 -- # [[ '' == '' ]] 00:28:57.259 04:30:47 -- host/discovery.sh@91 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:28:57.259 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.259 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.259 [2024-11-30 04:30:47.751543] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:28:57.259 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.259 04:30:47 -- host/discovery.sh@92 -- # get_subsystem_names 00:28:57.259 04:30:47 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:57.259 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.259 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.259 04:30:47 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:57.259 04:30:47 -- host/discovery.sh@59 -- # sort 00:28:57.259 04:30:47 -- host/discovery.sh@59 -- # xargs 00:28:57.259 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.259 04:30:47 -- host/discovery.sh@92 -- # [[ '' == '' ]] 00:28:57.259 04:30:47 -- host/discovery.sh@93 -- # get_bdev_list 00:28:57.259 04:30:47 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:57.259 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.259 04:30:47 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:57.259 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.259 04:30:47 -- host/discovery.sh@55 -- # sort 00:28:57.259 04:30:47 -- host/discovery.sh@55 -- # xargs 00:28:57.259 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.259 04:30:47 -- host/discovery.sh@93 -- # [[ '' == '' ]] 00:28:57.259 04:30:47 -- host/discovery.sh@94 -- # get_notification_count 00:28:57.259 04:30:47 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:57.259 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.259 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.259 04:30:47 -- host/discovery.sh@74 -- # jq '. | length' 00:28:57.259 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.259 04:30:47 -- host/discovery.sh@74 -- # notification_count=0 00:28:57.259 04:30:47 -- host/discovery.sh@75 -- # notify_id=0 00:28:57.259 04:30:47 -- host/discovery.sh@95 -- # [[ 0 == 0 ]] 00:28:57.259 04:30:47 -- host/discovery.sh@99 -- # rpc_cmd nvmf_subsystem_add_host nqn.2016-06.io.spdk:cnode0 nqn.2021-12.io.spdk:test 00:28:57.259 04:30:47 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:57.259 04:30:47 -- common/autotest_common.sh@10 -- # set +x 00:28:57.259 04:30:47 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:57.259 04:30:47 -- host/discovery.sh@100 -- # sleep 1 00:28:58.192 [2024-11-30 04:30:48.509121] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:28:58.192 [2024-11-30 04:30:48.509154] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:28:58.192 [2024-11-30 04:30:48.509177] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:58.192 [2024-11-30 04:30:48.595488] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:28:58.192 [2024-11-30 04:30:48.773722] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:58.192 [2024-11-30 04:30:48.773750] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:58.450 04:30:48 -- host/discovery.sh@101 -- # get_subsystem_names 00:28:58.451 04:30:48 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:28:58.451 04:30:48 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:28:58.451 04:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.451 04:30:48 -- host/discovery.sh@59 -- # sort 00:28:58.451 04:30:48 -- common/autotest_common.sh@10 -- # set +x 00:28:58.451 04:30:48 -- host/discovery.sh@59 -- # xargs 00:28:58.451 04:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.451 04:30:48 -- host/discovery.sh@101 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:28:58.451 04:30:48 -- host/discovery.sh@102 -- # get_bdev_list 00:28:58.451 04:30:48 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:58.451 04:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.451 04:30:48 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:58.451 04:30:48 -- common/autotest_common.sh@10 -- # set +x 00:28:58.451 04:30:48 -- host/discovery.sh@55 -- # sort 00:28:58.451 04:30:48 -- host/discovery.sh@55 -- # xargs 00:28:58.451 04:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.451 04:30:48 -- host/discovery.sh@102 -- # [[ nvme0n1 == \n\v\m\e\0\n\1 ]] 00:28:58.451 04:30:48 -- host/discovery.sh@103 -- # get_subsystem_paths nvme0 00:28:58.451 04:30:48 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:28:58.451 04:30:48 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.451 04:30:48 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:28:58.451 04:30:48 -- common/autotest_common.sh@10 -- # set +x 00:28:58.451 04:30:48 -- host/discovery.sh@63 -- # sort -n 00:28:58.451 04:30:48 -- host/discovery.sh@63 -- # xargs 00:28:58.451 04:30:48 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.451 04:30:49 -- host/discovery.sh@103 -- # [[ 4420 == \4\4\2\0 ]] 00:28:58.451 04:30:49 -- host/discovery.sh@104 -- # get_notification_count 00:28:58.451 04:30:49 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 0 00:28:58.451 04:30:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.451 04:30:49 -- host/discovery.sh@74 -- # jq '. | length' 00:28:58.451 04:30:49 -- common/autotest_common.sh@10 -- # set +x 00:28:58.451 04:30:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.451 04:30:49 -- host/discovery.sh@74 -- # notification_count=1 00:28:58.451 04:30:49 -- host/discovery.sh@75 -- # notify_id=1 00:28:58.451 04:30:49 -- host/discovery.sh@105 -- # [[ 1 == 1 ]] 00:28:58.451 04:30:49 -- host/discovery.sh@108 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 null1 00:28:58.451 04:30:49 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:58.451 04:30:49 -- common/autotest_common.sh@10 -- # set +x 00:28:58.451 04:30:49 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:58.451 04:30:49 -- host/discovery.sh@109 -- # sleep 1 00:28:59.825 04:30:50 -- host/discovery.sh@110 -- # get_bdev_list 00:28:59.825 04:30:50 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:28:59.825 04:30:50 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:28:59.825 04:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.825 04:30:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.825 04:30:50 -- host/discovery.sh@55 -- # sort 00:28:59.825 04:30:50 -- host/discovery.sh@55 -- # xargs 00:28:59.825 04:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.825 04:30:50 -- host/discovery.sh@110 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:28:59.825 04:30:50 -- host/discovery.sh@111 -- # get_notification_count 00:28:59.825 04:30:50 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 1 00:28:59.825 04:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.825 04:30:50 -- host/discovery.sh@74 -- # jq '. | length' 00:28:59.825 04:30:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.825 04:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.825 04:30:50 -- host/discovery.sh@74 -- # notification_count=1 00:28:59.825 04:30:50 -- host/discovery.sh@75 -- # notify_id=2 00:28:59.825 04:30:50 -- host/discovery.sh@112 -- # [[ 1 == 1 ]] 00:28:59.825 04:30:50 -- host/discovery.sh@116 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4421 00:28:59.825 04:30:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:28:59.825 04:30:50 -- common/autotest_common.sh@10 -- # set +x 00:28:59.825 [2024-11-30 04:30:50.150856] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4421 *** 00:28:59.825 [2024-11-30 04:30:50.151460] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:28:59.825 [2024-11-30 04:30:50.151505] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:28:59.825 04:30:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:28:59.825 04:30:50 -- host/discovery.sh@117 -- # sleep 1 00:28:59.825 [2024-11-30 04:30:50.237714] bdev_nvme.c:6683:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new path for nvme0 00:28:59.825 [2024-11-30 04:30:50.335435] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:28:59.825 [2024-11-30 04:30:50.335462] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:28:59.825 [2024-11-30 04:30:50.335472] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:00.759 04:30:51 -- host/discovery.sh@118 -- # get_subsystem_names 00:29:00.759 04:30:51 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:00.759 04:30:51 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:00.759 04:30:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.759 04:30:51 -- common/autotest_common.sh@10 -- # set +x 00:29:00.759 04:30:51 -- host/discovery.sh@59 -- # sort 00:29:00.759 04:30:51 -- host/discovery.sh@59 -- # xargs 00:29:00.759 04:30:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.759 04:30:51 -- host/discovery.sh@118 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:00.759 04:30:51 -- host/discovery.sh@119 -- # get_bdev_list 00:29:00.759 04:30:51 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:00.759 04:30:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.759 04:30:51 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:00.759 04:30:51 -- common/autotest_common.sh@10 -- # set +x 00:29:00.759 04:30:51 -- host/discovery.sh@55 -- # sort 00:29:00.759 04:30:51 -- host/discovery.sh@55 -- # xargs 00:29:00.759 04:30:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.759 04:30:51 -- host/discovery.sh@119 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:00.759 04:30:51 -- host/discovery.sh@120 -- # get_subsystem_paths nvme0 00:29:00.759 04:30:51 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:00.759 04:30:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.759 04:30:51 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:00.759 04:30:51 -- common/autotest_common.sh@10 -- # set +x 00:29:00.759 04:30:51 -- host/discovery.sh@63 -- # sort -n 00:29:00.759 04:30:51 -- host/discovery.sh@63 -- # xargs 00:29:00.759 04:30:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.759 04:30:51 -- host/discovery.sh@120 -- # [[ 4420 4421 == \4\4\2\0\ \4\4\2\1 ]] 00:29:00.759 04:30:51 -- host/discovery.sh@121 -- # get_notification_count 00:29:00.759 04:30:51 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:00.759 04:30:51 -- host/discovery.sh@74 -- # jq '. | length' 00:29:00.759 04:30:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.759 04:30:51 -- common/autotest_common.sh@10 -- # set +x 00:29:00.759 04:30:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.759 04:30:51 -- host/discovery.sh@74 -- # notification_count=0 00:29:00.759 04:30:51 -- host/discovery.sh@75 -- # notify_id=2 00:29:00.759 04:30:51 -- host/discovery.sh@122 -- # [[ 0 == 0 ]] 00:29:00.759 04:30:51 -- host/discovery.sh@126 -- # rpc_cmd nvmf_subsystem_remove_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:29:00.759 04:30:51 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:00.759 04:30:51 -- common/autotest_common.sh@10 -- # set +x 00:29:00.759 [2024-11-30 04:30:51.318694] bdev_nvme.c:6741:discovery_aer_cb: *INFO*: Discovery[10.0.0.2:8009] got aer 00:29:00.759 [2024-11-30 04:30:51.318725] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:00.759 04:30:51 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:00.759 04:30:51 -- host/discovery.sh@127 -- # sleep 1 00:29:00.759 [2024-11-30 04:30:51.327161] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:00.759 [2024-11-30 04:30:51.327194] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:00.759 [2024-11-30 04:30:51.327219] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:00.759 [2024-11-30 04:30:51.327235] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:00.759 [2024-11-30 04:30:51.327267] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:00.759 [2024-11-30 04:30:51.327282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:00.759 [2024-11-30 04:30:51.327298] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:00.759 [2024-11-30 04:30:51.327314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:00.759 [2024-11-30 04:30:51.327329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18c3410 is same with the state(5) to be set 00:29:00.760 [2024-11-30 04:30:51.337167] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18c3410 (9): Bad file descriptor 00:29:00.760 [2024-11-30 04:30:51.347213] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:00.760 [2024-11-30 04:30:51.347942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.760 [2024-11-30 04:30:51.348115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.760 [2024-11-30 04:30:51.348143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18c3410 with addr=10.0.0.2, port=4420 00:29:00.760 [2024-11-30 04:30:51.348161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18c3410 is same with the state(5) to be set 00:29:00.760 [2024-11-30 04:30:51.348184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18c3410 (9): Bad file descriptor 00:29:00.760 [2024-11-30 04:30:51.348229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:00.760 [2024-11-30 04:30:51.348249] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:00.760 [2024-11-30 04:30:51.348264] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:00.760 [2024-11-30 04:30:51.348287] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:00.760 [2024-11-30 04:30:51.357305] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:00.760 [2024-11-30 04:30:51.357462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.760 [2024-11-30 04:30:51.357629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.760 [2024-11-30 04:30:51.357657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18c3410 with addr=10.0.0.2, port=4420 00:29:00.760 [2024-11-30 04:30:51.357676] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18c3410 is same with the state(5) to be set 00:29:00.760 [2024-11-30 04:30:51.357701] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18c3410 (9): Bad file descriptor 00:29:00.760 [2024-11-30 04:30:51.357724] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:00.760 [2024-11-30 04:30:51.357740] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:00.760 [2024-11-30 04:30:51.357755] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:00.760 [2024-11-30 04:30:51.357776] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:00.760 [2024-11-30 04:30:51.367386] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:00.760 [2024-11-30 04:30:51.367598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.760 [2024-11-30 04:30:51.367703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.760 [2024-11-30 04:30:51.367728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18c3410 with addr=10.0.0.2, port=4420 00:29:00.760 [2024-11-30 04:30:51.367746] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18c3410 is same with the state(5) to be set 00:29:00.760 [2024-11-30 04:30:51.367768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18c3410 (9): Bad file descriptor 00:29:00.760 [2024-11-30 04:30:51.367790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:00.760 [2024-11-30 04:30:51.367804] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:00.760 [2024-11-30 04:30:51.367818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:00.760 [2024-11-30 04:30:51.367853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:00.760 [2024-11-30 04:30:51.377474] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:00.760 [2024-11-30 04:30:51.377635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.760 [2024-11-30 04:30:51.377768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.760 [2024-11-30 04:30:51.377796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18c3410 with addr=10.0.0.2, port=4420 00:29:00.760 [2024-11-30 04:30:51.377814] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18c3410 is same with the state(5) to be set 00:29:00.760 [2024-11-30 04:30:51.377838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18c3410 (9): Bad file descriptor 00:29:00.760 [2024-11-30 04:30:51.377862] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:00.760 [2024-11-30 04:30:51.377878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:00.760 [2024-11-30 04:30:51.377893] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:00.760 [2024-11-30 04:30:51.377915] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:00.760 [2024-11-30 04:30:51.387554] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:00.760 [2024-11-30 04:30:51.387725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.760 [2024-11-30 04:30:51.387851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:00.760 [2024-11-30 04:30:51.387877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18c3410 with addr=10.0.0.2, port=4420 00:29:00.760 [2024-11-30 04:30:51.387893] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18c3410 is same with the state(5) to be set 00:29:00.760 [2024-11-30 04:30:51.387915] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18c3410 (9): Bad file descriptor 00:29:00.760 [2024-11-30 04:30:51.387936] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:00.760 [2024-11-30 04:30:51.387950] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:00.760 [2024-11-30 04:30:51.387973] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:00.760 [2024-11-30 04:30:51.387994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:01.018 [2024-11-30 04:30:51.397632] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:01.018 [2024-11-30 04:30:51.397757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:01.018 [2024-11-30 04:30:51.397865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:01.018 [2024-11-30 04:30:51.397900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x18c3410 with addr=10.0.0.2, port=4420 00:29:01.018 [2024-11-30 04:30:51.397919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x18c3410 is same with the state(5) to be set 00:29:01.018 [2024-11-30 04:30:51.397944] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x18c3410 (9): Bad file descriptor 00:29:01.018 [2024-11-30 04:30:51.397977] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:01.018 [2024-11-30 04:30:51.398009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:01.018 [2024-11-30 04:30:51.398023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:01.018 [2024-11-30 04:30:51.398042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:01.018 [2024-11-30 04:30:51.404459] bdev_nvme.c:6546:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 not found 00:29:01.018 [2024-11-30 04:30:51.404493] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:01.951 04:30:52 -- host/discovery.sh@128 -- # get_subsystem_names 00:29:01.951 04:30:52 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:01.951 04:30:52 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:01.951 04:30:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.951 04:30:52 -- host/discovery.sh@59 -- # sort 00:29:01.951 04:30:52 -- common/autotest_common.sh@10 -- # set +x 00:29:01.951 04:30:52 -- host/discovery.sh@59 -- # xargs 00:29:01.951 04:30:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.951 04:30:52 -- host/discovery.sh@128 -- # [[ nvme0 == \n\v\m\e\0 ]] 00:29:01.951 04:30:52 -- host/discovery.sh@129 -- # get_bdev_list 00:29:01.951 04:30:52 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:01.951 04:30:52 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:01.951 04:30:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.951 04:30:52 -- common/autotest_common.sh@10 -- # set +x 00:29:01.951 04:30:52 -- host/discovery.sh@55 -- # sort 00:29:01.951 04:30:52 -- host/discovery.sh@55 -- # xargs 00:29:01.951 04:30:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.951 04:30:52 -- host/discovery.sh@129 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:01.951 04:30:52 -- host/discovery.sh@130 -- # get_subsystem_paths nvme0 00:29:01.951 04:30:52 -- host/discovery.sh@63 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers -n nvme0 00:29:01.951 04:30:52 -- host/discovery.sh@63 -- # jq -r '.[].ctrlrs[].trid.trsvcid' 00:29:01.951 04:30:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.951 04:30:52 -- common/autotest_common.sh@10 -- # set +x 00:29:01.951 04:30:52 -- host/discovery.sh@63 -- # sort -n 00:29:01.951 04:30:52 -- host/discovery.sh@63 -- # xargs 00:29:01.951 04:30:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.951 04:30:52 -- host/discovery.sh@130 -- # [[ 4421 == \4\4\2\1 ]] 00:29:01.951 04:30:52 -- host/discovery.sh@131 -- # get_notification_count 00:29:01.951 04:30:52 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:01.951 04:30:52 -- host/discovery.sh@74 -- # jq '. | length' 00:29:01.951 04:30:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.951 04:30:52 -- common/autotest_common.sh@10 -- # set +x 00:29:01.951 04:30:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.951 04:30:52 -- host/discovery.sh@74 -- # notification_count=0 00:29:01.951 04:30:52 -- host/discovery.sh@75 -- # notify_id=2 00:29:01.951 04:30:52 -- host/discovery.sh@132 -- # [[ 0 == 0 ]] 00:29:01.951 04:30:52 -- host/discovery.sh@134 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_stop_discovery -b nvme 00:29:01.951 04:30:52 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:01.951 04:30:52 -- common/autotest_common.sh@10 -- # set +x 00:29:01.951 04:30:52 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:01.951 04:30:52 -- host/discovery.sh@135 -- # sleep 1 00:29:02.884 04:30:53 -- host/discovery.sh@136 -- # get_subsystem_names 00:29:02.884 04:30:53 -- host/discovery.sh@59 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_controllers 00:29:02.884 04:30:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:02.884 04:30:53 -- host/discovery.sh@59 -- # jq -r '.[].name' 00:29:02.884 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:29:02.884 04:30:53 -- host/discovery.sh@59 -- # sort 00:29:02.884 04:30:53 -- host/discovery.sh@59 -- # xargs 00:29:03.142 04:30:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.142 04:30:53 -- host/discovery.sh@136 -- # [[ '' == '' ]] 00:29:03.142 04:30:53 -- host/discovery.sh@137 -- # get_bdev_list 00:29:03.142 04:30:53 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:03.142 04:30:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.142 04:30:53 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:03.142 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:29:03.142 04:30:53 -- host/discovery.sh@55 -- # sort 00:29:03.142 04:30:53 -- host/discovery.sh@55 -- # xargs 00:29:03.142 04:30:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.142 04:30:53 -- host/discovery.sh@137 -- # [[ '' == '' ]] 00:29:03.142 04:30:53 -- host/discovery.sh@138 -- # get_notification_count 00:29:03.142 04:30:53 -- host/discovery.sh@74 -- # rpc_cmd -s /tmp/host.sock notify_get_notifications -i 2 00:29:03.142 04:30:53 -- host/discovery.sh@74 -- # jq '. | length' 00:29:03.142 04:30:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.142 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:29:03.142 04:30:53 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:03.142 04:30:53 -- host/discovery.sh@74 -- # notification_count=2 00:29:03.142 04:30:53 -- host/discovery.sh@75 -- # notify_id=4 00:29:03.142 04:30:53 -- host/discovery.sh@139 -- # [[ 2 == 2 ]] 00:29:03.142 04:30:53 -- host/discovery.sh@142 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:03.142 04:30:53 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:03.142 04:30:53 -- common/autotest_common.sh@10 -- # set +x 00:29:04.076 [2024-11-30 04:30:54.686535] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:04.076 [2024-11-30 04:30:54.686564] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:04.076 [2024-11-30 04:30:54.686589] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:04.334 [2024-11-30 04:30:54.772870] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 new subsystem nvme0 00:29:04.334 [2024-11-30 04:30:54.880151] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:04.334 [2024-11-30 04:30:54.880184] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4421 found again 00:29:04.334 04:30:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.334 04:30:54 -- host/discovery.sh@144 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:04.334 04:30:54 -- common/autotest_common.sh@650 -- # local es=0 00:29:04.334 04:30:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:04.334 04:30:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:04.334 04:30:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:04.334 04:30:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:04.334 04:30:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:04.334 04:30:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:04.334 04:30:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.334 04:30:54 -- common/autotest_common.sh@10 -- # set +x 00:29:04.334 request: 00:29:04.334 { 00:29:04.334 "name": "nvme", 00:29:04.334 "trtype": "tcp", 00:29:04.334 "traddr": "10.0.0.2", 00:29:04.334 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:04.334 "adrfam": "ipv4", 00:29:04.334 "trsvcid": "8009", 00:29:04.334 "wait_for_attach": true, 00:29:04.334 "method": "bdev_nvme_start_discovery", 00:29:04.334 "req_id": 1 00:29:04.334 } 00:29:04.334 Got JSON-RPC error response 00:29:04.334 response: 00:29:04.334 { 00:29:04.334 "code": -17, 00:29:04.334 "message": "File exists" 00:29:04.334 } 00:29:04.334 04:30:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:04.334 04:30:54 -- common/autotest_common.sh@653 -- # es=1 00:29:04.334 04:30:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:04.334 04:30:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:04.334 04:30:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:04.334 04:30:54 -- host/discovery.sh@146 -- # get_discovery_ctrlrs 00:29:04.334 04:30:54 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:04.334 04:30:54 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:04.334 04:30:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.334 04:30:54 -- common/autotest_common.sh@10 -- # set +x 00:29:04.334 04:30:54 -- host/discovery.sh@67 -- # sort 00:29:04.334 04:30:54 -- host/discovery.sh@67 -- # xargs 00:29:04.334 04:30:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.334 04:30:54 -- host/discovery.sh@146 -- # [[ nvme == \n\v\m\e ]] 00:29:04.334 04:30:54 -- host/discovery.sh@147 -- # get_bdev_list 00:29:04.334 04:30:54 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:04.334 04:30:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.334 04:30:54 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:04.334 04:30:54 -- common/autotest_common.sh@10 -- # set +x 00:29:04.334 04:30:54 -- host/discovery.sh@55 -- # sort 00:29:04.334 04:30:54 -- host/discovery.sh@55 -- # xargs 00:29:04.334 04:30:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.593 04:30:54 -- host/discovery.sh@147 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:04.593 04:30:54 -- host/discovery.sh@150 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:04.593 04:30:54 -- common/autotest_common.sh@650 -- # local es=0 00:29:04.593 04:30:54 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:04.593 04:30:54 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:04.593 04:30:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:04.593 04:30:54 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:04.593 04:30:54 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:04.593 04:30:54 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test -w 00:29:04.593 04:30:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.593 04:30:54 -- common/autotest_common.sh@10 -- # set +x 00:29:04.593 request: 00:29:04.593 { 00:29:04.593 "name": "nvme_second", 00:29:04.593 "trtype": "tcp", 00:29:04.593 "traddr": "10.0.0.2", 00:29:04.593 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:04.593 "adrfam": "ipv4", 00:29:04.593 "trsvcid": "8009", 00:29:04.593 "wait_for_attach": true, 00:29:04.593 "method": "bdev_nvme_start_discovery", 00:29:04.593 "req_id": 1 00:29:04.593 } 00:29:04.593 Got JSON-RPC error response 00:29:04.593 response: 00:29:04.593 { 00:29:04.593 "code": -17, 00:29:04.593 "message": "File exists" 00:29:04.593 } 00:29:04.593 04:30:54 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:04.593 04:30:54 -- common/autotest_common.sh@653 -- # es=1 00:29:04.593 04:30:54 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:04.593 04:30:54 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:04.593 04:30:54 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:04.593 04:30:54 -- host/discovery.sh@152 -- # get_discovery_ctrlrs 00:29:04.593 04:30:54 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:04.593 04:30:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.593 04:30:54 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:04.593 04:30:54 -- common/autotest_common.sh@10 -- # set +x 00:29:04.593 04:30:54 -- host/discovery.sh@67 -- # sort 00:29:04.593 04:30:54 -- host/discovery.sh@67 -- # xargs 00:29:04.593 04:30:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.593 04:30:55 -- host/discovery.sh@152 -- # [[ nvme == \n\v\m\e ]] 00:29:04.593 04:30:55 -- host/discovery.sh@153 -- # get_bdev_list 00:29:04.593 04:30:55 -- host/discovery.sh@55 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:04.593 04:30:55 -- host/discovery.sh@55 -- # jq -r '.[].name' 00:29:04.593 04:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.593 04:30:55 -- host/discovery.sh@55 -- # sort 00:29:04.593 04:30:55 -- common/autotest_common.sh@10 -- # set +x 00:29:04.593 04:30:55 -- host/discovery.sh@55 -- # xargs 00:29:04.593 04:30:55 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:04.593 04:30:55 -- host/discovery.sh@153 -- # [[ nvme0n1 nvme0n2 == \n\v\m\e\0\n\1\ \n\v\m\e\0\n\2 ]] 00:29:04.593 04:30:55 -- host/discovery.sh@156 -- # NOT rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:04.593 04:30:55 -- common/autotest_common.sh@650 -- # local es=0 00:29:04.593 04:30:55 -- common/autotest_common.sh@652 -- # valid_exec_arg rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:04.593 04:30:55 -- common/autotest_common.sh@638 -- # local arg=rpc_cmd 00:29:04.593 04:30:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:04.593 04:30:55 -- common/autotest_common.sh@642 -- # type -t rpc_cmd 00:29:04.593 04:30:55 -- common/autotest_common.sh@642 -- # case "$(type -t "$arg")" in 00:29:04.593 04:30:55 -- common/autotest_common.sh@653 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme_second -t tcp -a 10.0.0.2 -s 8010 -f ipv4 -q nqn.2021-12.io.spdk:test -T 3000 00:29:04.593 04:30:55 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:04.593 04:30:55 -- common/autotest_common.sh@10 -- # set +x 00:29:05.525 [2024-11-30 04:30:56.075534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.525 [2024-11-30 04:30:56.075688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:05.525 [2024-11-30 04:30:56.075726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183a2e0 with addr=10.0.0.2, port=8010 00:29:05.525 [2024-11-30 04:30:56.075756] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:05.525 [2024-11-30 04:30:56.075772] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:05.525 [2024-11-30 04:30:56.075785] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:06.459 [2024-11-30 04:30:57.077906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.459 [2024-11-30 04:30:57.078104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:29:06.459 [2024-11-30 04:30:57.078133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x183a2e0 with addr=10.0.0.2, port=8010 00:29:06.459 [2024-11-30 04:30:57.078156] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:29:06.459 [2024-11-30 04:30:57.078170] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:29:06.459 [2024-11-30 04:30:57.078181] bdev_nvme.c:6821:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] could not start discovery connect 00:29:07.833 [2024-11-30 04:30:58.080193] bdev_nvme.c:6802:discovery_poller: *ERROR*: Discovery[10.0.0.2:8010] timed out while attaching discovery ctrlr 00:29:07.833 request: 00:29:07.833 { 00:29:07.833 "name": "nvme_second", 00:29:07.833 "trtype": "tcp", 00:29:07.833 "traddr": "10.0.0.2", 00:29:07.833 "hostnqn": "nqn.2021-12.io.spdk:test", 00:29:07.833 "adrfam": "ipv4", 00:29:07.833 "trsvcid": "8010", 00:29:07.833 "attach_timeout_ms": 3000, 00:29:07.833 "method": "bdev_nvme_start_discovery", 00:29:07.833 "req_id": 1 00:29:07.833 } 00:29:07.833 Got JSON-RPC error response 00:29:07.833 response: 00:29:07.833 { 00:29:07.833 "code": -110, 00:29:07.833 "message": "Connection timed out" 00:29:07.833 } 00:29:07.833 04:30:58 -- common/autotest_common.sh@589 -- # [[ 1 == 0 ]] 00:29:07.833 04:30:58 -- common/autotest_common.sh@653 -- # es=1 00:29:07.833 04:30:58 -- common/autotest_common.sh@661 -- # (( es > 128 )) 00:29:07.833 04:30:58 -- common/autotest_common.sh@672 -- # [[ -n '' ]] 00:29:07.833 04:30:58 -- common/autotest_common.sh@677 -- # (( !es == 0 )) 00:29:07.833 04:30:58 -- host/discovery.sh@158 -- # get_discovery_ctrlrs 00:29:07.833 04:30:58 -- host/discovery.sh@67 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_get_discovery_info 00:29:07.833 04:30:58 -- host/discovery.sh@67 -- # jq -r '.[].name' 00:29:07.833 04:30:58 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:07.833 04:30:58 -- host/discovery.sh@67 -- # sort 00:29:07.833 04:30:58 -- common/autotest_common.sh@10 -- # set +x 00:29:07.833 04:30:58 -- host/discovery.sh@67 -- # xargs 00:29:07.833 04:30:58 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:07.833 04:30:58 -- host/discovery.sh@158 -- # [[ nvme == \n\v\m\e ]] 00:29:07.833 04:30:58 -- host/discovery.sh@160 -- # trap - SIGINT SIGTERM EXIT 00:29:07.833 04:30:58 -- host/discovery.sh@162 -- # kill 2476364 00:29:07.833 04:30:58 -- host/discovery.sh@163 -- # nvmftestfini 00:29:07.833 04:30:58 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:07.833 04:30:58 -- nvmf/common.sh@116 -- # sync 00:29:07.833 04:30:58 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:07.833 04:30:58 -- nvmf/common.sh@119 -- # set +e 00:29:07.833 04:30:58 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:07.833 04:30:58 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:07.833 rmmod nvme_tcp 00:29:07.833 rmmod nvme_fabrics 00:29:07.833 rmmod nvme_keyring 00:29:07.833 04:30:58 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:07.833 04:30:58 -- nvmf/common.sh@123 -- # set -e 00:29:07.833 04:30:58 -- nvmf/common.sh@124 -- # return 0 00:29:07.833 04:30:58 -- nvmf/common.sh@477 -- # '[' -n 2476205 ']' 00:29:07.833 04:30:58 -- nvmf/common.sh@478 -- # killprocess 2476205 00:29:07.833 04:30:58 -- common/autotest_common.sh@936 -- # '[' -z 2476205 ']' 00:29:07.833 04:30:58 -- common/autotest_common.sh@940 -- # kill -0 2476205 00:29:07.833 04:30:58 -- common/autotest_common.sh@941 -- # uname 00:29:07.833 04:30:58 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:07.833 04:30:58 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2476205 00:29:07.833 04:30:58 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:07.833 04:30:58 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:07.833 04:30:58 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2476205' 00:29:07.833 killing process with pid 2476205 00:29:07.833 04:30:58 -- common/autotest_common.sh@955 -- # kill 2476205 00:29:07.833 04:30:58 -- common/autotest_common.sh@960 -- # wait 2476205 00:29:08.091 04:30:58 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:08.091 04:30:58 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:08.091 04:30:58 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:08.091 04:30:58 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:08.091 04:30:58 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:08.091 04:30:58 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:08.091 04:30:58 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:08.091 04:30:58 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:09.996 04:31:00 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:09.996 00:29:09.996 real 0m17.263s 00:29:09.996 user 0m26.918s 00:29:09.996 sys 0m2.798s 00:29:09.996 04:31:00 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:09.996 04:31:00 -- common/autotest_common.sh@10 -- # set +x 00:29:09.996 ************************************ 00:29:09.996 END TEST nvmf_discovery 00:29:09.996 ************************************ 00:29:09.996 04:31:00 -- nvmf/nvmf.sh@102 -- # run_test nvmf_discovery_remove_ifc /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:09.996 04:31:00 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:09.996 04:31:00 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:09.996 04:31:00 -- common/autotest_common.sh@10 -- # set +x 00:29:09.996 ************************************ 00:29:09.996 START TEST nvmf_discovery_remove_ifc 00:29:09.996 ************************************ 00:29:09.996 04:31:00 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/discovery_remove_ifc.sh --transport=tcp 00:29:09.996 * Looking for test storage... 00:29:09.996 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:09.996 04:31:00 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:09.996 04:31:00 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:09.996 04:31:00 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:10.256 04:31:00 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:10.256 04:31:00 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:10.256 04:31:00 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:10.256 04:31:00 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:10.256 04:31:00 -- scripts/common.sh@335 -- # IFS=.-: 00:29:10.256 04:31:00 -- scripts/common.sh@335 -- # read -ra ver1 00:29:10.256 04:31:00 -- scripts/common.sh@336 -- # IFS=.-: 00:29:10.256 04:31:00 -- scripts/common.sh@336 -- # read -ra ver2 00:29:10.256 04:31:00 -- scripts/common.sh@337 -- # local 'op=<' 00:29:10.256 04:31:00 -- scripts/common.sh@339 -- # ver1_l=2 00:29:10.256 04:31:00 -- scripts/common.sh@340 -- # ver2_l=1 00:29:10.256 04:31:00 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:10.256 04:31:00 -- scripts/common.sh@343 -- # case "$op" in 00:29:10.256 04:31:00 -- scripts/common.sh@344 -- # : 1 00:29:10.256 04:31:00 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:10.256 04:31:00 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:10.256 04:31:00 -- scripts/common.sh@364 -- # decimal 1 00:29:10.256 04:31:00 -- scripts/common.sh@352 -- # local d=1 00:29:10.256 04:31:00 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:10.256 04:31:00 -- scripts/common.sh@354 -- # echo 1 00:29:10.256 04:31:00 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:10.256 04:31:00 -- scripts/common.sh@365 -- # decimal 2 00:29:10.256 04:31:00 -- scripts/common.sh@352 -- # local d=2 00:29:10.256 04:31:00 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:10.256 04:31:00 -- scripts/common.sh@354 -- # echo 2 00:29:10.256 04:31:00 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:10.256 04:31:00 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:10.256 04:31:00 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:10.256 04:31:00 -- scripts/common.sh@367 -- # return 0 00:29:10.256 04:31:00 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:10.256 04:31:00 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:10.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:10.256 --rc genhtml_branch_coverage=1 00:29:10.256 --rc genhtml_function_coverage=1 00:29:10.256 --rc genhtml_legend=1 00:29:10.256 --rc geninfo_all_blocks=1 00:29:10.256 --rc geninfo_unexecuted_blocks=1 00:29:10.256 00:29:10.256 ' 00:29:10.256 04:31:00 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:10.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:10.256 --rc genhtml_branch_coverage=1 00:29:10.256 --rc genhtml_function_coverage=1 00:29:10.256 --rc genhtml_legend=1 00:29:10.256 --rc geninfo_all_blocks=1 00:29:10.256 --rc geninfo_unexecuted_blocks=1 00:29:10.256 00:29:10.256 ' 00:29:10.256 04:31:00 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:10.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:10.256 --rc genhtml_branch_coverage=1 00:29:10.256 --rc genhtml_function_coverage=1 00:29:10.256 --rc genhtml_legend=1 00:29:10.256 --rc geninfo_all_blocks=1 00:29:10.256 --rc geninfo_unexecuted_blocks=1 00:29:10.256 00:29:10.256 ' 00:29:10.256 04:31:00 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:10.256 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:10.256 --rc genhtml_branch_coverage=1 00:29:10.256 --rc genhtml_function_coverage=1 00:29:10.256 --rc genhtml_legend=1 00:29:10.256 --rc geninfo_all_blocks=1 00:29:10.256 --rc geninfo_unexecuted_blocks=1 00:29:10.256 00:29:10.256 ' 00:29:10.256 04:31:00 -- host/discovery_remove_ifc.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:10.256 04:31:00 -- nvmf/common.sh@7 -- # uname -s 00:29:10.256 04:31:00 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:10.256 04:31:00 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:10.256 04:31:00 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:10.256 04:31:00 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:10.256 04:31:00 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:10.256 04:31:00 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:10.256 04:31:00 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:10.256 04:31:00 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:10.256 04:31:00 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:10.256 04:31:00 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:10.256 04:31:00 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:10.256 04:31:00 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:10.256 04:31:00 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:10.256 04:31:00 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:10.256 04:31:00 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:10.256 04:31:00 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:10.256 04:31:00 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:10.256 04:31:00 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:10.256 04:31:00 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:10.256 04:31:00 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:10.256 04:31:00 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:10.256 04:31:00 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:10.256 04:31:00 -- paths/export.sh@5 -- # export PATH 00:29:10.256 04:31:00 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:10.256 04:31:00 -- nvmf/common.sh@46 -- # : 0 00:29:10.256 04:31:00 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:10.256 04:31:00 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:10.256 04:31:00 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:10.256 04:31:00 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:10.256 04:31:00 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:10.256 04:31:00 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:10.256 04:31:00 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:10.256 04:31:00 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:10.256 04:31:00 -- host/discovery_remove_ifc.sh@14 -- # '[' tcp == rdma ']' 00:29:10.256 04:31:00 -- host/discovery_remove_ifc.sh@19 -- # discovery_port=8009 00:29:10.256 04:31:00 -- host/discovery_remove_ifc.sh@20 -- # discovery_nqn=nqn.2014-08.org.nvmexpress.discovery 00:29:10.256 04:31:00 -- host/discovery_remove_ifc.sh@23 -- # nqn=nqn.2016-06.io.spdk:cnode 00:29:10.256 04:31:00 -- host/discovery_remove_ifc.sh@25 -- # host_nqn=nqn.2021-12.io.spdk:test 00:29:10.256 04:31:00 -- host/discovery_remove_ifc.sh@26 -- # host_sock=/tmp/host.sock 00:29:10.256 04:31:00 -- host/discovery_remove_ifc.sh@39 -- # nvmftestinit 00:29:10.256 04:31:00 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:10.256 04:31:00 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:10.256 04:31:00 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:10.256 04:31:00 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:10.256 04:31:00 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:10.256 04:31:00 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:10.256 04:31:00 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:10.256 04:31:00 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:10.256 04:31:00 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:10.256 04:31:00 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:10.256 04:31:00 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:10.256 04:31:00 -- common/autotest_common.sh@10 -- # set +x 00:29:12.159 04:31:02 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:12.159 04:31:02 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:12.159 04:31:02 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:12.159 04:31:02 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:12.159 04:31:02 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:12.159 04:31:02 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:12.159 04:31:02 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:12.159 04:31:02 -- nvmf/common.sh@294 -- # net_devs=() 00:29:12.159 04:31:02 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:12.159 04:31:02 -- nvmf/common.sh@295 -- # e810=() 00:29:12.159 04:31:02 -- nvmf/common.sh@295 -- # local -ga e810 00:29:12.159 04:31:02 -- nvmf/common.sh@296 -- # x722=() 00:29:12.159 04:31:02 -- nvmf/common.sh@296 -- # local -ga x722 00:29:12.159 04:31:02 -- nvmf/common.sh@297 -- # mlx=() 00:29:12.159 04:31:02 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:12.159 04:31:02 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:12.159 04:31:02 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:12.159 04:31:02 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:12.159 04:31:02 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:12.159 04:31:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:12.159 04:31:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:12.159 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:12.159 04:31:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:12.159 04:31:02 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:12.159 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:12.159 04:31:02 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:12.159 04:31:02 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:12.159 04:31:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:12.159 04:31:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:12.159 04:31:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:12.159 04:31:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:12.159 04:31:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:12.159 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:12.159 04:31:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:12.159 04:31:02 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:12.159 04:31:02 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:12.159 04:31:02 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:12.159 04:31:02 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:12.159 04:31:02 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:12.159 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:12.159 04:31:02 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:12.159 04:31:02 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:12.159 04:31:02 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:12.159 04:31:02 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:12.160 04:31:02 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:12.160 04:31:02 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:12.160 04:31:02 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:12.160 04:31:02 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:12.160 04:31:02 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:12.160 04:31:02 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:12.160 04:31:02 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:12.160 04:31:02 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:12.160 04:31:02 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:12.160 04:31:02 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:12.160 04:31:02 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:12.160 04:31:02 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:12.160 04:31:02 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:12.160 04:31:02 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:12.160 04:31:02 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:12.160 04:31:02 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:12.160 04:31:02 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:12.160 04:31:02 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:12.160 04:31:02 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:12.160 04:31:02 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:12.160 04:31:02 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:12.160 04:31:02 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:12.160 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:12.160 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.296 ms 00:29:12.160 00:29:12.160 --- 10.0.0.2 ping statistics --- 00:29:12.160 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:12.160 rtt min/avg/max/mdev = 0.296/0.296/0.296/0.000 ms 00:29:12.160 04:31:02 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:12.160 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:12.160 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.048 ms 00:29:12.160 00:29:12.160 --- 10.0.0.1 ping statistics --- 00:29:12.160 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:12.160 rtt min/avg/max/mdev = 0.048/0.048/0.048/0.000 ms 00:29:12.160 04:31:02 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:12.160 04:31:02 -- nvmf/common.sh@410 -- # return 0 00:29:12.160 04:31:02 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:12.160 04:31:02 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:12.160 04:31:02 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:12.160 04:31:02 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:12.160 04:31:02 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:12.160 04:31:02 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:12.160 04:31:02 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:12.160 04:31:02 -- host/discovery_remove_ifc.sh@40 -- # nvmfappstart -m 0x2 00:29:12.160 04:31:02 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:12.160 04:31:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:12.160 04:31:02 -- common/autotest_common.sh@10 -- # set +x 00:29:12.160 04:31:02 -- nvmf/common.sh@469 -- # nvmfpid=2479837 00:29:12.160 04:31:02 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0x2 00:29:12.160 04:31:02 -- nvmf/common.sh@470 -- # waitforlisten 2479837 00:29:12.160 04:31:02 -- common/autotest_common.sh@829 -- # '[' -z 2479837 ']' 00:29:12.160 04:31:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:12.160 04:31:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:12.160 04:31:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:12.160 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:12.160 04:31:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:12.160 04:31:02 -- common/autotest_common.sh@10 -- # set +x 00:29:12.418 [2024-11-30 04:31:02.790664] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:12.418 [2024-11-30 04:31:02.790751] [ DPDK EAL parameters: nvmf -c 0x2 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:12.418 EAL: No free 2048 kB hugepages reported on node 1 00:29:12.418 [2024-11-30 04:31:02.852963] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:12.418 [2024-11-30 04:31:02.935258] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:12.418 [2024-11-30 04:31:02.935420] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:12.418 [2024-11-30 04:31:02.935437] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:12.418 [2024-11-30 04:31:02.935449] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:12.418 [2024-11-30 04:31:02.935488] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:13.350 04:31:03 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:13.350 04:31:03 -- common/autotest_common.sh@862 -- # return 0 00:29:13.350 04:31:03 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:13.350 04:31:03 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:13.350 04:31:03 -- common/autotest_common.sh@10 -- # set +x 00:29:13.350 04:31:03 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:13.350 04:31:03 -- host/discovery_remove_ifc.sh@43 -- # rpc_cmd 00:29:13.350 04:31:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.350 04:31:03 -- common/autotest_common.sh@10 -- # set +x 00:29:13.350 [2024-11-30 04:31:03.801556] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:13.350 [2024-11-30 04:31:03.809738] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 8009 *** 00:29:13.350 null0 00:29:13.350 [2024-11-30 04:31:03.841683] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:13.350 04:31:03 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.350 04:31:03 -- host/discovery_remove_ifc.sh@59 -- # hostpid=2479990 00:29:13.350 04:31:03 -- host/discovery_remove_ifc.sh@58 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x1 -r /tmp/host.sock --wait-for-rpc -L bdev_nvme 00:29:13.350 04:31:03 -- host/discovery_remove_ifc.sh@60 -- # waitforlisten 2479990 /tmp/host.sock 00:29:13.350 04:31:03 -- common/autotest_common.sh@829 -- # '[' -z 2479990 ']' 00:29:13.350 04:31:03 -- common/autotest_common.sh@833 -- # local rpc_addr=/tmp/host.sock 00:29:13.350 04:31:03 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:13.350 04:31:03 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock...' 00:29:13.350 Waiting for process to start up and listen on UNIX domain socket /tmp/host.sock... 00:29:13.350 04:31:03 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:13.350 04:31:03 -- common/autotest_common.sh@10 -- # set +x 00:29:13.350 [2024-11-30 04:31:03.904219] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:13.350 [2024-11-30 04:31:03.904298] [ DPDK EAL parameters: nvmf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2479990 ] 00:29:13.350 EAL: No free 2048 kB hugepages reported on node 1 00:29:13.350 [2024-11-30 04:31:03.966071] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:13.609 [2024-11-30 04:31:04.056898] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:13.609 [2024-11-30 04:31:04.057094] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:13.609 04:31:04 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:13.609 04:31:04 -- common/autotest_common.sh@862 -- # return 0 00:29:13.609 04:31:04 -- host/discovery_remove_ifc.sh@62 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; killprocess $hostpid; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:29:13.609 04:31:04 -- host/discovery_remove_ifc.sh@65 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_set_options -e 1 00:29:13.609 04:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.609 04:31:04 -- common/autotest_common.sh@10 -- # set +x 00:29:13.609 04:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.609 04:31:04 -- host/discovery_remove_ifc.sh@66 -- # rpc_cmd -s /tmp/host.sock framework_start_init 00:29:13.609 04:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.609 04:31:04 -- common/autotest_common.sh@10 -- # set +x 00:29:13.898 04:31:04 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:13.898 04:31:04 -- host/discovery_remove_ifc.sh@69 -- # rpc_cmd -s /tmp/host.sock bdev_nvme_start_discovery -b nvme -t tcp -a 10.0.0.2 -s 8009 -f ipv4 -q nqn.2021-12.io.spdk:test --ctrlr-loss-timeout-sec 2 --reconnect-delay-sec 1 --fast-io-fail-timeout-sec 1 --wait-for-attach 00:29:13.898 04:31:04 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:13.898 04:31:04 -- common/autotest_common.sh@10 -- # set +x 00:29:14.832 [2024-11-30 04:31:05.309645] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:14.832 [2024-11-30 04:31:05.309688] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:14.832 [2024-11-30 04:31:05.309718] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:14.832 [2024-11-30 04:31:05.438177] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme0 00:29:15.108 [2024-11-30 04:31:05.539985] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:15.108 [2024-11-30 04:31:05.540054] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:15.108 [2024-11-30 04:31:05.540093] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:15.108 [2024-11-30 04:31:05.540116] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme0 done 00:29:15.108 [2024-11-30 04:31:05.540149] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:15.108 04:31:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.108 04:31:05 -- host/discovery_remove_ifc.sh@72 -- # wait_for_bdev nvme0n1 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:15.109 04:31:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.109 04:31:05 -- common/autotest_common.sh@10 -- # set +x 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:15.109 [2024-11-30 04:31:05.547790] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x137cc50 was disconnected and freed. delete nvme_qpair. 00:29:15.109 04:31:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != \n\v\m\e\0\n\1 ]] 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@75 -- # ip netns exec cvl_0_0_ns_spdk ip addr del 10.0.0.2/24 dev cvl_0_0 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@76 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 down 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@79 -- # wait_for_bdev '' 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:15.109 04:31:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:15.109 04:31:05 -- common/autotest_common.sh@10 -- # set +x 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:15.109 04:31:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:15.109 04:31:05 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:16.083 04:31:06 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:16.083 04:31:06 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:16.083 04:31:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:16.083 04:31:06 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:16.083 04:31:06 -- common/autotest_common.sh@10 -- # set +x 00:29:16.083 04:31:06 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:16.083 04:31:06 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:16.083 04:31:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:16.341 04:31:06 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:16.341 04:31:06 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:17.275 04:31:07 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:17.275 04:31:07 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:17.275 04:31:07 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:17.275 04:31:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:17.275 04:31:07 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:17.275 04:31:07 -- common/autotest_common.sh@10 -- # set +x 00:29:17.275 04:31:07 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:17.275 04:31:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:17.275 04:31:07 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:17.275 04:31:07 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:18.209 04:31:08 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:18.209 04:31:08 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:18.209 04:31:08 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:18.209 04:31:08 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:18.209 04:31:08 -- common/autotest_common.sh@10 -- # set +x 00:29:18.209 04:31:08 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:18.209 04:31:08 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:18.209 04:31:08 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:18.209 04:31:08 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:18.209 04:31:08 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:19.584 04:31:09 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:19.584 04:31:09 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:19.584 04:31:09 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:19.584 04:31:09 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:19.584 04:31:09 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:19.584 04:31:09 -- common/autotest_common.sh@10 -- # set +x 00:29:19.584 04:31:09 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:19.584 04:31:09 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:19.584 04:31:09 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:19.584 04:31:09 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:20.519 04:31:10 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:20.519 04:31:10 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:20.519 04:31:10 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:20.519 04:31:10 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:20.520 04:31:10 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:20.520 04:31:10 -- common/autotest_common.sh@10 -- # set +x 00:29:20.520 04:31:10 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:20.520 04:31:10 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:20.520 04:31:10 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:20.520 04:31:10 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:20.520 [2024-11-30 04:31:10.980983] /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/include/spdk_internal/nvme_tcp.h: 428:nvme_tcp_read_data: *ERROR*: spdk_sock_recv() failed, errno 110: Connection timed out 00:29:20.520 [2024-11-30 04:31:10.981058] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:20.520 [2024-11-30 04:31:10.981079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:20.520 [2024-11-30 04:31:10.981096] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:20.520 [2024-11-30 04:31:10.981109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:20.520 [2024-11-30 04:31:10.981123] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:20.520 [2024-11-30 04:31:10.981137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:20.520 [2024-11-30 04:31:10.981150] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:20.520 [2024-11-30 04:31:10.981163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:20.520 [2024-11-30 04:31:10.981176] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:20.520 [2024-11-30 04:31:10.981190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:20.520 [2024-11-30 04:31:10.981203] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13430b0 is same with the state(5) to be set 00:29:20.520 [2024-11-30 04:31:10.991001] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13430b0 (9): Bad file descriptor 00:29:20.520 [2024-11-30 04:31:11.001054] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] resetting controller 00:29:21.454 04:31:11 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:21.454 04:31:11 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:21.454 04:31:11 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:21.454 04:31:11 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:21.454 04:31:11 -- common/autotest_common.sh@10 -- # set +x 00:29:21.454 04:31:11 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:21.454 04:31:11 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:21.454 [2024-11-30 04:31:12.038993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:22.827 [2024-11-30 04:31:13.063151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 110 00:29:22.827 [2024-11-30 04:31:13.063217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x13430b0 with addr=10.0.0.2, port=4420 00:29:22.827 [2024-11-30 04:31:13.063244] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x13430b0 is same with the state(5) to be set 00:29:22.827 [2024-11-30 04:31:13.063282] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode0] in failed state. 00:29:22.827 [2024-11-30 04:31:13.063299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode0] Ctrlr is in error state 00:29:22.827 [2024-11-30 04:31:13.063314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode0] controller reinitialization failed 00:29:22.827 [2024-11-30 04:31:13.063330] nvme_ctrlr.c:1017:nvme_ctrlr_fail: *NOTICE*: [nqn.2016-06.io.spdk:cnode0] already in failed state 00:29:22.827 [2024-11-30 04:31:13.063758] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13430b0 (9): Bad file descriptor 00:29:22.827 [2024-11-30 04:31:13.063806] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:29:22.827 [2024-11-30 04:31:13.063854] bdev_nvme.c:6510:remove_discovery_entry: *INFO*: Discovery[10.0.0.2:8009] Remove discovery entry: nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 00:29:22.827 [2024-11-30 04:31:13.063895] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:0 nsid:0 cdw10:00000000 cdw11:00000000 00:29:22.827 [2024-11-30 04:31:13.063917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:22.828 [2024-11-30 04:31:13.063937] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:1 nsid:0 cdw10:00000000 cdw11:00000000 00:29:22.828 [2024-11-30 04:31:13.063952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:22.828 [2024-11-30 04:31:13.063990] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:2 nsid:0 cdw10:00000000 cdw11:00000000 00:29:22.828 [2024-11-30 04:31:13.064022] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:22.828 [2024-11-30 04:31:13.064037] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: ASYNC EVENT REQUEST (0c) qid:0 cid:3 nsid:0 cdw10:00000000 cdw11:00000000 00:29:22.828 [2024-11-30 04:31:13.064051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:22.828 [2024-11-30 04:31:13.064065] nvme_qpair.c: 223:nvme_admin_qpair_print_command: *NOTICE*: KEEP ALIVE (18) qid:0 cid:4 nsid:0 cdw10:00000000 cdw11:00000000 00:29:22.828 [2024-11-30 04:31:13.064078] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:0 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:29:22.828 [2024-11-30 04:31:13.064091] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] in failed state. 00:29:22.828 [2024-11-30 04:31:13.064282] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x13434c0 (9): Bad file descriptor 00:29:22.828 [2024-11-30 04:31:13.065304] nvme_fabric.c: 214:nvme_fabric_prop_get_cmd_async: *ERROR*: Failed to send Property Get fabrics command 00:29:22.828 [2024-11-30 04:31:13.065330] nvme_ctrlr.c:1136:nvme_ctrlr_shutdown_async: *ERROR*: [nqn.2014-08.org.nvmexpress.discovery] Failed to read the CC register 00:29:22.828 04:31:13 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:22.828 04:31:13 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme0n1 != '' ]] 00:29:22.828 04:31:13 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:23.762 04:31:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.762 04:31:14 -- common/autotest_common.sh@10 -- # set +x 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:23.762 04:31:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != '' ]] 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@82 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@83 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@86 -- # wait_for_bdev nvme1n1 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:23.762 04:31:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:23.762 04:31:14 -- common/autotest_common.sh@10 -- # set +x 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:23.762 04:31:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:23.762 04:31:14 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:24.695 [2024-11-30 04:31:15.116103] bdev_nvme.c:6759:discovery_attach_cb: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr attached 00:29:24.695 [2024-11-30 04:31:15.116126] bdev_nvme.c:6839:discovery_poller: *INFO*: Discovery[10.0.0.2:8009] discovery ctrlr connected 00:29:24.695 [2024-11-30 04:31:15.116149] bdev_nvme.c:6722:get_discovery_log_page: *INFO*: Discovery[10.0.0.2:8009] sent discovery log page command 00:29:24.695 [2024-11-30 04:31:15.202431] bdev_nvme.c:6688:discovery_log_page_cb: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 new subsystem nvme1 00:29:24.695 04:31:15 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:24.695 04:31:15 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:24.695 04:31:15 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:24.695 04:31:15 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:24.695 04:31:15 -- common/autotest_common.sh@10 -- # set +x 00:29:24.695 04:31:15 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:24.695 04:31:15 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:24.695 04:31:15 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:24.695 [2024-11-30 04:31:15.307351] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 8 blocks with offset 0 00:29:24.695 [2024-11-30 04:31:15.307416] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 1 blocks with offset 0 00:29:24.695 [2024-11-30 04:31:15.307452] bdev_nvme.c:7548:bdev_nvme_readv: *DEBUG*: read 64 blocks with offset 0 00:29:24.695 [2024-11-30 04:31:15.307477] bdev_nvme.c:6578:discovery_attach_controller_done: *INFO*: Discovery[10.0.0.2:8009] attach nvme1 done 00:29:24.695 [2024-11-30 04:31:15.307493] bdev_nvme.c:6537:discovery_remove_controllers: *INFO*: Discovery[10.0.0.2:8009] NVM nqn.2016-06.io.spdk:cnode0:10.0.0.2:4420 found again 00:29:24.695 [2024-11-30 04:31:15.313917] bdev_nvme.c:1595:bdev_nvme_disconnected_qpair_cb: *DEBUG*: qpair 0x1351ac0 was disconnected and freed. delete nvme_qpair. 00:29:24.695 04:31:15 -- host/discovery_remove_ifc.sh@33 -- # [[ '' != \n\v\m\e\1\n\1 ]] 00:29:24.695 04:31:15 -- host/discovery_remove_ifc.sh@34 -- # sleep 1 00:29:26.068 04:31:16 -- host/discovery_remove_ifc.sh@33 -- # get_bdev_list 00:29:26.068 04:31:16 -- host/discovery_remove_ifc.sh@29 -- # rpc_cmd -s /tmp/host.sock bdev_get_bdevs 00:29:26.068 04:31:16 -- host/discovery_remove_ifc.sh@29 -- # jq -r '.[].name' 00:29:26.068 04:31:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:26.069 04:31:16 -- host/discovery_remove_ifc.sh@29 -- # sort 00:29:26.069 04:31:16 -- common/autotest_common.sh@10 -- # set +x 00:29:26.069 04:31:16 -- host/discovery_remove_ifc.sh@29 -- # xargs 00:29:26.069 04:31:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:26.069 04:31:16 -- host/discovery_remove_ifc.sh@33 -- # [[ nvme1n1 != \n\v\m\e\1\n\1 ]] 00:29:26.069 04:31:16 -- host/discovery_remove_ifc.sh@88 -- # trap - SIGINT SIGTERM EXIT 00:29:26.069 04:31:16 -- host/discovery_remove_ifc.sh@90 -- # killprocess 2479990 00:29:26.069 04:31:16 -- common/autotest_common.sh@936 -- # '[' -z 2479990 ']' 00:29:26.069 04:31:16 -- common/autotest_common.sh@940 -- # kill -0 2479990 00:29:26.069 04:31:16 -- common/autotest_common.sh@941 -- # uname 00:29:26.069 04:31:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:26.069 04:31:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2479990 00:29:26.069 04:31:16 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:26.069 04:31:16 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:26.069 04:31:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2479990' 00:29:26.069 killing process with pid 2479990 00:29:26.069 04:31:16 -- common/autotest_common.sh@955 -- # kill 2479990 00:29:26.069 04:31:16 -- common/autotest_common.sh@960 -- # wait 2479990 00:29:26.069 04:31:16 -- host/discovery_remove_ifc.sh@91 -- # nvmftestfini 00:29:26.069 04:31:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:29:26.069 04:31:16 -- nvmf/common.sh@116 -- # sync 00:29:26.069 04:31:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:29:26.069 04:31:16 -- nvmf/common.sh@119 -- # set +e 00:29:26.069 04:31:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:29:26.069 04:31:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:29:26.069 rmmod nvme_tcp 00:29:26.069 rmmod nvme_fabrics 00:29:26.069 rmmod nvme_keyring 00:29:26.069 04:31:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:29:26.069 04:31:16 -- nvmf/common.sh@123 -- # set -e 00:29:26.069 04:31:16 -- nvmf/common.sh@124 -- # return 0 00:29:26.069 04:31:16 -- nvmf/common.sh@477 -- # '[' -n 2479837 ']' 00:29:26.069 04:31:16 -- nvmf/common.sh@478 -- # killprocess 2479837 00:29:26.069 04:31:16 -- common/autotest_common.sh@936 -- # '[' -z 2479837 ']' 00:29:26.069 04:31:16 -- common/autotest_common.sh@940 -- # kill -0 2479837 00:29:26.069 04:31:16 -- common/autotest_common.sh@941 -- # uname 00:29:26.069 04:31:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:26.069 04:31:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2479837 00:29:26.328 04:31:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:26.328 04:31:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:26.328 04:31:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2479837' 00:29:26.328 killing process with pid 2479837 00:29:26.328 04:31:16 -- common/autotest_common.sh@955 -- # kill 2479837 00:29:26.328 04:31:16 -- common/autotest_common.sh@960 -- # wait 2479837 00:29:26.328 04:31:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:29:26.328 04:31:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:29:26.328 04:31:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:29:26.328 04:31:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:29:26.328 04:31:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:29:26.328 04:31:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:26.328 04:31:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:26.328 04:31:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:28.858 04:31:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:29:28.859 00:29:28.859 real 0m18.447s 00:29:28.859 user 0m25.805s 00:29:28.859 sys 0m2.875s 00:29:28.859 04:31:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:28.859 04:31:18 -- common/autotest_common.sh@10 -- # set +x 00:29:28.859 ************************************ 00:29:28.859 END TEST nvmf_discovery_remove_ifc 00:29:28.859 ************************************ 00:29:28.859 04:31:19 -- nvmf/nvmf.sh@106 -- # [[ tcp == \t\c\p ]] 00:29:28.859 04:31:19 -- nvmf/nvmf.sh@107 -- # run_test nvmf_digest /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:28.859 04:31:19 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:29:28.859 04:31:19 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:28.859 04:31:19 -- common/autotest_common.sh@10 -- # set +x 00:29:28.859 ************************************ 00:29:28.859 START TEST nvmf_digest 00:29:28.859 ************************************ 00:29:28.859 04:31:19 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/digest.sh --transport=tcp 00:29:28.859 * Looking for test storage... 00:29:28.859 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:29:28.859 04:31:19 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:29:28.859 04:31:19 -- common/autotest_common.sh@1690 -- # lcov --version 00:29:28.859 04:31:19 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:29:28.859 04:31:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:29:28.859 04:31:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:29:28.859 04:31:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:29:28.859 04:31:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:29:28.859 04:31:19 -- scripts/common.sh@335 -- # IFS=.-: 00:29:28.859 04:31:19 -- scripts/common.sh@335 -- # read -ra ver1 00:29:28.859 04:31:19 -- scripts/common.sh@336 -- # IFS=.-: 00:29:28.859 04:31:19 -- scripts/common.sh@336 -- # read -ra ver2 00:29:28.859 04:31:19 -- scripts/common.sh@337 -- # local 'op=<' 00:29:28.859 04:31:19 -- scripts/common.sh@339 -- # ver1_l=2 00:29:28.859 04:31:19 -- scripts/common.sh@340 -- # ver2_l=1 00:29:28.859 04:31:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:29:28.859 04:31:19 -- scripts/common.sh@343 -- # case "$op" in 00:29:28.859 04:31:19 -- scripts/common.sh@344 -- # : 1 00:29:28.859 04:31:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:29:28.859 04:31:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:29:28.859 04:31:19 -- scripts/common.sh@364 -- # decimal 1 00:29:28.859 04:31:19 -- scripts/common.sh@352 -- # local d=1 00:29:28.859 04:31:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:29:28.859 04:31:19 -- scripts/common.sh@354 -- # echo 1 00:29:28.859 04:31:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:29:28.859 04:31:19 -- scripts/common.sh@365 -- # decimal 2 00:29:28.859 04:31:19 -- scripts/common.sh@352 -- # local d=2 00:29:28.859 04:31:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:29:28.859 04:31:19 -- scripts/common.sh@354 -- # echo 2 00:29:28.859 04:31:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:29:28.859 04:31:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:29:28.859 04:31:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:29:28.859 04:31:19 -- scripts/common.sh@367 -- # return 0 00:29:28.859 04:31:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:29:28.859 04:31:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:29:28.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:28.859 --rc genhtml_branch_coverage=1 00:29:28.859 --rc genhtml_function_coverage=1 00:29:28.859 --rc genhtml_legend=1 00:29:28.859 --rc geninfo_all_blocks=1 00:29:28.859 --rc geninfo_unexecuted_blocks=1 00:29:28.859 00:29:28.859 ' 00:29:28.859 04:31:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:29:28.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:28.859 --rc genhtml_branch_coverage=1 00:29:28.859 --rc genhtml_function_coverage=1 00:29:28.859 --rc genhtml_legend=1 00:29:28.859 --rc geninfo_all_blocks=1 00:29:28.859 --rc geninfo_unexecuted_blocks=1 00:29:28.859 00:29:28.859 ' 00:29:28.859 04:31:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:29:28.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:28.859 --rc genhtml_branch_coverage=1 00:29:28.859 --rc genhtml_function_coverage=1 00:29:28.859 --rc genhtml_legend=1 00:29:28.859 --rc geninfo_all_blocks=1 00:29:28.859 --rc geninfo_unexecuted_blocks=1 00:29:28.859 00:29:28.859 ' 00:29:28.859 04:31:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:29:28.859 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:29:28.859 --rc genhtml_branch_coverage=1 00:29:28.859 --rc genhtml_function_coverage=1 00:29:28.859 --rc genhtml_legend=1 00:29:28.859 --rc geninfo_all_blocks=1 00:29:28.859 --rc geninfo_unexecuted_blocks=1 00:29:28.859 00:29:28.859 ' 00:29:28.859 04:31:19 -- host/digest.sh@12 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:29:28.859 04:31:19 -- nvmf/common.sh@7 -- # uname -s 00:29:28.859 04:31:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:29:28.859 04:31:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:29:28.859 04:31:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:29:28.859 04:31:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:29:28.859 04:31:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:29:28.859 04:31:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:29:28.859 04:31:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:29:28.859 04:31:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:29:28.859 04:31:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:29:28.859 04:31:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:29:28.859 04:31:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:29:28.859 04:31:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:29:28.859 04:31:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:29:28.859 04:31:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:29:28.859 04:31:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:29:28.859 04:31:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:29:28.859 04:31:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:29:28.859 04:31:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:29:28.859 04:31:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:29:28.859 04:31:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:28.859 04:31:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:28.859 04:31:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:28.859 04:31:19 -- paths/export.sh@5 -- # export PATH 00:29:28.859 04:31:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:29:28.859 04:31:19 -- nvmf/common.sh@46 -- # : 0 00:29:28.859 04:31:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:29:28.859 04:31:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:29:28.859 04:31:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:29:28.859 04:31:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:29:28.859 04:31:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:29:28.859 04:31:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:29:28.859 04:31:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:29:28.859 04:31:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:29:28.859 04:31:19 -- host/digest.sh@14 -- # nqn=nqn.2016-06.io.spdk:cnode1 00:29:28.859 04:31:19 -- host/digest.sh@15 -- # bperfsock=/var/tmp/bperf.sock 00:29:28.859 04:31:19 -- host/digest.sh@16 -- # runtime=2 00:29:28.859 04:31:19 -- host/digest.sh@130 -- # [[ tcp != \t\c\p ]] 00:29:28.859 04:31:19 -- host/digest.sh@132 -- # nvmftestinit 00:29:28.859 04:31:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:29:28.859 04:31:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:29:28.859 04:31:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:29:28.859 04:31:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:29:28.859 04:31:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:29:28.859 04:31:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:29:28.859 04:31:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:29:28.859 04:31:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:29:28.859 04:31:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:29:28.859 04:31:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:29:28.859 04:31:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:29:28.859 04:31:19 -- common/autotest_common.sh@10 -- # set +x 00:29:30.759 04:31:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:29:30.759 04:31:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:29:30.759 04:31:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:29:30.759 04:31:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:29:30.759 04:31:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:29:30.759 04:31:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:29:30.759 04:31:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:29:30.759 04:31:21 -- nvmf/common.sh@294 -- # net_devs=() 00:29:30.759 04:31:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:29:30.759 04:31:21 -- nvmf/common.sh@295 -- # e810=() 00:29:30.759 04:31:21 -- nvmf/common.sh@295 -- # local -ga e810 00:29:30.759 04:31:21 -- nvmf/common.sh@296 -- # x722=() 00:29:30.759 04:31:21 -- nvmf/common.sh@296 -- # local -ga x722 00:29:30.759 04:31:21 -- nvmf/common.sh@297 -- # mlx=() 00:29:30.759 04:31:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:29:30.759 04:31:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:29:30.759 04:31:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:29:30.759 04:31:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:29:30.759 04:31:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:29:30.759 04:31:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:30.759 04:31:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:29:30.759 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:29:30.759 04:31:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:29:30.759 04:31:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:29:30.759 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:29:30.759 04:31:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:29:30.759 04:31:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:30.759 04:31:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:30.759 04:31:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:30.759 04:31:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:30.759 04:31:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:29:30.759 Found net devices under 0000:0a:00.0: cvl_0_0 00:29:30.759 04:31:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:30.759 04:31:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:29:30.759 04:31:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:29:30.759 04:31:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:29:30.759 04:31:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:29:30.759 04:31:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:29:30.759 Found net devices under 0000:0a:00.1: cvl_0_1 00:29:30.759 04:31:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:29:30.759 04:31:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:29:30.759 04:31:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:29:30.759 04:31:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:29:30.759 04:31:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:29:30.759 04:31:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:29:30.759 04:31:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:29:30.759 04:31:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:29:30.759 04:31:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:29:30.759 04:31:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:29:30.759 04:31:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:29:30.759 04:31:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:29:30.759 04:31:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:29:30.759 04:31:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:29:30.759 04:31:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:29:30.759 04:31:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:29:30.759 04:31:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:29:30.759 04:31:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:29:30.759 04:31:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:29:30.759 04:31:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:29:30.759 04:31:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:29:30.759 04:31:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:29:30.759 04:31:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:29:30.759 04:31:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:29:30.759 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:29:30.759 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.237 ms 00:29:30.759 00:29:30.759 --- 10.0.0.2 ping statistics --- 00:29:30.759 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:30.759 rtt min/avg/max/mdev = 0.237/0.237/0.237/0.000 ms 00:29:30.759 04:31:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:29:30.759 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:29:30.759 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:29:30.759 00:29:30.759 --- 10.0.0.1 ping statistics --- 00:29:30.759 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:29:30.759 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:29:30.759 04:31:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:29:30.759 04:31:21 -- nvmf/common.sh@410 -- # return 0 00:29:30.759 04:31:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:29:30.759 04:31:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:29:30.759 04:31:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:29:30.759 04:31:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:29:30.759 04:31:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:29:30.759 04:31:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:29:30.759 04:31:21 -- host/digest.sh@134 -- # trap cleanup SIGINT SIGTERM EXIT 00:29:30.759 04:31:21 -- host/digest.sh@135 -- # run_test nvmf_digest_clean run_digest 00:29:30.759 04:31:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:30.759 04:31:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:30.759 04:31:21 -- common/autotest_common.sh@10 -- # set +x 00:29:30.759 ************************************ 00:29:30.759 START TEST nvmf_digest_clean 00:29:30.759 ************************************ 00:29:30.759 04:31:21 -- common/autotest_common.sh@1114 -- # run_digest 00:29:30.759 04:31:21 -- host/digest.sh@119 -- # nvmfappstart --wait-for-rpc 00:29:30.759 04:31:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:30.759 04:31:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:30.759 04:31:21 -- common/autotest_common.sh@10 -- # set +x 00:29:30.759 04:31:21 -- nvmf/common.sh@469 -- # nvmfpid=2483514 00:29:30.759 04:31:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:30.759 04:31:21 -- nvmf/common.sh@470 -- # waitforlisten 2483514 00:29:30.759 04:31:21 -- common/autotest_common.sh@829 -- # '[' -z 2483514 ']' 00:29:30.759 04:31:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:30.759 04:31:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:30.760 04:31:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:30.760 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:30.760 04:31:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:30.760 04:31:21 -- common/autotest_common.sh@10 -- # set +x 00:29:30.760 [2024-11-30 04:31:21.386512] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:30.760 [2024-11-30 04:31:21.386600] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:31.017 EAL: No free 2048 kB hugepages reported on node 1 00:29:31.017 [2024-11-30 04:31:21.449971] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:31.017 [2024-11-30 04:31:21.534878] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:31.017 [2024-11-30 04:31:21.535058] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:31.017 [2024-11-30 04:31:21.535078] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:31.017 [2024-11-30 04:31:21.535092] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:31.017 [2024-11-30 04:31:21.535119] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:31.017 04:31:21 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:31.017 04:31:21 -- common/autotest_common.sh@862 -- # return 0 00:29:31.017 04:31:21 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:31.017 04:31:21 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:31.017 04:31:21 -- common/autotest_common.sh@10 -- # set +x 00:29:31.017 04:31:21 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:31.017 04:31:21 -- host/digest.sh@120 -- # common_target_config 00:29:31.017 04:31:21 -- host/digest.sh@43 -- # rpc_cmd 00:29:31.017 04:31:21 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:31.017 04:31:21 -- common/autotest_common.sh@10 -- # set +x 00:29:31.273 null0 00:29:31.273 [2024-11-30 04:31:21.725722] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:31.273 [2024-11-30 04:31:21.749949] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:31.273 04:31:21 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:31.274 04:31:21 -- host/digest.sh@122 -- # run_bperf randread 4096 128 00:29:31.274 04:31:21 -- host/digest.sh@77 -- # local rw bs qd 00:29:31.274 04:31:21 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:31.274 04:31:21 -- host/digest.sh@80 -- # rw=randread 00:29:31.274 04:31:21 -- host/digest.sh@80 -- # bs=4096 00:29:31.274 04:31:21 -- host/digest.sh@80 -- # qd=128 00:29:31.274 04:31:21 -- host/digest.sh@82 -- # bperfpid=2483657 00:29:31.274 04:31:21 -- host/digest.sh@83 -- # waitforlisten 2483657 /var/tmp/bperf.sock 00:29:31.274 04:31:21 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:31.274 04:31:21 -- common/autotest_common.sh@829 -- # '[' -z 2483657 ']' 00:29:31.274 04:31:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:31.274 04:31:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:31.274 04:31:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:31.274 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:31.274 04:31:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:31.274 04:31:21 -- common/autotest_common.sh@10 -- # set +x 00:29:31.274 [2024-11-30 04:31:21.793193] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:31.274 [2024-11-30 04:31:21.793310] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2483657 ] 00:29:31.274 EAL: No free 2048 kB hugepages reported on node 1 00:29:31.274 [2024-11-30 04:31:21.856758] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:31.530 [2024-11-30 04:31:21.945317] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:31.530 04:31:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:31.530 04:31:22 -- common/autotest_common.sh@862 -- # return 0 00:29:31.530 04:31:22 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:31.531 04:31:22 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:31.531 04:31:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:31.788 04:31:22 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:31.788 04:31:22 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:32.045 nvme0n1 00:29:32.045 04:31:22 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:32.045 04:31:22 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:32.303 Running I/O for 2 seconds... 00:29:34.202 00:29:34.202 Latency(us) 00:29:34.202 [2024-11-30T03:31:24.833Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:34.202 [2024-11-30T03:31:24.833Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:34.202 nvme0n1 : 2.01 17373.75 67.87 0.00 0.00 7360.82 3422.44 18350.08 00:29:34.202 [2024-11-30T03:31:24.833Z] =================================================================================================================== 00:29:34.202 [2024-11-30T03:31:24.833Z] Total : 17373.75 67.87 0.00 0.00 7360.82 3422.44 18350.08 00:29:34.202 0 00:29:34.202 04:31:24 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:34.202 04:31:24 -- host/digest.sh@92 -- # get_accel_stats 00:29:34.202 04:31:24 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:34.202 04:31:24 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:34.202 | select(.opcode=="crc32c") 00:29:34.202 | "\(.module_name) \(.executed)"' 00:29:34.202 04:31:24 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:34.461 04:31:25 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:34.461 04:31:25 -- host/digest.sh@93 -- # exp_module=software 00:29:34.461 04:31:25 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:34.461 04:31:25 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:34.461 04:31:25 -- host/digest.sh@97 -- # killprocess 2483657 00:29:34.461 04:31:25 -- common/autotest_common.sh@936 -- # '[' -z 2483657 ']' 00:29:34.461 04:31:25 -- common/autotest_common.sh@940 -- # kill -0 2483657 00:29:34.461 04:31:25 -- common/autotest_common.sh@941 -- # uname 00:29:34.461 04:31:25 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:34.461 04:31:25 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2483657 00:29:34.719 04:31:25 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:34.719 04:31:25 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:34.719 04:31:25 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2483657' 00:29:34.719 killing process with pid 2483657 00:29:34.719 04:31:25 -- common/autotest_common.sh@955 -- # kill 2483657 00:29:34.719 Received shutdown signal, test time was about 2.000000 seconds 00:29:34.719 00:29:34.719 Latency(us) 00:29:34.719 [2024-11-30T03:31:25.350Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:34.719 [2024-11-30T03:31:25.350Z] =================================================================================================================== 00:29:34.719 [2024-11-30T03:31:25.350Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:34.719 04:31:25 -- common/autotest_common.sh@960 -- # wait 2483657 00:29:34.719 04:31:25 -- host/digest.sh@123 -- # run_bperf randread 131072 16 00:29:34.719 04:31:25 -- host/digest.sh@77 -- # local rw bs qd 00:29:34.719 04:31:25 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:34.719 04:31:25 -- host/digest.sh@80 -- # rw=randread 00:29:34.719 04:31:25 -- host/digest.sh@80 -- # bs=131072 00:29:34.719 04:31:25 -- host/digest.sh@80 -- # qd=16 00:29:34.719 04:31:25 -- host/digest.sh@82 -- # bperfpid=2484079 00:29:34.719 04:31:25 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:34.719 04:31:25 -- host/digest.sh@83 -- # waitforlisten 2484079 /var/tmp/bperf.sock 00:29:34.719 04:31:25 -- common/autotest_common.sh@829 -- # '[' -z 2484079 ']' 00:29:34.719 04:31:25 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:34.719 04:31:25 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:34.719 04:31:25 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:34.719 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:34.719 04:31:25 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:34.719 04:31:25 -- common/autotest_common.sh@10 -- # set +x 00:29:34.719 [2024-11-30 04:31:25.339163] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:34.719 [2024-11-30 04:31:25.339264] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2484079 ] 00:29:34.719 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:34.719 Zero copy mechanism will not be used. 00:29:34.978 EAL: No free 2048 kB hugepages reported on node 1 00:29:34.978 [2024-11-30 04:31:25.408186] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:34.978 [2024-11-30 04:31:25.496263] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:34.978 04:31:25 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:34.978 04:31:25 -- common/autotest_common.sh@862 -- # return 0 00:29:34.978 04:31:25 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:34.978 04:31:25 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:34.978 04:31:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:35.544 04:31:25 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:35.544 04:31:25 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:35.802 nvme0n1 00:29:35.802 04:31:26 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:35.802 04:31:26 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:35.802 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:35.802 Zero copy mechanism will not be used. 00:29:35.802 Running I/O for 2 seconds... 00:29:37.783 00:29:37.783 Latency(us) 00:29:37.783 [2024-11-30T03:31:28.414Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:37.783 [2024-11-30T03:31:28.414Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:37.783 nvme0n1 : 2.00 6510.64 813.83 0.00 0.00 2453.83 776.72 7524.50 00:29:37.783 [2024-11-30T03:31:28.414Z] =================================================================================================================== 00:29:37.783 [2024-11-30T03:31:28.414Z] Total : 6510.64 813.83 0.00 0.00 2453.83 776.72 7524.50 00:29:37.783 0 00:29:37.783 04:31:28 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:37.783 04:31:28 -- host/digest.sh@92 -- # get_accel_stats 00:29:37.783 04:31:28 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:37.783 04:31:28 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:37.783 04:31:28 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:37.783 | select(.opcode=="crc32c") 00:29:37.783 | "\(.module_name) \(.executed)"' 00:29:38.349 04:31:28 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:38.349 04:31:28 -- host/digest.sh@93 -- # exp_module=software 00:29:38.349 04:31:28 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:38.349 04:31:28 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:38.349 04:31:28 -- host/digest.sh@97 -- # killprocess 2484079 00:29:38.349 04:31:28 -- common/autotest_common.sh@936 -- # '[' -z 2484079 ']' 00:29:38.349 04:31:28 -- common/autotest_common.sh@940 -- # kill -0 2484079 00:29:38.349 04:31:28 -- common/autotest_common.sh@941 -- # uname 00:29:38.349 04:31:28 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:38.349 04:31:28 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2484079 00:29:38.349 04:31:28 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:38.349 04:31:28 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:38.349 04:31:28 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2484079' 00:29:38.349 killing process with pid 2484079 00:29:38.349 04:31:28 -- common/autotest_common.sh@955 -- # kill 2484079 00:29:38.349 Received shutdown signal, test time was about 2.000000 seconds 00:29:38.349 00:29:38.349 Latency(us) 00:29:38.349 [2024-11-30T03:31:28.980Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:38.349 [2024-11-30T03:31:28.980Z] =================================================================================================================== 00:29:38.349 [2024-11-30T03:31:28.980Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:38.349 04:31:28 -- common/autotest_common.sh@960 -- # wait 2484079 00:29:38.349 04:31:28 -- host/digest.sh@124 -- # run_bperf randwrite 4096 128 00:29:38.349 04:31:28 -- host/digest.sh@77 -- # local rw bs qd 00:29:38.349 04:31:28 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:38.349 04:31:28 -- host/digest.sh@80 -- # rw=randwrite 00:29:38.349 04:31:28 -- host/digest.sh@80 -- # bs=4096 00:29:38.349 04:31:28 -- host/digest.sh@80 -- # qd=128 00:29:38.349 04:31:28 -- host/digest.sh@82 -- # bperfpid=2484505 00:29:38.349 04:31:28 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z --wait-for-rpc 00:29:38.349 04:31:28 -- host/digest.sh@83 -- # waitforlisten 2484505 /var/tmp/bperf.sock 00:29:38.349 04:31:28 -- common/autotest_common.sh@829 -- # '[' -z 2484505 ']' 00:29:38.349 04:31:28 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:38.349 04:31:28 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:38.349 04:31:28 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:38.349 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:38.349 04:31:28 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:38.349 04:31:28 -- common/autotest_common.sh@10 -- # set +x 00:29:38.349 [2024-11-30 04:31:28.972371] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:38.349 [2024-11-30 04:31:28.972460] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2484505 ] 00:29:38.607 EAL: No free 2048 kB hugepages reported on node 1 00:29:38.607 [2024-11-30 04:31:29.032901] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:38.607 [2024-11-30 04:31:29.116474] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:38.607 04:31:29 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:38.607 04:31:29 -- common/autotest_common.sh@862 -- # return 0 00:29:38.607 04:31:29 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:38.607 04:31:29 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:38.607 04:31:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:39.173 04:31:29 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:39.173 04:31:29 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:39.431 nvme0n1 00:29:39.431 04:31:30 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:39.431 04:31:30 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:39.689 Running I/O for 2 seconds... 00:29:41.588 00:29:41.588 Latency(us) 00:29:41.588 [2024-11-30T03:31:32.219Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:41.588 [2024-11-30T03:31:32.219Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:41.588 nvme0n1 : 2.01 20209.54 78.94 0.00 0.00 6319.55 2924.85 16214.09 00:29:41.588 [2024-11-30T03:31:32.219Z] =================================================================================================================== 00:29:41.588 [2024-11-30T03:31:32.219Z] Total : 20209.54 78.94 0.00 0.00 6319.55 2924.85 16214.09 00:29:41.588 0 00:29:41.588 04:31:32 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:41.588 04:31:32 -- host/digest.sh@92 -- # get_accel_stats 00:29:41.588 04:31:32 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:41.588 04:31:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:41.588 04:31:32 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:41.588 | select(.opcode=="crc32c") 00:29:41.588 | "\(.module_name) \(.executed)"' 00:29:41.846 04:31:32 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:41.846 04:31:32 -- host/digest.sh@93 -- # exp_module=software 00:29:41.846 04:31:32 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:41.846 04:31:32 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:41.846 04:31:32 -- host/digest.sh@97 -- # killprocess 2484505 00:29:41.846 04:31:32 -- common/autotest_common.sh@936 -- # '[' -z 2484505 ']' 00:29:41.846 04:31:32 -- common/autotest_common.sh@940 -- # kill -0 2484505 00:29:41.846 04:31:32 -- common/autotest_common.sh@941 -- # uname 00:29:41.846 04:31:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:41.846 04:31:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2484505 00:29:41.846 04:31:32 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:41.846 04:31:32 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:41.846 04:31:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2484505' 00:29:41.846 killing process with pid 2484505 00:29:41.846 04:31:32 -- common/autotest_common.sh@955 -- # kill 2484505 00:29:41.846 Received shutdown signal, test time was about 2.000000 seconds 00:29:41.846 00:29:41.846 Latency(us) 00:29:41.846 [2024-11-30T03:31:32.477Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:41.846 [2024-11-30T03:31:32.477Z] =================================================================================================================== 00:29:41.846 [2024-11-30T03:31:32.477Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:41.846 04:31:32 -- common/autotest_common.sh@960 -- # wait 2484505 00:29:42.105 04:31:32 -- host/digest.sh@125 -- # run_bperf randwrite 131072 16 00:29:42.105 04:31:32 -- host/digest.sh@77 -- # local rw bs qd 00:29:42.105 04:31:32 -- host/digest.sh@78 -- # local acc_module acc_executed exp_module 00:29:42.105 04:31:32 -- host/digest.sh@80 -- # rw=randwrite 00:29:42.105 04:31:32 -- host/digest.sh@80 -- # bs=131072 00:29:42.105 04:31:32 -- host/digest.sh@80 -- # qd=16 00:29:42.105 04:31:32 -- host/digest.sh@82 -- # bperfpid=2484921 00:29:42.105 04:31:32 -- host/digest.sh@81 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z --wait-for-rpc 00:29:42.105 04:31:32 -- host/digest.sh@83 -- # waitforlisten 2484921 /var/tmp/bperf.sock 00:29:42.105 04:31:32 -- common/autotest_common.sh@829 -- # '[' -z 2484921 ']' 00:29:42.105 04:31:32 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:42.105 04:31:32 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:42.105 04:31:32 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:42.105 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:42.105 04:31:32 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:42.105 04:31:32 -- common/autotest_common.sh@10 -- # set +x 00:29:42.105 [2024-11-30 04:31:32.716658] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:42.105 [2024-11-30 04:31:32.716753] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2484921 ] 00:29:42.105 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:42.105 Zero copy mechanism will not be used. 00:29:42.363 EAL: No free 2048 kB hugepages reported on node 1 00:29:42.363 [2024-11-30 04:31:32.775084] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:42.363 [2024-11-30 04:31:32.859095] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:42.363 04:31:32 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:42.363 04:31:32 -- common/autotest_common.sh@862 -- # return 0 00:29:42.363 04:31:32 -- host/digest.sh@85 -- # [[ 0 -eq 1 ]] 00:29:42.363 04:31:32 -- host/digest.sh@86 -- # bperf_rpc framework_start_init 00:29:42.363 04:31:32 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock framework_start_init 00:29:42.930 04:31:33 -- host/digest.sh@88 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:42.930 04:31:33 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:43.188 nvme0n1 00:29:43.188 04:31:33 -- host/digest.sh@91 -- # bperf_py perform_tests 00:29:43.188 04:31:33 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:43.188 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:43.188 Zero copy mechanism will not be used. 00:29:43.188 Running I/O for 2 seconds... 00:29:45.715 00:29:45.716 Latency(us) 00:29:45.716 [2024-11-30T03:31:36.347Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:45.716 [2024-11-30T03:31:36.347Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:29:45.716 nvme0n1 : 2.00 6264.57 783.07 0.00 0.00 2546.66 1929.67 7912.87 00:29:45.716 [2024-11-30T03:31:36.347Z] =================================================================================================================== 00:29:45.716 [2024-11-30T03:31:36.347Z] Total : 6264.57 783.07 0.00 0.00 2546.66 1929.67 7912.87 00:29:45.716 0 00:29:45.716 04:31:35 -- host/digest.sh@92 -- # read -r acc_module acc_executed 00:29:45.716 04:31:35 -- host/digest.sh@92 -- # get_accel_stats 00:29:45.716 04:31:35 -- host/digest.sh@36 -- # bperf_rpc accel_get_stats 00:29:45.716 04:31:35 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock accel_get_stats 00:29:45.716 04:31:35 -- host/digest.sh@37 -- # jq -rc '.operations[] 00:29:45.716 | select(.opcode=="crc32c") 00:29:45.716 | "\(.module_name) \(.executed)"' 00:29:45.716 04:31:36 -- host/digest.sh@93 -- # [[ 0 -eq 1 ]] 00:29:45.716 04:31:36 -- host/digest.sh@93 -- # exp_module=software 00:29:45.716 04:31:36 -- host/digest.sh@94 -- # (( acc_executed > 0 )) 00:29:45.716 04:31:36 -- host/digest.sh@95 -- # [[ software == \s\o\f\t\w\a\r\e ]] 00:29:45.716 04:31:36 -- host/digest.sh@97 -- # killprocess 2484921 00:29:45.716 04:31:36 -- common/autotest_common.sh@936 -- # '[' -z 2484921 ']' 00:29:45.716 04:31:36 -- common/autotest_common.sh@940 -- # kill -0 2484921 00:29:45.716 04:31:36 -- common/autotest_common.sh@941 -- # uname 00:29:45.716 04:31:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:45.716 04:31:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2484921 00:29:45.716 04:31:36 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:45.716 04:31:36 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:45.716 04:31:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2484921' 00:29:45.716 killing process with pid 2484921 00:29:45.716 04:31:36 -- common/autotest_common.sh@955 -- # kill 2484921 00:29:45.716 Received shutdown signal, test time was about 2.000000 seconds 00:29:45.716 00:29:45.716 Latency(us) 00:29:45.716 [2024-11-30T03:31:36.347Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:45.716 [2024-11-30T03:31:36.347Z] =================================================================================================================== 00:29:45.716 [2024-11-30T03:31:36.347Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:45.716 04:31:36 -- common/autotest_common.sh@960 -- # wait 2484921 00:29:45.974 04:31:36 -- host/digest.sh@126 -- # killprocess 2483514 00:29:45.974 04:31:36 -- common/autotest_common.sh@936 -- # '[' -z 2483514 ']' 00:29:45.974 04:31:36 -- common/autotest_common.sh@940 -- # kill -0 2483514 00:29:45.974 04:31:36 -- common/autotest_common.sh@941 -- # uname 00:29:45.974 04:31:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:45.974 04:31:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2483514 00:29:45.974 04:31:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:29:45.974 04:31:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:29:45.974 04:31:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2483514' 00:29:45.974 killing process with pid 2483514 00:29:45.974 04:31:36 -- common/autotest_common.sh@955 -- # kill 2483514 00:29:45.974 04:31:36 -- common/autotest_common.sh@960 -- # wait 2483514 00:29:46.232 00:29:46.232 real 0m15.284s 00:29:46.232 user 0m30.345s 00:29:46.232 sys 0m4.259s 00:29:46.232 04:31:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:29:46.232 04:31:36 -- common/autotest_common.sh@10 -- # set +x 00:29:46.232 ************************************ 00:29:46.232 END TEST nvmf_digest_clean 00:29:46.232 ************************************ 00:29:46.232 04:31:36 -- host/digest.sh@136 -- # run_test nvmf_digest_error run_digest_error 00:29:46.232 04:31:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:29:46.232 04:31:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:29:46.232 04:31:36 -- common/autotest_common.sh@10 -- # set +x 00:29:46.232 ************************************ 00:29:46.232 START TEST nvmf_digest_error 00:29:46.232 ************************************ 00:29:46.232 04:31:36 -- common/autotest_common.sh@1114 -- # run_digest_error 00:29:46.232 04:31:36 -- host/digest.sh@101 -- # nvmfappstart --wait-for-rpc 00:29:46.232 04:31:36 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:29:46.232 04:31:36 -- common/autotest_common.sh@722 -- # xtrace_disable 00:29:46.232 04:31:36 -- common/autotest_common.sh@10 -- # set +x 00:29:46.232 04:31:36 -- nvmf/common.sh@469 -- # nvmfpid=2485489 00:29:46.232 04:31:36 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF --wait-for-rpc 00:29:46.232 04:31:36 -- nvmf/common.sh@470 -- # waitforlisten 2485489 00:29:46.232 04:31:36 -- common/autotest_common.sh@829 -- # '[' -z 2485489 ']' 00:29:46.232 04:31:36 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:29:46.232 04:31:36 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:46.232 04:31:36 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:29:46.232 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:29:46.232 04:31:36 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:46.232 04:31:36 -- common/autotest_common.sh@10 -- # set +x 00:29:46.232 [2024-11-30 04:31:36.704262] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:46.232 [2024-11-30 04:31:36.704365] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:29:46.232 EAL: No free 2048 kB hugepages reported on node 1 00:29:46.232 [2024-11-30 04:31:36.768078] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:46.232 [2024-11-30 04:31:36.853154] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:29:46.232 [2024-11-30 04:31:36.853306] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:29:46.232 [2024-11-30 04:31:36.853324] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:29:46.232 [2024-11-30 04:31:36.853337] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:29:46.232 [2024-11-30 04:31:36.853365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:29:46.490 04:31:36 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:46.490 04:31:36 -- common/autotest_common.sh@862 -- # return 0 00:29:46.490 04:31:36 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:29:46.490 04:31:36 -- common/autotest_common.sh@728 -- # xtrace_disable 00:29:46.490 04:31:36 -- common/autotest_common.sh@10 -- # set +x 00:29:46.490 04:31:36 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:29:46.490 04:31:36 -- host/digest.sh@103 -- # rpc_cmd accel_assign_opc -o crc32c -m error 00:29:46.490 04:31:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.490 04:31:36 -- common/autotest_common.sh@10 -- # set +x 00:29:46.490 [2024-11-30 04:31:36.946038] accel_rpc.c: 168:rpc_accel_assign_opc: *NOTICE*: Operation crc32c will be assigned to module error 00:29:46.490 04:31:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.490 04:31:36 -- host/digest.sh@104 -- # common_target_config 00:29:46.490 04:31:36 -- host/digest.sh@43 -- # rpc_cmd 00:29:46.490 04:31:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:46.490 04:31:36 -- common/autotest_common.sh@10 -- # set +x 00:29:46.490 null0 00:29:46.490 [2024-11-30 04:31:37.061685] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:29:46.490 [2024-11-30 04:31:37.085949] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:29:46.490 04:31:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:46.491 04:31:37 -- host/digest.sh@107 -- # run_bperf_err randread 4096 128 00:29:46.491 04:31:37 -- host/digest.sh@54 -- # local rw bs qd 00:29:46.491 04:31:37 -- host/digest.sh@56 -- # rw=randread 00:29:46.491 04:31:37 -- host/digest.sh@56 -- # bs=4096 00:29:46.491 04:31:37 -- host/digest.sh@56 -- # qd=128 00:29:46.491 04:31:37 -- host/digest.sh@58 -- # bperfpid=2485516 00:29:46.491 04:31:37 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 4096 -t 2 -q 128 -z 00:29:46.491 04:31:37 -- host/digest.sh@60 -- # waitforlisten 2485516 /var/tmp/bperf.sock 00:29:46.491 04:31:37 -- common/autotest_common.sh@829 -- # '[' -z 2485516 ']' 00:29:46.491 04:31:37 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:46.491 04:31:37 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:46.491 04:31:37 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:46.491 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:46.491 04:31:37 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:46.491 04:31:37 -- common/autotest_common.sh@10 -- # set +x 00:29:46.749 [2024-11-30 04:31:37.131684] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:46.749 [2024-11-30 04:31:37.131747] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2485516 ] 00:29:46.749 EAL: No free 2048 kB hugepages reported on node 1 00:29:46.749 [2024-11-30 04:31:37.193593] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:46.749 [2024-11-30 04:31:37.282377] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:47.007 04:31:37 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:47.007 04:31:37 -- common/autotest_common.sh@862 -- # return 0 00:29:47.007 04:31:37 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:47.007 04:31:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:47.265 04:31:37 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:47.265 04:31:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.265 04:31:37 -- common/autotest_common.sh@10 -- # set +x 00:29:47.265 04:31:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.265 04:31:37 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:47.265 04:31:37 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:47.523 nvme0n1 00:29:47.523 04:31:38 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:47.523 04:31:38 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:47.523 04:31:38 -- common/autotest_common.sh@10 -- # set +x 00:29:47.523 04:31:38 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:47.523 04:31:38 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:47.523 04:31:38 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:47.523 Running I/O for 2 seconds... 00:29:47.782 [2024-11-30 04:31:38.177846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.177895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14407 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.177914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.193197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.193228] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:10413 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.193245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.208363] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.208393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.208410] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.218992] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.219023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:1600 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.219042] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.233700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.233746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:18949 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.233764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.243972] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.244004] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:15807 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.244021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.259813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.259844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:32 nsid:1 lba:22912 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.259861] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:32 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.274388] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.274420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:15157 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.274444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:54 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.290297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.290325] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:21345 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.290341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.305565] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.305594] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:7134 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.305610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.321194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.321224] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:12154 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.321240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.336858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.336887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:4177 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.336903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.352132] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.352164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:78 nsid:1 lba:9655 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.352181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:78 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.366184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.366217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:17845 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.366234] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:80 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.377826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.377854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:22729 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.377870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:68 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.782 [2024-11-30 04:31:38.392688] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.782 [2024-11-30 04:31:38.392717] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:3571 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.782 [2024-11-30 04:31:38.392733] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:47.783 [2024-11-30 04:31:38.408112] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:47.783 [2024-11-30 04:31:38.408165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:8151 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:47.783 [2024-11-30 04:31:38.408183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.040 [2024-11-30 04:31:38.422482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.040 [2024-11-30 04:31:38.422510] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:17118 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.040 [2024-11-30 04:31:38.422527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.040 [2024-11-30 04:31:38.434057] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.040 [2024-11-30 04:31:38.434087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:20271 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.040 [2024-11-30 04:31:38.434105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:98 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.040 [2024-11-30 04:31:38.448642] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.448672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:13419 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.448690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.464503] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.464532] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:24570 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.464548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.479808] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.479837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14816 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.479854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.494843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.494871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:16101 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.494888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.510511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.510540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:19966 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.510555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.526043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.526073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:15826 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.526089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.541321] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.541350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:16951 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.541366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:89 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.557202] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.557234] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8334 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.557251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.572913] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.572965] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:46 nsid:1 lba:12508 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.572984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:46 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.588144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.588174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:15482 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.588191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.603130] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.603160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11852 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.603176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.617291] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.617322] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:1857 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.617340] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:39 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.627776] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.627804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:22821 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.627820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:41 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.644169] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.644200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:12417 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.644217] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.041 [2024-11-30 04:31:38.659365] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.041 [2024-11-30 04:31:38.659394] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:14711 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.041 [2024-11-30 04:31:38.659417] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:73 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.298 [2024-11-30 04:31:38.675440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.298 [2024-11-30 04:31:38.675472] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:23171 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.298 [2024-11-30 04:31:38.675490] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.298 [2024-11-30 04:31:38.690971] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.298 [2024-11-30 04:31:38.691000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:8942 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.298 [2024-11-30 04:31:38.691025] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.298 [2024-11-30 04:31:38.701144] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.298 [2024-11-30 04:31:38.701190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:6627 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.701208] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.715806] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.715835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:6660 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.715851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.731546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.731575] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14408 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.731591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.746702] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.746731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:18484 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.746747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.761935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.761987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:19983 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.762005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.777357] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.777387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:11049 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.777403] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.793147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.793176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:24314 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.793193] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.808535] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.808564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:1772 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.808580] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.823775] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.823803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:3553 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.823819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.839041] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.839072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:11027 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.839089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.849178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.849207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:25449 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.849224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.864224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.864253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:29 nsid:1 lba:24310 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.864285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:29 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.879796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.879825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:6056 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.879843] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:24 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.894511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.894540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:23771 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.894556] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:105 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.909759] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.909787] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:2781 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.909810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:96 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.299 [2024-11-30 04:31:38.925110] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.299 [2024-11-30 04:31:38.925139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:94 nsid:1 lba:11301 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.299 [2024-11-30 04:31:38.925156] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:94 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.557 [2024-11-30 04:31:38.941275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.557 [2024-11-30 04:31:38.941320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3360 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.557 [2024-11-30 04:31:38.941336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.557 [2024-11-30 04:31:38.956371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.557 [2024-11-30 04:31:38.956402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:10888 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.557 [2024-11-30 04:31:38.956418] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:61 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.557 [2024-11-30 04:31:38.971658] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.557 [2024-11-30 04:31:38.971687] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:11533 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.557 [2024-11-30 04:31:38.971719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.557 [2024-11-30 04:31:38.986791] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.557 [2024-11-30 04:31:38.986836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:18488 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.557 [2024-11-30 04:31:38.986852] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.557 [2024-11-30 04:31:39.001266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.001295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:16760 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.001310] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.017179] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.017209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:5910 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.017225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:93 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.033081] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.033110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:19996 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.033126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.050461] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.050507] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:3299 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.050526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.067672] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.067707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:31 nsid:1 lba:12108 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.067726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:31 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.082647] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.082681] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:12398 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.082700] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.094779] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.094813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:19616 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.094832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:47 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.112148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.112180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:40 nsid:1 lba:10694 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.112198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:40 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.129482] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.129517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:12970 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.129537] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.140584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.140617] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:3432 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.140636] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.157807] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.157841] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:23456 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.157860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.558 [2024-11-30 04:31:39.173340] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.558 [2024-11-30 04:31:39.173374] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:8818 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.558 [2024-11-30 04:31:39.173394] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:106 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.189617] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.189650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:8976 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.189669] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.202009] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.202037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:111 nsid:1 lba:11216 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.202053] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:111 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.218797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.218833] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:12432 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.218853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:83 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.235610] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.235644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:109 nsid:1 lba:1130 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.235664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:109 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.252460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.252494] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:11628 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.252514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:82 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.269678] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.269712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:2653 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.269732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:118 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.280817] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.280851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:15702 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.280870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.297681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.297715] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:13599 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.297736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.314414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.314450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9754 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.314475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.331825] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.331859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:10937 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.331879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.349121] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.349150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:24136 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.349166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:91 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.364415] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.364449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:4082 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.364469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.376279] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.376307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:56 nsid:1 lba:17129 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.376323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:56 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.392325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.392359] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23423 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.392378] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.409160] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.409189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:6186 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.409204] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:95 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.426124] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.426169] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:53 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.426186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:48.816 [2024-11-30 04:31:39.442185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:48.816 [2024-11-30 04:31:39.442215] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:3349 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:48.816 [2024-11-30 04:31:39.442232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.453870] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.453904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21048 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.453924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.471726] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.471762] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25140 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.471781] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.488554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.488589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:16170 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.488610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.505501] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.505535] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:15180 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.505555] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:86 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.522367] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.522402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:17756 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.522422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:101 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.533185] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.533213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15369 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.533229] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.549146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.549180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:24064 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.549199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:119 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.566966] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.567000] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:10156 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.567034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:76 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.584437] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.584471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:25174 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.584497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:21 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.601181] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.601209] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20415 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.601225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.618219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.618267] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:117 nsid:1 lba:12252 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.618287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:117 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.629796] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.629829] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:12739 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.629849] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:87 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.646007] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.646037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:102 nsid:1 lba:22400 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.646054] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:102 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.663172] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.663200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:23517 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.663215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.680070] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.680099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:9166 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.680116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:103 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.075 [2024-11-30 04:31:39.696890] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.075 [2024-11-30 04:31:39.696925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:16525 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.075 [2024-11-30 04:31:39.696945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:36 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.708146] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.708195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:16930 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.708213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:58 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.724243] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.724295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:10582 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.724313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:88 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.741078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.741106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:15062 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.741123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:27 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.757818] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.757855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:22647 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.757874] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:43 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.775303] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.775339] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:16502 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.775358] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:85 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.786325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.786367] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:51 nsid:1 lba:2451 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.786387] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:51 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.802267] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.802310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3560 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.802326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.820399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.820433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:18786 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.820452] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:35 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.837330] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.837363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14246 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.837382] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.854097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.854127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:15462 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.854143] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:69 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.865149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.865176] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:21477 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.865192] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:84 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.880970] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.881015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:6296 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.881030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.897641] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.897674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:16842 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.334 [2024-11-30 04:31:39.897694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:20 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.334 [2024-11-30 04:31:39.914463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.334 [2024-11-30 04:31:39.914495] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:55 nsid:1 lba:21014 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.335 [2024-11-30 04:31:39.914515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:55 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.335 [2024-11-30 04:31:39.932325] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.335 [2024-11-30 04:31:39.932358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:19356 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.335 [2024-11-30 04:31:39.932377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:45 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.335 [2024-11-30 04:31:39.948589] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.335 [2024-11-30 04:31:39.948622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6872 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.335 [2024-11-30 04:31:39.948641] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.593 [2024-11-30 04:31:39.965485] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.593 [2024-11-30 04:31:39.965519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:5102 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.593 [2024-11-30 04:31:39.965538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.593 [2024-11-30 04:31:39.982053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.593 [2024-11-30 04:31:39.982098] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1370 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.593 [2024-11-30 04:31:39.982116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.593 [2024-11-30 04:31:39.998853] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.593 [2024-11-30 04:31:39.998887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:8658 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.593 [2024-11-30 04:31:39.998917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.593 [2024-11-30 04:31:40.014917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.593 [2024-11-30 04:31:40.014971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:11855 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.593 [2024-11-30 04:31:40.015011] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:92 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.593 [2024-11-30 04:31:40.028575] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.593 [2024-11-30 04:31:40.028631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:9 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.594 [2024-11-30 04:31:40.028664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:110 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.594 [2024-11-30 04:31:40.044296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.594 [2024-11-30 04:31:40.044330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:21845 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.594 [2024-11-30 04:31:40.044364] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:66 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.594 [2024-11-30 04:31:40.060084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.594 [2024-11-30 04:31:40.060116] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:20278 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.594 [2024-11-30 04:31:40.060134] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:64 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.594 [2024-11-30 04:31:40.075851] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.594 [2024-11-30 04:31:40.075880] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:12444 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.594 [2024-11-30 04:31:40.075912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:99 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.594 [2024-11-30 04:31:40.092008] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.594 [2024-11-30 04:31:40.092037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:18183 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.594 [2024-11-30 04:31:40.092069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:23 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.594 [2024-11-30 04:31:40.107499] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.594 [2024-11-30 04:31:40.107530] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:20381 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.594 [2024-11-30 04:31:40.107547] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:59 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.594 [2024-11-30 04:31:40.122055] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.594 [2024-11-30 04:31:40.122085] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:24171 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.594 [2024-11-30 04:31:40.122103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:67 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.594 [2024-11-30 04:31:40.132590] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.594 [2024-11-30 04:31:40.132629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:20681 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.594 [2024-11-30 04:31:40.132662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.594 [2024-11-30 04:31:40.147923] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.594 [2024-11-30 04:31:40.147953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:125 nsid:1 lba:8895 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.594 [2024-11-30 04:31:40.147993] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:125 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.594 [2024-11-30 04:31:40.163197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x1d2c300) 00:29:49.594 [2024-11-30 04:31:40.163226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:120 nsid:1 lba:25145 len:1 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:49.594 [2024-11-30 04:31:40.163257] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:120 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:49.594 00:29:49.594 Latency(us) 00:29:49.594 [2024-11-30T03:31:40.225Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:49.594 [2024-11-30T03:31:40.225Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 128, IO size: 4096) 00:29:49.594 nvme0n1 : 2.01 16648.90 65.03 0.00 0.00 7681.03 3398.16 25243.50 00:29:49.594 [2024-11-30T03:31:40.225Z] =================================================================================================================== 00:29:49.594 [2024-11-30T03:31:40.225Z] Total : 16648.90 65.03 0.00 0.00 7681.03 3398.16 25243.50 00:29:49.594 0 00:29:49.594 04:31:40 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:49.594 04:31:40 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:49.594 04:31:40 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:49.594 04:31:40 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:49.594 | .driver_specific 00:29:49.594 | .nvme_error 00:29:49.594 | .status_code 00:29:49.594 | .command_transient_transport_error' 00:29:49.852 04:31:40 -- host/digest.sh@71 -- # (( 131 > 0 )) 00:29:49.852 04:31:40 -- host/digest.sh@73 -- # killprocess 2485516 00:29:49.852 04:31:40 -- common/autotest_common.sh@936 -- # '[' -z 2485516 ']' 00:29:49.852 04:31:40 -- common/autotest_common.sh@940 -- # kill -0 2485516 00:29:49.852 04:31:40 -- common/autotest_common.sh@941 -- # uname 00:29:49.852 04:31:40 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:49.852 04:31:40 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2485516 00:29:49.852 04:31:40 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:49.852 04:31:40 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:49.852 04:31:40 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2485516' 00:29:49.852 killing process with pid 2485516 00:29:49.852 04:31:40 -- common/autotest_common.sh@955 -- # kill 2485516 00:29:49.852 Received shutdown signal, test time was about 2.000000 seconds 00:29:49.852 00:29:49.852 Latency(us) 00:29:49.852 [2024-11-30T03:31:40.483Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:49.852 [2024-11-30T03:31:40.483Z] =================================================================================================================== 00:29:49.852 [2024-11-30T03:31:40.483Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:49.852 04:31:40 -- common/autotest_common.sh@960 -- # wait 2485516 00:29:50.111 04:31:40 -- host/digest.sh@108 -- # run_bperf_err randread 131072 16 00:29:50.111 04:31:40 -- host/digest.sh@54 -- # local rw bs qd 00:29:50.111 04:31:40 -- host/digest.sh@56 -- # rw=randread 00:29:50.111 04:31:40 -- host/digest.sh@56 -- # bs=131072 00:29:50.111 04:31:40 -- host/digest.sh@56 -- # qd=16 00:29:50.111 04:31:40 -- host/digest.sh@58 -- # bperfpid=2485932 00:29:50.111 04:31:40 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randread -o 131072 -t 2 -q 16 -z 00:29:50.111 04:31:40 -- host/digest.sh@60 -- # waitforlisten 2485932 /var/tmp/bperf.sock 00:29:50.111 04:31:40 -- common/autotest_common.sh@829 -- # '[' -z 2485932 ']' 00:29:50.111 04:31:40 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:50.111 04:31:40 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:50.111 04:31:40 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:50.111 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:50.111 04:31:40 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:50.111 04:31:40 -- common/autotest_common.sh@10 -- # set +x 00:29:50.369 [2024-11-30 04:31:40.746274] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:50.369 [2024-11-30 04:31:40.746363] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2485932 ] 00:29:50.369 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:50.369 Zero copy mechanism will not be used. 00:29:50.369 EAL: No free 2048 kB hugepages reported on node 1 00:29:50.369 [2024-11-30 04:31:40.804570] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:50.369 [2024-11-30 04:31:40.890702] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:51.302 04:31:41 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:51.302 04:31:41 -- common/autotest_common.sh@862 -- # return 0 00:29:51.302 04:31:41 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:51.302 04:31:41 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:51.560 04:31:42 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:51.560 04:31:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.560 04:31:42 -- common/autotest_common.sh@10 -- # set +x 00:29:51.560 04:31:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.560 04:31:42 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:51.560 04:31:42 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:51.818 nvme0n1 00:29:51.818 04:31:42 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:29:51.818 04:31:42 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:51.818 04:31:42 -- common/autotest_common.sh@10 -- # set +x 00:29:51.818 04:31:42 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:51.818 04:31:42 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:51.818 04:31:42 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:52.077 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:52.077 Zero copy mechanism will not be used. 00:29:52.077 Running I/O for 2 seconds... 00:29:52.077 [2024-11-30 04:31:42.509479] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.077 [2024-11-30 04:31:42.509527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.077 [2024-11-30 04:31:42.509561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.077 [2024-11-30 04:31:42.517347] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.077 [2024-11-30 04:31:42.517377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.077 [2024-11-30 04:31:42.517420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.077 [2024-11-30 04:31:42.525918] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.077 [2024-11-30 04:31:42.525971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.077 [2024-11-30 04:31:42.526005] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.077 [2024-11-30 04:31:42.532858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.077 [2024-11-30 04:31:42.532887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.077 [2024-11-30 04:31:42.532919] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.077 [2024-11-30 04:31:42.538149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.077 [2024-11-30 04:31:42.538180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.077 [2024-11-30 04:31:42.538198] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.543148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.543177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11488 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.543210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.548197] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.548226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.548243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.553210] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.553252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:96 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.553268] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.558266] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.558294] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.558324] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.563212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.563255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.563272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.568164] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.568196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.568228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.572911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.572939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.572979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.577965] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.577992] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.578008] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.582780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.582823] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.582838] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.587615] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.587642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.587674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.592676] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.592704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.592735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.597667] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.597697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.597714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.601820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.601849] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.601866] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.605948] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.605988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.606006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.609810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.609839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.609870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.613794] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.613824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.613841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.618720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.618763] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.618779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.623498] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.623541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.623557] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.628159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.628188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.628205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.632256] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.632299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.632316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.636773] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.636802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.636834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.642085] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.642115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.642148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.647391] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.647421] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.647445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.652097] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.652141] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.652157] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.657268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.657297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.657314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.662414] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.662444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.078 [2024-11-30 04:31:42.662461] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.078 [2024-11-30 04:31:42.667355] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.078 [2024-11-30 04:31:42.667383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.079 [2024-11-30 04:31:42.667400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.079 [2024-11-30 04:31:42.672337] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.079 [2024-11-30 04:31:42.672364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:6112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.079 [2024-11-30 04:31:42.672381] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.079 [2024-11-30 04:31:42.677546] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.079 [2024-11-30 04:31:42.677573] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.079 [2024-11-30 04:31:42.677589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.079 [2024-11-30 04:31:42.682885] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.079 [2024-11-30 04:31:42.682913] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.079 [2024-11-30 04:31:42.682930] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.079 [2024-11-30 04:31:42.688051] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.079 [2024-11-30 04:31:42.688079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.079 [2024-11-30 04:31:42.688096] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.079 [2024-11-30 04:31:42.693012] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.079 [2024-11-30 04:31:42.693045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.079 [2024-11-30 04:31:42.693063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.079 [2024-11-30 04:31:42.698359] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.079 [2024-11-30 04:31:42.698389] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:12032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.079 [2024-11-30 04:31:42.698406] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.079 [2024-11-30 04:31:42.703429] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.079 [2024-11-30 04:31:42.703458] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.079 [2024-11-30 04:31:42.703475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.709080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.709124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.709141] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.714577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.714622] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.714639] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.720410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.720439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:7392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.720457] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.726630] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.726677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.726694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.732681] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.732712] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.732730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.738113] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.738159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.738176] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.743463] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.743493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.743510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.749027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.749056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.749073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.754939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.754981] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.755014] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.760577] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.760607] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:7552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.760640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.766368] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.766400] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.766419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.771998] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.772044] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.772063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.777178] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.777223] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:25056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.338 [2024-11-30 04:31:42.777241] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.338 [2024-11-30 04:31:42.782334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.338 [2024-11-30 04:31:42.782365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.782383] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.787254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.787283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.787306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.793148] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.793192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.793209] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.799332] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.799381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:2400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.799400] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.805737] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.805767] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:4256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.805785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.813387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.813418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.813436] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.821571] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.821616] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.821633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.828675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.828721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:24544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.828739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.835213] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.835243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.835260] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.842914] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.842971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.842994] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.850394] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.850427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.850445] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.857297] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.857328] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.857346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.862749] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.862779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.862797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.867236] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.867265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.867284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.872275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.872320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.872337] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.877399] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.877442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.877459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.882471] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.882501] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.882518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.887616] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.887644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:18432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.887661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.892797] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.892825] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.892863] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.339 [2024-11-30 04:31:42.898004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.339 [2024-11-30 04:31:42.898033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.339 [2024-11-30 04:31:42.898050] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.903039] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.903067] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.903083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.908416] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.908460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:14080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.908477] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.913474] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.913503] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.913520] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.918483] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.918512] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.918529] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.923774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.923803] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:10656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.923835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.928911] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.928940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.928963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.934131] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.934174] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.934191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.939440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.939475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:12480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.939510] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.944708] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.944737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.944755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.949846] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.949875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.949906] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.954987] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.955015] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:10560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.955031] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.960212] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.960240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.960258] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.340 [2024-11-30 04:31:42.965282] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.340 [2024-11-30 04:31:42.965326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.340 [2024-11-30 04:31:42.965343] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.600 [2024-11-30 04:31:42.970554] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.600 [2024-11-30 04:31:42.970582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.600 [2024-11-30 04:31:42.970598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.600 [2024-11-30 04:31:42.975496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.600 [2024-11-30 04:31:42.975542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.600 [2024-11-30 04:31:42.975560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.600 [2024-11-30 04:31:42.979720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.600 [2024-11-30 04:31:42.979749] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.600 [2024-11-30 04:31:42.979766] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.600 [2024-11-30 04:31:42.983674] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.600 [2024-11-30 04:31:42.983702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.600 [2024-11-30 04:31:42.983719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.600 [2024-11-30 04:31:42.988011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.600 [2024-11-30 04:31:42.988039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:21920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.600 [2024-11-30 04:31:42.988055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.600 [2024-11-30 04:31:42.993036] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.600 [2024-11-30 04:31:42.993065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.600 [2024-11-30 04:31:42.993082] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.600 [2024-11-30 04:31:42.998490] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.600 [2024-11-30 04:31:42.998519] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.600 [2024-11-30 04:31:42.998536] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.600 [2024-11-30 04:31:43.004122] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.600 [2024-11-30 04:31:43.004153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.600 [2024-11-30 04:31:43.004171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.600 [2024-11-30 04:31:43.008861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.008890] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.008907] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.013752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.013782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.013798] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.018770] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.018816] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.018836] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.023935] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.023972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.023997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.028477] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.028508] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.028527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.033284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.033314] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:3776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.033331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.038207] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.038236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:19968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.038253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.043417] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.043447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:22592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.043464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.048427] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.048456] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.048473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.053430] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.053459] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:14592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.053476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.058440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.058469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.058486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.063519] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.063548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.063579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.068700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.068735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.068754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.073453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.073499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.073517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.076706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.076735] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.076751] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.081612] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.081642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:20832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.081674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.086809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.086839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.086870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.091598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.091628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.091644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.096421] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.096465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.601 [2024-11-30 04:31:43.096481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.601 [2024-11-30 04:31:43.101439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.601 [2024-11-30 04:31:43.101466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.101481] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.106476] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.106504] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.106535] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.111460] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.111487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.111518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.116568] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.116596] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.116626] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.121637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.121663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.121694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.126752] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.126779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.126808] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.131867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.131896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.131926] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.136895] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.136943] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.136967] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.141858] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.141885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.141901] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.146756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.146785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.146816] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.151732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.151760] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.151797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.156552] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.156579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.156611] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.161551] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.161579] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.161610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.166410] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.166437] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.166467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.171219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.171269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.171284] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.176244] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.176272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.176287] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.181108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.181150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.181166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.186406] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.186433] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.186448] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.191371] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.191398] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.191429] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.602 [2024-11-30 04:31:43.196372] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.602 [2024-11-30 04:31:43.196416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.602 [2024-11-30 04:31:43.196433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.603 [2024-11-30 04:31:43.201043] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.603 [2024-11-30 04:31:43.201086] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.603 [2024-11-30 04:31:43.201101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.603 [2024-11-30 04:31:43.206015] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.603 [2024-11-30 04:31:43.206068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.603 [2024-11-30 04:31:43.206085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.603 [2024-11-30 04:31:43.210219] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.603 [2024-11-30 04:31:43.210247] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.603 [2024-11-30 04:31:43.210264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.603 [2024-11-30 04:31:43.214637] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.603 [2024-11-30 04:31:43.214666] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:10112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.603 [2024-11-30 04:31:43.214683] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.603 [2024-11-30 04:31:43.218876] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.603 [2024-11-30 04:31:43.218903] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.603 [2024-11-30 04:31:43.218920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.603 [2024-11-30 04:31:43.222917] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.603 [2024-11-30 04:31:43.222969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.603 [2024-11-30 04:31:43.222989] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.603 [2024-11-30 04:31:43.227739] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.603 [2024-11-30 04:31:43.227770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.603 [2024-11-30 04:31:43.227788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.232128] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.232158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.232181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.236453] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.236482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.236499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.240826] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.240855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.240888] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.245370] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.245414] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.245433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.249741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.249770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.249788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.253751] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.253795] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.253812] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.258120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.258150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.258167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.262560] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.262589] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.262606] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.266707] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.266736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.266753] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.270711] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.270745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.270780] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.274897] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.274927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:11552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.274945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.279538] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.279568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.279586] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.284908] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.284953] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.284979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.289881] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.289910] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.289928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.295120] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.295148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.295165] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.300455] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.300483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.300515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.305840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.305869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.305886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.310810] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.310853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.310869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.315832] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.315878] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.315893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.320901] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.320929] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.320945] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.326158] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.326187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.326203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.331194] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.331222] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.331253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.336188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.336216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.336233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.341358] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.341386] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.341401] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.863 [2024-11-30 04:31:43.346334] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.863 [2024-11-30 04:31:43.346377] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.863 [2024-11-30 04:31:43.346393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.351343] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.351371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.351388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.356706] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.356738] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.356761] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.361878] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.361906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.361923] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.366809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.366852] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.366868] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.371716] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.371744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.371760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.376633] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.376661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:17056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.376678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.381518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.381550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.381568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.386613] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.386642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.386678] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.391660] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.391703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:8256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.391720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.396834] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.396867] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.396885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.402029] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.402062] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.402095] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.407011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.407054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:6080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.407070] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.412027] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.412070] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.412086] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.417235] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.417280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:1888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.417296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.422184] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.422226] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:18592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.422242] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.427346] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.427373] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.427405] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.432470] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.432513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.432531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.437741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.437785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.437802] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.441828] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.441873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7712 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.441890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.445634] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.445664] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.445681] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.449572] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.449601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:18400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.449618] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.454064] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.454093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.454110] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.459224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.459253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.459285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.464284] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.464312] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.464329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.469233] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.469262] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.469279] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.474137] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.474165] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.864 [2024-11-30 04:31:43.474182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:52.864 [2024-11-30 04:31:43.479159] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.864 [2024-11-30 04:31:43.479187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.865 [2024-11-30 04:31:43.479219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:52.865 [2024-11-30 04:31:43.484276] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.865 [2024-11-30 04:31:43.484304] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.865 [2024-11-30 04:31:43.484326] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:52.865 [2024-11-30 04:31:43.489409] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:52.865 [2024-11-30 04:31:43.489438] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:52.865 [2024-11-30 04:31:43.489454] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.494661] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.494692] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.494725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.499848] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.499876] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:8960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.499910] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.505175] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.505206] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.505223] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.510387] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.510416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.510434] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.515518] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.515548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.515564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.520587] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.520631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.520647] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.525721] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.525764] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:24704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.525782] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.530820] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.530851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.530894] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.536033] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.536061] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.536077] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.541071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.541100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.541117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.546153] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.546197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.546240] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.551133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.551163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20384 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.551181] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.555838] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.555868] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.555886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.560909] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.560939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.560964] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.566023] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.124 [2024-11-30 04:31:43.566052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:4064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.124 [2024-11-30 04:31:43.566069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.124 [2024-11-30 04:31:43.570984] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.571028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:8064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.571051] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.576002] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.576046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.576063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.581149] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.581179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.581196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.586457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.586500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:17376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.586517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.591324] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.591353] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.591370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.596168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.596197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:8736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.596213] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.601487] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.601516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:20960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.601533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.606741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.606769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:19776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.606800] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.611829] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.611857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.611873] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.616868] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.616901] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.616935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.622251] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.622282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.622299] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.627624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.627669] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:9472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.627689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.632754] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.632782] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.632815] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.637887] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.637930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.637946] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.642505] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.642534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.642551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.646720] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.646748] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:22048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.646765] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.650857] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.650886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.650903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.654100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.654128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.654145] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.657262] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.657290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.657307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.660781] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.660809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.660826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.664553] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.664581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.664598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.668629] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.668658] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:22560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.668674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.672819] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.672848] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:20576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.672864] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.677180] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.677208] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.677225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.681439] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.681468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.681484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.685662] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.685690] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.685706] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.689774] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.125 [2024-11-30 04:31:43.689802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:9248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.125 [2024-11-30 04:31:43.689824] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.125 [2024-11-30 04:31:43.694062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.694090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.694122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.698071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.698099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.698115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.701850] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.701877] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.701893] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.705942] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.705978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.705995] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.709750] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.709778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:24800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.709795] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.713835] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.713863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.713880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.717899] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.717927] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.717944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.722689] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.722720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.722737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.727182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.727220] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.727239] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.732017] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.732046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.732063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.736928] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.736966] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.736986] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.741813] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.741843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.741860] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.746837] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.746866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.746883] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.126 [2024-11-30 04:31:43.751865] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.126 [2024-11-30 04:31:43.751895] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.126 [2024-11-30 04:31:43.751912] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.385 [2024-11-30 04:31:43.756874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.385 [2024-11-30 04:31:43.756904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:9344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.385 [2024-11-30 04:31:43.756921] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.385 [2024-11-30 04:31:43.761991] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.385 [2024-11-30 04:31:43.762021] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.385 [2024-11-30 04:31:43.762039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.385 [2024-11-30 04:31:43.767103] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.385 [2024-11-30 04:31:43.767133] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:1792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.385 [2024-11-30 04:31:43.767150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.385 [2024-11-30 04:31:43.771605] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.385 [2024-11-30 04:31:43.771634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:2016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.385 [2024-11-30 04:31:43.771651] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.385 [2024-11-30 04:31:43.777215] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.385 [2024-11-30 04:31:43.777246] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.385 [2024-11-30 04:31:43.777264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.385 [2024-11-30 04:31:43.783831] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.385 [2024-11-30 04:31:43.783866] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.385 [2024-11-30 04:31:43.783887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.385 [2024-11-30 04:31:43.790320] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.385 [2024-11-30 04:31:43.790364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.385 [2024-11-30 04:31:43.790380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.385 [2024-11-30 04:31:43.797874] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.385 [2024-11-30 04:31:43.797909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.385 [2024-11-30 04:31:43.797929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.385 [2024-11-30 04:31:43.804930] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.385 [2024-11-30 04:31:43.804968] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.385 [2024-11-30 04:31:43.805003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.385 [2024-11-30 04:31:43.811578] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.811608] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.811640] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.817129] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.817160] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.817178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.822598] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.822627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.822649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.827732] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.827761] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.827794] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.832685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.832727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.832744] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.837768] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.837797] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.837814] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.842635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.842678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.842694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.847700] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.847728] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:21504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.847760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.852997] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.853046] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:2976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.853065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.857780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.857810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:23008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.857827] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.862840] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.862869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.862903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.868048] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.868076] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:32 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.868091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.873108] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.873135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.873167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.878307] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.878334] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.878366] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.883464] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.883492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:1056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.883509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.888741] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.888769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.888801] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.894269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.894299] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.894331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.900078] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.900123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:17504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.900139] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.905522] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.905551] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.905583] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.910692] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.910721] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:12960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.910758] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.915438] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.915468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:19136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.915484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.919902] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.919931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.919948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.924275] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.924320] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:25568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.924339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.929084] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.929113] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:14144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.929146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.934073] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.934103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:10400 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.934136] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.938866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.938896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.938914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.943824] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.386 [2024-11-30 04:31:43.943854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.386 [2024-11-30 04:31:43.943872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.386 [2024-11-30 04:31:43.948993] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:43.949022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:4928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:43.949055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:43.953679] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:43.953713] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:7104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:43.953746] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:43.958511] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:43.958541] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:4576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:43.958559] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:43.963019] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:43.963049] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:43.963066] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:43.967995] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:43.968023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:43.968058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:43.974050] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:43.974095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:18464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:43.974112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:43.979952] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:43.979988] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:43.980020] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:43.985699] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:43.985742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:43.985759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:43.991227] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:43.991271] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:18304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:43.991288] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:43.996317] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:43.996362] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:15168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:43.996379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:44.002053] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:44.002083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:6752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:44.002101] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:44.008074] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:44.008122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:44.008142] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.387 [2024-11-30 04:31:44.013786] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.387 [2024-11-30 04:31:44.013817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:25152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.387 [2024-11-30 04:31:44.013834] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.646 [2024-11-30 04:31:44.019177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.646 [2024-11-30 04:31:44.019207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:13568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.646 [2024-11-30 04:31:44.019225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.646 [2024-11-30 04:31:44.024293] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.646 [2024-11-30 04:31:44.024323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:11072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.646 [2024-11-30 04:31:44.024356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.646 [2024-11-30 04:31:44.029428] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.646 [2024-11-30 04:31:44.029460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.646 [2024-11-30 04:31:44.029492] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.646 [2024-11-30 04:31:44.034584] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.646 [2024-11-30 04:31:44.034615] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.646 [2024-11-30 04:31:44.034632] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.646 [2024-11-30 04:31:44.039651] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.646 [2024-11-30 04:31:44.039695] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.646 [2024-11-30 04:31:44.039712] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.646 [2024-11-30 04:31:44.044496] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.646 [2024-11-30 04:31:44.044526] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:17760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.646 [2024-11-30 04:31:44.044549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.646 [2024-11-30 04:31:44.049624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.646 [2024-11-30 04:31:44.049652] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.646 [2024-11-30 04:31:44.049685] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.646 [2024-11-30 04:31:44.054635] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.646 [2024-11-30 04:31:44.054682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.646 [2024-11-30 04:31:44.054701] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.646 [2024-11-30 04:31:44.059296] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.646 [2024-11-30 04:31:44.059324] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.646 [2024-11-30 04:31:44.059356] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.646 [2024-11-30 04:31:44.064133] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.064163] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.064180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.069071] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.069099] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:10464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.069116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.073168] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.073197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:20768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.073214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.077127] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.077155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.077172] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.081117] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.081145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:3200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.081162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.085295] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.085329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.085347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.089985] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.090028] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.090044] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.095254] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.095283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:20704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.095315] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.100458] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.100486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.100503] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.105350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.105379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.105395] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.110301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.110329] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:8576 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.110345] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.115263] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.115292] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:17536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.115309] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.120323] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.120352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.120369] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.125288] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.125317] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:12096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.125334] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.130802] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.130832] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:20736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.130848] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.136398] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.136427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.136444] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.142861] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.142891] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.142908] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.150278] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.150323] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.150341] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.156537] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.156567] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.156585] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.162341] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.162372] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.162389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.166866] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.166896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:3264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.166913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.171100] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.171128] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.171144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.176095] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.176139] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.176161] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:5 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.181268] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.181296] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:18496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.181313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.187468] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.647 [2024-11-30 04:31:44.187498] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:11616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.647 [2024-11-30 04:31:44.187515] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.647 [2024-11-30 04:31:44.192780] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.192811] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:13184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.192828] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.197675] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.197703] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:24768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.197721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.203098] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.203127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:11456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.203144] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.208431] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.208462] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:4 nsid:1 lba:17664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.208479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:4 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.214089] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.214120] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:2144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.214138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.219943] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.219984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:4544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.220003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:13 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.225339] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.225371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:15968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.225388] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.230327] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.230358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.230375] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.235596] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.235627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.235645] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.238981] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.239023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.239039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.244177] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.244210] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:25440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.244230] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.249188] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.249217] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.249248] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.255030] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.255059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.255092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.261165] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.261211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.261228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.267624] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.267653] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.267689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.648 [2024-11-30 04:31:44.273423] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.648 [2024-11-30 04:31:44.273452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:22112 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.648 [2024-11-30 04:31:44.273484] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.279021] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.279052] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.279069] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.285062] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.285095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.285115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.291035] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.291065] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:16192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.291083] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.296250] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.296280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.296313] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.301242] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.301278] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.301296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.306827] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.306858] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.306876] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.312316] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.312354] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:21408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.312370] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.317588] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.317624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:1152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.317642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.323756] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.323786] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.323818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.330860] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.330907] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:11872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.330924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.336452] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.336482] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.336499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.342151] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.342182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.342199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.907 [2024-11-30 04:31:44.347440] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.907 [2024-11-30 04:31:44.347468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.907 [2024-11-30 04:31:44.347501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.352685] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.352718] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:12128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.352736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.358004] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.358032] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:8544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.358063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.363147] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.363175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:21632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.363207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.368226] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.368255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:8768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.368272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.373445] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.373474] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:2880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.373507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.378301] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.378330] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:20544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.378348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.382632] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.382661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.382692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.386867] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.386896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.386913] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.390845] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.390874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.390891] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.394809] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.394837] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:12800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.394855] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.399269] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.399297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.399314] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.404441] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.404471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:3680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.404497] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.410076] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.410105] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.410122] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.416182] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.416213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.416231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.422080] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.422110] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:14048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.422127] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.429451] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.429481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:6912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.429499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.435982] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.436013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:6368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.436030] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:3 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.442350] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.442380] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:13120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.442397] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.449224] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.449268] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:9184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.449285] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:9 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.454784] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.454814] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:6944 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.454832] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:10 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.460011] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.460041] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.460058] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.464843] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.464873] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:15296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.464890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:11 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.469118] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.469147] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:7680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.469164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.473198] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.473227] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:6 nsid:1 lba:8992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.473244] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:6 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.478709] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.478739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.478757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:14 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.484457] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.484487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:18976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.908 [2024-11-30 04:31:44.484504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:8 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:29:53.908 [2024-11-30 04:31:44.489556] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.908 [2024-11-30 04:31:44.489586] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:20032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.909 [2024-11-30 04:31:44.489603] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:12 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:29:53.909 [2024-11-30 04:31:44.494939] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.909 [2024-11-30 04:31:44.494978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.909 [2024-11-30 04:31:44.494997] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:7 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:29:53.909 [2024-11-30 04:31:44.500369] nvme_tcp.c:1391:nvme_tcp_accel_seq_recv_compute_crc32_done: *ERROR*: data digest error on tqpair=(0x131f190) 00:29:53.909 [2024-11-30 04:31:44.500399] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:29:53.909 [2024-11-30 04:31:44.500421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:29:53.909 00:29:53.909 Latency(us) 00:29:53.909 [2024-11-30T03:31:44.540Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:53.909 [2024-11-30T03:31:44.540Z] Job: nvme0n1 (Core Mask 0x2, workload: randread, depth: 16, IO size: 131072) 00:29:53.909 nvme0n1 : 2.00 6050.13 756.27 0.00 0.00 2640.24 591.64 10340.12 00:29:53.909 [2024-11-30T03:31:44.540Z] =================================================================================================================== 00:29:53.909 [2024-11-30T03:31:44.540Z] Total : 6050.13 756.27 0.00 0.00 2640.24 591.64 10340.12 00:29:53.909 0 00:29:53.909 04:31:44 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:53.909 04:31:44 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:53.909 04:31:44 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:53.909 04:31:44 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:53.909 | .driver_specific 00:29:53.909 | .nvme_error 00:29:53.909 | .status_code 00:29:53.909 | .command_transient_transport_error' 00:29:54.167 04:31:44 -- host/digest.sh@71 -- # (( 390 > 0 )) 00:29:54.167 04:31:44 -- host/digest.sh@73 -- # killprocess 2485932 00:29:54.167 04:31:44 -- common/autotest_common.sh@936 -- # '[' -z 2485932 ']' 00:29:54.167 04:31:44 -- common/autotest_common.sh@940 -- # kill -0 2485932 00:29:54.167 04:31:44 -- common/autotest_common.sh@941 -- # uname 00:29:54.167 04:31:44 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:54.167 04:31:44 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2485932 00:29:54.425 04:31:44 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:54.425 04:31:44 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:54.425 04:31:44 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2485932' 00:29:54.425 killing process with pid 2485932 00:29:54.425 04:31:44 -- common/autotest_common.sh@955 -- # kill 2485932 00:29:54.425 Received shutdown signal, test time was about 2.000000 seconds 00:29:54.425 00:29:54.425 Latency(us) 00:29:54.425 [2024-11-30T03:31:45.056Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:54.425 [2024-11-30T03:31:45.056Z] =================================================================================================================== 00:29:54.425 [2024-11-30T03:31:45.056Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:54.425 04:31:44 -- common/autotest_common.sh@960 -- # wait 2485932 00:29:54.425 04:31:45 -- host/digest.sh@113 -- # run_bperf_err randwrite 4096 128 00:29:54.425 04:31:45 -- host/digest.sh@54 -- # local rw bs qd 00:29:54.425 04:31:45 -- host/digest.sh@56 -- # rw=randwrite 00:29:54.425 04:31:45 -- host/digest.sh@56 -- # bs=4096 00:29:54.425 04:31:45 -- host/digest.sh@56 -- # qd=128 00:29:54.425 04:31:45 -- host/digest.sh@58 -- # bperfpid=2486483 00:29:54.425 04:31:45 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 4096 -t 2 -q 128 -z 00:29:54.425 04:31:45 -- host/digest.sh@60 -- # waitforlisten 2486483 /var/tmp/bperf.sock 00:29:54.425 04:31:45 -- common/autotest_common.sh@829 -- # '[' -z 2486483 ']' 00:29:54.425 04:31:45 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:54.425 04:31:45 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:54.425 04:31:45 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:54.425 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:54.425 04:31:45 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:54.425 04:31:45 -- common/autotest_common.sh@10 -- # set +x 00:29:54.682 [2024-11-30 04:31:45.085844] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:54.682 [2024-11-30 04:31:45.085931] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2486483 ] 00:29:54.682 EAL: No free 2048 kB hugepages reported on node 1 00:29:54.682 [2024-11-30 04:31:45.147918] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:54.682 [2024-11-30 04:31:45.236542] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:54.939 04:31:45 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:54.939 04:31:45 -- common/autotest_common.sh@862 -- # return 0 00:29:54.939 04:31:45 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:54.939 04:31:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:55.196 04:31:45 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:55.196 04:31:45 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.196 04:31:45 -- common/autotest_common.sh@10 -- # set +x 00:29:55.196 04:31:45 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.196 04:31:45 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:55.196 04:31:45 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:55.762 nvme0n1 00:29:55.762 04:31:46 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 256 00:29:55.762 04:31:46 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:55.762 04:31:46 -- common/autotest_common.sh@10 -- # set +x 00:29:55.762 04:31:46 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:55.762 04:31:46 -- host/digest.sh@69 -- # bperf_py perform_tests 00:29:55.762 04:31:46 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:29:55.762 Running I/O for 2 seconds... 00:29:55.762 [2024-11-30 04:31:46.250828] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.251121] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:2778 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.251159] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:55.762 [2024-11-30 04:31:46.263785] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.264037] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:15667 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.264068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:55.762 [2024-11-30 04:31:46.276895] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.277138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:24599 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.277167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:55.762 [2024-11-30 04:31:46.289905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.290122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:13404 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.290151] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:55.762 [2024-11-30 04:31:46.303262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.303577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:21017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.303607] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:55.762 [2024-11-30 04:31:46.316419] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.316702] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:16479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.316731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:55.762 [2024-11-30 04:31:46.329551] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.329813] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:16994 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.329841] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:55.762 [2024-11-30 04:31:46.342641] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.342874] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:22791 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.342902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:55.762 [2024-11-30 04:31:46.355766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.356016] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:21165 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.356045] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:55.762 [2024-11-30 04:31:46.368825] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.369075] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:18962 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.369103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:55.762 [2024-11-30 04:31:46.382004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:55.762 [2024-11-30 04:31:46.382253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:13356 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:55.762 [2024-11-30 04:31:46.382281] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.021 [2024-11-30 04:31:46.394937] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.021 [2024-11-30 04:31:46.395177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:16361 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.021 [2024-11-30 04:31:46.395205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.021 [2024-11-30 04:31:46.408076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.021 [2024-11-30 04:31:46.408307] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:424 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.021 [2024-11-30 04:31:46.408335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.021 [2024-11-30 04:31:46.421147] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.021 [2024-11-30 04:31:46.421379] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:17224 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.021 [2024-11-30 04:31:46.421416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.021 [2024-11-30 04:31:46.434404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.021 [2024-11-30 04:31:46.434727] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:2238 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.021 [2024-11-30 04:31:46.434755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.021 [2024-11-30 04:31:46.447701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.021 [2024-11-30 04:31:46.447954] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:24567 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.021 [2024-11-30 04:31:46.447992] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.021 [2024-11-30 04:31:46.460843] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.021 [2024-11-30 04:31:46.461091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:17929 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.021 [2024-11-30 04:31:46.461119] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.021 [2024-11-30 04:31:46.473932] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.021 [2024-11-30 04:31:46.474204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:24176 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.021 [2024-11-30 04:31:46.474233] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.021 [2024-11-30 04:31:46.486821] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.021 [2024-11-30 04:31:46.487125] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:19539 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.021 [2024-11-30 04:31:46.487153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.021 [2024-11-30 04:31:46.499655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.021 [2024-11-30 04:31:46.499921] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:14488 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.021 [2024-11-30 04:31:46.499949] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.021 [2024-11-30 04:31:46.512685] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.021 [2024-11-30 04:31:46.512971] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:11971 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.513001] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.022 [2024-11-30 04:31:46.525756] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.022 [2024-11-30 04:31:46.526080] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:11623 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.526109] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.022 [2024-11-30 04:31:46.538757] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.022 [2024-11-30 04:31:46.539036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:21011 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.539064] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.022 [2024-11-30 04:31:46.551952] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.022 [2024-11-30 04:31:46.552195] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:23456 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.552228] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.022 [2024-11-30 04:31:46.565139] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.022 [2024-11-30 04:31:46.565393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:20664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.565421] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.022 [2024-11-30 04:31:46.578275] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.022 [2024-11-30 04:31:46.578540] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:9082 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.578568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.022 [2024-11-30 04:31:46.591438] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.022 [2024-11-30 04:31:46.591751] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:25112 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.591779] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.022 [2024-11-30 04:31:46.604672] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.022 [2024-11-30 04:31:46.604987] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:4948 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.605021] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.022 [2024-11-30 04:31:46.617855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.022 [2024-11-30 04:31:46.618146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:22713 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.618174] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.022 [2024-11-30 04:31:46.631122] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.022 [2024-11-30 04:31:46.631361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:21350 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.631390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.022 [2024-11-30 04:31:46.644121] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.022 [2024-11-30 04:31:46.644387] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:15212 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.022 [2024-11-30 04:31:46.644415] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.280 [2024-11-30 04:31:46.656818] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.280 [2024-11-30 04:31:46.657091] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:23660 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.280 [2024-11-30 04:31:46.657120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.280 [2024-11-30 04:31:46.669815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.280 [2024-11-30 04:31:46.670126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:19846 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.670154] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.683074] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.683346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:5466 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.683374] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.696015] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.696258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:16904 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.696286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.709097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.709349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:15372 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.709377] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.722261] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.722536] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:1491 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.722568] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.736113] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.736391] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:14578 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.736419] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.750299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.750565] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19670 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.750593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.764296] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.764581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:10696 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.764619] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.778387] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.778673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:2624 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.778709] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.792900] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.793155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:829 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.793186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.806984] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.807286] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:14255 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.807316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.821075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.821396] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:2472 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.821425] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.835187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.835449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:17246 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.835479] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.849237] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.849599] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:20664 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.849629] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.863150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.863442] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.863473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.877092] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.877450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:20001 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.877480] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.891046] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.891291] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:5041 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.891320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.281 [2024-11-30 04:31:46.904835] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.281 [2024-11-30 04:31:46.905122] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:6991 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.281 [2024-11-30 04:31:46.905153] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:46.918349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:46.918624] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:8600 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:46.918654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:46.931855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:46.932155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:15895 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:46.932186] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:46.945771] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:46.946069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:13736 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:46.946100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:46.959736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:46.960034] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:21602 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:46.960065] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:46.973766] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:46.974068] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:21258 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:46.974100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:46.987657] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:46.987923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:15073 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:46.987965] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:47.001363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:47.001662] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:4517 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:47.001692] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:47.015423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:47.015707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:12989 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:47.015736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:47.029428] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:47.029709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:6479 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:47.029740] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:47.043445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:47.043725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:6724 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:47.043754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:47.057416] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:47.057697] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:6139 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:47.057726] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.540 [2024-11-30 04:31:47.071440] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.540 [2024-11-30 04:31:47.071720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:8348 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.540 [2024-11-30 04:31:47.071749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.541 [2024-11-30 04:31:47.085500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.541 [2024-11-30 04:31:47.085779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:6893 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.541 [2024-11-30 04:31:47.085807] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.541 [2024-11-30 04:31:47.099445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.541 [2024-11-30 04:31:47.099731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:3189 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.541 [2024-11-30 04:31:47.099760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.541 [2024-11-30 04:31:47.113458] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.541 [2024-11-30 04:31:47.113734] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:746 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.541 [2024-11-30 04:31:47.113763] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.541 [2024-11-30 04:31:47.127448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.541 [2024-11-30 04:31:47.127739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:7601 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.541 [2024-11-30 04:31:47.127773] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.541 [2024-11-30 04:31:47.141508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.541 [2024-11-30 04:31:47.141790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:8033 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.541 [2024-11-30 04:31:47.141818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.541 [2024-11-30 04:31:47.155498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.541 [2024-11-30 04:31:47.155779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:25114 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.541 [2024-11-30 04:31:47.155806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.541 [2024-11-30 04:31:47.169391] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.541 [2024-11-30 04:31:47.169678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:4259 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.541 [2024-11-30 04:31:47.169707] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.183351] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.799 [2024-11-30 04:31:47.183627] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:21781 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.799 [2024-11-30 04:31:47.183656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.197402] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.799 [2024-11-30 04:31:47.197680] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:19729 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.799 [2024-11-30 04:31:47.197708] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.211394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.799 [2024-11-30 04:31:47.211742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:22089 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.799 [2024-11-30 04:31:47.211770] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.225350] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.799 [2024-11-30 04:31:47.225642] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:1353 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.799 [2024-11-30 04:31:47.225670] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.239470] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.799 [2024-11-30 04:31:47.239754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:1879 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.799 [2024-11-30 04:31:47.239783] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.253516] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.799 [2024-11-30 04:31:47.253804] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:19288 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.799 [2024-11-30 04:31:47.253830] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.267454] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.799 [2024-11-30 04:31:47.267750] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:11399 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.799 [2024-11-30 04:31:47.267778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.281426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.799 [2024-11-30 04:31:47.281707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:1260 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.799 [2024-11-30 04:31:47.281754] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.295515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.799 [2024-11-30 04:31:47.295791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:3190 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.799 [2024-11-30 04:31:47.295820] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.309583] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.799 [2024-11-30 04:31:47.309875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:6273 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.799 [2024-11-30 04:31:47.309903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.799 [2024-11-30 04:31:47.323506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.800 [2024-11-30 04:31:47.323791] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:17097 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.800 [2024-11-30 04:31:47.323819] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.800 [2024-11-30 04:31:47.337473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.800 [2024-11-30 04:31:47.337747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:23952 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.800 [2024-11-30 04:31:47.337775] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.800 [2024-11-30 04:31:47.351469] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.800 [2024-11-30 04:31:47.351741] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:19933 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.800 [2024-11-30 04:31:47.351772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.800 [2024-11-30 04:31:47.365381] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.800 [2024-11-30 04:31:47.365661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:20419 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.800 [2024-11-30 04:31:47.365689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.800 [2024-11-30 04:31:47.379433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.800 [2024-11-30 04:31:47.379716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:3957 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.800 [2024-11-30 04:31:47.379747] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.800 [2024-11-30 04:31:47.393403] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.800 [2024-11-30 04:31:47.393758] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:6436 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.800 [2024-11-30 04:31:47.393805] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.800 [2024-11-30 04:31:47.407409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.800 [2024-11-30 04:31:47.407674] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:8299 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.800 [2024-11-30 04:31:47.407702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:56.800 [2024-11-30 04:31:47.421489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:56.800 [2024-11-30 04:31:47.421780] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:1865 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:56.800 [2024-11-30 04:31:47.421826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.435285] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.435581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:9057 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.058 [2024-11-30 04:31:47.435610] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.449311] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.449603] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:9098 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.058 [2024-11-30 04:31:47.449631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.463359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.463636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:19054 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.058 [2024-11-30 04:31:47.463664] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.477432] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.477700] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:16940 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.058 [2024-11-30 04:31:47.477730] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.491497] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.491785] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:22482 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.058 [2024-11-30 04:31:47.491818] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.505415] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.505709] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:6293 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.058 [2024-11-30 04:31:47.505739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.519522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.519808] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:3490 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.058 [2024-11-30 04:31:47.519837] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.533523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.533812] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:23157 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.058 [2024-11-30 04:31:47.533842] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.547598] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.547909] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:12413 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.058 [2024-11-30 04:31:47.547937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.561692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.561986] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:22020 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.058 [2024-11-30 04:31:47.562034] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.058 [2024-11-30 04:31:47.575890] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.058 [2024-11-30 04:31:47.576216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:18742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.059 [2024-11-30 04:31:47.576246] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.059 [2024-11-30 04:31:47.589996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.059 [2024-11-30 04:31:47.590288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:24352 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.059 [2024-11-30 04:31:47.590319] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.059 [2024-11-30 04:31:47.604097] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.059 [2024-11-30 04:31:47.604384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:7560 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.059 [2024-11-30 04:31:47.604413] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.059 [2024-11-30 04:31:47.618155] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.059 [2024-11-30 04:31:47.618476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:23946 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.059 [2024-11-30 04:31:47.618524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.059 [2024-11-30 04:31:47.632204] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.059 [2024-11-30 04:31:47.632489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:21446 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.059 [2024-11-30 04:31:47.632518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.059 [2024-11-30 04:31:47.646308] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.059 [2024-11-30 04:31:47.646583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:3603 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.059 [2024-11-30 04:31:47.646614] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.059 [2024-11-30 04:31:47.660242] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.059 [2024-11-30 04:31:47.660525] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:9609 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.059 [2024-11-30 04:31:47.660553] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.059 [2024-11-30 04:31:47.674333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.059 [2024-11-30 04:31:47.674629] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:19144 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.059 [2024-11-30 04:31:47.674657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.059 [2024-11-30 04:31:47.688312] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.059 [2024-11-30 04:31:47.688628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:23904 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.059 [2024-11-30 04:31:47.688657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.702212] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.702489] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:10794 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.702517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.716251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.716534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:12164 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.716561] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.730343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.730628] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:2385 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.730656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.744027] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.744243] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:5506 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.744271] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.758045] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.758248] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:1325 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.758276] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.771841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.772124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:10481 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.772152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.785889] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.786180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:15013 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.786210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.799970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.800219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:8475 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.800247] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.813927] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.814193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:2518 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.814221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.828010] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.828295] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:24498 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.828323] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.842160] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.842465] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:14390 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.842493] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.856255] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.856568] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:6276 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.856597] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.870276] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.870564] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:25039 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.870593] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.884353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.884626] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:2080 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.884654] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.898343] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.898618] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:16742 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.898646] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.912357] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.912635] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:21903 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.912663] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.926423] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.926744] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:4016 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.926790] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.318 [2024-11-30 04:31:47.940494] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.318 [2024-11-30 04:31:47.940817] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:2815 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.318 [2024-11-30 04:31:47.940845] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:47.954143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:47.954410] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:11652 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:47.954438] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:47.968223] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:47.968505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:6519 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:47.968533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:47.982299] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:47.982582] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:1285 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:47.982615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:47.996335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:47.996621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:24452 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:47.996649] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:48.010617] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:48.010896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:2517 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:48.010925] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:48.024605] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:48.024889] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:1770 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:48.024918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:48.038611] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:48.038886] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:12358 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:48.038917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:48.052618] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:48.052947] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:10581 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:48.052983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:48.066597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:48.066888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:12168 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:48.066920] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:48.080680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:48.080975] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:7174 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:48.081003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:48.094670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:48.095006] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:3804 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:48.095036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:48.108783] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:48.109093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:24199 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:48.109121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:48.122877] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.577 [2024-11-30 04:31:48.123238] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:4544 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.577 [2024-11-30 04:31:48.123270] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:122 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.577 [2024-11-30 04:31:48.136922] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.578 [2024-11-30 04:31:48.137221] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:17 nsid:1 lba:4185 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.578 [2024-11-30 04:31:48.137266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:17 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.578 [2024-11-30 04:31:48.151070] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.578 [2024-11-30 04:31:48.151361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:33 nsid:1 lba:10017 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.578 [2024-11-30 04:31:48.151389] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:33 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.578 [2024-11-30 04:31:48.165128] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.578 [2024-11-30 04:31:48.165445] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:49 nsid:1 lba:12706 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.578 [2024-11-30 04:31:48.165476] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:49 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.578 [2024-11-30 04:31:48.179222] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.578 [2024-11-30 04:31:48.179550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:65 nsid:1 lba:25486 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.578 [2024-11-30 04:31:48.179577] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:65 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.578 [2024-11-30 04:31:48.193266] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.578 [2024-11-30 04:31:48.193569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:81 nsid:1 lba:21215 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.578 [2024-11-30 04:31:48.193600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:81 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.578 [2024-11-30 04:31:48.207229] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.578 [2024-11-30 04:31:48.207538] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:2655 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.578 [2024-11-30 04:31:48.207566] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:97 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.837 [2024-11-30 04:31:48.221207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.837 [2024-11-30 04:31:48.221500] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:113 nsid:1 lba:23447 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.837 [2024-11-30 04:31:48.221527] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:113 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.837 [2024-11-30 04:31:48.235322] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a3f0) with pdu=0x2000190fe720 00:29:57.837 [2024-11-30 04:31:48.235614] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:123 nsid:1 lba:18930 len:1 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:29:57.837 [2024-11-30 04:31:48.235642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:123 cdw0:0 sqhd:007c p:0 m:0 dnr:0 00:29:57.837 00:29:57.837 Latency(us) 00:29:57.837 [2024-11-30T03:31:48.468Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:57.837 [2024-11-30T03:31:48.468Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 128, IO size: 4096) 00:29:57.837 nvme0n1 : 2.01 18530.58 72.39 0.00 0.00 6892.14 2864.17 14466.47 00:29:57.837 [2024-11-30T03:31:48.468Z] =================================================================================================================== 00:29:57.837 [2024-11-30T03:31:48.468Z] Total : 18530.58 72.39 0.00 0.00 6892.14 2864.17 14466.47 00:29:57.837 0 00:29:57.837 04:31:48 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:29:57.837 04:31:48 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:29:57.837 04:31:48 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:29:57.837 04:31:48 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:29:57.837 | .driver_specific 00:29:57.837 | .nvme_error 00:29:57.837 | .status_code 00:29:57.837 | .command_transient_transport_error' 00:29:58.095 04:31:48 -- host/digest.sh@71 -- # (( 145 > 0 )) 00:29:58.095 04:31:48 -- host/digest.sh@73 -- # killprocess 2486483 00:29:58.095 04:31:48 -- common/autotest_common.sh@936 -- # '[' -z 2486483 ']' 00:29:58.095 04:31:48 -- common/autotest_common.sh@940 -- # kill -0 2486483 00:29:58.095 04:31:48 -- common/autotest_common.sh@941 -- # uname 00:29:58.095 04:31:48 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:29:58.095 04:31:48 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2486483 00:29:58.095 04:31:48 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:29:58.095 04:31:48 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:29:58.095 04:31:48 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2486483' 00:29:58.095 killing process with pid 2486483 00:29:58.095 04:31:48 -- common/autotest_common.sh@955 -- # kill 2486483 00:29:58.095 Received shutdown signal, test time was about 2.000000 seconds 00:29:58.095 00:29:58.095 Latency(us) 00:29:58.095 [2024-11-30T03:31:48.726Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:29:58.095 [2024-11-30T03:31:48.726Z] =================================================================================================================== 00:29:58.095 [2024-11-30T03:31:48.726Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:29:58.095 04:31:48 -- common/autotest_common.sh@960 -- # wait 2486483 00:29:58.353 04:31:48 -- host/digest.sh@114 -- # run_bperf_err randwrite 131072 16 00:29:58.353 04:31:48 -- host/digest.sh@54 -- # local rw bs qd 00:29:58.353 04:31:48 -- host/digest.sh@56 -- # rw=randwrite 00:29:58.353 04:31:48 -- host/digest.sh@56 -- # bs=131072 00:29:58.353 04:31:48 -- host/digest.sh@56 -- # qd=16 00:29:58.353 04:31:48 -- host/digest.sh@58 -- # bperfpid=2486916 00:29:58.353 04:31:48 -- host/digest.sh@60 -- # waitforlisten 2486916 /var/tmp/bperf.sock 00:29:58.353 04:31:48 -- host/digest.sh@57 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf -m 2 -r /var/tmp/bperf.sock -w randwrite -o 131072 -t 2 -q 16 -z 00:29:58.353 04:31:48 -- common/autotest_common.sh@829 -- # '[' -z 2486916 ']' 00:29:58.353 04:31:48 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/bperf.sock 00:29:58.353 04:31:48 -- common/autotest_common.sh@834 -- # local max_retries=100 00:29:58.353 04:31:48 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock...' 00:29:58.353 Waiting for process to start up and listen on UNIX domain socket /var/tmp/bperf.sock... 00:29:58.353 04:31:48 -- common/autotest_common.sh@838 -- # xtrace_disable 00:29:58.353 04:31:48 -- common/autotest_common.sh@10 -- # set +x 00:29:58.353 [2024-11-30 04:31:48.808339] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:29:58.353 [2024-11-30 04:31:48.808415] [ DPDK EAL parameters: bdevperf --no-shconf -c 2 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2486916 ] 00:29:58.353 I/O size of 131072 is greater than zero copy threshold (65536). 00:29:58.353 Zero copy mechanism will not be used. 00:29:58.353 EAL: No free 2048 kB hugepages reported on node 1 00:29:58.353 [2024-11-30 04:31:48.872774] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:29:58.353 [2024-11-30 04:31:48.961049] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:29:59.287 04:31:49 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:29:59.287 04:31:49 -- common/autotest_common.sh@862 -- # return 0 00:29:59.287 04:31:49 -- host/digest.sh@61 -- # bperf_rpc bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:59.287 04:31:49 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_set_options --nvme-error-stat --bdev-retry-count -1 00:29:59.544 04:31:50 -- host/digest.sh@63 -- # rpc_cmd accel_error_inject_error -o crc32c -t disable 00:29:59.544 04:31:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:29:59.544 04:31:50 -- common/autotest_common.sh@10 -- # set +x 00:29:59.545 04:31:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:29:59.545 04:31:50 -- host/digest.sh@64 -- # bperf_rpc bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:29:59.545 04:31:50 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_nvme_attach_controller --ddgst -t tcp -a 10.0.0.2 -s 4420 -f ipv4 -n nqn.2016-06.io.spdk:cnode1 -b nvme0 00:30:00.109 nvme0n1 00:30:00.109 04:31:50 -- host/digest.sh@67 -- # rpc_cmd accel_error_inject_error -o crc32c -t corrupt -i 32 00:30:00.109 04:31:50 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:00.109 04:31:50 -- common/autotest_common.sh@10 -- # set +x 00:30:00.109 04:31:50 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:00.109 04:31:50 -- host/digest.sh@69 -- # bperf_py perform_tests 00:30:00.109 04:31:50 -- host/digest.sh@19 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/examples/bdev/bdevperf/bdevperf.py -s /var/tmp/bperf.sock perform_tests 00:30:00.109 I/O size of 131072 is greater than zero copy threshold (65536). 00:30:00.109 Zero copy mechanism will not be used. 00:30:00.109 Running I/O for 2 seconds... 00:30:00.109 [2024-11-30 04:31:50.715845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.109 [2024-11-30 04:31:50.716405] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.109 [2024-11-30 04:31:50.716473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.109 [2024-11-30 04:31:50.721254] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.109 [2024-11-30 04:31:50.721888] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.109 [2024-11-30 04:31:50.721924] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.109 [2024-11-30 04:31:50.726543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.109 [2024-11-30 04:31:50.727073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.109 [2024-11-30 04:31:50.727105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.109 [2024-11-30 04:31:50.732062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.109 [2024-11-30 04:31:50.732457] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.109 [2024-11-30 04:31:50.732572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.109 [2024-11-30 04:31:50.737660] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.109 [2024-11-30 04:31:50.737923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.109 [2024-11-30 04:31:50.738205] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.743044] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.743597] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1248 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.743691] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.748370] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.748609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.748722] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.753910] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.754200] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.754245] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.759642] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.759836] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.759869] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.765085] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.765631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.765749] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.770500] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.770806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.770840] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.775279] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.775790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.775823] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.780554] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.780879] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.781097] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.785739] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.786216] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.786262] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.791089] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.791486] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.791571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.796395] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.796754] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.796788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.801731] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.802252] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.802422] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.807111] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.807263] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.807335] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.812394] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.812925] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.813063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.817681] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.817937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.817979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.823054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.823598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.823631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.828328] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.370 [2024-11-30 04:31:50.828663] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.370 [2024-11-30 04:31:50.828697] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.370 [2024-11-30 04:31:50.834179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.834351] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:24960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.834459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.839659] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.839939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.840073] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.844906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.845371] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.845404] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.850284] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.850725] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.850759] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.855719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.856097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12544 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.856180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.861323] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.861578] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.861682] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.866906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.867202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.867232] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.872117] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.872534] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:3360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.872634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.877460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.877771] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.877983] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.882735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.883193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.883222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.888161] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.888706] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.888760] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.893579] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.893930] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.893971] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.898694] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.898882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11680 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.898915] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.904674] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.904939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.904982] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.911196] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.911516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.911548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.917449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.917661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.917693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.923449] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.923598] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.923630] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.929761] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.930357] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.930390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.935527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.935985] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.936106] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.941001] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.941231] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.941344] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.947335] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.947634] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.371 [2024-11-30 04:31:50.947739] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.371 [2024-11-30 04:31:50.952804] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.371 [2024-11-30 04:31:50.953145] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.372 [2024-11-30 04:31:50.953275] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.372 [2024-11-30 04:31:50.958184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.372 [2024-11-30 04:31:50.958475] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:25024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.372 [2024-11-30 04:31:50.958508] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.372 [2024-11-30 04:31:50.963635] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.372 [2024-11-30 04:31:50.964180] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:7072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.372 [2024-11-30 04:31:50.964243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.372 [2024-11-30 04:31:50.969179] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.372 [2024-11-30 04:31:50.969819] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.372 [2024-11-30 04:31:50.969851] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.372 [2024-11-30 04:31:50.974782] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.372 [2024-11-30 04:31:50.975100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.372 [2024-11-30 04:31:50.975132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.372 [2024-11-30 04:31:50.979858] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.372 [2024-11-30 04:31:50.980250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:15808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.372 [2024-11-30 04:31:50.980296] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.372 [2024-11-30 04:31:50.984758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.372 [2024-11-30 04:31:50.985166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.372 [2024-11-30 04:31:50.985231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.372 [2024-11-30 04:31:50.989748] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.372 [2024-11-30 04:31:50.990258] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.372 [2024-11-30 04:31:50.990322] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.372 [2024-11-30 04:31:50.994668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.372 [2024-11-30 04:31:50.995077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.372 [2024-11-30 04:31:50.995107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:50.999544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:50.999802] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:22336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:50.999854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.004453] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.004827] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:51.004963] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.009409] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.009905] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:51.009935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.014170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.014773] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:51.014897] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.019057] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.019595] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:51.019628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.024410] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.024916] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:51.024948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.029518] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.030060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:51.030090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.035140] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.035527] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:64 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:51.035560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.040460] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.041152] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:51.041183] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.045905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.046111] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:51.046210] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.051485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.051736] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.632 [2024-11-30 04:31:51.051806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.632 [2024-11-30 04:31:51.058171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.632 [2024-11-30 04:31:51.058427] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.058459] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.064544] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.064659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.064719] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.071344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.071657] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.071742] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.077215] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.077529] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.077644] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.083115] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.083775] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.083829] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.088885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.089170] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:18720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.089200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.094970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.095167] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.095301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.100616] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.100984] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.101103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.106491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.106923] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.107047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.112841] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.113115] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.113180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.118885] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.119211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.119320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.124326] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.125030] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.125061] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.129861] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.130587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.130656] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.135163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.135855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.135887] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.140836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.141499] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.141533] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.146443] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.147090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.147120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.152054] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.152469] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.152578] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.158087] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.158361] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.158393] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.164704] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.164945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.165072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.171514] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.171654] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.171686] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.178136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.178401] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.633 [2024-11-30 04:31:51.178433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.633 [2024-11-30 04:31:51.184251] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.633 [2024-11-30 04:31:51.184704] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21056 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.184736] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.189915] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.190177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.190207] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.195530] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.195937] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.196055] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.201191] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.201444] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.201524] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.206862] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.207079] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.207169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.212606] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.213072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.213150] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.217623] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.218232] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.218282] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.222842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.223403] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1664 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.223469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.228018] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.228647] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.228695] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.233197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.233747] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14528 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.233835] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.238707] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.239069] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.239099] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.243905] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.244417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9152 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.244450] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.249217] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.249590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.249661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.634 [2024-11-30 04:31:51.255359] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.634 [2024-11-30 04:31:51.255620] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.634 [2024-11-30 04:31:51.255653] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.261725] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.262149] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.262238] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.267269] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.267683] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.267716] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.273177] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.273569] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:2720 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.273690] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.279006] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.279363] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.279396] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.285736] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.286036] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.286123] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.292302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.292476] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.292509] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.298456] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.298853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.298952] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.304508] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.305090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.305166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.310127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.310550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.310624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.316717] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.316896] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.317015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.322774] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.322980] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.323085] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.329048] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.894 [2024-11-30 04:31:51.329439] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.894 [2024-11-30 04:31:51.329471] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.894 [2024-11-30 04:31:51.335355] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.335543] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.335575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.341398] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.341731] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.341764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.346842] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.347352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.347386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.352710] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.352978] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.353103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.358829] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.359104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.359182] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.365585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.365915] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23296 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.365947] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.371896] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.372157] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17984 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.372264] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.378495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.378659] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.378731] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.383760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.384153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.384215] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.389143] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.389682] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.389757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.394485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.394882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.394934] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.399794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.400255] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22784 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.400365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.405178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.405820] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.405928] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.410495] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.410972] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.411072] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.415863] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.416240] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6624 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.416306] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.421832] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.422190] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:16000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.422220] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.427445] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.427931] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17184 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.427972] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.432485] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.433082] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.433259] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.437857] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.438431] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.438465] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.442981] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.443606] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19808 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.443657] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.895 [2024-11-30 04:31:51.448487] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.895 [2024-11-30 04:31:51.448872] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.895 [2024-11-30 04:31:51.448904] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.453539] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.454094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23840 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.454146] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.459017] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.459345] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.459398] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.464712] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.465092] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.465126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.470498] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.470711] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.470743] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.476080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.476483] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.476517] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.481506] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.481941] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22496 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.481988] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.487136] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.487316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.487424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.492983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.493450] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.493483] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.498860] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.499109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:1024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.499216] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.504489] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.504699] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23744 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.504872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.510134] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.510298] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21216 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.510330] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.515746] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.516341] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17920 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.516376] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:00.896 [2024-11-30 04:31:51.521384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:00.896 [2024-11-30 04:31:51.521562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:00.896 [2024-11-30 04:31:51.521595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.155 [2024-11-30 04:31:51.527080] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.155 [2024-11-30 04:31:51.527282] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.155 [2024-11-30 04:31:51.527333] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.155 [2024-11-30 04:31:51.532670] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.155 [2024-11-30 04:31:51.532967] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:3520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.155 [2024-11-30 04:31:51.533016] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.155 [2024-11-30 04:31:51.537815] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.155 [2024-11-30 04:31:51.538277] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5024 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.538307] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.542977] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.543093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.543184] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.548397] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.548851] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.548948] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.553817] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.554188] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.554292] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.558955] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.559087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.559117] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.564025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.564487] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.564579] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.569742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.570013] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.570043] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.575185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.575518] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.575552] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.580535] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.580844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.580878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.585661] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.586033] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.586063] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.591042] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.591272] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23776 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.591320] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.596630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.596882] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10240 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.597018] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.602668] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.603056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.603105] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.608839] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.609181] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6880 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.609253] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.614502] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.615039] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.615094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.620270] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.620757] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.620789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.625943] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.626326] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.626424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.631680] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.632185] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:6560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.632273] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.637738] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.638090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.638120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.644479] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.644863] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.644895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.650185] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.650454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.156 [2024-11-30 04:31:51.650486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.156 [2024-11-30 04:31:51.656171] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.156 [2024-11-30 04:31:51.656470] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.656522] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.663163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.663346] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.663386] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.669286] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.669566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.669600] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.675235] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.675661] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.675694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.681340] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.681641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16608 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.681675] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.687448] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.687854] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.687886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.693262] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.693904] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.693937] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.698714] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.699288] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.699372] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.704198] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.704818] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.704880] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.709855] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.709951] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.710163] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.715822] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.716087] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.716116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.721404] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.721945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.722040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.726531] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.727161] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.727191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.731719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.732517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.732551] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.737082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.737556] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.737590] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.742615] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.742893] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.743006] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.747969] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.748126] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20992 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.748219] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.753170] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.753673] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.753727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.758836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.759114] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.759152] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.764132] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.764593] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:7168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.764684] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.157 [2024-11-30 04:31:51.769652] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.157 [2024-11-30 04:31:51.770350] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14464 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.157 [2024-11-30 04:31:51.770424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.158 [2024-11-30 04:31:51.774799] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.158 [2024-11-30 04:31:51.775390] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:10432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.158 [2024-11-30 04:31:51.775423] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.158 [2024-11-30 04:31:51.779953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.158 [2024-11-30 04:31:51.780473] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.158 [2024-11-30 04:31:51.780539] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.158 [2024-11-30 04:31:51.785150] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.785714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.785764] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.790393] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.790908] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.790984] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.796025] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.796197] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.796489] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.801406] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.801716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.801803] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.806719] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.807166] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.807199] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.812090] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.812577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.812609] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.817319] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.817688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.817721] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.822573] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.822945] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.823024] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.828149] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.828452] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.828486] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.833553] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.833770] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23072 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.834003] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.838840] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.839196] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:7136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.839225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.844163] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.844636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:23360 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.844667] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.849424] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.850138] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15328 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.850167] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.854647] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.855077] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25504 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.855121] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.859732] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.860441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:19584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.418 [2024-11-30 04:31:51.860473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.418 [2024-11-30 04:31:51.864923] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.418 [2024-11-30 04:31:51.865548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.865581] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.870400] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.870853] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.870936] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.875928] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.876280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.876327] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.881310] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.881562] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.881796] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.886781] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.887239] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.887286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.892228] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.892467] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4736 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.892564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.897515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.897885] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.897918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.903049] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.903471] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:18208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.903504] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.908088] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.908641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14912 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.908674] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.913203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.913765] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.913878] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.918613] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.919127] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14016 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.919155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.923758] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.924368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.924491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.928709] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.929250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.929297] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.933983] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.934630] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16288 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.934662] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.939426] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.939809] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.939903] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.944521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.944940] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.945116] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.949844] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.950219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.950312] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.955205] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.955566] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.955727] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.960488] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.960969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.961100] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.966197] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.966454] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13888 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.966514] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.972576] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.972976] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.419 [2024-11-30 04:31:51.973023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.419 [2024-11-30 04:31:51.979207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.419 [2024-11-30 04:31:51.979550] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:51.979635] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.420 [2024-11-30 04:31:51.985688] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.420 [2024-11-30 04:31:51.986071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:51.986107] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.420 [2024-11-30 04:31:51.991523] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.420 [2024-11-30 04:31:51.991730] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13600 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:51.991785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.420 [2024-11-30 04:31:51.997543] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.420 [2024-11-30 04:31:51.998159] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:51.998188] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.420 [2024-11-30 04:31:52.003363] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.420 [2024-11-30 04:31:52.003660] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:52.003694] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.420 [2024-11-30 04:31:52.009076] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.420 [2024-11-30 04:31:52.009418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:11232 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:52.009451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.420 [2024-11-30 04:31:52.016187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.420 [2024-11-30 04:31:52.016340] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:52.016416] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.420 [2024-11-30 04:31:52.022836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.420 [2024-11-30 04:31:52.023026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7872 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:52.023091] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.420 [2024-11-30 04:31:52.029637] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.420 [2024-11-30 04:31:52.029861] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:20224 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:52.029890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.420 [2024-11-30 04:31:52.036716] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.420 [2024-11-30 04:31:52.037109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:24672 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:52.037155] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.420 [2024-11-30 04:31:52.043655] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.420 [2024-11-30 04:31:52.044109] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:8128 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.420 [2024-11-30 04:31:52.044138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.050525] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.050815] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17632 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.050886] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.057522] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.057911] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.057944] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.064075] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.064583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.064615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.071207] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.071441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:25536 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.071473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.078127] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.078381] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:14208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.078491] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.083953] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.084250] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:1088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.084468] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.089686] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.090303] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:6272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.090507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.095998] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.096119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23168 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.096148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.102004] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.102364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.102521] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.107455] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.108056] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11968 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.108092] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.113325] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.113936] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9568 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.114052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.119372] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.119546] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.119634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.124997] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.125636] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.125689] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.130556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.131548] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.131598] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.136265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.680 [2024-11-30 04:31:52.136778] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.680 [2024-11-30 04:31:52.136810] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.680 [2024-11-30 04:31:52.141742] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.141949] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.142007] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.147708] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.148103] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:0 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.148180] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.154692] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.155025] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.155094] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.161336] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.161514] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:23456 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.161572] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.168114] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.168287] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:5440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.168390] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.173760] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.174081] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:3008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.174112] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.179597] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.180184] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.180214] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.184585] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.185189] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.185283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.190696] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.191045] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:22272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.191075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.195836] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.196269] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.196301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.201062] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.201641] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:15520 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.201693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.206183] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.206511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.206627] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.211384] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.211810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24448 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.211875] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.216536] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.217059] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.217089] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.221794] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.222313] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:18656 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.222346] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.227036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.227517] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.227549] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.232346] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.232752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:10176 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.232785] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.237358] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.238071] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:2 nsid:1 lba:7200 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.238191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:2 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.242630] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.243253] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:15104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.243347] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.248099] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.248418] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:12896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.681 [2024-11-30 04:31:52.248584] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.681 [2024-11-30 04:31:52.253265] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.681 [2024-11-30 04:31:52.253740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:11040 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.253879] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.682 [2024-11-30 04:31:52.258527] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.682 [2024-11-30 04:31:52.258950] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14336 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.259026] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.682 [2024-11-30 04:31:52.263515] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.682 [2024-11-30 04:31:52.264108] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24832 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.264168] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.682 [2024-11-30 04:31:52.268741] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.682 [2024-11-30 04:31:52.269179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.269251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.682 [2024-11-30 04:31:52.274366] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.682 [2024-11-30 04:31:52.274621] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.274672] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.682 [2024-11-30 04:31:52.279906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.682 [2024-11-30 04:31:52.280542] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.280575] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.682 [2024-11-30 04:31:52.285417] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.682 [2024-11-30 04:31:52.285707] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:4864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.285762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.682 [2024-11-30 04:31:52.290901] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.682 [2024-11-30 04:31:52.291100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8704 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.291169] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.682 [2024-11-30 04:31:52.296036] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.682 [2024-11-30 04:31:52.296368] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:19936 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.296420] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.682 [2024-11-30 04:31:52.301534] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.682 [2024-11-30 04:31:52.301932] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:6848 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.302062] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.682 [2024-11-30 04:31:52.306845] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.682 [2024-11-30 04:31:52.307505] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:21344 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.682 [2024-11-30 04:31:52.307589] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.941 [2024-11-30 04:31:52.312473] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.941 [2024-11-30 04:31:52.312701] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16256 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.941 [2024-11-30 04:31:52.312755] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.941 [2024-11-30 04:31:52.317830] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.941 [2024-11-30 04:31:52.318192] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13728 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.941 [2024-11-30 04:31:52.318222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.941 [2024-11-30 04:31:52.323567] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.941 [2024-11-30 04:31:52.323859] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16640 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.941 [2024-11-30 04:31:52.323911] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.941 [2024-11-30 04:31:52.328968] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.941 [2024-11-30 04:31:52.329393] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:21088 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.941 [2024-11-30 04:31:52.329426] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.941 [2024-11-30 04:31:52.334344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.941 [2024-11-30 04:31:52.334935] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24480 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.941 [2024-11-30 04:31:52.335039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.941 [2024-11-30 04:31:52.339974] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.941 [2024-11-30 04:31:52.340365] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.941 [2024-11-30 04:31:52.340473] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.941 [2024-11-30 04:31:52.345755] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.941 [2024-11-30 04:31:52.345857] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:14368 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.941 [2024-11-30 04:31:52.345975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.941 [2024-11-30 04:31:52.351483] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.941 [2024-11-30 04:31:52.351805] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.941 [2024-11-30 04:31:52.351933] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.941 [2024-11-30 04:31:52.357086] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.941 [2024-11-30 04:31:52.357297] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.357331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.362853] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.363060] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:1440 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.363108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.368349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.368558] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:8896 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.368680] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.373846] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.374244] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19008 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.374329] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.379353] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.379779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14560 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.379881] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.384405] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.385119] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.385149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.389556] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.390094] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:5472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.390190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.394665] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.394983] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.395103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.400188] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.400557] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:18272 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.400591] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.405552] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.406003] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:19616 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.406032] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.410701] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.411214] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.411243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.416386] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.416644] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:4192 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.416929] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.421936] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.422310] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.422424] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.427227] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.427466] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:20320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.427564] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.432639] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.433171] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:17472 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.433200] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.437941] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.438219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:11392 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.438301] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.443208] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.443806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9312 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.443839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.448187] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.448720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6144 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.448797] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.453184] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.453835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.453895] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.458178] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.458584] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:16928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.458616] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.463248] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.942 [2024-11-30 04:31:52.463650] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.942 [2024-11-30 04:31:52.463704] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.942 [2024-11-30 04:31:52.468491] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.468969] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:352 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.469015] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.473908] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.474100] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:12768 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.474196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.479243] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.479739] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:9120 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.479772] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.484735] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.485023] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12000 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.485126] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.490234] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.490417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5376 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.490642] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.495241] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.495835] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13792 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.495896] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.500203] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.500685] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.500714] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.505059] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.505337] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:24928 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.505367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.510482] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.511072] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:17856 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.511190] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.515797] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.516213] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10304 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.516243] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.521162] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.521468] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:9408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.521502] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.526666] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.527095] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:23584 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.527148] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.532349] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.532570] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:10592 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.532702] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.537619] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.538194] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6048 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.538317] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.542924] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.543150] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16096 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.543286] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.548332] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.548493] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15424 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.548526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.553730] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.554048] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24160 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.554079] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.559064] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.559420] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:12416 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.559453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.564297] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.564601] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:20800 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.564633] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:01.943 [2024-11-30 04:31:52.569333] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:01.943 [2024-11-30 04:31:52.569740] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:14752 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:01.943 [2024-11-30 04:31:52.569826] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.203 [2024-11-30 04:31:52.574591] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.203 [2024-11-30 04:31:52.575097] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:13952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.203 [2024-11-30 04:31:52.575164] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.203 [2024-11-30 04:31:52.579884] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.203 [2024-11-30 04:31:52.580305] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16864 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.203 [2024-11-30 04:31:52.580339] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.203 [2024-11-30 04:31:52.585344] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.203 [2024-11-30 04:31:52.585590] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.203 [2024-11-30 04:31:52.585737] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.203 [2024-11-30 04:31:52.590433] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.203 [2024-11-30 04:31:52.590869] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:17952 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.203 [2024-11-30 04:31:52.591047] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.203 [2024-11-30 04:31:52.595906] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.203 [2024-11-30 04:31:52.596449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:1 nsid:1 lba:8320 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.203 [2024-11-30 04:31:52.596482] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:1 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.203 [2024-11-30 04:31:52.601996] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.602402] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:19552 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.602501] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.608302] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.608408] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:23264 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.608518] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.615211] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.615522] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:15648 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.615631] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.621257] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.621583] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:9696 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.621615] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.626978] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.627481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2688 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.627548] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.632970] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.633158] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2080 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.633222] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.639651] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.640179] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:2208 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.640251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.644621] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.645104] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:13760 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.645133] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.650202] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.650793] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:6432 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.650872] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.655422] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.655716] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:25280 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.655822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.661418] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.661561] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3104 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.661594] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.668082] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.668290] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22816 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.668380] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.673521] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.674053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5824 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.674115] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.678737] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.679260] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:0 nsid:1 lba:16064 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.679453] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:0 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.684244] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.684631] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:5408 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.684732] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.690041] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.690358] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:4960 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.690469] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.696019] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.696417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:3136 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.696451] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0041 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.701481] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.701745] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:16032 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.701778] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0061 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.708053] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.708202] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:24512 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.708231] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0001 p:0 m:0 dnr:0 00:30:02.204 [2024-11-30 04:31:52.713273] tcp.c:2036:data_crc32_calc_done: *ERROR*: Data digest error on tqpair=(0x68a730) with pdu=0x2000190fef90 00:30:02.204 [2024-11-30 04:31:52.713441] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:15 nsid:1 lba:22976 len:32 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:02.204 [2024-11-30 04:31:52.713475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: COMMAND TRANSIENT TRANSPORT ERROR (00/22) qid:1 cid:15 cdw0:0 sqhd:0021 p:0 m:0 dnr:0 00:30:02.204 00:30:02.204 Latency(us) 00:30:02.204 [2024-11-30T03:31:52.835Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:02.204 [2024-11-30T03:31:52.835Z] Job: nvme0n1 (Core Mask 0x2, workload: randwrite, depth: 16, IO size: 131072) 00:30:02.205 nvme0n1 : 2.00 5527.32 690.91 0.00 0.00 2881.63 1881.13 7233.23 00:30:02.205 [2024-11-30T03:31:52.836Z] =================================================================================================================== 00:30:02.205 [2024-11-30T03:31:52.836Z] Total : 5527.32 690.91 0.00 0.00 2881.63 1881.13 7233.23 00:30:02.205 0 00:30:02.205 04:31:52 -- host/digest.sh@71 -- # get_transient_errcount nvme0n1 00:30:02.205 04:31:52 -- host/digest.sh@27 -- # bperf_rpc bdev_get_iostat -b nvme0n1 00:30:02.205 04:31:52 -- host/digest.sh@18 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/rpc.py -s /var/tmp/bperf.sock bdev_get_iostat -b nvme0n1 00:30:02.205 04:31:52 -- host/digest.sh@28 -- # jq -r '.bdevs[0] 00:30:02.205 | .driver_specific 00:30:02.205 | .nvme_error 00:30:02.205 | .status_code 00:30:02.205 | .command_transient_transport_error' 00:30:02.463 04:31:52 -- host/digest.sh@71 -- # (( 357 > 0 )) 00:30:02.463 04:31:52 -- host/digest.sh@73 -- # killprocess 2486916 00:30:02.463 04:31:52 -- common/autotest_common.sh@936 -- # '[' -z 2486916 ']' 00:30:02.463 04:31:52 -- common/autotest_common.sh@940 -- # kill -0 2486916 00:30:02.463 04:31:52 -- common/autotest_common.sh@941 -- # uname 00:30:02.463 04:31:52 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:02.463 04:31:52 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2486916 00:30:02.463 04:31:53 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:02.463 04:31:53 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:02.463 04:31:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2486916' 00:30:02.463 killing process with pid 2486916 00:30:02.463 04:31:53 -- common/autotest_common.sh@955 -- # kill 2486916 00:30:02.463 Received shutdown signal, test time was about 2.000000 seconds 00:30:02.463 00:30:02.463 Latency(us) 00:30:02.463 [2024-11-30T03:31:53.094Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:02.463 [2024-11-30T03:31:53.094Z] =================================================================================================================== 00:30:02.463 [2024-11-30T03:31:53.094Z] Total : 0.00 0.00 0.00 0.00 0.00 0.00 0.00 00:30:02.463 04:31:53 -- common/autotest_common.sh@960 -- # wait 2486916 00:30:02.721 04:31:53 -- host/digest.sh@115 -- # killprocess 2485489 00:30:02.721 04:31:53 -- common/autotest_common.sh@936 -- # '[' -z 2485489 ']' 00:30:02.721 04:31:53 -- common/autotest_common.sh@940 -- # kill -0 2485489 00:30:02.721 04:31:53 -- common/autotest_common.sh@941 -- # uname 00:30:02.721 04:31:53 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:02.721 04:31:53 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2485489 00:30:02.721 04:31:53 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:30:02.721 04:31:53 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:30:02.721 04:31:53 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2485489' 00:30:02.721 killing process with pid 2485489 00:30:02.721 04:31:53 -- common/autotest_common.sh@955 -- # kill 2485489 00:30:02.721 04:31:53 -- common/autotest_common.sh@960 -- # wait 2485489 00:30:02.980 00:30:02.980 real 0m16.868s 00:30:02.980 user 0m33.150s 00:30:02.980 sys 0m4.510s 00:30:02.980 04:31:53 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:02.980 04:31:53 -- common/autotest_common.sh@10 -- # set +x 00:30:02.980 ************************************ 00:30:02.980 END TEST nvmf_digest_error 00:30:02.980 ************************************ 00:30:02.980 04:31:53 -- host/digest.sh@138 -- # trap - SIGINT SIGTERM EXIT 00:30:02.980 04:31:53 -- host/digest.sh@139 -- # nvmftestfini 00:30:02.980 04:31:53 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:02.980 04:31:53 -- nvmf/common.sh@116 -- # sync 00:30:02.980 04:31:53 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:02.980 04:31:53 -- nvmf/common.sh@119 -- # set +e 00:30:02.980 04:31:53 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:02.980 04:31:53 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:02.980 rmmod nvme_tcp 00:30:02.980 rmmod nvme_fabrics 00:30:02.980 rmmod nvme_keyring 00:30:02.980 04:31:53 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:02.980 04:31:53 -- nvmf/common.sh@123 -- # set -e 00:30:02.980 04:31:53 -- nvmf/common.sh@124 -- # return 0 00:30:02.980 04:31:53 -- nvmf/common.sh@477 -- # '[' -n 2485489 ']' 00:30:02.980 04:31:53 -- nvmf/common.sh@478 -- # killprocess 2485489 00:30:02.980 04:31:53 -- common/autotest_common.sh@936 -- # '[' -z 2485489 ']' 00:30:02.980 04:31:53 -- common/autotest_common.sh@940 -- # kill -0 2485489 00:30:02.980 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2485489) - No such process 00:30:02.980 04:31:53 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2485489 is not found' 00:30:02.980 Process with pid 2485489 is not found 00:30:02.980 04:31:53 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:02.980 04:31:53 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:02.980 04:31:53 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:02.980 04:31:53 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:02.980 04:31:53 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:02.980 04:31:53 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:02.980 04:31:53 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:02.980 04:31:53 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:05.517 04:31:55 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:05.517 00:30:05.517 real 0m36.610s 00:30:05.517 user 1m4.355s 00:30:05.517 sys 0m10.356s 00:30:05.517 04:31:55 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:05.517 04:31:55 -- common/autotest_common.sh@10 -- # set +x 00:30:05.517 ************************************ 00:30:05.517 END TEST nvmf_digest 00:30:05.517 ************************************ 00:30:05.517 04:31:55 -- nvmf/nvmf.sh@110 -- # [[ 0 -eq 1 ]] 00:30:05.517 04:31:55 -- nvmf/nvmf.sh@115 -- # [[ 0 -eq 1 ]] 00:30:05.517 04:31:55 -- nvmf/nvmf.sh@120 -- # [[ phy == phy ]] 00:30:05.517 04:31:55 -- nvmf/nvmf.sh@122 -- # run_test nvmf_bdevperf /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:05.517 04:31:55 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:05.517 04:31:55 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:05.517 04:31:55 -- common/autotest_common.sh@10 -- # set +x 00:30:05.517 ************************************ 00:30:05.517 START TEST nvmf_bdevperf 00:30:05.517 ************************************ 00:30:05.517 04:31:55 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh --transport=tcp 00:30:05.517 * Looking for test storage... 00:30:05.517 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:05.517 04:31:55 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:05.517 04:31:55 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:05.517 04:31:55 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:05.517 04:31:55 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:05.517 04:31:55 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:05.517 04:31:55 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:05.517 04:31:55 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:05.517 04:31:55 -- scripts/common.sh@335 -- # IFS=.-: 00:30:05.517 04:31:55 -- scripts/common.sh@335 -- # read -ra ver1 00:30:05.517 04:31:55 -- scripts/common.sh@336 -- # IFS=.-: 00:30:05.517 04:31:55 -- scripts/common.sh@336 -- # read -ra ver2 00:30:05.517 04:31:55 -- scripts/common.sh@337 -- # local 'op=<' 00:30:05.517 04:31:55 -- scripts/common.sh@339 -- # ver1_l=2 00:30:05.517 04:31:55 -- scripts/common.sh@340 -- # ver2_l=1 00:30:05.517 04:31:55 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:05.517 04:31:55 -- scripts/common.sh@343 -- # case "$op" in 00:30:05.517 04:31:55 -- scripts/common.sh@344 -- # : 1 00:30:05.517 04:31:55 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:05.517 04:31:55 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:05.517 04:31:55 -- scripts/common.sh@364 -- # decimal 1 00:30:05.517 04:31:55 -- scripts/common.sh@352 -- # local d=1 00:30:05.517 04:31:55 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:05.517 04:31:55 -- scripts/common.sh@354 -- # echo 1 00:30:05.517 04:31:55 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:05.517 04:31:55 -- scripts/common.sh@365 -- # decimal 2 00:30:05.517 04:31:55 -- scripts/common.sh@352 -- # local d=2 00:30:05.517 04:31:55 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:05.517 04:31:55 -- scripts/common.sh@354 -- # echo 2 00:30:05.517 04:31:55 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:05.517 04:31:55 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:05.517 04:31:55 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:05.517 04:31:55 -- scripts/common.sh@367 -- # return 0 00:30:05.517 04:31:55 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:05.517 04:31:55 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:05.517 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:05.517 --rc genhtml_branch_coverage=1 00:30:05.517 --rc genhtml_function_coverage=1 00:30:05.517 --rc genhtml_legend=1 00:30:05.517 --rc geninfo_all_blocks=1 00:30:05.517 --rc geninfo_unexecuted_blocks=1 00:30:05.517 00:30:05.517 ' 00:30:05.517 04:31:55 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:05.517 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:05.517 --rc genhtml_branch_coverage=1 00:30:05.517 --rc genhtml_function_coverage=1 00:30:05.517 --rc genhtml_legend=1 00:30:05.517 --rc geninfo_all_blocks=1 00:30:05.517 --rc geninfo_unexecuted_blocks=1 00:30:05.517 00:30:05.517 ' 00:30:05.517 04:31:55 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:05.517 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:05.517 --rc genhtml_branch_coverage=1 00:30:05.518 --rc genhtml_function_coverage=1 00:30:05.518 --rc genhtml_legend=1 00:30:05.518 --rc geninfo_all_blocks=1 00:30:05.518 --rc geninfo_unexecuted_blocks=1 00:30:05.518 00:30:05.518 ' 00:30:05.518 04:31:55 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:05.518 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:05.518 --rc genhtml_branch_coverage=1 00:30:05.518 --rc genhtml_function_coverage=1 00:30:05.518 --rc genhtml_legend=1 00:30:05.518 --rc geninfo_all_blocks=1 00:30:05.518 --rc geninfo_unexecuted_blocks=1 00:30:05.518 00:30:05.518 ' 00:30:05.518 04:31:55 -- host/bdevperf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:05.518 04:31:55 -- nvmf/common.sh@7 -- # uname -s 00:30:05.518 04:31:55 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:05.518 04:31:55 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:05.518 04:31:55 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:05.518 04:31:55 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:05.518 04:31:55 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:05.518 04:31:55 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:05.518 04:31:55 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:05.518 04:31:55 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:05.518 04:31:55 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:05.518 04:31:55 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:05.518 04:31:55 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:05.518 04:31:55 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:05.518 04:31:55 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:05.518 04:31:55 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:05.518 04:31:55 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:05.518 04:31:55 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:05.518 04:31:55 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:05.518 04:31:55 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:05.518 04:31:55 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:05.518 04:31:55 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:05.518 04:31:55 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:05.518 04:31:55 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:05.518 04:31:55 -- paths/export.sh@5 -- # export PATH 00:30:05.518 04:31:55 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:05.518 04:31:55 -- nvmf/common.sh@46 -- # : 0 00:30:05.518 04:31:55 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:05.518 04:31:55 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:05.518 04:31:55 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:05.518 04:31:55 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:05.518 04:31:55 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:05.518 04:31:55 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:05.518 04:31:55 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:05.518 04:31:55 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:05.518 04:31:55 -- host/bdevperf.sh@11 -- # MALLOC_BDEV_SIZE=64 00:30:05.518 04:31:55 -- host/bdevperf.sh@12 -- # MALLOC_BLOCK_SIZE=512 00:30:05.518 04:31:55 -- host/bdevperf.sh@24 -- # nvmftestinit 00:30:05.518 04:31:55 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:05.518 04:31:55 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:05.518 04:31:55 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:05.518 04:31:55 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:05.518 04:31:55 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:05.518 04:31:55 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:05.518 04:31:55 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:05.518 04:31:55 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:05.518 04:31:55 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:05.518 04:31:55 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:05.518 04:31:55 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:05.518 04:31:55 -- common/autotest_common.sh@10 -- # set +x 00:30:07.422 04:31:57 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:07.422 04:31:57 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:07.422 04:31:57 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:07.422 04:31:57 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:07.422 04:31:57 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:07.422 04:31:57 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:07.422 04:31:57 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:07.422 04:31:57 -- nvmf/common.sh@294 -- # net_devs=() 00:30:07.422 04:31:57 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:07.422 04:31:57 -- nvmf/common.sh@295 -- # e810=() 00:30:07.422 04:31:57 -- nvmf/common.sh@295 -- # local -ga e810 00:30:07.422 04:31:57 -- nvmf/common.sh@296 -- # x722=() 00:30:07.422 04:31:57 -- nvmf/common.sh@296 -- # local -ga x722 00:30:07.422 04:31:57 -- nvmf/common.sh@297 -- # mlx=() 00:30:07.422 04:31:57 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:07.422 04:31:57 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:07.422 04:31:57 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:07.422 04:31:57 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:07.422 04:31:57 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:07.422 04:31:57 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:07.422 04:31:57 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:07.422 04:31:57 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:07.422 04:31:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:07.422 04:31:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:07.422 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:07.422 04:31:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:07.423 04:31:57 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:07.423 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:07.423 04:31:57 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:07.423 04:31:57 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:07.423 04:31:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:07.423 04:31:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:07.423 04:31:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:07.423 04:31:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:07.423 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:07.423 04:31:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:07.423 04:31:57 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:07.423 04:31:57 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:07.423 04:31:57 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:07.423 04:31:57 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:07.423 04:31:57 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:07.423 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:07.423 04:31:57 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:07.423 04:31:57 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:07.423 04:31:57 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:07.423 04:31:57 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:07.423 04:31:57 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:07.423 04:31:57 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:07.423 04:31:57 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:07.423 04:31:57 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:07.423 04:31:57 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:07.423 04:31:57 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:07.423 04:31:57 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:07.423 04:31:57 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:07.423 04:31:57 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:07.423 04:31:57 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:07.423 04:31:57 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:07.423 04:31:57 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:07.423 04:31:57 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:07.423 04:31:57 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:07.423 04:31:57 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:07.423 04:31:57 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:07.423 04:31:57 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:07.423 04:31:57 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:07.423 04:31:57 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:07.423 04:31:57 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:07.423 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:07.423 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.387 ms 00:30:07.423 00:30:07.423 --- 10.0.0.2 ping statistics --- 00:30:07.423 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:07.423 rtt min/avg/max/mdev = 0.387/0.387/0.387/0.000 ms 00:30:07.423 04:31:57 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:07.423 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:07.423 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.183 ms 00:30:07.423 00:30:07.423 --- 10.0.0.1 ping statistics --- 00:30:07.423 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:07.423 rtt min/avg/max/mdev = 0.183/0.183/0.183/0.000 ms 00:30:07.423 04:31:57 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:07.423 04:31:57 -- nvmf/common.sh@410 -- # return 0 00:30:07.423 04:31:57 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:07.423 04:31:57 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:07.423 04:31:57 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:07.423 04:31:57 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:07.423 04:31:57 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:07.423 04:31:57 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:07.423 04:31:58 -- host/bdevperf.sh@25 -- # tgt_init 00:30:07.423 04:31:58 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:07.423 04:31:58 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:07.423 04:31:58 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:07.423 04:31:58 -- common/autotest_common.sh@10 -- # set +x 00:30:07.423 04:31:58 -- nvmf/common.sh@469 -- # nvmfpid=2489538 00:30:07.423 04:31:58 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:07.423 04:31:58 -- nvmf/common.sh@470 -- # waitforlisten 2489538 00:30:07.423 04:31:58 -- common/autotest_common.sh@829 -- # '[' -z 2489538 ']' 00:30:07.423 04:31:58 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:07.423 04:31:58 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:07.423 04:31:58 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:07.423 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:07.423 04:31:58 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:07.423 04:31:58 -- common/autotest_common.sh@10 -- # set +x 00:30:07.682 [2024-11-30 04:31:58.060079] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:07.682 [2024-11-30 04:31:58.060151] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:07.682 EAL: No free 2048 kB hugepages reported on node 1 00:30:07.682 [2024-11-30 04:31:58.125344] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:07.682 [2024-11-30 04:31:58.214415] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:07.682 [2024-11-30 04:31:58.214580] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:07.682 [2024-11-30 04:31:58.214610] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:07.682 [2024-11-30 04:31:58.214625] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:07.682 [2024-11-30 04:31:58.214721] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:07.682 [2024-11-30 04:31:58.214911] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:07.682 [2024-11-30 04:31:58.214915] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:08.616 04:31:59 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:08.616 04:31:59 -- common/autotest_common.sh@862 -- # return 0 00:30:08.616 04:31:59 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:08.616 04:31:59 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:08.616 04:31:59 -- common/autotest_common.sh@10 -- # set +x 00:30:08.616 04:31:59 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:08.616 04:31:59 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:08.616 04:31:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.616 04:31:59 -- common/autotest_common.sh@10 -- # set +x 00:30:08.616 [2024-11-30 04:31:59.076502] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:08.616 04:31:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.616 04:31:59 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:08.616 04:31:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.616 04:31:59 -- common/autotest_common.sh@10 -- # set +x 00:30:08.616 Malloc0 00:30:08.616 04:31:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.616 04:31:59 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:08.616 04:31:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.616 04:31:59 -- common/autotest_common.sh@10 -- # set +x 00:30:08.616 04:31:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.616 04:31:59 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:08.616 04:31:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.616 04:31:59 -- common/autotest_common.sh@10 -- # set +x 00:30:08.616 04:31:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.616 04:31:59 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:08.616 04:31:59 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:08.616 04:31:59 -- common/autotest_common.sh@10 -- # set +x 00:30:08.616 [2024-11-30 04:31:59.135597] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:08.616 04:31:59 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:08.616 04:31:59 -- host/bdevperf.sh@27 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/62 -q 128 -o 4096 -w verify -t 1 00:30:08.616 04:31:59 -- host/bdevperf.sh@27 -- # gen_nvmf_target_json 00:30:08.616 04:31:59 -- nvmf/common.sh@520 -- # config=() 00:30:08.616 04:31:59 -- nvmf/common.sh@520 -- # local subsystem config 00:30:08.616 04:31:59 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:08.616 04:31:59 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:08.616 { 00:30:08.616 "params": { 00:30:08.616 "name": "Nvme$subsystem", 00:30:08.616 "trtype": "$TEST_TRANSPORT", 00:30:08.616 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:08.616 "adrfam": "ipv4", 00:30:08.616 "trsvcid": "$NVMF_PORT", 00:30:08.616 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:08.616 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:08.616 "hdgst": ${hdgst:-false}, 00:30:08.616 "ddgst": ${ddgst:-false} 00:30:08.616 }, 00:30:08.616 "method": "bdev_nvme_attach_controller" 00:30:08.616 } 00:30:08.616 EOF 00:30:08.616 )") 00:30:08.616 04:31:59 -- nvmf/common.sh@542 -- # cat 00:30:08.616 04:31:59 -- nvmf/common.sh@544 -- # jq . 00:30:08.616 04:31:59 -- nvmf/common.sh@545 -- # IFS=, 00:30:08.616 04:31:59 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:08.616 "params": { 00:30:08.616 "name": "Nvme1", 00:30:08.616 "trtype": "tcp", 00:30:08.616 "traddr": "10.0.0.2", 00:30:08.616 "adrfam": "ipv4", 00:30:08.616 "trsvcid": "4420", 00:30:08.616 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:08.616 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:08.616 "hdgst": false, 00:30:08.616 "ddgst": false 00:30:08.616 }, 00:30:08.616 "method": "bdev_nvme_attach_controller" 00:30:08.616 }' 00:30:08.616 [2024-11-30 04:31:59.177969] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:08.616 [2024-11-30 04:31:59.178057] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2489699 ] 00:30:08.616 EAL: No free 2048 kB hugepages reported on node 1 00:30:08.616 [2024-11-30 04:31:59.236868] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:08.875 [2024-11-30 04:31:59.321101] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:09.134 Running I/O for 1 seconds... 00:30:10.069 00:30:10.069 Latency(us) 00:30:10.069 [2024-11-30T03:32:00.700Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:10.069 [2024-11-30T03:32:00.700Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:10.069 Verification LBA range: start 0x0 length 0x4000 00:30:10.069 Nvme1n1 : 1.01 12719.36 49.69 0.00 0.00 10017.40 1074.06 16311.18 00:30:10.069 [2024-11-30T03:32:00.700Z] =================================================================================================================== 00:30:10.069 [2024-11-30T03:32:00.700Z] Total : 12719.36 49.69 0.00 0.00 10017.40 1074.06 16311.18 00:30:10.327 04:32:00 -- host/bdevperf.sh@30 -- # bdevperfpid=2489847 00:30:10.327 04:32:00 -- host/bdevperf.sh@32 -- # sleep 3 00:30:10.327 04:32:00 -- host/bdevperf.sh@29 -- # gen_nvmf_target_json 00:30:10.327 04:32:00 -- host/bdevperf.sh@29 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/bdevperf --json /dev/fd/63 -q 128 -o 4096 -w verify -t 15 -f 00:30:10.327 04:32:00 -- nvmf/common.sh@520 -- # config=() 00:30:10.327 04:32:00 -- nvmf/common.sh@520 -- # local subsystem config 00:30:10.327 04:32:00 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:30:10.327 04:32:00 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:30:10.327 { 00:30:10.327 "params": { 00:30:10.327 "name": "Nvme$subsystem", 00:30:10.327 "trtype": "$TEST_TRANSPORT", 00:30:10.327 "traddr": "$NVMF_FIRST_TARGET_IP", 00:30:10.327 "adrfam": "ipv4", 00:30:10.327 "trsvcid": "$NVMF_PORT", 00:30:10.327 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:30:10.327 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:30:10.327 "hdgst": ${hdgst:-false}, 00:30:10.327 "ddgst": ${ddgst:-false} 00:30:10.327 }, 00:30:10.327 "method": "bdev_nvme_attach_controller" 00:30:10.327 } 00:30:10.327 EOF 00:30:10.327 )") 00:30:10.327 04:32:00 -- nvmf/common.sh@542 -- # cat 00:30:10.327 04:32:00 -- nvmf/common.sh@544 -- # jq . 00:30:10.327 04:32:00 -- nvmf/common.sh@545 -- # IFS=, 00:30:10.327 04:32:00 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:30:10.327 "params": { 00:30:10.327 "name": "Nvme1", 00:30:10.327 "trtype": "tcp", 00:30:10.327 "traddr": "10.0.0.2", 00:30:10.327 "adrfam": "ipv4", 00:30:10.327 "trsvcid": "4420", 00:30:10.327 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:30:10.327 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:30:10.327 "hdgst": false, 00:30:10.327 "ddgst": false 00:30:10.327 }, 00:30:10.327 "method": "bdev_nvme_attach_controller" 00:30:10.327 }' 00:30:10.327 [2024-11-30 04:32:00.883125] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:10.327 [2024-11-30 04:32:00.883206] [ DPDK EAL parameters: bdevperf --no-shconf -c 0x1 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2489847 ] 00:30:10.327 EAL: No free 2048 kB hugepages reported on node 1 00:30:10.327 [2024-11-30 04:32:00.943461] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:30:10.586 [2024-11-30 04:32:01.033688] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:10.844 Running I/O for 15 seconds... 00:30:13.380 04:32:03 -- host/bdevperf.sh@33 -- # kill -9 2489538 00:30:13.380 04:32:03 -- host/bdevperf.sh@35 -- # sleep 3 00:30:13.380 [2024-11-30 04:32:03.854844] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:96 nsid:1 lba:4728 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.380 [2024-11-30 04:32:03.854914] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.854952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:95 nsid:1 lba:4736 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.854979] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855018] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:84 nsid:1 lba:4744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855035] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855053] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:38 nsid:1 lba:5264 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855076] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855093] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:82 nsid:1 lba:5272 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855108] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855124] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:10 nsid:1 lba:5280 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855138] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855155] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:113 nsid:1 lba:5288 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855171] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855187] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:92 nsid:1 lba:5296 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855203] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855219] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:99 nsid:1 lba:5312 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855251] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855281] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:12 nsid:1 lba:5320 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855315] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:11 nsid:1 lba:5336 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855332] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855349] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:17 nsid:1 lba:5360 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855365] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:80 nsid:1 lba:5368 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855417] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:115 nsid:1 lba:5376 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855433] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855451] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:101 nsid:1 lba:5392 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855467] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855484] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:7 nsid:1 lba:5408 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855499] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855516] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:54 nsid:1 lba:5416 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855531] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:65 nsid:1 lba:5424 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855581] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:86 nsid:1 lba:5432 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855596] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855613] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:13 nsid:1 lba:5440 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:60 nsid:1 lba:5448 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855660] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855677] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:63 nsid:1 lba:4752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855696] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855714] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:59 nsid:1 lba:4776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855729] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855746] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:21 nsid:1 lba:4792 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855762] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855779] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:42 nsid:1 lba:4800 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855793] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855810] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:85 nsid:1 lba:4840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855825] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855843] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:25 nsid:1 lba:4872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855858] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855875] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:41 nsid:1 lba:4888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855890] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855906] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:76 nsid:1 lba:4896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855922] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855939] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:33 nsid:1 lba:5464 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.855954] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.855979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:103 nsid:1 lba:5472 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.856010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.856026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:68 nsid:1 lba:5512 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.856040] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.856055] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:9 nsid:1 lba:5528 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.856075] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.856090] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:24 nsid:1 lba:5536 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.856103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.856123] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:35 nsid:1 lba:5544 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.856137] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.856153] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:73 nsid:1 lba:5552 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.856166] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.856182] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:16 nsid:1 lba:5568 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.381 [2024-11-30 04:32:03.856196] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.856211] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:53 nsid:1 lba:5576 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.381 [2024-11-30 04:32:03.856224] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.856257] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:117 nsid:1 lba:5584 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.381 [2024-11-30 04:32:03.856272] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.381 [2024-11-30 04:32:03.856289] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:105 nsid:1 lba:4904 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.381 [2024-11-30 04:32:03.856304] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856321] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:81 nsid:1 lba:4912 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856336] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856352] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:123 nsid:1 lba:4920 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856367] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856384] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:67 nsid:1 lba:4928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:15 nsid:1 lba:4968 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856430] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856447] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:114 nsid:1 lba:4976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856462] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856479] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:83 nsid:1 lba:4992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856495] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856511] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:64 nsid:1 lba:5000 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856526] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856547] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:97 nsid:1 lba:5592 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.382 [2024-11-30 04:32:03.856563] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856580] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:126 nsid:1 lba:5600 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.382 [2024-11-30 04:32:03.856595] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856612] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:87 nsid:1 lba:5008 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856628] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856645] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:26 nsid:1 lba:5032 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856661] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856678] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:71 nsid:1 lba:5072 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856693] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856710] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:88 nsid:1 lba:5080 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856725] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856742] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:77 nsid:1 lba:5128 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856757] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856774] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:19 nsid:1 lba:5160 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856789] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:48 nsid:1 lba:5200 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856821] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856838] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:104 nsid:1 lba:5216 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856853] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856870] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:116 nsid:1 lba:5608 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:28 nsid:1 lba:5616 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.856917] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:125 nsid:1 lba:5624 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.382 [2024-11-30 04:32:03.856953] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.856979] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:89 nsid:1 lba:5632 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857010] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857026] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:107 nsid:1 lba:5640 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.382 [2024-11-30 04:32:03.857039] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857054] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:72 nsid:1 lba:5648 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857068] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857083] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:50 nsid:1 lba:5656 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857103] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857118] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:124 nsid:1 lba:5664 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857132] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857148] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:70 nsid:1 lba:5672 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857162] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857177] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:112 nsid:1 lba:5680 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857191] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857207] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:29 nsid:1 lba:5688 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.382 [2024-11-30 04:32:03.857221] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857236] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:46 nsid:1 lba:5696 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.382 [2024-11-30 04:32:03.857266] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857283] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:36 nsid:1 lba:5704 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857298] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857316] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:2 nsid:1 lba:5712 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857331] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857348] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:102 nsid:1 lba:5720 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.382 [2024-11-30 04:32:03.857362] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857383] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:109 nsid:1 lba:5728 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.382 [2024-11-30 04:32:03.857399] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857416] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:94 nsid:1 lba:5736 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.382 [2024-11-30 04:32:03.857432] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857449] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:100 nsid:1 lba:5744 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857464] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857481] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:23 nsid:1 lba:5752 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857496] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857513] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:78 nsid:1 lba:5760 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.382 [2024-11-30 04:32:03.857528] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857545] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:90 nsid:1 lba:5768 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857560] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.382 [2024-11-30 04:32:03.857577] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:52 nsid:1 lba:5776 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.382 [2024-11-30 04:32:03.857592] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857609] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:74 nsid:1 lba:5784 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.857624] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857640] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:44 nsid:1 lba:5792 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.857655] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857672] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:32 nsid:1 lba:5800 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.857688] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857705] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:111 nsid:1 lba:5808 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.857720] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857737] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:79 nsid:1 lba:5816 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.857752] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857769] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:119 nsid:1 lba:5824 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.857788] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857806] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:62 nsid:1 lba:5832 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.857822] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857839] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:106 nsid:1 lba:5840 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.857854] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857871] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:57 nsid:1 lba:5848 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.857885] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857902] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:49 nsid:1 lba:5856 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.857918] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857934] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:40 nsid:1 lba:5864 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.857950] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.857974] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:75 nsid:1 lba:5872 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.857990] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858022] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:56 nsid:1 lba:5880 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.858036] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858051] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:45 nsid:1 lba:5888 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858074] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858089] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:14 nsid:1 lba:5896 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858102] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858117] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:108 nsid:1 lba:5904 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.858131] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858146] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:122 nsid:1 lba:5912 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.858160] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858175] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:6 nsid:1 lba:5920 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.858189] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858204] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:69 nsid:1 lba:5928 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858225] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858265] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:37 nsid:1 lba:5936 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858283] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858300] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:51 nsid:1 lba:5944 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.858316] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858332] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:58 nsid:1 lba:5952 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858348] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858364] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:61 nsid:1 lba:5960 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858379] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858397] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:18 nsid:1 lba:5968 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.858412] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858428] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:110 nsid:1 lba:5976 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858443] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858460] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:30 nsid:1 lba:5984 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858475] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858492] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:3 nsid:1 lba:5224 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858507] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858523] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:47 nsid:1 lba:5232 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858538] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858555] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5256 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858571] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858587] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:93 nsid:1 lba:5304 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858602] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858619] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:43 nsid:1 lba:5328 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858634] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858655] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:1 nsid:1 lba:5344 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858671] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858688] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:27 nsid:1 lba:5352 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858703] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858720] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:98 nsid:1 lba:5384 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858735] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858752] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:34 nsid:1 lba:5992 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.383 [2024-11-30 04:32:03.858768] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858790] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:31 nsid:1 lba:6000 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.858806] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858824] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:120 nsid:1 lba:6008 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.858839] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858855] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:55 nsid:1 lba:6016 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.858870] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858887] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:4 nsid:1 lba:6024 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.383 [2024-11-30 04:32:03.858902] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.383 [2024-11-30 04:32:03.858919] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: WRITE sqid:1 cid:22 nsid:1 lba:6032 len:8 SGL DATA BLOCK OFFSET 0x0 len:0x1000 00:30:13.384 [2024-11-30 04:32:03.858935] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.384 [2024-11-30 04:32:03.858952] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:39 nsid:1 lba:6040 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.384 [2024-11-30 04:32:03.858975] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.384 [2024-11-30 04:32:03.859008] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:66 nsid:1 lba:5400 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.384 [2024-11-30 04:32:03.859023] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.384 [2024-11-30 04:32:03.859038] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:91 nsid:1 lba:5456 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.384 [2024-11-30 04:32:03.859052] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.384 [2024-11-30 04:32:03.859073] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:8 nsid:1 lba:5480 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.384 [2024-11-30 04:32:03.859090] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.384 [2024-11-30 04:32:03.859106] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:118 nsid:1 lba:5488 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.384 [2024-11-30 04:32:03.859120] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.384 [2024-11-30 04:32:03.859135] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:20 nsid:1 lba:5496 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.384 [2024-11-30 04:32:03.859149] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.384 [2024-11-30 04:32:03.859164] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:121 nsid:1 lba:5504 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.384 [2024-11-30 04:32:03.859178] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.384 [2024-11-30 04:32:03.859193] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:5 nsid:1 lba:5520 len:8 SGL TRANSPORT DATA BLOCK TRANSPORT 0x0 00:30:13.384 [2024-11-30 04:32:03.859206] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.384 [2024-11-30 04:32:03.859221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ed900 is same with the state(5) to be set 00:30:13.384 [2024-11-30 04:32:03.859252] nvme_qpair.c: 579:nvme_qpair_abort_queued_reqs: *ERROR*: aborting queued i/o 00:30:13.384 [2024-11-30 04:32:03.859267] nvme_qpair.c: 558:nvme_qpair_manual_complete_request: *NOTICE*: Command completed manually: 00:30:13.384 [2024-11-30 04:32:03.859280] nvme_qpair.c: 243:nvme_io_qpair_print_command: *NOTICE*: READ sqid:1 cid:0 nsid:1 lba:5560 len:8 PRP1 0x0 PRP2 0x0 00:30:13.384 [2024-11-30 04:32:03.859294] nvme_qpair.c: 474:spdk_nvme_print_completion: *NOTICE*: ABORTED - SQ DELETION (00/08) qid:1 cid:0 cdw0:0 sqhd:0000 p:0 m:0 dnr:0 00:30:13.384 [2024-11-30 04:32:03.859364] bdev_nvme.c:1590:bdev_nvme_disconnected_qpair_cb: *NOTICE*: qpair 0x15ed900 was disconnected and freed. reset controller. 00:30:13.384 [2024-11-30 04:32:03.861876] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.384 [2024-11-30 04:32:03.861949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.384 [2024-11-30 04:32:03.862483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.862605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.862634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.384 [2024-11-30 04:32:03.862652] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.384 [2024-11-30 04:32:03.862819] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.384 [2024-11-30 04:32:03.862951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.384 [2024-11-30 04:32:03.863172] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.384 [2024-11-30 04:32:03.863191] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.384 [2024-11-30 04:32:03.865496] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.384 [2024-11-30 04:32:03.874482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.384 [2024-11-30 04:32:03.874880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.875013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.875063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.384 [2024-11-30 04:32:03.875081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.384 [2024-11-30 04:32:03.875246] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.384 [2024-11-30 04:32:03.875414] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.384 [2024-11-30 04:32:03.875438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.384 [2024-11-30 04:32:03.875453] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.384 [2024-11-30 04:32:03.877795] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.384 [2024-11-30 04:32:03.887041] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.384 [2024-11-30 04:32:03.887292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.887500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.887526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.384 [2024-11-30 04:32:03.887542] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.384 [2024-11-30 04:32:03.887704] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.384 [2024-11-30 04:32:03.887869] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.384 [2024-11-30 04:32:03.887891] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.384 [2024-11-30 04:32:03.887907] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.384 [2024-11-30 04:32:03.890083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.384 [2024-11-30 04:32:03.899714] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.384 [2024-11-30 04:32:03.900019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.900194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.900223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.384 [2024-11-30 04:32:03.900241] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.384 [2024-11-30 04:32:03.900405] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.384 [2024-11-30 04:32:03.900556] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.384 [2024-11-30 04:32:03.900578] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.384 [2024-11-30 04:32:03.900594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.384 [2024-11-30 04:32:03.903076] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.384 [2024-11-30 04:32:03.912287] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.384 [2024-11-30 04:32:03.912612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.912786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.912812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.384 [2024-11-30 04:32:03.912833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.384 [2024-11-30 04:32:03.913026] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.384 [2024-11-30 04:32:03.913207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.384 [2024-11-30 04:32:03.913230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.384 [2024-11-30 04:32:03.913246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.384 [2024-11-30 04:32:03.915480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.384 [2024-11-30 04:32:03.924996] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.384 [2024-11-30 04:32:03.925240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.925377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.925406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.384 [2024-11-30 04:32:03.925424] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.384 [2024-11-30 04:32:03.925589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.384 [2024-11-30 04:32:03.925721] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.384 [2024-11-30 04:32:03.925744] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.384 [2024-11-30 04:32:03.925759] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.384 [2024-11-30 04:32:03.928168] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.384 [2024-11-30 04:32:03.937472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.384 [2024-11-30 04:32:03.937744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.937915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.384 [2024-11-30 04:32:03.937944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.384 [2024-11-30 04:32:03.937974] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.384 [2024-11-30 04:32:03.938122] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.384 [2024-11-30 04:32:03.938254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.385 [2024-11-30 04:32:03.938277] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.385 [2024-11-30 04:32:03.938292] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.385 [2024-11-30 04:32:03.940599] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.385 [2024-11-30 04:32:03.949751] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.385 [2024-11-30 04:32:03.950058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.385 [2024-11-30 04:32:03.950226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.385 [2024-11-30 04:32:03.950255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.385 [2024-11-30 04:32:03.950273] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.385 [2024-11-30 04:32:03.950407] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.385 [2024-11-30 04:32:03.950558] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.385 [2024-11-30 04:32:03.950580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.385 [2024-11-30 04:32:03.950596] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.385 [2024-11-30 04:32:03.952853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.385 [2024-11-30 04:32:03.962489] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.385 [2024-11-30 04:32:03.962795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.385 [2024-11-30 04:32:03.962935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.385 [2024-11-30 04:32:03.962974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.385 [2024-11-30 04:32:03.962995] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.385 [2024-11-30 04:32:03.963160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.385 [2024-11-30 04:32:03.963274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.385 [2024-11-30 04:32:03.963296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.385 [2024-11-30 04:32:03.963311] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.385 [2024-11-30 04:32:03.965618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.385 [2024-11-30 04:32:03.975074] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.385 [2024-11-30 04:32:03.975471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.385 [2024-11-30 04:32:03.975650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.385 [2024-11-30 04:32:03.975701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.385 [2024-11-30 04:32:03.975718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.385 [2024-11-30 04:32:03.975864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.385 [2024-11-30 04:32:03.976044] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.385 [2024-11-30 04:32:03.976067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.385 [2024-11-30 04:32:03.976083] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.385 [2024-11-30 04:32:03.978245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.385 [2024-11-30 04:32:03.987796] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.385 [2024-11-30 04:32:03.988111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.385 [2024-11-30 04:32:03.988277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.385 [2024-11-30 04:32:03.988305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.385 [2024-11-30 04:32:03.988323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.385 [2024-11-30 04:32:03.988523] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.385 [2024-11-30 04:32:03.988733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.385 [2024-11-30 04:32:03.988756] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.385 [2024-11-30 04:32:03.988772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.385 [2024-11-30 04:32:03.991053] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.385 [2024-11-30 04:32:04.000289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.385 [2024-11-30 04:32:04.000653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.385 [2024-11-30 04:32:04.000787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.385 [2024-11-30 04:32:04.000813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.385 [2024-11-30 04:32:04.000828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.385 [2024-11-30 04:32:04.001075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.385 [2024-11-30 04:32:04.001191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.385 [2024-11-30 04:32:04.001214] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.385 [2024-11-30 04:32:04.001229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.385 [2024-11-30 04:32:04.003571] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.646 [2024-11-30 04:32:04.012899] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.646 [2024-11-30 04:32:04.013197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.013405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.013457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.646 [2024-11-30 04:32:04.013475] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.646 [2024-11-30 04:32:04.013621] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.646 [2024-11-30 04:32:04.013825] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.646 [2024-11-30 04:32:04.013848] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.646 [2024-11-30 04:32:04.013864] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.646 [2024-11-30 04:32:04.016039] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.646 [2024-11-30 04:32:04.025724] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.646 [2024-11-30 04:32:04.026041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.026198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.026224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.646 [2024-11-30 04:32:04.026240] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.646 [2024-11-30 04:32:04.026414] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.646 [2024-11-30 04:32:04.026583] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.646 [2024-11-30 04:32:04.026612] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.646 [2024-11-30 04:32:04.026628] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.646 [2024-11-30 04:32:04.029070] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.646 [2024-11-30 04:32:04.038403] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.646 [2024-11-30 04:32:04.038801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.038980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.039010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.646 [2024-11-30 04:32:04.039027] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.646 [2024-11-30 04:32:04.039191] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.646 [2024-11-30 04:32:04.039377] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.646 [2024-11-30 04:32:04.039401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.646 [2024-11-30 04:32:04.039417] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.646 [2024-11-30 04:32:04.041837] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.646 [2024-11-30 04:32:04.050950] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.646 [2024-11-30 04:32:04.051261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.051525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.051578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.646 [2024-11-30 04:32:04.051596] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.646 [2024-11-30 04:32:04.051743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.646 [2024-11-30 04:32:04.051911] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.646 [2024-11-30 04:32:04.051935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.646 [2024-11-30 04:32:04.051950] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.646 [2024-11-30 04:32:04.054487] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.646 [2024-11-30 04:32:04.063611] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.646 [2024-11-30 04:32:04.063892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.064049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.064076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.646 [2024-11-30 04:32:04.064092] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.646 [2024-11-30 04:32:04.064267] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.646 [2024-11-30 04:32:04.064418] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.646 [2024-11-30 04:32:04.064441] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.646 [2024-11-30 04:32:04.064462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.646 [2024-11-30 04:32:04.066846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.646 [2024-11-30 04:32:04.076325] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.646 [2024-11-30 04:32:04.076658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.076838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.076864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.646 [2024-11-30 04:32:04.076880] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.646 [2024-11-30 04:32:04.077040] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.646 [2024-11-30 04:32:04.077258] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.646 [2024-11-30 04:32:04.077282] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.646 [2024-11-30 04:32:04.077298] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.646 [2024-11-30 04:32:04.079748] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.646 [2024-11-30 04:32:04.088810] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.646 [2024-11-30 04:32:04.089155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.089299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.089328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.646 [2024-11-30 04:32:04.089346] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.646 [2024-11-30 04:32:04.089510] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.646 [2024-11-30 04:32:04.089661] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.646 [2024-11-30 04:32:04.089684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.646 [2024-11-30 04:32:04.089700] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.646 [2024-11-30 04:32:04.092311] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.646 [2024-11-30 04:32:04.101331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.646 [2024-11-30 04:32:04.101659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.101799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.646 [2024-11-30 04:32:04.101828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.646 [2024-11-30 04:32:04.101846] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.646 [2024-11-30 04:32:04.102059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.647 [2024-11-30 04:32:04.102229] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.647 [2024-11-30 04:32:04.102252] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.647 [2024-11-30 04:32:04.102266] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.647 [2024-11-30 04:32:04.104614] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.647 [2024-11-30 04:32:04.114010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.647 [2024-11-30 04:32:04.114302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.114427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.114454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.647 [2024-11-30 04:32:04.114470] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.647 [2024-11-30 04:32:04.114585] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.647 [2024-11-30 04:32:04.114726] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.647 [2024-11-30 04:32:04.114750] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.647 [2024-11-30 04:32:04.114765] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.647 [2024-11-30 04:32:04.117192] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.647 [2024-11-30 04:32:04.126498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.647 [2024-11-30 04:32:04.126831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.126942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.126981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.647 [2024-11-30 04:32:04.127001] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.647 [2024-11-30 04:32:04.127184] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.647 [2024-11-30 04:32:04.127335] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.647 [2024-11-30 04:32:04.127358] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.647 [2024-11-30 04:32:04.127373] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.647 [2024-11-30 04:32:04.129536] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.647 [2024-11-30 04:32:04.138832] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.647 [2024-11-30 04:32:04.139157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.139329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.139355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.647 [2024-11-30 04:32:04.139371] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.647 [2024-11-30 04:32:04.139534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.647 [2024-11-30 04:32:04.139664] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.647 [2024-11-30 04:32:04.139684] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.647 [2024-11-30 04:32:04.139697] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.647 [2024-11-30 04:32:04.142031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.647 [2024-11-30 04:32:04.151477] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.647 [2024-11-30 04:32:04.151785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.151927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.151952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.647 [2024-11-30 04:32:04.151993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.647 [2024-11-30 04:32:04.152171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.647 [2024-11-30 04:32:04.152359] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.647 [2024-11-30 04:32:04.152382] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.647 [2024-11-30 04:32:04.152398] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.647 [2024-11-30 04:32:04.154789] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.647 [2024-11-30 04:32:04.163919] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.647 [2024-11-30 04:32:04.164259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.164420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.164445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.647 [2024-11-30 04:32:04.164461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.647 [2024-11-30 04:32:04.164653] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.647 [2024-11-30 04:32:04.164821] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.647 [2024-11-30 04:32:04.164843] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.647 [2024-11-30 04:32:04.164859] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.647 [2024-11-30 04:32:04.167239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.647 [2024-11-30 04:32:04.176397] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.647 [2024-11-30 04:32:04.176672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.176812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.176841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.647 [2024-11-30 04:32:04.176858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.647 [2024-11-30 04:32:04.177034] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.647 [2024-11-30 04:32:04.177185] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.647 [2024-11-30 04:32:04.177208] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.647 [2024-11-30 04:32:04.177222] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.647 [2024-11-30 04:32:04.179480] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.647 [2024-11-30 04:32:04.188855] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.647 [2024-11-30 04:32:04.189125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.189274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.189305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.647 [2024-11-30 04:32:04.189323] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.647 [2024-11-30 04:32:04.189488] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.647 [2024-11-30 04:32:04.189675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.647 [2024-11-30 04:32:04.189698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.647 [2024-11-30 04:32:04.189713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.647 [2024-11-30 04:32:04.192130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.647 [2024-11-30 04:32:04.201469] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.647 [2024-11-30 04:32:04.201798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.201901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.201929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.647 [2024-11-30 04:32:04.201947] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.647 [2024-11-30 04:32:04.202105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.647 [2024-11-30 04:32:04.202328] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.647 [2024-11-30 04:32:04.202352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.647 [2024-11-30 04:32:04.202368] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.647 [2024-11-30 04:32:04.204782] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.647 [2024-11-30 04:32:04.214158] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.647 [2024-11-30 04:32:04.214438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.214598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.647 [2024-11-30 04:32:04.214624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.647 [2024-11-30 04:32:04.214640] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.647 [2024-11-30 04:32:04.214785] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.647 [2024-11-30 04:32:04.214979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.647 [2024-11-30 04:32:04.215003] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.647 [2024-11-30 04:32:04.215019] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.648 [2024-11-30 04:32:04.217345] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.648 [2024-11-30 04:32:04.226907] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.648 [2024-11-30 04:32:04.227200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.648 [2024-11-30 04:32:04.227360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.648 [2024-11-30 04:32:04.227394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.648 [2024-11-30 04:32:04.227411] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.648 [2024-11-30 04:32:04.227602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.648 [2024-11-30 04:32:04.227784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.648 [2024-11-30 04:32:04.227807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.648 [2024-11-30 04:32:04.227822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.648 [2024-11-30 04:32:04.229920] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.648 [2024-11-30 04:32:04.239473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.648 [2024-11-30 04:32:04.239795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.648 [2024-11-30 04:32:04.239955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.648 [2024-11-30 04:32:04.240007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.648 [2024-11-30 04:32:04.240024] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.648 [2024-11-30 04:32:04.240186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.648 [2024-11-30 04:32:04.240383] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.648 [2024-11-30 04:32:04.240407] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.648 [2024-11-30 04:32:04.240422] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.648 [2024-11-30 04:32:04.242783] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.648 [2024-11-30 04:32:04.252063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.648 [2024-11-30 04:32:04.252414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.648 [2024-11-30 04:32:04.252615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.648 [2024-11-30 04:32:04.252665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.648 [2024-11-30 04:32:04.252683] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.648 [2024-11-30 04:32:04.252882] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.648 [2024-11-30 04:32:04.253080] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.648 [2024-11-30 04:32:04.253104] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.648 [2024-11-30 04:32:04.253119] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.648 [2024-11-30 04:32:04.255299] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.648 [2024-11-30 04:32:04.264611] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.648 [2024-11-30 04:32:04.264898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.648 [2024-11-30 04:32:04.265040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.648 [2024-11-30 04:32:04.265070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.648 [2024-11-30 04:32:04.265094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.648 [2024-11-30 04:32:04.265295] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.648 [2024-11-30 04:32:04.265409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.648 [2024-11-30 04:32:04.265432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.648 [2024-11-30 04:32:04.265447] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.648 [2024-11-30 04:32:04.267807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.909 [2024-11-30 04:32:04.277267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.909 [2024-11-30 04:32:04.277596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.909 [2024-11-30 04:32:04.277772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.909 [2024-11-30 04:32:04.277797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.909 [2024-11-30 04:32:04.277813] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.909 [2024-11-30 04:32:04.277969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.909 [2024-11-30 04:32:04.278207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.909 [2024-11-30 04:32:04.278230] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.909 [2024-11-30 04:32:04.278246] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.909 [2024-11-30 04:32:04.280646] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.909 [2024-11-30 04:32:04.289814] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.909 [2024-11-30 04:32:04.290177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.909 [2024-11-30 04:32:04.290313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.909 [2024-11-30 04:32:04.290341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.909 [2024-11-30 04:32:04.290359] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.909 [2024-11-30 04:32:04.290577] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.909 [2024-11-30 04:32:04.290709] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.909 [2024-11-30 04:32:04.290732] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.909 [2024-11-30 04:32:04.290748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.909 [2024-11-30 04:32:04.293016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.909 [2024-11-30 04:32:04.302330] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.909 [2024-11-30 04:32:04.302651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.909 [2024-11-30 04:32:04.302821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.909 [2024-11-30 04:32:04.302849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.909 [2024-11-30 04:32:04.302867] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.909 [2024-11-30 04:32:04.303065] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.910 [2024-11-30 04:32:04.303253] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.910 [2024-11-30 04:32:04.303276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.910 [2024-11-30 04:32:04.303291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.910 [2024-11-30 04:32:04.305651] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.910 [2024-11-30 04:32:04.314837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.910 [2024-11-30 04:32:04.315127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.315289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.315317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.910 [2024-11-30 04:32:04.315335] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.910 [2024-11-30 04:32:04.315480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.910 [2024-11-30 04:32:04.315630] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.910 [2024-11-30 04:32:04.315654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.910 [2024-11-30 04:32:04.315669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.910 [2024-11-30 04:32:04.317906] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.910 [2024-11-30 04:32:04.327507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.910 [2024-11-30 04:32:04.327772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.327932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.327965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.910 [2024-11-30 04:32:04.327983] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.910 [2024-11-30 04:32:04.328159] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.910 [2024-11-30 04:32:04.328364] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.910 [2024-11-30 04:32:04.328387] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.910 [2024-11-30 04:32:04.328403] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.910 [2024-11-30 04:32:04.330800] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.910 [2024-11-30 04:32:04.339999] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.910 [2024-11-30 04:32:04.340374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.340511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.340554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.910 [2024-11-30 04:32:04.340571] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.910 [2024-11-30 04:32:04.340792] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.910 [2024-11-30 04:32:04.341041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.910 [2024-11-30 04:32:04.341065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.910 [2024-11-30 04:32:04.341081] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.910 [2024-11-30 04:32:04.343261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.910 [2024-11-30 04:32:04.352453] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.910 [2024-11-30 04:32:04.352813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.352980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.353011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.910 [2024-11-30 04:32:04.353029] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.910 [2024-11-30 04:32:04.353158] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.910 [2024-11-30 04:32:04.353326] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.910 [2024-11-30 04:32:04.353348] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.910 [2024-11-30 04:32:04.353364] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.910 [2024-11-30 04:32:04.355691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.910 [2024-11-30 04:32:04.364892] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.910 [2024-11-30 04:32:04.365201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.365380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.365409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.910 [2024-11-30 04:32:04.365427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.910 [2024-11-30 04:32:04.365590] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.910 [2024-11-30 04:32:04.365795] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.910 [2024-11-30 04:32:04.365818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.910 [2024-11-30 04:32:04.365834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.910 [2024-11-30 04:32:04.368188] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.910 [2024-11-30 04:32:04.377423] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.910 [2024-11-30 04:32:04.377745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.377881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.377910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.910 [2024-11-30 04:32:04.377928] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.910 [2024-11-30 04:32:04.378105] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.910 [2024-11-30 04:32:04.378274] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.910 [2024-11-30 04:32:04.378302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.910 [2024-11-30 04:32:04.378318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.910 [2024-11-30 04:32:04.380627] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.910 [2024-11-30 04:32:04.389910] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.910 [2024-11-30 04:32:04.390219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.390387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.390416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.910 [2024-11-30 04:32:04.390433] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.910 [2024-11-30 04:32:04.390579] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.910 [2024-11-30 04:32:04.390783] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.910 [2024-11-30 04:32:04.390807] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.910 [2024-11-30 04:32:04.390822] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.910 [2024-11-30 04:32:04.393180] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.910 [2024-11-30 04:32:04.402657] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.910 [2024-11-30 04:32:04.402940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.403136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.403163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.910 [2024-11-30 04:32:04.403179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.910 [2024-11-30 04:32:04.403355] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.910 [2024-11-30 04:32:04.403495] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.910 [2024-11-30 04:32:04.403518] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.910 [2024-11-30 04:32:04.403533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.910 [2024-11-30 04:32:04.405860] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.910 [2024-11-30 04:32:04.415293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.910 [2024-11-30 04:32:04.415621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.415762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.910 [2024-11-30 04:32:04.415790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.910 [2024-11-30 04:32:04.415807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.910 [2024-11-30 04:32:04.415985] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.910 [2024-11-30 04:32:04.416137] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.910 [2024-11-30 04:32:04.416160] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.910 [2024-11-30 04:32:04.416180] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.911 [2024-11-30 04:32:04.418431] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.911 [2024-11-30 04:32:04.427547] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.911 [2024-11-30 04:32:04.427894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.428029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.428059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.911 [2024-11-30 04:32:04.428077] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.911 [2024-11-30 04:32:04.428259] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.911 [2024-11-30 04:32:04.428428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.911 [2024-11-30 04:32:04.428451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.911 [2024-11-30 04:32:04.428466] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.911 [2024-11-30 04:32:04.430845] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.911 [2024-11-30 04:32:04.440255] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.911 [2024-11-30 04:32:04.440576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.440713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.440742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.911 [2024-11-30 04:32:04.440760] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.911 [2024-11-30 04:32:04.440942] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.911 [2024-11-30 04:32:04.441108] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.911 [2024-11-30 04:32:04.441131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.911 [2024-11-30 04:32:04.441146] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.911 [2024-11-30 04:32:04.443436] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.911 [2024-11-30 04:32:04.452913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.911 [2024-11-30 04:32:04.453218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.453355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.453381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.911 [2024-11-30 04:32:04.453396] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.911 [2024-11-30 04:32:04.453568] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.911 [2024-11-30 04:32:04.453736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.911 [2024-11-30 04:32:04.453759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.911 [2024-11-30 04:32:04.453774] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.911 [2024-11-30 04:32:04.456149] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.911 [2024-11-30 04:32:04.465363] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.911 [2024-11-30 04:32:04.465674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.465787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.465828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.911 [2024-11-30 04:32:04.465844] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.911 [2024-11-30 04:32:04.466004] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.911 [2024-11-30 04:32:04.466166] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.911 [2024-11-30 04:32:04.466190] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.911 [2024-11-30 04:32:04.466205] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.911 [2024-11-30 04:32:04.468707] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.911 [2024-11-30 04:32:04.478025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.911 [2024-11-30 04:32:04.478356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.478505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.478531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.911 [2024-11-30 04:32:04.478546] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.911 [2024-11-30 04:32:04.478708] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.911 [2024-11-30 04:32:04.478876] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.911 [2024-11-30 04:32:04.478899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.911 [2024-11-30 04:32:04.478914] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.911 [2024-11-30 04:32:04.481213] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.911 [2024-11-30 04:32:04.490401] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.911 [2024-11-30 04:32:04.490720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.490856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.490884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.911 [2024-11-30 04:32:04.490902] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.911 [2024-11-30 04:32:04.491061] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.911 [2024-11-30 04:32:04.491176] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.911 [2024-11-30 04:32:04.491198] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.911 [2024-11-30 04:32:04.491213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.911 [2024-11-30 04:32:04.493380] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.911 [2024-11-30 04:32:04.502898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.911 [2024-11-30 04:32:04.503228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.503411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.503437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.911 [2024-11-30 04:32:04.503453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.911 [2024-11-30 04:32:04.503616] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.911 [2024-11-30 04:32:04.503800] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.911 [2024-11-30 04:32:04.503823] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.911 [2024-11-30 04:32:04.503837] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.911 [2024-11-30 04:32:04.506245] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.911 [2024-11-30 04:32:04.515369] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.911 [2024-11-30 04:32:04.515654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.515785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.515814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.911 [2024-11-30 04:32:04.515832] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.911 [2024-11-30 04:32:04.516025] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.911 [2024-11-30 04:32:04.516195] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.911 [2024-11-30 04:32:04.516218] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.911 [2024-11-30 04:32:04.516233] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.911 [2024-11-30 04:32:04.518523] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:13.911 [2024-11-30 04:32:04.527785] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:13.911 [2024-11-30 04:32:04.528080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.528222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:13.911 [2024-11-30 04:32:04.528251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:13.911 [2024-11-30 04:32:04.528269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:13.911 [2024-11-30 04:32:04.528469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:13.911 [2024-11-30 04:32:04.528637] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:13.911 [2024-11-30 04:32:04.528660] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:13.911 [2024-11-30 04:32:04.528675] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:13.911 [2024-11-30 04:32:04.530992] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.172 [2024-11-30 04:32:04.540345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.172 [2024-11-30 04:32:04.540665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.172 [2024-11-30 04:32:04.540794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.172 [2024-11-30 04:32:04.540836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.172 [2024-11-30 04:32:04.540851] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.172 [2024-11-30 04:32:04.541023] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.172 [2024-11-30 04:32:04.541221] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.172 [2024-11-30 04:32:04.541244] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.172 [2024-11-30 04:32:04.541259] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.172 [2024-11-30 04:32:04.543691] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.172 [2024-11-30 04:32:04.552865] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.172 [2024-11-30 04:32:04.553150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.172 [2024-11-30 04:32:04.553311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.172 [2024-11-30 04:32:04.553339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.172 [2024-11-30 04:32:04.553357] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.172 [2024-11-30 04:32:04.553538] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.172 [2024-11-30 04:32:04.553652] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.172 [2024-11-30 04:32:04.553674] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.172 [2024-11-30 04:32:04.553690] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.172 [2024-11-30 04:32:04.556027] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.172 [2024-11-30 04:32:04.565427] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.172 [2024-11-30 04:32:04.565782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.172 [2024-11-30 04:32:04.565900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.172 [2024-11-30 04:32:04.565928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.172 [2024-11-30 04:32:04.565946] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.172 [2024-11-30 04:32:04.566138] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.172 [2024-11-30 04:32:04.566343] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.172 [2024-11-30 04:32:04.566366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.172 [2024-11-30 04:32:04.566382] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.172 [2024-11-30 04:32:04.568559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.172 [2024-11-30 04:32:04.577786] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.172 [2024-11-30 04:32:04.578111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.172 [2024-11-30 04:32:04.578245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.172 [2024-11-30 04:32:04.578278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.172 [2024-11-30 04:32:04.578297] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.172 [2024-11-30 04:32:04.578497] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.172 [2024-11-30 04:32:04.578683] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.172 [2024-11-30 04:32:04.578706] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.172 [2024-11-30 04:32:04.578721] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.172 [2024-11-30 04:32:04.580989] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.172 [2024-11-30 04:32:04.590261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.172 [2024-11-30 04:32:04.590557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.172 [2024-11-30 04:32:04.590733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.172 [2024-11-30 04:32:04.590758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.173 [2024-11-30 04:32:04.590774] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.173 [2024-11-30 04:32:04.590930] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.173 [2024-11-30 04:32:04.591125] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.173 [2024-11-30 04:32:04.591149] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.173 [2024-11-30 04:32:04.591165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.173 [2024-11-30 04:32:04.593400] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.173 [2024-11-30 04:32:04.602791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.173 [2024-11-30 04:32:04.603166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.603331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.603359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.173 [2024-11-30 04:32:04.603376] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.173 [2024-11-30 04:32:04.603522] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.173 [2024-11-30 04:32:04.603718] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.173 [2024-11-30 04:32:04.603743] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.173 [2024-11-30 04:32:04.603758] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.173 [2024-11-30 04:32:04.606204] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.173 [2024-11-30 04:32:04.615353] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.173 [2024-11-30 04:32:04.615702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.615826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.615851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.173 [2024-11-30 04:32:04.615872] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.173 [2024-11-30 04:32:04.616066] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.173 [2024-11-30 04:32:04.616254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.173 [2024-11-30 04:32:04.616278] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.173 [2024-11-30 04:32:04.616294] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.173 [2024-11-30 04:32:04.618697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.173 [2024-11-30 04:32:04.627762] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.173 [2024-11-30 04:32:04.628115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.628248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.628274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.173 [2024-11-30 04:32:04.628290] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.173 [2024-11-30 04:32:04.628469] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.173 [2024-11-30 04:32:04.628619] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.173 [2024-11-30 04:32:04.628643] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.173 [2024-11-30 04:32:04.628659] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.173 [2024-11-30 04:32:04.630936] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.173 [2024-11-30 04:32:04.640259] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.173 [2024-11-30 04:32:04.640602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.640746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.640775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.173 [2024-11-30 04:32:04.640793] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.173 [2024-11-30 04:32:04.640966] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.173 [2024-11-30 04:32:04.641190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.173 [2024-11-30 04:32:04.641210] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.173 [2024-11-30 04:32:04.641224] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.173 [2024-11-30 04:32:04.643370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.173 [2024-11-30 04:32:04.652787] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.173 [2024-11-30 04:32:04.653135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.653280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.653311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.173 [2024-11-30 04:32:04.653329] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.173 [2024-11-30 04:32:04.653534] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.173 [2024-11-30 04:32:04.653703] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.173 [2024-11-30 04:32:04.653726] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.173 [2024-11-30 04:32:04.653741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.173 [2024-11-30 04:32:04.656098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.173 [2024-11-30 04:32:04.665391] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.173 [2024-11-30 04:32:04.665718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.665877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.665903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.173 [2024-11-30 04:32:04.665919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.173 [2024-11-30 04:32:04.666144] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.173 [2024-11-30 04:32:04.666279] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.173 [2024-11-30 04:32:04.666302] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.173 [2024-11-30 04:32:04.666317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.173 [2024-11-30 04:32:04.668444] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.173 [2024-11-30 04:32:04.677970] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.173 [2024-11-30 04:32:04.678380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.678583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.678642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.173 [2024-11-30 04:32:04.678659] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.173 [2024-11-30 04:32:04.678823] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.173 [2024-11-30 04:32:04.679021] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.173 [2024-11-30 04:32:04.679045] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.173 [2024-11-30 04:32:04.679060] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.173 [2024-11-30 04:32:04.681284] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.173 [2024-11-30 04:32:04.690425] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.173 [2024-11-30 04:32:04.690778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.690926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.690952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.173 [2024-11-30 04:32:04.690978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.173 [2024-11-30 04:32:04.691110] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.173 [2024-11-30 04:32:04.691280] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.173 [2024-11-30 04:32:04.691303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.173 [2024-11-30 04:32:04.691318] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.173 [2024-11-30 04:32:04.693794] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.173 [2024-11-30 04:32:04.703118] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.173 [2024-11-30 04:32:04.703497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.703690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.173 [2024-11-30 04:32:04.703731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.173 [2024-11-30 04:32:04.703749] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.173 [2024-11-30 04:32:04.703858] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.173 [2024-11-30 04:32:04.704019] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.174 [2024-11-30 04:32:04.704043] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.174 [2024-11-30 04:32:04.704058] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.174 [2024-11-30 04:32:04.706456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.174 [2024-11-30 04:32:04.715768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.174 [2024-11-30 04:32:04.716053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.716201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.716227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.174 [2024-11-30 04:32:04.716242] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.174 [2024-11-30 04:32:04.716372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.174 [2024-11-30 04:32:04.716605] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.174 [2024-11-30 04:32:04.716628] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.174 [2024-11-30 04:32:04.716643] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.174 [2024-11-30 04:32:04.718983] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.174 [2024-11-30 04:32:04.728349] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.174 [2024-11-30 04:32:04.728786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.728920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.728945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.174 [2024-11-30 04:32:04.728968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.174 [2024-11-30 04:32:04.729160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.174 [2024-11-30 04:32:04.729292] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.174 [2024-11-30 04:32:04.729320] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.174 [2024-11-30 04:32:04.729336] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.174 [2024-11-30 04:32:04.731807] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.174 [2024-11-30 04:32:04.740942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.174 [2024-11-30 04:32:04.741236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.741366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.741393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.174 [2024-11-30 04:32:04.741408] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.174 [2024-11-30 04:32:04.741539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.174 [2024-11-30 04:32:04.741691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.174 [2024-11-30 04:32:04.741725] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.174 [2024-11-30 04:32:04.741741] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.174 [2024-11-30 04:32:04.744169] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.174 [2024-11-30 04:32:04.753593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.174 [2024-11-30 04:32:04.753888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.754037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.754063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.174 [2024-11-30 04:32:04.754079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.174 [2024-11-30 04:32:04.754258] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.174 [2024-11-30 04:32:04.754419] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.174 [2024-11-30 04:32:04.754442] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.174 [2024-11-30 04:32:04.754458] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.174 [2024-11-30 04:32:04.756723] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.174 [2024-11-30 04:32:04.766093] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.174 [2024-11-30 04:32:04.766488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.766646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.766674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.174 [2024-11-30 04:32:04.766692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.174 [2024-11-30 04:32:04.766818] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.174 [2024-11-30 04:32:04.767048] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.174 [2024-11-30 04:32:04.767070] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.174 [2024-11-30 04:32:04.767089] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.174 [2024-11-30 04:32:04.769395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.174 [2024-11-30 04:32:04.778630] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.174 [2024-11-30 04:32:04.778952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.779109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.779135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.174 [2024-11-30 04:32:04.779152] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.174 [2024-11-30 04:32:04.779323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.174 [2024-11-30 04:32:04.779528] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.174 [2024-11-30 04:32:04.779550] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.174 [2024-11-30 04:32:04.779565] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.174 [2024-11-30 04:32:04.781738] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.174 [2024-11-30 04:32:04.791332] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.174 [2024-11-30 04:32:04.791678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.791858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.174 [2024-11-30 04:32:04.791884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.174 [2024-11-30 04:32:04.791900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.174 [2024-11-30 04:32:04.792132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.174 [2024-11-30 04:32:04.792302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.174 [2024-11-30 04:32:04.792325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.174 [2024-11-30 04:32:04.792339] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.174 [2024-11-30 04:32:04.794789] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.435 [2024-11-30 04:32:04.804115] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.435 [2024-11-30 04:32:04.804456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.804585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.804614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.435 [2024-11-30 04:32:04.804631] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.435 [2024-11-30 04:32:04.804831] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.435 [2024-11-30 04:32:04.804994] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.435 [2024-11-30 04:32:04.805018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.435 [2024-11-30 04:32:04.805034] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.435 [2024-11-30 04:32:04.807334] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.435 [2024-11-30 04:32:04.816494] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.435 [2024-11-30 04:32:04.816795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.816924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.816975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.435 [2024-11-30 04:32:04.816993] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.435 [2024-11-30 04:32:04.817154] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.435 [2024-11-30 04:32:04.817330] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.435 [2024-11-30 04:32:04.817353] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.435 [2024-11-30 04:32:04.817369] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.435 [2024-11-30 04:32:04.819550] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.435 [2024-11-30 04:32:04.828864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.435 [2024-11-30 04:32:04.829193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.829382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.829431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.435 [2024-11-30 04:32:04.829449] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.435 [2024-11-30 04:32:04.829667] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.435 [2024-11-30 04:32:04.829817] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.435 [2024-11-30 04:32:04.829840] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.435 [2024-11-30 04:32:04.829855] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.435 [2024-11-30 04:32:04.831946] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.435 [2024-11-30 04:32:04.841499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.435 [2024-11-30 04:32:04.841846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.842004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.842031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.435 [2024-11-30 04:32:04.842047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.435 [2024-11-30 04:32:04.842170] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.435 [2024-11-30 04:32:04.842321] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.435 [2024-11-30 04:32:04.842344] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.435 [2024-11-30 04:32:04.842359] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.435 [2024-11-30 04:32:04.844791] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.435 [2024-11-30 04:32:04.854024] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.435 [2024-11-30 04:32:04.854401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.854550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.854578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.435 [2024-11-30 04:32:04.854595] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.435 [2024-11-30 04:32:04.854795] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.435 [2024-11-30 04:32:04.854993] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.435 [2024-11-30 04:32:04.855017] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.435 [2024-11-30 04:32:04.855032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.435 [2024-11-30 04:32:04.857407] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.435 [2024-11-30 04:32:04.866331] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.435 [2024-11-30 04:32:04.866593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.866729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.866758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.435 [2024-11-30 04:32:04.866776] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.435 [2024-11-30 04:32:04.866903] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.435 [2024-11-30 04:32:04.867100] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.435 [2024-11-30 04:32:04.867124] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.435 [2024-11-30 04:32:04.867141] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.435 [2024-11-30 04:32:04.869408] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.435 [2024-11-30 04:32:04.879023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.435 [2024-11-30 04:32:04.879372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.879544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.879569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.435 [2024-11-30 04:32:04.879585] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.435 [2024-11-30 04:32:04.879760] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.435 [2024-11-30 04:32:04.879971] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.435 [2024-11-30 04:32:04.879995] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.435 [2024-11-30 04:32:04.880010] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.435 [2024-11-30 04:32:04.882351] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.435 [2024-11-30 04:32:04.891536] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.435 [2024-11-30 04:32:04.891820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.891943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.435 [2024-11-30 04:32:04.891990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.435 [2024-11-30 04:32:04.892009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.435 [2024-11-30 04:32:04.892174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.436 [2024-11-30 04:32:04.892288] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.436 [2024-11-30 04:32:04.892310] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.436 [2024-11-30 04:32:04.892326] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.436 [2024-11-30 04:32:04.894687] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.436 [2024-11-30 04:32:04.904044] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.436 [2024-11-30 04:32:04.904399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.904527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.904552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.436 [2024-11-30 04:32:04.904568] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.436 [2024-11-30 04:32:04.904743] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.436 [2024-11-30 04:32:04.904929] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.436 [2024-11-30 04:32:04.904953] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.436 [2024-11-30 04:32:04.904982] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.436 [2024-11-30 04:32:04.907288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.436 [2024-11-30 04:32:04.916593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.436 [2024-11-30 04:32:04.916894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.917072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.917099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.436 [2024-11-30 04:32:04.917114] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.436 [2024-11-30 04:32:04.917277] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.436 [2024-11-30 04:32:04.917457] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.436 [2024-11-30 04:32:04.917481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.436 [2024-11-30 04:32:04.917496] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.436 [2024-11-30 04:32:04.919712] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.436 [2024-11-30 04:32:04.929125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.436 [2024-11-30 04:32:04.929436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.929577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.929611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.436 [2024-11-30 04:32:04.929630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.436 [2024-11-30 04:32:04.929794] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.436 [2024-11-30 04:32:04.930010] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.436 [2024-11-30 04:32:04.930034] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.436 [2024-11-30 04:32:04.930050] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.436 [2024-11-30 04:32:04.932371] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.436 [2024-11-30 04:32:04.941639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.436 [2024-11-30 04:32:04.941974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.942112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.942142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.436 [2024-11-30 04:32:04.942159] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.436 [2024-11-30 04:32:04.942323] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.436 [2024-11-30 04:32:04.942473] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.436 [2024-11-30 04:32:04.942497] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.436 [2024-11-30 04:32:04.942512] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.436 [2024-11-30 04:32:04.944944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.436 [2024-11-30 04:32:04.954426] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.436 [2024-11-30 04:32:04.954781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.954918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.954947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.436 [2024-11-30 04:32:04.954976] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.436 [2024-11-30 04:32:04.955124] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.436 [2024-11-30 04:32:04.955291] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.436 [2024-11-30 04:32:04.955314] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.436 [2024-11-30 04:32:04.955330] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.436 [2024-11-30 04:32:04.957744] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.436 [2024-11-30 04:32:04.966984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.436 [2024-11-30 04:32:04.967249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.967395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.967421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.436 [2024-11-30 04:32:04.967442] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.436 [2024-11-30 04:32:04.967655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.436 [2024-11-30 04:32:04.967752] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.436 [2024-11-30 04:32:04.967775] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.436 [2024-11-30 04:32:04.967790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.436 [2024-11-30 04:32:04.970158] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.436 [2024-11-30 04:32:04.979522] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.436 [2024-11-30 04:32:04.979837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.979950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.979990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.436 [2024-11-30 04:32:04.980009] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.436 [2024-11-30 04:32:04.980208] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.436 [2024-11-30 04:32:04.980431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.436 [2024-11-30 04:32:04.980454] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.436 [2024-11-30 04:32:04.980469] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.436 [2024-11-30 04:32:04.982755] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.436 [2024-11-30 04:32:04.992095] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.436 [2024-11-30 04:32:04.992377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.992517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:04.992545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.436 [2024-11-30 04:32:04.992562] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.436 [2024-11-30 04:32:04.992726] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.436 [2024-11-30 04:32:04.992859] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.436 [2024-11-30 04:32:04.992882] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.436 [2024-11-30 04:32:04.992897] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.436 [2024-11-30 04:32:04.995249] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.436 [2024-11-30 04:32:05.004812] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.436 [2024-11-30 04:32:05.005081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:05.005217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.436 [2024-11-30 04:32:05.005246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.436 [2024-11-30 04:32:05.005263] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.436 [2024-11-30 04:32:05.005451] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.436 [2024-11-30 04:32:05.005584] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.436 [2024-11-30 04:32:05.005607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.436 [2024-11-30 04:32:05.005622] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.437 [2024-11-30 04:32:05.007929] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.437 [2024-11-30 04:32:05.017345] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.437 [2024-11-30 04:32:05.017654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.437 [2024-11-30 04:32:05.017789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.437 [2024-11-30 04:32:05.017817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.437 [2024-11-30 04:32:05.017835] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.437 [2024-11-30 04:32:05.017992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.437 [2024-11-30 04:32:05.018162] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.437 [2024-11-30 04:32:05.018185] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.437 [2024-11-30 04:32:05.018200] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.437 [2024-11-30 04:32:05.020469] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.437 [2024-11-30 04:32:05.030025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.437 [2024-11-30 04:32:05.030348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.437 [2024-11-30 04:32:05.030485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.437 [2024-11-30 04:32:05.030514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.437 [2024-11-30 04:32:05.030532] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.437 [2024-11-30 04:32:05.030714] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.437 [2024-11-30 04:32:05.030902] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.437 [2024-11-30 04:32:05.030925] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.437 [2024-11-30 04:32:05.030940] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.437 [2024-11-30 04:32:05.033165] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.437 [2024-11-30 04:32:05.042699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.437 [2024-11-30 04:32:05.042980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.437 [2024-11-30 04:32:05.043133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.437 [2024-11-30 04:32:05.043159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.437 [2024-11-30 04:32:05.043175] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.437 [2024-11-30 04:32:05.043307] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.437 [2024-11-30 04:32:05.043500] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.437 [2024-11-30 04:32:05.043523] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.437 [2024-11-30 04:32:05.043538] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.437 [2024-11-30 04:32:05.046072] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.437 [2024-11-30 04:32:05.055352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.437 [2024-11-30 04:32:05.055652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.437 [2024-11-30 04:32:05.055787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.437 [2024-11-30 04:32:05.055816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.437 [2024-11-30 04:32:05.055834] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.437 [2024-11-30 04:32:05.056010] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.437 [2024-11-30 04:32:05.056179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.437 [2024-11-30 04:32:05.056203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.437 [2024-11-30 04:32:05.056218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.437 [2024-11-30 04:32:05.058397] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.695 [2024-11-30 04:32:05.068034] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.695 [2024-11-30 04:32:05.068352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.695 [2024-11-30 04:32:05.068490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.695 [2024-11-30 04:32:05.068531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.695 [2024-11-30 04:32:05.068547] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.695 [2024-11-30 04:32:05.068677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.695 [2024-11-30 04:32:05.068848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.695 [2024-11-30 04:32:05.068871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.695 [2024-11-30 04:32:05.068887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.695 [2024-11-30 04:32:05.071147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.695 [2024-11-30 04:32:05.080571] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.695 [2024-11-30 04:32:05.080895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.695 [2024-11-30 04:32:05.081025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.695 [2024-11-30 04:32:05.081054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.695 [2024-11-30 04:32:05.081072] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.695 [2024-11-30 04:32:05.081291] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.695 [2024-11-30 04:32:05.081459] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.695 [2024-11-30 04:32:05.081488] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.695 [2024-11-30 04:32:05.081504] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.695 [2024-11-30 04:32:05.083900] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.695 [2024-11-30 04:32:05.093010] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.695 [2024-11-30 04:32:05.093344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.695 [2024-11-30 04:32:05.093434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.695 [2024-11-30 04:32:05.093458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.695 [2024-11-30 04:32:05.093474] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.695 [2024-11-30 04:32:05.093632] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.695 [2024-11-30 04:32:05.093794] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.695 [2024-11-30 04:32:05.093818] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.695 [2024-11-30 04:32:05.093833] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.695 [2024-11-30 04:32:05.096089] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.695 [2024-11-30 04:32:05.105511] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.695 [2024-11-30 04:32:05.105866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.695 [2024-11-30 04:32:05.106027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.695 [2024-11-30 04:32:05.106057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.695 [2024-11-30 04:32:05.106075] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.695 [2024-11-30 04:32:05.106275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.695 [2024-11-30 04:32:05.106408] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.695 [2024-11-30 04:32:05.106430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.696 [2024-11-30 04:32:05.106445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.696 [2024-11-30 04:32:05.108856] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.696 [2024-11-30 04:32:05.117885] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.696 [2024-11-30 04:32:05.118193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.118334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.118363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.696 [2024-11-30 04:32:05.118381] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.696 [2024-11-30 04:32:05.118564] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.696 [2024-11-30 04:32:05.118769] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.696 [2024-11-30 04:32:05.118792] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.696 [2024-11-30 04:32:05.118813] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.696 [2024-11-30 04:32:05.121147] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.696 [2024-11-30 04:32:05.130507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.696 [2024-11-30 04:32:05.130848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.130993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.131022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.696 [2024-11-30 04:32:05.131041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.696 [2024-11-30 04:32:05.131240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.696 [2024-11-30 04:32:05.131409] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.696 [2024-11-30 04:32:05.131432] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.696 [2024-11-30 04:32:05.131447] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.696 [2024-11-30 04:32:05.133948] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.696 [2024-11-30 04:32:05.143192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.696 [2024-11-30 04:32:05.143533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.143672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.143701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.696 [2024-11-30 04:32:05.143718] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.696 [2024-11-30 04:32:05.143864] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.696 [2024-11-30 04:32:05.144043] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.696 [2024-11-30 04:32:05.144067] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.696 [2024-11-30 04:32:05.144082] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.696 [2024-11-30 04:32:05.146385] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.696 [2024-11-30 04:32:05.155654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.696 [2024-11-30 04:32:05.156019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.156184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.156209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.696 [2024-11-30 04:32:05.156225] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.696 [2024-11-30 04:32:05.156467] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.696 [2024-11-30 04:32:05.156672] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.696 [2024-11-30 04:32:05.156695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.696 [2024-11-30 04:32:05.156710] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.696 [2024-11-30 04:32:05.158901] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.696 [2024-11-30 04:32:05.168219] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.696 [2024-11-30 04:32:05.168520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.168631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.168660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.696 [2024-11-30 04:32:05.168678] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.696 [2024-11-30 04:32:05.168842] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.696 [2024-11-30 04:32:05.169058] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.696 [2024-11-30 04:32:05.169082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.696 [2024-11-30 04:32:05.169098] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.696 [2024-11-30 04:32:05.171420] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.696 [2024-11-30 04:32:05.180576] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.696 [2024-11-30 04:32:05.180864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.181000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.181029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.696 [2024-11-30 04:32:05.181047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.696 [2024-11-30 04:32:05.181265] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.696 [2024-11-30 04:32:05.181415] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.696 [2024-11-30 04:32:05.181438] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.696 [2024-11-30 04:32:05.181454] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.696 [2024-11-30 04:32:05.183812] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.696 [2024-11-30 04:32:05.193267] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.696 [2024-11-30 04:32:05.193605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.193781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.193807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.696 [2024-11-30 04:32:05.193823] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.696 [2024-11-30 04:32:05.193995] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.696 [2024-11-30 04:32:05.194179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.696 [2024-11-30 04:32:05.194202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.696 [2024-11-30 04:32:05.194218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.696 [2024-11-30 04:32:05.196503] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.696 [2024-11-30 04:32:05.205592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.696 [2024-11-30 04:32:05.205893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.206030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.206061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.696 [2024-11-30 04:32:05.206079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.696 [2024-11-30 04:32:05.206207] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.696 [2024-11-30 04:32:05.206376] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.696 [2024-11-30 04:32:05.206399] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.696 [2024-11-30 04:32:05.206414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.696 [2024-11-30 04:32:05.208728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.696 [2024-11-30 04:32:05.218265] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.696 [2024-11-30 04:32:05.218571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.218729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.696 [2024-11-30 04:32:05.218758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.696 [2024-11-30 04:32:05.218775] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.696 [2024-11-30 04:32:05.218940] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.696 [2024-11-30 04:32:05.219173] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.696 [2024-11-30 04:32:05.219197] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.696 [2024-11-30 04:32:05.219213] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.696 [2024-11-30 04:32:05.221643] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.696 [2024-11-30 04:32:05.230844] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.696 [2024-11-30 04:32:05.231239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.231364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.231409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.697 [2024-11-30 04:32:05.231427] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.697 [2024-11-30 04:32:05.231555] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.697 [2024-11-30 04:32:05.231723] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.697 [2024-11-30 04:32:05.231746] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.697 [2024-11-30 04:32:05.231761] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.697 [2024-11-30 04:32:05.234060] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.697 [2024-11-30 04:32:05.243293] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.697 [2024-11-30 04:32:05.243634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.243802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.243831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.697 [2024-11-30 04:32:05.243848] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.697 [2024-11-30 04:32:05.243988] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.697 [2024-11-30 04:32:05.244121] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.697 [2024-11-30 04:32:05.244144] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.697 [2024-11-30 04:32:05.244160] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.697 [2024-11-30 04:32:05.246392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.697 [2024-11-30 04:32:05.255984] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.697 [2024-11-30 04:32:05.256332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.256482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.256508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.697 [2024-11-30 04:32:05.256524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.697 [2024-11-30 04:32:05.256639] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.697 [2024-11-30 04:32:05.256854] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.697 [2024-11-30 04:32:05.256878] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.697 [2024-11-30 04:32:05.256894] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.697 [2024-11-30 04:32:05.259173] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.697 [2024-11-30 04:32:05.268542] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.697 [2024-11-30 04:32:05.268862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.269011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.269038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.697 [2024-11-30 04:32:05.269055] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.697 [2024-11-30 04:32:05.269233] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.697 [2024-11-30 04:32:05.269456] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.697 [2024-11-30 04:32:05.269479] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.697 [2024-11-30 04:32:05.269495] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.697 [2024-11-30 04:32:05.271728] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.697 [2024-11-30 04:32:05.281286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.697 [2024-11-30 04:32:05.281525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.281709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.281740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.697 [2024-11-30 04:32:05.281757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.697 [2024-11-30 04:32:05.281949] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.697 [2024-11-30 04:32:05.282126] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.697 [2024-11-30 04:32:05.282150] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.697 [2024-11-30 04:32:05.282165] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.697 [2024-11-30 04:32:05.284489] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.697 [2024-11-30 04:32:05.293824] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.697 [2024-11-30 04:32:05.294169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.294299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.294327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.697 [2024-11-30 04:32:05.294345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.697 [2024-11-30 04:32:05.294509] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.697 [2024-11-30 04:32:05.294696] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.697 [2024-11-30 04:32:05.294719] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.697 [2024-11-30 04:32:05.294734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.697 [2024-11-30 04:32:05.297067] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.697 [2024-11-30 04:32:05.306505] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.697 [2024-11-30 04:32:05.306797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.306936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.306970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.697 [2024-11-30 04:32:05.306988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.697 [2024-11-30 04:32:05.307136] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.697 [2024-11-30 04:32:05.307299] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.697 [2024-11-30 04:32:05.307322] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.697 [2024-11-30 04:32:05.307338] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.697 [2024-11-30 04:32:05.309641] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.697 [2024-11-30 04:32:05.319048] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.697 [2024-11-30 04:32:05.319413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.319547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.697 [2024-11-30 04:32:05.319576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.697 [2024-11-30 04:32:05.319599] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.697 [2024-11-30 04:32:05.319783] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.697 [2024-11-30 04:32:05.319951] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.697 [2024-11-30 04:32:05.319984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.697 [2024-11-30 04:32:05.320000] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.697 [2024-11-30 04:32:05.322328] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.956 [2024-11-30 04:32:05.331620] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.956 [2024-11-30 04:32:05.331965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-30 04:32:05.332135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-30 04:32:05.332161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.956 [2024-11-30 04:32:05.332177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.956 [2024-11-30 04:32:05.332370] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.956 [2024-11-30 04:32:05.332484] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.956 [2024-11-30 04:32:05.332507] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.956 [2024-11-30 04:32:05.332522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.956 [2024-11-30 04:32:05.334821] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.956 [2024-11-30 04:32:05.344230] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.956 [2024-11-30 04:32:05.344554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-30 04:32:05.344673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-30 04:32:05.344702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.956 [2024-11-30 04:32:05.344720] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.956 [2024-11-30 04:32:05.344890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.956 [2024-11-30 04:32:05.345109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.956 [2024-11-30 04:32:05.345146] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.956 [2024-11-30 04:32:05.345159] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.956 [2024-11-30 04:32:05.347429] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.956 [2024-11-30 04:32:05.356698] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.956 [2024-11-30 04:32:05.357036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-30 04:32:05.357206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-30 04:32:05.357234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.956 [2024-11-30 04:32:05.357251] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.956 [2024-11-30 04:32:05.357433] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.956 [2024-11-30 04:32:05.357602] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.956 [2024-11-30 04:32:05.357626] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.956 [2024-11-30 04:32:05.357642] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.956 [2024-11-30 04:32:05.360091] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.956 [2024-11-30 04:32:05.369261] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.956 [2024-11-30 04:32:05.369626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-30 04:32:05.369810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.956 [2024-11-30 04:32:05.369844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.956 [2024-11-30 04:32:05.369862] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.956 [2024-11-30 04:32:05.370055] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.956 [2024-11-30 04:32:05.370188] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.956 [2024-11-30 04:32:05.370211] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.956 [2024-11-30 04:32:05.370226] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.956 [2024-11-30 04:32:05.372526] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.956 [2024-11-30 04:32:05.381866] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.957 [2024-11-30 04:32:05.382215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.382447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.382475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.957 [2024-11-30 04:32:05.382492] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.957 [2024-11-30 04:32:05.382657] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.957 [2024-11-30 04:32:05.382843] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.957 [2024-11-30 04:32:05.382866] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.957 [2024-11-30 04:32:05.382881] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.957 [2024-11-30 04:32:05.385257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.957 [2024-11-30 04:32:05.394459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.957 [2024-11-30 04:32:05.394729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.394865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.394894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.957 [2024-11-30 04:32:05.394912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.957 [2024-11-30 04:32:05.395091] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.957 [2024-11-30 04:32:05.395304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.957 [2024-11-30 04:32:05.395327] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.957 [2024-11-30 04:32:05.395343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.957 [2024-11-30 04:32:05.397705] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.957 [2024-11-30 04:32:05.407109] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.957 [2024-11-30 04:32:05.407441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.407664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.407715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.957 [2024-11-30 04:32:05.407733] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.957 [2024-11-30 04:32:05.407950] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.957 [2024-11-30 04:32:05.408148] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.957 [2024-11-30 04:32:05.408171] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.957 [2024-11-30 04:32:05.408186] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.957 [2024-11-30 04:32:05.410415] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.957 [2024-11-30 04:32:05.419779] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.957 [2024-11-30 04:32:05.420090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.420232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.420260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.957 [2024-11-30 04:32:05.420277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.957 [2024-11-30 04:32:05.420459] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.957 [2024-11-30 04:32:05.420592] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.957 [2024-11-30 04:32:05.420615] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.957 [2024-11-30 04:32:05.420631] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.957 [2024-11-30 04:32:05.422938] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.957 [2024-11-30 04:32:05.432286] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.957 [2024-11-30 04:32:05.432606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.432731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.432760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.957 [2024-11-30 04:32:05.432777] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.957 [2024-11-30 04:32:05.432969] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.957 [2024-11-30 04:32:05.433138] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.957 [2024-11-30 04:32:05.433167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.957 [2024-11-30 04:32:05.433184] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.957 [2024-11-30 04:32:05.435668] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.957 [2024-11-30 04:32:05.444791] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.957 [2024-11-30 04:32:05.445154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.445294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.445322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.957 [2024-11-30 04:32:05.445340] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.957 [2024-11-30 04:32:05.445468] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.957 [2024-11-30 04:32:05.445618] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.957 [2024-11-30 04:32:05.445641] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.957 [2024-11-30 04:32:05.445656] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.957 [2024-11-30 04:32:05.448042] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.957 [2024-11-30 04:32:05.457454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.957 [2024-11-30 04:32:05.457773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.457885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.457914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.957 [2024-11-30 04:32:05.457931] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.957 [2024-11-30 04:32:05.458087] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.957 [2024-11-30 04:32:05.458275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.957 [2024-11-30 04:32:05.458298] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.957 [2024-11-30 04:32:05.458314] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.957 [2024-11-30 04:32:05.460438] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.957 [2024-11-30 04:32:05.470063] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.957 [2024-11-30 04:32:05.470430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.470567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.470596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.957 [2024-11-30 04:32:05.470613] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.957 [2024-11-30 04:32:05.470759] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.957 [2024-11-30 04:32:05.470927] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.957 [2024-11-30 04:32:05.470951] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.957 [2024-11-30 04:32:05.470983] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.957 [2024-11-30 04:32:05.473378] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.957 [2024-11-30 04:32:05.482721] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.957 [2024-11-30 04:32:05.482975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.483114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.483143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.957 [2024-11-30 04:32:05.483161] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.957 [2024-11-30 04:32:05.483361] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.957 [2024-11-30 04:32:05.483510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.957 [2024-11-30 04:32:05.483534] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.957 [2024-11-30 04:32:05.483550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.957 [2024-11-30 04:32:05.485944] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.957 [2024-11-30 04:32:05.495099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.957 [2024-11-30 04:32:05.495382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.495521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.957 [2024-11-30 04:32:05.495550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.957 [2024-11-30 04:32:05.495567] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.958 [2024-11-30 04:32:05.495731] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.958 [2024-11-30 04:32:05.495918] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.958 [2024-11-30 04:32:05.495941] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.958 [2024-11-30 04:32:05.495966] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.958 [2024-11-30 04:32:05.498312] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.958 [2024-11-30 04:32:05.507537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.958 [2024-11-30 04:32:05.507872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.508012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.508042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.958 [2024-11-30 04:32:05.508060] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.958 [2024-11-30 04:32:05.508242] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.958 [2024-11-30 04:32:05.508393] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.958 [2024-11-30 04:32:05.508416] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.958 [2024-11-30 04:32:05.508431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.958 [2024-11-30 04:32:05.510671] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.958 [2024-11-30 04:32:05.520122] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.958 [2024-11-30 04:32:05.520416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.520572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.520599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.958 [2024-11-30 04:32:05.520614] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.958 [2024-11-30 04:32:05.520825] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.958 [2024-11-30 04:32:05.520988] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.958 [2024-11-30 04:32:05.521012] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.958 [2024-11-30 04:32:05.521027] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.958 [2024-11-30 04:32:05.523440] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.958 [2024-11-30 04:32:05.532454] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.958 [2024-11-30 04:32:05.532763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.532899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.532928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.958 [2024-11-30 04:32:05.532945] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.958 [2024-11-30 04:32:05.533102] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.958 [2024-11-30 04:32:05.533254] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.958 [2024-11-30 04:32:05.533276] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.958 [2024-11-30 04:32:05.533291] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.958 [2024-11-30 04:32:05.535560] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.958 [2024-11-30 04:32:05.545135] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.958 [2024-11-30 04:32:05.545430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.545606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.545632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.958 [2024-11-30 04:32:05.545648] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.958 [2024-11-30 04:32:05.545744] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.958 [2024-11-30 04:32:05.545920] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.958 [2024-11-30 04:32:05.545943] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.958 [2024-11-30 04:32:05.545968] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.958 [2024-11-30 04:32:05.548277] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.958 [2024-11-30 04:32:05.557671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.958 [2024-11-30 04:32:05.557973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.558117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.558146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.958 [2024-11-30 04:32:05.558163] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.958 [2024-11-30 04:32:05.558345] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.958 [2024-11-30 04:32:05.558568] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.958 [2024-11-30 04:32:05.558592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.958 [2024-11-30 04:32:05.558607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.958 [2024-11-30 04:32:05.560716] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.958 [2024-11-30 04:32:05.570139] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.958 [2024-11-30 04:32:05.570468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.570628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.570656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.958 [2024-11-30 04:32:05.570674] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.958 [2024-11-30 04:32:05.570838] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.958 [2024-11-30 04:32:05.570982] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.958 [2024-11-30 04:32:05.571006] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.958 [2024-11-30 04:32:05.571021] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:14.958 [2024-11-30 04:32:05.573326] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:14.958 [2024-11-30 04:32:05.582928] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:14.958 [2024-11-30 04:32:05.583294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.583429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:14.958 [2024-11-30 04:32:05.583458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:14.958 [2024-11-30 04:32:05.583476] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:14.958 [2024-11-30 04:32:05.583658] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:14.958 [2024-11-30 04:32:05.583790] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:14.958 [2024-11-30 04:32:05.583813] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:14.958 [2024-11-30 04:32:05.583828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.218 [2024-11-30 04:32:05.586106] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.218 [2024-11-30 04:32:05.595499] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.218 [2024-11-30 04:32:05.595808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.595989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.596016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.218 [2024-11-30 04:32:05.596032] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.218 [2024-11-30 04:32:05.596164] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.218 [2024-11-30 04:32:05.596342] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.218 [2024-11-30 04:32:05.596366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.218 [2024-11-30 04:32:05.596381] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.218 [2024-11-30 04:32:05.598650] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.218 [2024-11-30 04:32:05.607969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.218 [2024-11-30 04:32:05.608272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.608408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.608437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.218 [2024-11-30 04:32:05.608454] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.218 [2024-11-30 04:32:05.608655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.218 [2024-11-30 04:32:05.608824] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.218 [2024-11-30 04:32:05.608847] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.218 [2024-11-30 04:32:05.608862] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.218 [2024-11-30 04:32:05.611122] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.218 [2024-11-30 04:32:05.620414] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.218 [2024-11-30 04:32:05.620713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.620849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.620877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.218 [2024-11-30 04:32:05.620895] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.218 [2024-11-30 04:32:05.621073] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.218 [2024-11-30 04:32:05.621243] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.218 [2024-11-30 04:32:05.621266] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.218 [2024-11-30 04:32:05.621281] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.218 [2024-11-30 04:32:05.623592] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.218 [2024-11-30 04:32:05.632980] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.218 [2024-11-30 04:32:05.633302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.633497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.633532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.218 [2024-11-30 04:32:05.633551] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.218 [2024-11-30 04:32:05.633716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.218 [2024-11-30 04:32:05.633903] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.218 [2024-11-30 04:32:05.633926] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.218 [2024-11-30 04:32:05.633941] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.218 [2024-11-30 04:32:05.636238] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.218 [2024-11-30 04:32:05.645529] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.218 [2024-11-30 04:32:05.645813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.645939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.645972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.218 [2024-11-30 04:32:05.645990] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.218 [2024-11-30 04:32:05.646238] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.218 [2024-11-30 04:32:05.646407] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.218 [2024-11-30 04:32:05.646430] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.218 [2024-11-30 04:32:05.646445] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.218 [2024-11-30 04:32:05.648838] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.218 [2024-11-30 04:32:05.657913] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.218 [2024-11-30 04:32:05.658280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.658400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.218 [2024-11-30 04:32:05.658430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.218 [2024-11-30 04:32:05.658447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.218 [2024-11-30 04:32:05.658612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.218 [2024-11-30 04:32:05.658780] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.218 [2024-11-30 04:32:05.658803] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.219 [2024-11-30 04:32:05.658818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.219 [2024-11-30 04:32:05.661205] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.219 [2024-11-30 04:32:05.670296] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.219 [2024-11-30 04:32:05.670630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.670777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.670803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.219 [2024-11-30 04:32:05.670825] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.219 [2024-11-30 04:32:05.671017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.219 [2024-11-30 04:32:05.671168] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.219 [2024-11-30 04:32:05.671191] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.219 [2024-11-30 04:32:05.671206] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.219 [2024-11-30 04:32:05.673492] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.219 [2024-11-30 04:32:05.682784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.219 [2024-11-30 04:32:05.683076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.683212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.683241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.219 [2024-11-30 04:32:05.683259] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.219 [2024-11-30 04:32:05.683477] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.219 [2024-11-30 04:32:05.683627] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.219 [2024-11-30 04:32:05.683650] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.219 [2024-11-30 04:32:05.683665] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.219 [2024-11-30 04:32:05.686054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.219 [2024-11-30 04:32:05.695399] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.219 [2024-11-30 04:32:05.695749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.695874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.695901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.219 [2024-11-30 04:32:05.695917] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.219 [2024-11-30 04:32:05.696099] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.219 [2024-11-30 04:32:05.696286] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.219 [2024-11-30 04:32:05.696309] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.219 [2024-11-30 04:32:05.696324] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.219 [2024-11-30 04:32:05.698611] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.219 [2024-11-30 04:32:05.707828] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.219 [2024-11-30 04:32:05.708258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.708391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.708415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.219 [2024-11-30 04:32:05.708431] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.219 [2024-11-30 04:32:05.708598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.219 [2024-11-30 04:32:05.708832] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.219 [2024-11-30 04:32:05.708856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.219 [2024-11-30 04:32:05.708871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.219 [2024-11-30 04:32:05.711279] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.219 [2024-11-30 04:32:05.720210] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.219 [2024-11-30 04:32:05.720505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.720669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.720697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.219 [2024-11-30 04:32:05.720715] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.219 [2024-11-30 04:32:05.720843] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.219 [2024-11-30 04:32:05.721041] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.219 [2024-11-30 04:32:05.721065] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.219 [2024-11-30 04:32:05.721080] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.219 [2024-11-30 04:32:05.723297] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.219 [2024-11-30 04:32:05.732712] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.219 [2024-11-30 04:32:05.733054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.733183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.733208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.219 [2024-11-30 04:32:05.733224] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.219 [2024-11-30 04:32:05.733419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.219 [2024-11-30 04:32:05.733569] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.219 [2024-11-30 04:32:05.733592] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.219 [2024-11-30 04:32:05.733607] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.219 [2024-11-30 04:32:05.736103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.219 [2024-11-30 04:32:05.745289] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.219 [2024-11-30 04:32:05.745587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.745729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.745755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.219 [2024-11-30 04:32:05.745770] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.219 [2024-11-30 04:32:05.745953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.219 [2024-11-30 04:32:05.746177] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.219 [2024-11-30 04:32:05.746200] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.219 [2024-11-30 04:32:05.746216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.219 [2024-11-30 04:32:05.748808] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.219 [2024-11-30 04:32:05.757917] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.219 [2024-11-30 04:32:05.758247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.758435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.758487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.219 [2024-11-30 04:32:05.758505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.219 [2024-11-30 04:32:05.758686] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.219 [2024-11-30 04:32:05.758910] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.219 [2024-11-30 04:32:05.758933] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.219 [2024-11-30 04:32:05.758948] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.219 [2024-11-30 04:32:05.761176] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.219 [2024-11-30 04:32:05.770488] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.219 [2024-11-30 04:32:05.770803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.770925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.219 [2024-11-30 04:32:05.770951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.219 [2024-11-30 04:32:05.770978] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.219 [2024-11-30 04:32:05.771101] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.219 [2024-11-30 04:32:05.771216] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.219 [2024-11-30 04:32:05.771239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.219 [2024-11-30 04:32:05.771254] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.219 [2024-11-30 04:32:05.773600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.219 [2024-11-30 04:32:05.783028] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.219 [2024-11-30 04:32:05.783448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.783608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.783633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.220 [2024-11-30 04:32:05.783649] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.220 [2024-11-30 04:32:05.783807] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.220 [2024-11-30 04:32:05.784007] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.220 [2024-11-30 04:32:05.784037] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.220 [2024-11-30 04:32:05.784053] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.220 [2024-11-30 04:32:05.786434] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.220 [2024-11-30 04:32:05.795681] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.220 [2024-11-30 04:32:05.796041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.796170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.796196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.220 [2024-11-30 04:32:05.796212] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.220 [2024-11-30 04:32:05.796372] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.220 [2024-11-30 04:32:05.796523] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.220 [2024-11-30 04:32:05.796546] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.220 [2024-11-30 04:32:05.796561] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.220 [2024-11-30 04:32:05.798990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.220 [2024-11-30 04:32:05.808290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.220 [2024-11-30 04:32:05.808564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.808713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.808749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.220 [2024-11-30 04:32:05.808765] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.220 [2024-11-30 04:32:05.808928] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.220 [2024-11-30 04:32:05.809104] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.220 [2024-11-30 04:32:05.809129] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.220 [2024-11-30 04:32:05.809145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.220 [2024-11-30 04:32:05.811561] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.220 [2024-11-30 04:32:05.820969] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.220 [2024-11-30 04:32:05.821302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.821437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.821466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.220 [2024-11-30 04:32:05.821483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.220 [2024-11-30 04:32:05.821612] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.220 [2024-11-30 04:32:05.821798] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.220 [2024-11-30 04:32:05.821821] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.220 [2024-11-30 04:32:05.821842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.220 [2024-11-30 04:32:05.824257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.220 [2024-11-30 04:32:05.833677] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.220 [2024-11-30 04:32:05.833974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.834159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.834185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.220 [2024-11-30 04:32:05.834201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.220 [2024-11-30 04:32:05.834454] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.220 [2024-11-30 04:32:05.834678] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.220 [2024-11-30 04:32:05.834701] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.220 [2024-11-30 04:32:05.834716] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.220 [2024-11-30 04:32:05.837239] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.220 [2024-11-30 04:32:05.846240] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.220 [2024-11-30 04:32:05.846621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.846768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.220 [2024-11-30 04:32:05.846795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.220 [2024-11-30 04:32:05.846811] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.220 [2024-11-30 04:32:05.846989] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.220 [2024-11-30 04:32:05.847215] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.220 [2024-11-30 04:32:05.847239] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.220 [2024-11-30 04:32:05.847255] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.480 [2024-11-30 04:32:05.849543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.480 [2024-11-30 04:32:05.858987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.480 [2024-11-30 04:32:05.859306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.480 [2024-11-30 04:32:05.859499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.480 [2024-11-30 04:32:05.859524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.480 [2024-11-30 04:32:05.859540] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.480 [2024-11-30 04:32:05.859671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.480 [2024-11-30 04:32:05.859875] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.480 [2024-11-30 04:32:05.859899] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.480 [2024-11-30 04:32:05.859915] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.480 [2024-11-30 04:32:05.862229] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.480 [2024-11-30 04:32:05.871478] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.480 [2024-11-30 04:32:05.871743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.480 [2024-11-30 04:32:05.871834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.480 [2024-11-30 04:32:05.871863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.480 [2024-11-30 04:32:05.871882] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.480 [2024-11-30 04:32:05.872075] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.480 [2024-11-30 04:32:05.872190] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.480 [2024-11-30 04:32:05.872214] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.480 [2024-11-30 04:32:05.872229] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.480 [2024-11-30 04:32:05.874610] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.480 [2024-11-30 04:32:05.883918] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.480 [2024-11-30 04:32:05.884238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.480 [2024-11-30 04:32:05.884358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.480 [2024-11-30 04:32:05.884402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.480 [2024-11-30 04:32:05.884418] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.480 [2024-11-30 04:32:05.884598] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.480 [2024-11-30 04:32:05.884808] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.480 [2024-11-30 04:32:05.884832] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.480 [2024-11-30 04:32:05.884847] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.480 [2024-11-30 04:32:05.887029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.480 [2024-11-30 04:32:05.896468] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.480 [2024-11-30 04:32:05.896804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.480 [2024-11-30 04:32:05.896905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.480 [2024-11-30 04:32:05.896936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.480 [2024-11-30 04:32:05.896954] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.480 [2024-11-30 04:32:05.897119] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.481 [2024-11-30 04:32:05.897223] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.481 [2024-11-30 04:32:05.897258] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.481 [2024-11-30 04:32:05.897272] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.481 [2024-11-30 04:32:05.899683] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.481 [2024-11-30 04:32:05.909105] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.481 [2024-11-30 04:32:05.909501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.909649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.909678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.481 [2024-11-30 04:32:05.909696] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.481 [2024-11-30 04:32:05.909860] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.481 [2024-11-30 04:32:05.910070] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.481 [2024-11-30 04:32:05.910093] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.481 [2024-11-30 04:32:05.910107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.481 [2024-11-30 04:32:05.912342] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.481 [2024-11-30 04:32:05.921771] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.481 [2024-11-30 04:32:05.922098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.922288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.922316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.481 [2024-11-30 04:32:05.922334] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.481 [2024-11-30 04:32:05.922480] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.481 [2024-11-30 04:32:05.922631] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.481 [2024-11-30 04:32:05.922654] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.481 [2024-11-30 04:32:05.922669] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.481 [2024-11-30 04:32:05.924994] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.481 [2024-11-30 04:32:05.934367] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.481 [2024-11-30 04:32:05.934754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.934916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.934942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.481 [2024-11-30 04:32:05.934965] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.481 [2024-11-30 04:32:05.935116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.481 [2024-11-30 04:32:05.935301] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.481 [2024-11-30 04:32:05.935325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.481 [2024-11-30 04:32:05.935340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.481 [2024-11-30 04:32:05.937632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.481 [2024-11-30 04:32:05.947067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.481 [2024-11-30 04:32:05.947505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.947732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.947788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.481 [2024-11-30 04:32:05.947806] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.481 [2024-11-30 04:32:05.947952] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.481 [2024-11-30 04:32:05.948113] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.481 [2024-11-30 04:32:05.948137] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.481 [2024-11-30 04:32:05.948152] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.481 [2024-11-30 04:32:05.950628] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.481 [2024-11-30 04:32:05.959452] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.481 [2024-11-30 04:32:05.959708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.959880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.959905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.481 [2024-11-30 04:32:05.959921] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.481 [2024-11-30 04:32:05.960116] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.481 [2024-11-30 04:32:05.960304] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.481 [2024-11-30 04:32:05.960328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.481 [2024-11-30 04:32:05.960343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.481 [2024-11-30 04:32:05.962632] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.481 [2024-11-30 04:32:05.972094] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.481 [2024-11-30 04:32:05.972392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.972518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.972544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.481 [2024-11-30 04:32:05.972560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.481 [2024-11-30 04:32:05.972698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.481 [2024-11-30 04:32:05.972848] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.481 [2024-11-30 04:32:05.972872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.481 [2024-11-30 04:32:05.972887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.481 [2024-11-30 04:32:05.975057] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.481 [2024-11-30 04:32:05.984654] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.481 [2024-11-30 04:32:05.984996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.985160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.985198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.481 [2024-11-30 04:32:05.985217] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.481 [2024-11-30 04:32:05.985363] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.481 [2024-11-30 04:32:05.985586] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.481 [2024-11-30 04:32:05.985610] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.481 [2024-11-30 04:32:05.985626] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.481 [2024-11-30 04:32:05.987844] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.481 [2024-11-30 04:32:05.997215] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.481 [2024-11-30 04:32:05.997549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.997755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:05.997785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.481 [2024-11-30 04:32:05.997803] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.481 [2024-11-30 04:32:05.997978] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.481 [2024-11-30 04:32:05.998129] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.481 [2024-11-30 04:32:05.998152] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.481 [2024-11-30 04:32:05.998167] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.481 [2024-11-30 04:32:06.000600] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.481 [2024-11-30 04:32:06.009783] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.481 [2024-11-30 04:32:06.010160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:06.010264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.481 [2024-11-30 04:32:06.010290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.481 [2024-11-30 04:32:06.010306] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.481 [2024-11-30 04:32:06.010539] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.481 [2024-11-30 04:32:06.010763] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.482 [2024-11-30 04:32:06.010787] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.482 [2024-11-30 04:32:06.010802] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.482 [2024-11-30 04:32:06.013223] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.482 [2024-11-30 04:32:06.022234] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.482 [2024-11-30 04:32:06.022513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.022688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.022713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.482 [2024-11-30 04:32:06.022743] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.482 [2024-11-30 04:32:06.022886] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.482 [2024-11-30 04:32:06.023047] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.482 [2024-11-30 04:32:06.023072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.482 [2024-11-30 04:32:06.023087] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.482 [2024-11-30 04:32:06.025409] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.482 [2024-11-30 04:32:06.034674] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.482 [2024-11-30 04:32:06.034995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.035163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.035188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.482 [2024-11-30 04:32:06.035204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.482 [2024-11-30 04:32:06.035379] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.482 [2024-11-30 04:32:06.035545] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.482 [2024-11-30 04:32:06.035568] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.482 [2024-11-30 04:32:06.035583] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.482 [2024-11-30 04:32:06.037797] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.482 [2024-11-30 04:32:06.047085] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.482 [2024-11-30 04:32:06.047451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.047576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.047602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.482 [2024-11-30 04:32:06.047635] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.482 [2024-11-30 04:32:06.047799] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.482 [2024-11-30 04:32:06.048018] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.482 [2024-11-30 04:32:06.048042] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.482 [2024-11-30 04:32:06.048057] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.482 [2024-11-30 04:32:06.050414] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.482 [2024-11-30 04:32:06.059879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.482 [2024-11-30 04:32:06.060207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.060342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.060371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.482 [2024-11-30 04:32:06.060389] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.482 [2024-11-30 04:32:06.060559] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.482 [2024-11-30 04:32:06.060710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.482 [2024-11-30 04:32:06.060733] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.482 [2024-11-30 04:32:06.060748] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.482 [2024-11-30 04:32:06.063290] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.482 [2024-11-30 04:32:06.072431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.482 [2024-11-30 04:32:06.072761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.072868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.072897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.482 [2024-11-30 04:32:06.072915] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.482 [2024-11-30 04:32:06.073072] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.482 [2024-11-30 04:32:06.073241] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.482 [2024-11-30 04:32:06.073264] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.482 [2024-11-30 04:32:06.073280] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.482 [2024-11-30 04:32:06.075620] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.482 [2024-11-30 04:32:06.084896] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.482 [2024-11-30 04:32:06.085226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.085361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.085389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.482 [2024-11-30 04:32:06.085407] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.482 [2024-11-30 04:32:06.085608] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.482 [2024-11-30 04:32:06.085813] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.482 [2024-11-30 04:32:06.085836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.482 [2024-11-30 04:32:06.085851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.482 [2024-11-30 04:32:06.088225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.482 [2024-11-30 04:32:06.097592] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.482 [2024-11-30 04:32:06.097973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.098137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.482 [2024-11-30 04:32:06.098166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.482 [2024-11-30 04:32:06.098183] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.482 [2024-11-30 04:32:06.098330] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.482 [2024-11-30 04:32:06.098540] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.482 [2024-11-30 04:32:06.098563] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.482 [2024-11-30 04:32:06.098579] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.482 [2024-11-30 04:32:06.101054] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.742 [2024-11-30 04:32:06.110078] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.742 [2024-11-30 04:32:06.110415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.742 [2024-11-30 04:32:06.110524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.742 [2024-11-30 04:32:06.110552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.742 [2024-11-30 04:32:06.110570] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.742 [2024-11-30 04:32:06.110735] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.742 [2024-11-30 04:32:06.110968] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.743 [2024-11-30 04:32:06.110992] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.743 [2024-11-30 04:32:06.111007] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.743 [2024-11-30 04:32:06.113259] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.743 [2024-11-30 04:32:06.122593] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.743 [2024-11-30 04:32:06.122889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.123043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.123070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.743 [2024-11-30 04:32:06.123086] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.743 [2024-11-30 04:32:06.123235] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.743 [2024-11-30 04:32:06.123438] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.743 [2024-11-30 04:32:06.123462] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.743 [2024-11-30 04:32:06.123477] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.743 [2024-11-30 04:32:06.125697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.743 [2024-11-30 04:32:06.135023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.743 [2024-11-30 04:32:06.135364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.135476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.135505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.743 [2024-11-30 04:32:06.135524] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.743 [2024-11-30 04:32:06.135688] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.743 [2024-11-30 04:32:06.135839] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.743 [2024-11-30 04:32:06.135868] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.743 [2024-11-30 04:32:06.135884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.743 [2024-11-30 04:32:06.138110] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.743 [2024-11-30 04:32:06.147341] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.743 [2024-11-30 04:32:06.147639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.147770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.147799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.743 [2024-11-30 04:32:06.147816] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.743 [2024-11-30 04:32:06.148028] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.743 [2024-11-30 04:32:06.148179] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.743 [2024-11-30 04:32:06.148203] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.743 [2024-11-30 04:32:06.148218] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.743 [2024-11-30 04:32:06.150545] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.743 [2024-11-30 04:32:06.159808] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.743 [2024-11-30 04:32:06.160142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.160281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.160323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.743 [2024-11-30 04:32:06.160339] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.743 [2024-11-30 04:32:06.160515] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.743 [2024-11-30 04:32:06.160742] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.743 [2024-11-30 04:32:06.160766] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.743 [2024-11-30 04:32:06.160782] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.743 [2024-11-30 04:32:06.163130] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.743 [2024-11-30 04:32:06.172467] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.743 [2024-11-30 04:32:06.172885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.173013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.173040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.743 [2024-11-30 04:32:06.173056] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.743 [2024-11-30 04:32:06.173171] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.743 [2024-11-30 04:32:06.173339] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.743 [2024-11-30 04:32:06.173362] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.743 [2024-11-30 04:32:06.173383] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.743 [2024-11-30 04:32:06.175618] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.743 [2024-11-30 04:32:06.185052] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.743 [2024-11-30 04:32:06.185327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.185454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.185483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.743 [2024-11-30 04:32:06.185500] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.743 [2024-11-30 04:32:06.185647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.743 [2024-11-30 04:32:06.185833] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.743 [2024-11-30 04:32:06.185856] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.743 [2024-11-30 04:32:06.185872] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.743 [2024-11-30 04:32:06.188081] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.743 [2024-11-30 04:32:06.197723] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.743 [2024-11-30 04:32:06.198008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.198138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.198163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.743 [2024-11-30 04:32:06.198179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.743 [2024-11-30 04:32:06.198334] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.743 [2024-11-30 04:32:06.198502] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.743 [2024-11-30 04:32:06.198525] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.743 [2024-11-30 04:32:06.198540] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.743 [2024-11-30 04:32:06.201037] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.743 [2024-11-30 04:32:06.210271] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.743 [2024-11-30 04:32:06.210646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.210782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.210810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.743 [2024-11-30 04:32:06.210828] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.743 [2024-11-30 04:32:06.210955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.743 [2024-11-30 04:32:06.211118] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.743 [2024-11-30 04:32:06.211140] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.743 [2024-11-30 04:32:06.211156] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.743 [2024-11-30 04:32:06.213576] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.743 [2024-11-30 04:32:06.222963] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.743 [2024-11-30 04:32:06.223316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.223437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.743 [2024-11-30 04:32:06.223463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.743 [2024-11-30 04:32:06.223479] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.743 [2024-11-30 04:32:06.223655] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.743 [2024-11-30 04:32:06.223832] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.743 [2024-11-30 04:32:06.223855] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.744 [2024-11-30 04:32:06.223871] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.744 [2024-11-30 04:32:06.226276] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.744 [2024-11-30 04:32:06.235473] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.744 [2024-11-30 04:32:06.235772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.235907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.235935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.744 [2024-11-30 04:32:06.235952] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.744 [2024-11-30 04:32:06.236145] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.744 [2024-11-30 04:32:06.236332] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.744 [2024-11-30 04:32:06.236355] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.744 [2024-11-30 04:32:06.236370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.744 [2024-11-30 04:32:06.238693] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.744 [2024-11-30 04:32:06.248018] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.744 [2024-11-30 04:32:06.248365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.248507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.248535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.744 [2024-11-30 04:32:06.248553] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.744 [2024-11-30 04:32:06.248681] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.744 [2024-11-30 04:32:06.248849] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.744 [2024-11-30 04:32:06.248872] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.744 [2024-11-30 04:32:06.248887] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.744 [2024-11-30 04:32:06.251257] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.744 [2024-11-30 04:32:06.260352] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.744 [2024-11-30 04:32:06.260648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.260788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.260816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.744 [2024-11-30 04:32:06.260833] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.744 [2024-11-30 04:32:06.260992] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.744 [2024-11-30 04:32:06.261143] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.744 [2024-11-30 04:32:06.261167] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.744 [2024-11-30 04:32:06.261183] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.744 [2024-11-30 04:32:06.263631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.744 [2024-11-30 04:32:06.273031] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.744 [2024-11-30 04:32:06.273355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.273492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.273519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.744 [2024-11-30 04:32:06.273534] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.744 [2024-11-30 04:32:06.273693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.744 [2024-11-30 04:32:06.273879] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.744 [2024-11-30 04:32:06.273903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.744 [2024-11-30 04:32:06.273918] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.744 [2024-11-30 04:32:06.276329] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.744 [2024-11-30 04:32:06.285459] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.744 [2024-11-30 04:32:06.285772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.285946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.285981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.744 [2024-11-30 04:32:06.285998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.744 [2024-11-30 04:32:06.286190] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.744 [2024-11-30 04:32:06.286369] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.744 [2024-11-30 04:32:06.286392] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.744 [2024-11-30 04:32:06.286408] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.744 [2024-11-30 04:32:06.288568] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.744 [2024-11-30 04:32:06.297942] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.744 [2024-11-30 04:32:06.298399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.298535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.298566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.744 [2024-11-30 04:32:06.298584] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.744 [2024-11-30 04:32:06.298748] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.744 [2024-11-30 04:32:06.298898] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.744 [2024-11-30 04:32:06.298921] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.744 [2024-11-30 04:32:06.298936] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.744 [2024-11-30 04:32:06.301323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.744 [2024-11-30 04:32:06.310599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.744 [2024-11-30 04:32:06.310909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.311057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.311087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.744 [2024-11-30 04:32:06.311105] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.744 [2024-11-30 04:32:06.311288] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.744 [2024-11-30 04:32:06.311420] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.744 [2024-11-30 04:32:06.311443] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.744 [2024-11-30 04:32:06.311459] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.744 [2024-11-30 04:32:06.313820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.744 [2024-11-30 04:32:06.323329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.744 [2024-11-30 04:32:06.323663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.323828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.323853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.744 [2024-11-30 04:32:06.323869] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.744 [2024-11-30 04:32:06.324093] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.744 [2024-11-30 04:32:06.324246] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.744 [2024-11-30 04:32:06.324269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.744 [2024-11-30 04:32:06.324284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.744 [2024-11-30 04:32:06.326604] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.744 [2024-11-30 04:32:06.335874] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.744 [2024-11-30 04:32:06.336125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.336289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.744 [2024-11-30 04:32:06.336323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.744 [2024-11-30 04:32:06.336342] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.744 [2024-11-30 04:32:06.336524] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.744 [2024-11-30 04:32:06.336675] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.744 [2024-11-30 04:32:06.336698] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.744 [2024-11-30 04:32:06.336713] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.744 [2024-11-30 04:32:06.338857] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.744 [2024-11-30 04:32:06.348225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.744 [2024-11-30 04:32:06.348620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.745 [2024-11-30 04:32:06.348736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.745 [2024-11-30 04:32:06.348763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.745 [2024-11-30 04:32:06.348780] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.745 [2024-11-30 04:32:06.348908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.745 [2024-11-30 04:32:06.349072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.745 [2024-11-30 04:32:06.349097] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.745 [2024-11-30 04:32:06.349111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.745 [2024-11-30 04:32:06.351150] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:15.745 [2024-11-30 04:32:06.360843] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:15.745 [2024-11-30 04:32:06.361148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.745 [2024-11-30 04:32:06.361254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:15.745 [2024-11-30 04:32:06.361280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:15.745 [2024-11-30 04:32:06.361296] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:15.745 [2024-11-30 04:32:06.361460] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:15.745 [2024-11-30 04:32:06.361653] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:15.745 [2024-11-30 04:32:06.361677] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:15.745 [2024-11-30 04:32:06.361692] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:15.745 [2024-11-30 04:32:06.363945] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.005 [2024-11-30 04:32:06.373447] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.005 [2024-11-30 04:32:06.373732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.005 [2024-11-30 04:32:06.373866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.005 [2024-11-30 04:32:06.373892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.005 [2024-11-30 04:32:06.373913] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.005 [2024-11-30 04:32:06.374135] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.005 [2024-11-30 04:32:06.374305] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.005 [2024-11-30 04:32:06.374328] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.005 [2024-11-30 04:32:06.374343] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.005 [2024-11-30 04:32:06.376633] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.005 [2024-11-30 04:32:06.385702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.005 [2024-11-30 04:32:06.386024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.005 [2024-11-30 04:32:06.386141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.005 [2024-11-30 04:32:06.386170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.005 [2024-11-30 04:32:06.386188] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.005 [2024-11-30 04:32:06.386388] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.005 [2024-11-30 04:32:06.386557] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.005 [2024-11-30 04:32:06.386580] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.005 [2024-11-30 04:32:06.386597] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.005 [2024-11-30 04:32:06.388990] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.005 [2024-11-30 04:32:06.398329] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.005 [2024-11-30 04:32:06.398583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.005 [2024-11-30 04:32:06.398754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.005 [2024-11-30 04:32:06.398779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.005 [2024-11-30 04:32:06.398795] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.005 [2024-11-30 04:32:06.398953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.005 [2024-11-30 04:32:06.399144] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.005 [2024-11-30 04:32:06.399166] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.005 [2024-11-30 04:32:06.399182] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.005 [2024-11-30 04:32:06.401456] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.005 [2024-11-30 04:32:06.410671] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.005 [2024-11-30 04:32:06.410930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.005 [2024-11-30 04:32:06.411067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.005 [2024-11-30 04:32:06.411094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.005 [2024-11-30 04:32:06.411110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.005 [2024-11-30 04:32:06.411264] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.005 [2024-11-30 04:32:06.411427] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.005 [2024-11-30 04:32:06.411447] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.005 [2024-11-30 04:32:06.411460] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.005 [2024-11-30 04:32:06.413441] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.005 [2024-11-30 04:32:06.423017] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.005 [2024-11-30 04:32:06.423307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.005 [2024-11-30 04:32:06.423435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.005 [2024-11-30 04:32:06.423461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.006 [2024-11-30 04:32:06.423477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.006 [2024-11-30 04:32:06.423671] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.006 [2024-11-30 04:32:06.423785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.006 [2024-11-30 04:32:06.423808] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.006 [2024-11-30 04:32:06.423823] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.006 [2024-11-30 04:32:06.426108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.006 [2024-11-30 04:32:06.435498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.006 [2024-11-30 04:32:06.435820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.435936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.435986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.006 [2024-11-30 04:32:06.436005] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.006 [2024-11-30 04:32:06.436163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.006 [2024-11-30 04:32:06.436399] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.006 [2024-11-30 04:32:06.436422] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.006 [2024-11-30 04:32:06.436437] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.006 [2024-11-30 04:32:06.438675] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.006 [2024-11-30 04:32:06.448117] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.006 [2024-11-30 04:32:06.448402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.448566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.448594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.006 [2024-11-30 04:32:06.448611] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.006 [2024-11-30 04:32:06.448811] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.006 [2024-11-30 04:32:06.448949] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.006 [2024-11-30 04:32:06.448984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.006 [2024-11-30 04:32:06.449001] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.006 [2024-11-30 04:32:06.451306] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.006 [2024-11-30 04:32:06.460784] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.006 [2024-11-30 04:32:06.461135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.461265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.461291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.006 [2024-11-30 04:32:06.461307] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.006 [2024-11-30 04:32:06.461489] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.006 [2024-11-30 04:32:06.461650] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.006 [2024-11-30 04:32:06.461673] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.006 [2024-11-30 04:32:06.461689] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.006 [2024-11-30 04:32:06.464092] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.006 [2024-11-30 04:32:06.473068] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.006 [2024-11-30 04:32:06.473408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.473550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.473593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.006 [2024-11-30 04:32:06.473609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.006 [2024-11-30 04:32:06.473768] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.006 [2024-11-30 04:32:06.473930] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.006 [2024-11-30 04:32:06.473954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.006 [2024-11-30 04:32:06.473981] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.006 [2024-11-30 04:32:06.476261] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.006 [2024-11-30 04:32:06.485570] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.006 [2024-11-30 04:32:06.485885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.486046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.486075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.006 [2024-11-30 04:32:06.486093] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.006 [2024-11-30 04:32:06.486275] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.006 [2024-11-30 04:32:06.486444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.006 [2024-11-30 04:32:06.486474] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.006 [2024-11-30 04:32:06.486490] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.006 [2024-11-30 04:32:06.488869] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.006 [2024-11-30 04:32:06.498045] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.006 [2024-11-30 04:32:06.498428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.498574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.498602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.006 [2024-11-30 04:32:06.498620] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.006 [2024-11-30 04:32:06.498766] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.006 [2024-11-30 04:32:06.498916] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.006 [2024-11-30 04:32:06.498939] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.006 [2024-11-30 04:32:06.498955] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.006 [2024-11-30 04:32:06.501216] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.006 [2024-11-30 04:32:06.510564] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.006 [2024-11-30 04:32:06.510879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.511011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.511041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.006 [2024-11-30 04:32:06.511059] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.006 [2024-11-30 04:32:06.511224] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.006 [2024-11-30 04:32:06.511374] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.006 [2024-11-30 04:32:06.511397] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.006 [2024-11-30 04:32:06.511413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.006 [2024-11-30 04:32:06.513722] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.006 [2024-11-30 04:32:06.523176] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.006 [2024-11-30 04:32:06.523491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.523669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.523694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.006 [2024-11-30 04:32:06.523710] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.006 [2024-11-30 04:32:06.523857] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.006 [2024-11-30 04:32:06.524058] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.006 [2024-11-30 04:32:06.524082] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.006 [2024-11-30 04:32:06.524104] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.006 [2024-11-30 04:32:06.526356] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.006 [2024-11-30 04:32:06.535830] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.006 [2024-11-30 04:32:06.536200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.536326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.006 [2024-11-30 04:32:06.536369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.006 [2024-11-30 04:32:06.536386] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.006 [2024-11-30 04:32:06.536532] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.006 [2024-11-30 04:32:06.536736] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.006 [2024-11-30 04:32:06.536759] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.007 [2024-11-30 04:32:06.536775] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.007 [2024-11-30 04:32:06.538847] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.007 [2024-11-30 04:32:06.548513] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.007 [2024-11-30 04:32:06.548868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.549032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.549061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.007 [2024-11-30 04:32:06.549079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.007 [2024-11-30 04:32:06.549280] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.007 [2024-11-30 04:32:06.549430] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.007 [2024-11-30 04:32:06.549453] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.007 [2024-11-30 04:32:06.549468] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.007 [2024-11-30 04:32:06.551775] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.007 [2024-11-30 04:32:06.561008] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.007 [2024-11-30 04:32:06.561348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.561488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.561516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.007 [2024-11-30 04:32:06.561533] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.007 [2024-11-30 04:32:06.561698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.007 [2024-11-30 04:32:06.561830] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.007 [2024-11-30 04:32:06.561853] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.007 [2024-11-30 04:32:06.561868] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.007 [2024-11-30 04:32:06.564100] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.007 [2024-11-30 04:32:06.573609] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.007 [2024-11-30 04:32:06.573969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.574130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.574159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.007 [2024-11-30 04:32:06.574177] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.007 [2024-11-30 04:32:06.574341] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.007 [2024-11-30 04:32:06.574492] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.007 [2024-11-30 04:32:06.574515] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.007 [2024-11-30 04:32:06.574531] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.007 [2024-11-30 04:32:06.576803] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.007 [2024-11-30 04:32:06.586383] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.007 [2024-11-30 04:32:06.586771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.586892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.586918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.007 [2024-11-30 04:32:06.586934] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.007 [2024-11-30 04:32:06.587059] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.007 [2024-11-30 04:32:06.587245] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.007 [2024-11-30 04:32:06.587269] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.007 [2024-11-30 04:32:06.587284] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.007 [2024-11-30 04:32:06.589534] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.007 [2024-11-30 04:32:06.598926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.007 [2024-11-30 04:32:06.599229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.599329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.599359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.007 [2024-11-30 04:32:06.599377] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.007 [2024-11-30 04:32:06.599505] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.007 [2024-11-30 04:32:06.599691] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.007 [2024-11-30 04:32:06.599714] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.007 [2024-11-30 04:32:06.599730] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.007 [2024-11-30 04:32:06.602103] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.007 [2024-11-30 04:32:06.611537] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.007 [2024-11-30 04:32:06.611881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.612046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.612076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.007 [2024-11-30 04:32:06.612094] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.007 [2024-11-30 04:32:06.612240] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.007 [2024-11-30 04:32:06.612373] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.007 [2024-11-30 04:32:06.612396] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.007 [2024-11-30 04:32:06.612412] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.007 [2024-11-30 04:32:06.614771] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.007 [2024-11-30 04:32:06.623864] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.007 [2024-11-30 04:32:06.624193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.624336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.007 [2024-11-30 04:32:06.624365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.007 [2024-11-30 04:32:06.624383] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.007 [2024-11-30 04:32:06.624582] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.007 [2024-11-30 04:32:06.624788] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.007 [2024-11-30 04:32:06.624812] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.007 [2024-11-30 04:32:06.624828] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.007 [2024-11-30 04:32:06.627243] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.268 [2024-11-30 04:32:06.636327] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.268 [2024-11-30 04:32:06.636689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.268 [2024-11-30 04:32:06.636816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.268 [2024-11-30 04:32:06.636842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.268 [2024-11-30 04:32:06.636858] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.268 [2024-11-30 04:32:06.637051] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.268 [2024-11-30 04:32:06.637220] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.268 [2024-11-30 04:32:06.637268] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.268 [2024-11-30 04:32:06.637283] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.268 [2024-11-30 04:32:06.639370] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.268 [2024-11-30 04:32:06.649114] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.268 [2024-11-30 04:32:06.649423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.268 [2024-11-30 04:32:06.649584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.268 [2024-11-30 04:32:06.649613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.268 [2024-11-30 04:32:06.649630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.268 [2024-11-30 04:32:06.649757] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.649908] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.649931] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.649946] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.652221] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.661695] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.662023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.662163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.662188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.662204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.662344] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.662513] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.662535] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.662550] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.664872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.674376] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.674703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.674833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.674861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.674879] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.675017] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.675154] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.675174] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.675187] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.677519] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.686835] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.687153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.687301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.687332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.687349] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.687525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.687649] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.687672] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.687687] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.690118] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.699192] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.699474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.699583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.699626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.699642] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.699879] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.700080] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.700104] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.700120] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.702516] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.711926] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.712314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.712462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.712489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.712505] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.712665] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.712809] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.712833] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.712848] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.715024] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.724406] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.724834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.724956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.724993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.725015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.725188] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.725302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.725325] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.725340] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.727701] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.736967] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.737323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.737431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.737459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.737477] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.737677] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.737863] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.737886] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.737902] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.740323] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.749472] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.749739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.749917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.749943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.749968] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.750132] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.750294] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.750317] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.750332] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.752710] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.761951] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.762276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.762383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.762412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.762430] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.762600] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.762804] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.762827] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.762842] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.765341] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.774501] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.774787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.774972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.774999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.775015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.775163] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.775311] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.775334] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.775349] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.777746] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.787225] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.787525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.787698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.787726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.787744] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.787908] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.788072] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.788096] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.788111] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.790475] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.799789] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.800034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.800176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.800205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.800223] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.800351] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.800525] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.800548] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.800564] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.802970] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.812339] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.812658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.812771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.812799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.812817] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.812973] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.813191] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.813215] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.813230] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.815390] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.824912] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.825219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.825336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.825364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.825382] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.825565] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.825733] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.825756] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.825772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.828159] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 [2024-11-30 04:32:06.837434] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.837720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.837866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.837895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.837912] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.838096] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.269 [2024-11-30 04:32:06.838266] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.269 [2024-11-30 04:32:06.838295] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.269 [2024-11-30 04:32:06.838312] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.269 [2024-11-30 04:32:06.840667] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.269 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/bdevperf.sh: line 35: 2489538 Killed "${NVMF_APP[@]}" "$@" 00:30:16.269 04:32:06 -- host/bdevperf.sh@36 -- # tgt_init 00:30:16.269 04:32:06 -- host/bdevperf.sh@15 -- # nvmfappstart -m 0xE 00:30:16.269 04:32:06 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:16.269 04:32:06 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:16.269 04:32:06 -- common/autotest_common.sh@10 -- # set +x 00:30:16.269 [2024-11-30 04:32:06.849915] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.269 [2024-11-30 04:32:06.850285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.850406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.269 [2024-11-30 04:32:06.850432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.269 [2024-11-30 04:32:06.850447] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.269 [2024-11-30 04:32:06.850596] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.270 [2024-11-30 04:32:06.850801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.270 [2024-11-30 04:32:06.850825] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.270 [2024-11-30 04:32:06.850840] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.270 [2024-11-30 04:32:06.853029] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.270 04:32:06 -- nvmf/common.sh@469 -- # nvmfpid=2490538 00:30:16.270 04:32:06 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xE 00:30:16.270 04:32:06 -- nvmf/common.sh@470 -- # waitforlisten 2490538 00:30:16.270 04:32:06 -- common/autotest_common.sh@829 -- # '[' -z 2490538 ']' 00:30:16.270 04:32:06 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:16.270 04:32:06 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:16.270 04:32:06 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:16.270 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:16.270 04:32:06 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:16.270 04:32:06 -- common/autotest_common.sh@10 -- # set +x 00:30:16.270 [2024-11-30 04:32:06.862528] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.270 [2024-11-30 04:32:06.862890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.270 [2024-11-30 04:32:06.862998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.270 [2024-11-30 04:32:06.863025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.270 [2024-11-30 04:32:06.863041] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.270 [2024-11-30 04:32:06.863234] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.270 [2024-11-30 04:32:06.863458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.270 [2024-11-30 04:32:06.863481] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.270 [2024-11-30 04:32:06.863502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.270 [2024-11-30 04:32:06.865863] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.270 [2024-11-30 04:32:06.874973] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.270 [2024-11-30 04:32:06.875260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.270 [2024-11-30 04:32:06.875413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.270 [2024-11-30 04:32:06.875439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.270 [2024-11-30 04:32:06.875455] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.270 [2024-11-30 04:32:06.875602] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.270 [2024-11-30 04:32:06.875784] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.270 [2024-11-30 04:32:06.875806] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.270 [2024-11-30 04:32:06.875820] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.270 [2024-11-30 04:32:06.877927] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.270 [2024-11-30 04:32:06.887125] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.270 [2024-11-30 04:32:06.887496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.270 [2024-11-30 04:32:06.887650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.270 [2024-11-30 04:32:06.887676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.270 [2024-11-30 04:32:06.887692] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.270 [2024-11-30 04:32:06.887839] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.270 [2024-11-30 04:32:06.888050] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.270 [2024-11-30 04:32:06.888072] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.270 [2024-11-30 04:32:06.888086] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.270 [2024-11-30 04:32:06.890031] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.270 [2024-11-30 04:32:06.896734] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:16.270 [2024-11-30 04:32:06.896801] [ DPDK EAL parameters: nvmf -c 0xE --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:16.530 [2024-11-30 04:32:06.899573] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.531 [2024-11-30 04:32:06.899911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.900079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.900106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.531 [2024-11-30 04:32:06.900122] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.531 [2024-11-30 04:32:06.900287] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.531 [2024-11-30 04:32:06.900444] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.531 [2024-11-30 04:32:06.900469] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.531 [2024-11-30 04:32:06.900482] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.531 [2024-11-30 04:32:06.902365] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.531 [2024-11-30 04:32:06.911901] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.531 [2024-11-30 04:32:06.912213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.912339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.912365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.531 [2024-11-30 04:32:06.912381] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.531 [2024-11-30 04:32:06.912513] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.531 [2024-11-30 04:32:06.912702] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.531 [2024-11-30 04:32:06.912721] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.531 [2024-11-30 04:32:06.912734] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.531 [2024-11-30 04:32:06.914870] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.531 [2024-11-30 04:32:06.924272] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.531 [2024-11-30 04:32:06.924654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.924789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.924815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.531 [2024-11-30 04:32:06.924831] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.531 [2024-11-30 04:32:06.924971] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.531 [2024-11-30 04:32:06.925156] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.531 [2024-11-30 04:32:06.925177] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.531 [2024-11-30 04:32:06.925190] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.531 [2024-11-30 04:32:06.927395] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.531 EAL: No free 2048 kB hugepages reported on node 1 00:30:16.531 [2024-11-30 04:32:06.936599] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.531 [2024-11-30 04:32:06.936840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.936979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.937006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.531 [2024-11-30 04:32:06.937022] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.531 [2024-11-30 04:32:06.937186] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.531 [2024-11-30 04:32:06.937378] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.531 [2024-11-30 04:32:06.937401] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.531 [2024-11-30 04:32:06.937415] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.531 [2024-11-30 04:32:06.939972] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.531 [2024-11-30 04:32:06.949155] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.531 [2024-11-30 04:32:06.949565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.949671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.949697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.531 [2024-11-30 04:32:06.949713] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.531 [2024-11-30 04:32:06.949891] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.531 [2024-11-30 04:32:06.950109] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.531 [2024-11-30 04:32:06.950131] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.531 [2024-11-30 04:32:06.950145] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.531 [2024-11-30 04:32:06.952471] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.531 [2024-11-30 04:32:06.961588] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.531 [2024-11-30 04:32:06.961896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.962053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.962080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.531 [2024-11-30 04:32:06.962095] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.531 [2024-11-30 04:32:06.962227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.531 [2024-11-30 04:32:06.962380] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.531 [2024-11-30 04:32:06.962400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.531 [2024-11-30 04:32:06.962414] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.531 [2024-11-30 04:32:06.964855] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.531 [2024-11-30 04:32:06.970649] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 3 00:30:16.531 [2024-11-30 04:32:06.974099] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.531 [2024-11-30 04:32:06.974505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.974617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.974643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.531 [2024-11-30 04:32:06.974660] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.531 [2024-11-30 04:32:06.974809] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.531 [2024-11-30 04:32:06.974954] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.531 [2024-11-30 04:32:06.974984] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.531 [2024-11-30 04:32:06.975005] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.531 [2024-11-30 04:32:06.977321] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.531 [2024-11-30 04:32:06.986626] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.531 [2024-11-30 04:32:06.987119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.987245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.987281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.531 [2024-11-30 04:32:06.987300] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.531 [2024-11-30 04:32:06.987484] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.531 [2024-11-30 04:32:06.987671] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.531 [2024-11-30 04:32:06.987695] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.531 [2024-11-30 04:32:06.987712] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.531 [2024-11-30 04:32:06.990094] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.531 [2024-11-30 04:32:06.999282] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.531 [2024-11-30 04:32:06.999689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.999836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.531 [2024-11-30 04:32:06.999865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.531 [2024-11-30 04:32:06.999889] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.531 [2024-11-30 04:32:07.000123] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.531 [2024-11-30 04:32:07.000302] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.531 [2024-11-30 04:32:07.000323] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.531 [2024-11-30 04:32:07.000337] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.531 [2024-11-30 04:32:07.002624] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.532 [2024-11-30 04:32:07.012013] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.532 [2024-11-30 04:32:07.012390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.012520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.012547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.532 [2024-11-30 04:32:07.012563] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.532 [2024-11-30 04:32:07.012778] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.532 [2024-11-30 04:32:07.013119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.532 [2024-11-30 04:32:07.013142] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.532 [2024-11-30 04:32:07.013157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.532 [2024-11-30 04:32:07.015537] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.532 [2024-11-30 04:32:07.024431] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.532 [2024-11-30 04:32:07.024798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.024920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.024968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.532 [2024-11-30 04:32:07.024989] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.532 [2024-11-30 04:32:07.025160] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.532 [2024-11-30 04:32:07.025389] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.532 [2024-11-30 04:32:07.025413] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.532 [2024-11-30 04:32:07.025431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.532 [2024-11-30 04:32:07.027853] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.532 [2024-11-30 04:32:07.036897] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.532 [2024-11-30 04:32:07.037415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.037606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.037632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.532 [2024-11-30 04:32:07.037662] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.532 [2024-11-30 04:32:07.037829] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.532 [2024-11-30 04:32:07.038067] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.532 [2024-11-30 04:32:07.038090] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.532 [2024-11-30 04:32:07.038107] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.532 [2024-11-30 04:32:07.040340] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.532 [2024-11-30 04:32:07.049517] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.532 [2024-11-30 04:32:07.049809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.049930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.049967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.532 [2024-11-30 04:32:07.050004] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.532 [2024-11-30 04:32:07.050121] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.532 [2024-11-30 04:32:07.050317] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.532 [2024-11-30 04:32:07.050352] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.532 [2024-11-30 04:32:07.050370] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.532 [2024-11-30 04:32:07.052846] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.532 [2024-11-30 04:32:07.062067] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.532 [2024-11-30 04:32:07.062415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.062541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.062570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.532 [2024-11-30 04:32:07.062589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.532 [2024-11-30 04:32:07.062771] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.532 [2024-11-30 04:32:07.062904] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.532 [2024-11-30 04:32:07.062929] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.532 [2024-11-30 04:32:07.062953] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.532 [2024-11-30 04:32:07.065484] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.532 [2024-11-30 04:32:07.068319] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:16.532 [2024-11-30 04:32:07.068447] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:16.532 [2024-11-30 04:32:07.068468] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:16.532 [2024-11-30 04:32:07.068481] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:16.532 [2024-11-30 04:32:07.068549] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:30:16.532 [2024-11-30 04:32:07.068611] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:30:16.532 [2024-11-30 04:32:07.068614] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:16.532 [2024-11-30 04:32:07.074251] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.532 [2024-11-30 04:32:07.074600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.074726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.074752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.532 [2024-11-30 04:32:07.074771] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.532 [2024-11-30 04:32:07.074939] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.532 [2024-11-30 04:32:07.075119] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.532 [2024-11-30 04:32:07.075141] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.532 [2024-11-30 04:32:07.075157] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.532 [2024-11-30 04:32:07.077108] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.532 [2024-11-30 04:32:07.086563] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.532 [2024-11-30 04:32:07.087026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.087175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.087202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.532 [2024-11-30 04:32:07.087221] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.532 [2024-11-30 04:32:07.087354] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.532 [2024-11-30 04:32:07.087509] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.532 [2024-11-30 04:32:07.087530] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.532 [2024-11-30 04:32:07.087546] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.532 [2024-11-30 04:32:07.089631] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.532 [2024-11-30 04:32:07.098837] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.532 [2024-11-30 04:32:07.099466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.099610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.099637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.532 [2024-11-30 04:32:07.099656] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.532 [2024-11-30 04:32:07.099812] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.532 [2024-11-30 04:32:07.100009] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.532 [2024-11-30 04:32:07.100032] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.532 [2024-11-30 04:32:07.100049] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.532 [2024-11-30 04:32:07.102262] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.532 [2024-11-30 04:32:07.111023] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.532 [2024-11-30 04:32:07.111469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.111578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.532 [2024-11-30 04:32:07.111604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.532 [2024-11-30 04:32:07.111623] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.532 [2024-11-30 04:32:07.111764] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.532 [2024-11-30 04:32:07.111917] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.532 [2024-11-30 04:32:07.111954] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.533 [2024-11-30 04:32:07.111984] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.533 [2024-11-30 04:32:07.114194] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.533 [2024-11-30 04:32:07.123527] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.533 [2024-11-30 04:32:07.123934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.533 [2024-11-30 04:32:07.124064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.533 [2024-11-30 04:32:07.124092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.533 [2024-11-30 04:32:07.124110] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.533 [2024-11-30 04:32:07.124248] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.533 [2024-11-30 04:32:07.124425] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.533 [2024-11-30 04:32:07.124446] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.533 [2024-11-30 04:32:07.124461] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.533 [2024-11-30 04:32:07.126697] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.533 [2024-11-30 04:32:07.135921] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.533 [2024-11-30 04:32:07.136403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.533 [2024-11-30 04:32:07.136504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.533 [2024-11-30 04:32:07.136540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.533 [2024-11-30 04:32:07.136560] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.533 [2024-11-30 04:32:07.136733] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.533 [2024-11-30 04:32:07.136881] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.533 [2024-11-30 04:32:07.136903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.533 [2024-11-30 04:32:07.136920] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.533 [2024-11-30 04:32:07.138786] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.533 [2024-11-30 04:32:07.148370] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.533 [2024-11-30 04:32:07.148743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.533 [2024-11-30 04:32:07.148855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.533 [2024-11-30 04:32:07.148882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.533 [2024-11-30 04:32:07.148900] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.533 [2024-11-30 04:32:07.149053] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.533 [2024-11-30 04:32:07.149208] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.533 [2024-11-30 04:32:07.149229] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.533 [2024-11-30 04:32:07.149268] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.533 [2024-11-30 04:32:07.151479] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.804 [2024-11-30 04:32:07.160656] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.804 [2024-11-30 04:32:07.160984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.804 [2024-11-30 04:32:07.161089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.804 [2024-11-30 04:32:07.161116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.804 [2024-11-30 04:32:07.161132] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.804 [2024-11-30 04:32:07.161312] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.804 [2024-11-30 04:32:07.161491] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.804 [2024-11-30 04:32:07.161519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.804 [2024-11-30 04:32:07.161533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.804 [2024-11-30 04:32:07.163538] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.804 [2024-11-30 04:32:07.172924] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.804 [2024-11-30 04:32:07.173254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.804 [2024-11-30 04:32:07.173410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.804 [2024-11-30 04:32:07.173436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.804 [2024-11-30 04:32:07.173452] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.804 [2024-11-30 04:32:07.173551] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.804 [2024-11-30 04:32:07.173704] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.804 [2024-11-30 04:32:07.173724] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.804 [2024-11-30 04:32:07.173738] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.804 [2024-11-30 04:32:07.175662] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.804 [2024-11-30 04:32:07.185191] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.804 [2024-11-30 04:32:07.185502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.804 [2024-11-30 04:32:07.185608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.804 [2024-11-30 04:32:07.185634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.804 [2024-11-30 04:32:07.185650] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.804 [2024-11-30 04:32:07.185765] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.804 [2024-11-30 04:32:07.185915] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.804 [2024-11-30 04:32:07.185935] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.804 [2024-11-30 04:32:07.185972] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.804 [2024-11-30 04:32:07.188059] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.804 [2024-11-30 04:32:07.197492] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.804 [2024-11-30 04:32:07.197819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.804 [2024-11-30 04:32:07.197948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.804 [2024-11-30 04:32:07.197981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.804 [2024-11-30 04:32:07.197998] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.804 [2024-11-30 04:32:07.198114] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.804 [2024-11-30 04:32:07.198265] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.804 [2024-11-30 04:32:07.198300] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.804 [2024-11-30 04:32:07.198319] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.804 [2024-11-30 04:32:07.200402] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.804 [2024-11-30 04:32:07.209829] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.804 [2024-11-30 04:32:07.210123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.804 [2024-11-30 04:32:07.210222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.804 [2024-11-30 04:32:07.210247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.804 [2024-11-30 04:32:07.210269] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.805 [2024-11-30 04:32:07.210416] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.805 [2024-11-30 04:32:07.210550] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.805 [2024-11-30 04:32:07.210571] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.805 [2024-11-30 04:32:07.210584] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.805 [2024-11-30 04:32:07.212559] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.805 [2024-11-30 04:32:07.222110] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.805 [2024-11-30 04:32:07.222389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.222512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.222538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.805 [2024-11-30 04:32:07.222554] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.805 [2024-11-30 04:32:07.222685] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.805 [2024-11-30 04:32:07.222851] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.805 [2024-11-30 04:32:07.222871] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.805 [2024-11-30 04:32:07.222884] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.805 [2024-11-30 04:32:07.225041] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.805 [2024-11-30 04:32:07.234262] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.805 [2024-11-30 04:32:07.234565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.234686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.234712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.805 [2024-11-30 04:32:07.234728] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.805 [2024-11-30 04:32:07.234859] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.805 [2024-11-30 04:32:07.234987] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.805 [2024-11-30 04:32:07.235009] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.805 [2024-11-30 04:32:07.235023] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.805 [2024-11-30 04:32:07.237225] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.805 [2024-11-30 04:32:07.246273] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.805 [2024-11-30 04:32:07.246584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.246685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.246711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.805 [2024-11-30 04:32:07.246726] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.805 [2024-11-30 04:32:07.246890] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.805 [2024-11-30 04:32:07.247096] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.805 [2024-11-30 04:32:07.247119] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.805 [2024-11-30 04:32:07.247133] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.805 [2024-11-30 04:32:07.249250] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.805 [2024-11-30 04:32:07.258503] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.805 [2024-11-30 04:32:07.258783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.258910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.258935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.805 [2024-11-30 04:32:07.258951] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.805 [2024-11-30 04:32:07.259076] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.805 [2024-11-30 04:32:07.259212] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.805 [2024-11-30 04:32:07.259233] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.805 [2024-11-30 04:32:07.259262] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.805 [2024-11-30 04:32:07.261298] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.805 [2024-11-30 04:32:07.270639] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.805 [2024-11-30 04:32:07.270925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.271056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.271084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.805 [2024-11-30 04:32:07.271100] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.805 [2024-11-30 04:32:07.271263] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.805 [2024-11-30 04:32:07.271458] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.805 [2024-11-30 04:32:07.271478] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.805 [2024-11-30 04:32:07.271492] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.805 [2024-11-30 04:32:07.273663] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.805 [2024-11-30 04:32:07.283188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.805 [2024-11-30 04:32:07.283507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.283627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.283653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.805 [2024-11-30 04:32:07.283670] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.805 [2024-11-30 04:32:07.283817] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.805 [2024-11-30 04:32:07.284008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.805 [2024-11-30 04:32:07.284030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.805 [2024-11-30 04:32:07.284044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.805 [2024-11-30 04:32:07.286098] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.805 [2024-11-30 04:32:07.295416] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.805 [2024-11-30 04:32:07.295705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.295856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.295882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.805 [2024-11-30 04:32:07.295898] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.805 [2024-11-30 04:32:07.296038] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.805 [2024-11-30 04:32:07.296207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.805 [2024-11-30 04:32:07.296228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.805 [2024-11-30 04:32:07.296242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.805 [2024-11-30 04:32:07.298266] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.805 [2024-11-30 04:32:07.307773] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.805 [2024-11-30 04:32:07.308054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.308160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.308185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.805 [2024-11-30 04:32:07.308201] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.805 [2024-11-30 04:32:07.308333] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.805 [2024-11-30 04:32:07.308499] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.805 [2024-11-30 04:32:07.308519] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.805 [2024-11-30 04:32:07.308533] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.805 [2024-11-30 04:32:07.310554] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.805 [2024-11-30 04:32:07.320137] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.805 [2024-11-30 04:32:07.320441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.320570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.805 [2024-11-30 04:32:07.320596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.805 [2024-11-30 04:32:07.320612] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.805 [2024-11-30 04:32:07.320776] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.805 [2024-11-30 04:32:07.320997] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.805 [2024-11-30 04:32:07.321018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.806 [2024-11-30 04:32:07.321032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.806 [2024-11-30 04:32:07.322964] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.806 [2024-11-30 04:32:07.332507] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.806 [2024-11-30 04:32:07.332783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.332945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.332978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.806 [2024-11-30 04:32:07.332994] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.806 [2024-11-30 04:32:07.333174] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.806 [2024-11-30 04:32:07.333319] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.806 [2024-11-30 04:32:07.333340] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.806 [2024-11-30 04:32:07.333353] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.806 [2024-11-30 04:32:07.335358] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.806 [2024-11-30 04:32:07.344782] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.806 [2024-11-30 04:32:07.345108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.345235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.345261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.806 [2024-11-30 04:32:07.345277] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.806 [2024-11-30 04:32:07.345458] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.806 [2024-11-30 04:32:07.345591] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.806 [2024-11-30 04:32:07.345611] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.806 [2024-11-30 04:32:07.345624] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.806 [2024-11-30 04:32:07.347598] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.806 [2024-11-30 04:32:07.357075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.806 [2024-11-30 04:32:07.357398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.357530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.357560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.806 [2024-11-30 04:32:07.357577] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.806 [2024-11-30 04:32:07.357693] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.806 [2024-11-30 04:32:07.357811] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.806 [2024-11-30 04:32:07.357831] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.806 [2024-11-30 04:32:07.357844] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.806 [2024-11-30 04:32:07.360062] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.806 [2024-11-30 04:32:07.369495] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.806 [2024-11-30 04:32:07.369772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.369877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.369904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.806 [2024-11-30 04:32:07.369920] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.806 [2024-11-30 04:32:07.370097] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.806 [2024-11-30 04:32:07.370218] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.806 [2024-11-30 04:32:07.370238] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.806 [2024-11-30 04:32:07.370253] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.806 [2024-11-30 04:32:07.372349] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.806 [2024-11-30 04:32:07.381701] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.806 [2024-11-30 04:32:07.382035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.382160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.382186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.806 [2024-11-30 04:32:07.382204] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.806 [2024-11-30 04:32:07.382384] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.806 [2024-11-30 04:32:07.382567] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.806 [2024-11-30 04:32:07.382588] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.806 [2024-11-30 04:32:07.382602] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.806 [2024-11-30 04:32:07.384669] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.806 [2024-11-30 04:32:07.393858] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.806 [2024-11-30 04:32:07.394129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.394228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.394253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.806 [2024-11-30 04:32:07.394275] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.806 [2024-11-30 04:32:07.394440] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.806 [2024-11-30 04:32:07.394589] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.806 [2024-11-30 04:32:07.394609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.806 [2024-11-30 04:32:07.394623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.806 [2024-11-30 04:32:07.396774] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.806 [2024-11-30 04:32:07.406175] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.806 [2024-11-30 04:32:07.406439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.406559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.406585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.806 [2024-11-30 04:32:07.406601] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.806 [2024-11-30 04:32:07.406716] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.806 [2024-11-30 04:32:07.406882] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.806 [2024-11-30 04:32:07.406903] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.806 [2024-11-30 04:32:07.406916] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.806 [2024-11-30 04:32:07.409006] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:16.806 [2024-11-30 04:32:07.418476] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:16.806 [2024-11-30 04:32:07.418759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.418848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:16.806 [2024-11-30 04:32:07.418874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:16.806 [2024-11-30 04:32:07.418890] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:16.806 [2024-11-30 04:32:07.419062] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:16.806 [2024-11-30 04:32:07.419182] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:16.806 [2024-11-30 04:32:07.419202] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:16.806 [2024-11-30 04:32:07.419216] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:16.806 [2024-11-30 04:32:07.421339] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.157 [2024-11-30 04:32:07.430815] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.157 [2024-11-30 04:32:07.431076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.431205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.431231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.157 [2024-11-30 04:32:07.431248] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.157 [2024-11-30 04:32:07.431434] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.157 [2024-11-30 04:32:07.431585] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.157 [2024-11-30 04:32:07.431607] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.157 [2024-11-30 04:32:07.431620] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.157 [2024-11-30 04:32:07.433841] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.157 [2024-11-30 04:32:07.443091] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.157 [2024-11-30 04:32:07.443361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.443491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.443517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.157 [2024-11-30 04:32:07.443534] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.157 [2024-11-30 04:32:07.443698] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.157 [2024-11-30 04:32:07.443801] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.157 [2024-11-30 04:32:07.443822] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.157 [2024-11-30 04:32:07.443835] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.157 [2024-11-30 04:32:07.446015] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.157 [2024-11-30 04:32:07.455498] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.157 [2024-11-30 04:32:07.455776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.455877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.455903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.157 [2024-11-30 04:32:07.455919] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.157 [2024-11-30 04:32:07.456092] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.157 [2024-11-30 04:32:07.456275] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.157 [2024-11-30 04:32:07.456296] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.157 [2024-11-30 04:32:07.456310] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.157 [2024-11-30 04:32:07.458423] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.157 [2024-11-30 04:32:07.467768] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.157 [2024-11-30 04:32:07.468068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.468197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.468223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.157 [2024-11-30 04:32:07.468238] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.157 [2024-11-30 04:32:07.468337] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.157 [2024-11-30 04:32:07.468510] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.157 [2024-11-30 04:32:07.468531] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.157 [2024-11-30 04:32:07.468544] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.157 [2024-11-30 04:32:07.470473] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.157 [2024-11-30 04:32:07.479998] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.157 [2024-11-30 04:32:07.480274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.480399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.480425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.157 [2024-11-30 04:32:07.480441] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.157 [2024-11-30 04:32:07.480589] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.157 [2024-11-30 04:32:07.480738] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.157 [2024-11-30 04:32:07.480758] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.157 [2024-11-30 04:32:07.480772] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.157 [2024-11-30 04:32:07.482814] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.157 [2024-11-30 04:32:07.492304] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.157 [2024-11-30 04:32:07.492585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.492705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.492731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.157 [2024-11-30 04:32:07.492747] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.157 [2024-11-30 04:32:07.492910] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.157 [2024-11-30 04:32:07.493105] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.157 [2024-11-30 04:32:07.493128] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.157 [2024-11-30 04:32:07.493142] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.157 [2024-11-30 04:32:07.495288] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.157 [2024-11-30 04:32:07.504512] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.157 [2024-11-30 04:32:07.504794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.504898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.504923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.157 [2024-11-30 04:32:07.504939] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.157 [2024-11-30 04:32:07.505094] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.157 [2024-11-30 04:32:07.505263] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.157 [2024-11-30 04:32:07.505303] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.157 [2024-11-30 04:32:07.505317] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.157 [2024-11-30 04:32:07.507433] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.157 [2024-11-30 04:32:07.516879] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.157 [2024-11-30 04:32:07.517173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.517303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.157 [2024-11-30 04:32:07.517329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.157 [2024-11-30 04:32:07.517345] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.157 [2024-11-30 04:32:07.517525] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.157 [2024-11-30 04:32:07.517688] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.157 [2024-11-30 04:32:07.517709] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.158 [2024-11-30 04:32:07.517723] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.158 [2024-11-30 04:32:07.519658] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.158 [2024-11-30 04:32:07.529200] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.158 [2024-11-30 04:32:07.529527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.529612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.529638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.158 [2024-11-30 04:32:07.529654] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.158 [2024-11-30 04:32:07.529801] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.158 [2024-11-30 04:32:07.530008] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.158 [2024-11-30 04:32:07.530030] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.158 [2024-11-30 04:32:07.530044] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.158 [2024-11-30 04:32:07.532126] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.158 [2024-11-30 04:32:07.541594] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.158 [2024-11-30 04:32:07.541887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.542035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.542063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.158 [2024-11-30 04:32:07.542079] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.158 [2024-11-30 04:32:07.542211] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.158 [2024-11-30 04:32:07.542391] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.158 [2024-11-30 04:32:07.542412] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.158 [2024-11-30 04:32:07.542431] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.158 [2024-11-30 04:32:07.544392] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.158 [2024-11-30 04:32:07.553878] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.158 [2024-11-30 04:32:07.554168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.554288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.554315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.158 [2024-11-30 04:32:07.554331] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.158 [2024-11-30 04:32:07.554479] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.158 [2024-11-30 04:32:07.554613] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.158 [2024-11-30 04:32:07.554633] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.158 [2024-11-30 04:32:07.554647] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.158 [2024-11-30 04:32:07.556763] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.158 [2024-11-30 04:32:07.566169] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.158 [2024-11-30 04:32:07.566494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.566613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.566639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.158 [2024-11-30 04:32:07.566655] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.158 [2024-11-30 04:32:07.566803] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.158 [2024-11-30 04:32:07.566937] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.158 [2024-11-30 04:32:07.566981] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.158 [2024-11-30 04:32:07.567008] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.158 [2024-11-30 04:32:07.569016] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.158 [2024-11-30 04:32:07.578409] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.158 [2024-11-30 04:32:07.578715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.578842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.578868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.158 [2024-11-30 04:32:07.578884] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.158 [2024-11-30 04:32:07.579057] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.158 [2024-11-30 04:32:07.579211] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.158 [2024-11-30 04:32:07.579246] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.158 [2024-11-30 04:32:07.579260] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.158 [2024-11-30 04:32:07.581472] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.158 [2024-11-30 04:32:07.590702] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.158 [2024-11-30 04:32:07.591008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.591107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.591133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.158 [2024-11-30 04:32:07.591149] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.158 [2024-11-30 04:32:07.591281] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.158 [2024-11-30 04:32:07.591431] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.158 [2024-11-30 04:32:07.591451] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.158 [2024-11-30 04:32:07.591464] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.158 [2024-11-30 04:32:07.593601] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.158 [2024-11-30 04:32:07.602932] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.158 [2024-11-30 04:32:07.603251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.603370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.603396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.158 [2024-11-30 04:32:07.603413] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.158 [2024-11-30 04:32:07.603560] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.158 [2024-11-30 04:32:07.603710] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.158 [2024-11-30 04:32:07.603731] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.158 [2024-11-30 04:32:07.603744] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.158 [2024-11-30 04:32:07.605817] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.158 [2024-11-30 04:32:07.615290] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.158 [2024-11-30 04:32:07.615615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.615715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.615741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.158 [2024-11-30 04:32:07.615757] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.158 [2024-11-30 04:32:07.615953] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.158 [2024-11-30 04:32:07.616084] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.158 [2024-11-30 04:32:07.616107] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.158 [2024-11-30 04:32:07.616121] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.158 [2024-11-30 04:32:07.618286] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.158 [2024-11-30 04:32:07.627738] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.158 [2024-11-30 04:32:07.628069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.628174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.628200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.158 [2024-11-30 04:32:07.628216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.158 [2024-11-30 04:32:07.628380] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.158 [2024-11-30 04:32:07.628544] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.158 [2024-11-30 04:32:07.628564] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.158 [2024-11-30 04:32:07.628578] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.158 [2024-11-30 04:32:07.630818] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.158 [2024-11-30 04:32:07.639987] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.158 [2024-11-30 04:32:07.640292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.158 [2024-11-30 04:32:07.640455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.640482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.159 [2024-11-30 04:32:07.640498] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.159 [2024-11-30 04:32:07.640630] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.159 [2024-11-30 04:32:07.640815] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.159 [2024-11-30 04:32:07.640836] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.159 [2024-11-30 04:32:07.640851] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.159 [2024-11-30 04:32:07.643013] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.159 [2024-11-30 04:32:07.652445] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.159 [2024-11-30 04:32:07.652765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.652858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.652883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.159 [2024-11-30 04:32:07.652899] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.159 [2024-11-30 04:32:07.653039] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.159 [2024-11-30 04:32:07.653175] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.159 [2024-11-30 04:32:07.653196] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.159 [2024-11-30 04:32:07.653210] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.159 [2024-11-30 04:32:07.655258] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.159 [2024-11-30 04:32:07.664641] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.159 [2024-11-30 04:32:07.664966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.665099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.665124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.159 [2024-11-30 04:32:07.665140] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.159 [2024-11-30 04:32:07.665255] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.159 [2024-11-30 04:32:07.665440] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.159 [2024-11-30 04:32:07.665461] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.159 [2024-11-30 04:32:07.665475] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.159 [2024-11-30 04:32:07.667578] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.159 [2024-11-30 04:32:07.677166] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.159 [2024-11-30 04:32:07.677471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.677567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.677593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.159 [2024-11-30 04:32:07.677609] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.159 [2024-11-30 04:32:07.677773] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.159 [2024-11-30 04:32:07.677979] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.159 [2024-11-30 04:32:07.678000] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.159 [2024-11-30 04:32:07.678014] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.159 [2024-11-30 04:32:07.679943] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.159 [2024-11-30 04:32:07.689449] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.159 [2024-11-30 04:32:07.689775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.689924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.689969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.159 [2024-11-30 04:32:07.689988] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.159 [2024-11-30 04:32:07.690104] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.159 [2024-11-30 04:32:07.690239] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.159 [2024-11-30 04:32:07.690260] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.159 [2024-11-30 04:32:07.690273] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.159 [2024-11-30 04:32:07.692331] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.159 [2024-11-30 04:32:07.701725] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.159 [2024-11-30 04:32:07.702036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.702165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.702199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.159 [2024-11-30 04:32:07.702216] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.159 [2024-11-30 04:32:07.702381] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.159 [2024-11-30 04:32:07.702560] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.159 [2024-11-30 04:32:07.702581] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.159 [2024-11-30 04:32:07.702594] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.159 [2024-11-30 04:32:07.704513] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.159 [2024-11-30 04:32:07.714051] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.159 [2024-11-30 04:32:07.714338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.714463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.714490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.159 [2024-11-30 04:32:07.714507] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.159 [2024-11-30 04:32:07.714622] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.159 [2024-11-30 04:32:07.714756] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.159 [2024-11-30 04:32:07.714777] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.159 [2024-11-30 04:32:07.714790] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.159 [2024-11-30 04:32:07.716872] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.159 [2024-11-30 04:32:07.726342] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.159 [2024-11-30 04:32:07.726629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.726726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.726752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.159 [2024-11-30 04:32:07.726769] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.159 [2024-11-30 04:32:07.726884] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.159 [2024-11-30 04:32:07.726997] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.159 [2024-11-30 04:32:07.727018] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.159 [2024-11-30 04:32:07.727032] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.159 [2024-11-30 04:32:07.728991] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.159 [2024-11-30 04:32:07.738699] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.159 [2024-11-30 04:32:07.739006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.739132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.739158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.159 [2024-11-30 04:32:07.739179] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.159 [2024-11-30 04:32:07.739328] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.159 [2024-11-30 04:32:07.739493] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.159 [2024-11-30 04:32:07.739513] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.159 [2024-11-30 04:32:07.739526] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.159 [2024-11-30 04:32:07.741590] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.159 [2024-11-30 04:32:07.751075] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.159 [2024-11-30 04:32:07.751369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.751497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.159 [2024-11-30 04:32:07.751523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.159 [2024-11-30 04:32:07.751539] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.159 [2024-11-30 04:32:07.751687] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.160 [2024-11-30 04:32:07.751899] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.160 [2024-11-30 04:32:07.751919] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.160 [2024-11-30 04:32:07.751933] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.160 [2024-11-30 04:32:07.754119] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.160 [2024-11-30 04:32:07.763428] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.160 [2024-11-30 04:32:07.763679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.160 [2024-11-30 04:32:07.763765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.160 [2024-11-30 04:32:07.763791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.160 [2024-11-30 04:32:07.763807] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.160 [2024-11-30 04:32:07.763955] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.160 [2024-11-30 04:32:07.764101] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.160 [2024-11-30 04:32:07.764122] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.160 [2024-11-30 04:32:07.764136] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.160 [2024-11-30 04:32:07.766224] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.443 [2024-11-30 04:32:07.775734] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.443 [2024-11-30 04:32:07.775995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.776092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.776125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.443 [2024-11-30 04:32:07.776144] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.443 [2024-11-30 04:32:07.776298] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.443 [2024-11-30 04:32:07.776466] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.443 [2024-11-30 04:32:07.776487] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.443 [2024-11-30 04:32:07.776502] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.443 [2024-11-30 04:32:07.778656] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.443 [2024-11-30 04:32:07.788147] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.443 [2024-11-30 04:32:07.788420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.788546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.788572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.443 [2024-11-30 04:32:07.788589] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.443 [2024-11-30 04:32:07.788753] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.443 [2024-11-30 04:32:07.788901] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.443 [2024-11-30 04:32:07.788922] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.443 [2024-11-30 04:32:07.788951] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.443 [2024-11-30 04:32:07.791142] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.443 [2024-11-30 04:32:07.800314] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.443 [2024-11-30 04:32:07.800602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.800721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.800747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.443 [2024-11-30 04:32:07.800763] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.443 [2024-11-30 04:32:07.800895] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.443 [2024-11-30 04:32:07.801057] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.443 [2024-11-30 04:32:07.801079] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.443 [2024-11-30 04:32:07.801093] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.443 [2024-11-30 04:32:07.803210] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.443 [2024-11-30 04:32:07.812656] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.443 [2024-11-30 04:32:07.812906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.813003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.813030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.443 [2024-11-30 04:32:07.813047] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.443 [2024-11-30 04:32:07.813227] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.443 [2024-11-30 04:32:07.813428] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.443 [2024-11-30 04:32:07.813449] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.443 [2024-11-30 04:32:07.813462] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.443 [2024-11-30 04:32:07.815642] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.443 [2024-11-30 04:32:07.825206] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.443 [2024-11-30 04:32:07.825459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.825588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.825614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.443 [2024-11-30 04:32:07.825630] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.443 [2024-11-30 04:32:07.825762] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.443 [2024-11-30 04:32:07.825968] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.443 [2024-11-30 04:32:07.825990] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.443 [2024-11-30 04:32:07.826004] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.443 [2024-11-30 04:32:07.827820] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.443 [2024-11-30 04:32:07.837624] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.443 [2024-11-30 04:32:07.837908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.838038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.838066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.443 [2024-11-30 04:32:07.838081] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.443 [2024-11-30 04:32:07.838262] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.443 [2024-11-30 04:32:07.838379] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.443 [2024-11-30 04:32:07.838400] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.443 [2024-11-30 04:32:07.838413] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.443 [2024-11-30 04:32:07.840330] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.443 [2024-11-30 04:32:07.849847] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.443 [2024-11-30 04:32:07.850187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.850350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.850376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.443 [2024-11-30 04:32:07.850392] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.443 [2024-11-30 04:32:07.850573] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.443 [2024-11-30 04:32:07.850708] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.443 [2024-11-30 04:32:07.850735] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.443 [2024-11-30 04:32:07.850749] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.443 [2024-11-30 04:32:07.852799] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.443 [2024-11-30 04:32:07.862025] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.443 [2024-11-30 04:32:07.862310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.862412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.443 [2024-11-30 04:32:07.862438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.444 [2024-11-30 04:32:07.862453] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.444 [2024-11-30 04:32:07.862617] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.444 [2024-11-30 04:32:07.862785] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.444 [2024-11-30 04:32:07.862805] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.444 [2024-11-30 04:32:07.862818] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.444 [2024-11-30 04:32:07.864772] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.444 04:32:07 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:17.444 04:32:07 -- common/autotest_common.sh@862 -- # return 0 00:30:17.444 04:32:07 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:17.444 04:32:07 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:17.444 04:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:17.444 [2024-11-30 04:32:07.874482] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.444 [2024-11-30 04:32:07.874765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.874855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.874880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.444 [2024-11-30 04:32:07.874897] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.444 [2024-11-30 04:32:07.875022] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.444 [2024-11-30 04:32:07.875207] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.444 [2024-11-30 04:32:07.875228] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.444 [2024-11-30 04:32:07.875242] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.444 [2024-11-30 04:32:07.877449] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.444 [2024-11-30 04:32:07.886793] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.444 [2024-11-30 04:32:07.887101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.887230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.887256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.444 [2024-11-30 04:32:07.887272] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.444 [2024-11-30 04:32:07.887419] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.444 [2024-11-30 04:32:07.887588] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.444 [2024-11-30 04:32:07.887609] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.444 [2024-11-30 04:32:07.887623] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.444 [2024-11-30 04:32:07.889727] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.444 04:32:07 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:17.444 04:32:07 -- host/bdevperf.sh@17 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:30:17.444 04:32:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.444 04:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:17.444 [2024-11-30 04:32:07.896111] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:17.444 [2024-11-30 04:32:07.899055] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.444 [2024-11-30 04:32:07.899282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.899440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.899466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.444 [2024-11-30 04:32:07.899483] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.444 [2024-11-30 04:32:07.899647] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.444 [2024-11-30 04:32:07.899799] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.444 [2024-11-30 04:32:07.899820] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.444 [2024-11-30 04:32:07.899834] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.444 04:32:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.444 04:32:07 -- host/bdevperf.sh@18 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:17.444 04:32:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.444 [2024-11-30 04:32:07.902083] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.444 04:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:17.444 [2024-11-30 04:32:07.911604] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.444 [2024-11-30 04:32:07.911963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.912093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.912119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.444 [2024-11-30 04:32:07.912135] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.444 [2024-11-30 04:32:07.912346] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.444 [2024-11-30 04:32:07.912490] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.444 [2024-11-30 04:32:07.912509] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.444 [2024-11-30 04:32:07.912522] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.444 [2024-11-30 04:32:07.914531] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.444 [2024-11-30 04:32:07.923898] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.444 [2024-11-30 04:32:07.924262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.924417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.924444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.444 [2024-11-30 04:32:07.924461] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.444 [2024-11-30 04:32:07.924613] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.444 [2024-11-30 04:32:07.924748] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.444 [2024-11-30 04:32:07.924768] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.444 [2024-11-30 04:32:07.924783] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.444 [2024-11-30 04:32:07.926843] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.444 [2024-11-30 04:32:07.936188] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.444 [2024-11-30 04:32:07.936606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.936748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.936775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.444 [2024-11-30 04:32:07.936794] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.444 [2024-11-30 04:32:07.936976] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.444 [2024-11-30 04:32:07.937099] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.444 [2024-11-30 04:32:07.937120] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.444 [2024-11-30 04:32:07.937135] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.444 Malloc0 00:30:17.444 04:32:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.444 04:32:07 -- host/bdevperf.sh@19 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:17.444 04:32:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.444 [2024-11-30 04:32:07.939202] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.444 04:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:17.444 04:32:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.444 04:32:07 -- host/bdevperf.sh@20 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:17.444 04:32:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.444 04:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:17.444 [2024-11-30 04:32:07.948582] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.444 [2024-11-30 04:32:07.948828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.948970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:17.444 [2024-11-30 04:32:07.948998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x15ce870 with addr=10.0.0.2, port=4420 00:30:17.444 [2024-11-30 04:32:07.949015] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x15ce870 is same with the state(5) to be set 00:30:17.444 [2024-11-30 04:32:07.949180] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x15ce870 (9): Bad file descriptor 00:30:17.444 [2024-11-30 04:32:07.949345] nvme_ctrlr.c:4028:nvme_ctrlr_process_init: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Ctrlr is in error state 00:30:17.444 [2024-11-30 04:32:07.949366] nvme_ctrlr.c:1737:spdk_nvme_ctrlr_reconnect_poll_async: *ERROR*: [nqn.2016-06.io.spdk:cnode1] controller reinitialization failed 00:30:17.444 [2024-11-30 04:32:07.949388] nvme_ctrlr.c:1029:nvme_ctrlr_fail: *ERROR*: [nqn.2016-06.io.spdk:cnode1] in failed state. 00:30:17.444 [2024-11-30 04:32:07.951543] bdev_nvme.c:2038:_bdev_nvme_reset_ctrlr_complete: *ERROR*: Resetting controller failed. 00:30:17.444 04:32:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.444 04:32:07 -- host/bdevperf.sh@21 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:17.444 04:32:07 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:17.444 04:32:07 -- common/autotest_common.sh@10 -- # set +x 00:30:17.445 [2024-11-30 04:32:07.958352] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:17.445 [2024-11-30 04:32:07.960905] nvme_ctrlr.c:1639:nvme_ctrlr_disconnect: *NOTICE*: [nqn.2016-06.io.spdk:cnode1] resetting controller 00:30:17.445 04:32:07 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:17.445 04:32:07 -- host/bdevperf.sh@38 -- # wait 2489847 00:30:17.702 [2024-11-30 04:32:08.114871] bdev_nvme.c:2040:_bdev_nvme_reset_ctrlr_complete: *NOTICE*: Resetting controller successful. 00:30:25.812 00:30:25.812 Latency(us) 00:30:25.812 [2024-11-30T03:32:16.443Z] Device Information : runtime(s) IOPS MiB/s Fail/s TO/s Average min max 00:30:25.812 [2024-11-30T03:32:16.443Z] Job: Nvme1n1 (Core Mask 0x1, workload: verify, depth: 128, IO size: 4096) 00:30:25.812 Verification LBA range: start 0x0 length 0x4000 00:30:25.812 Nvme1n1 : 15.01 9314.86 36.39 16416.04 0.00 4959.92 594.68 21651.15 00:30:25.812 [2024-11-30T03:32:16.443Z] =================================================================================================================== 00:30:25.812 [2024-11-30T03:32:16.443Z] Total : 9314.86 36.39 16416.04 0.00 4959.92 594.68 21651.15 00:30:26.069 04:32:16 -- host/bdevperf.sh@39 -- # sync 00:30:26.069 04:32:16 -- host/bdevperf.sh@40 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:30:26.069 04:32:16 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:26.069 04:32:16 -- common/autotest_common.sh@10 -- # set +x 00:30:26.069 04:32:16 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:26.070 04:32:16 -- host/bdevperf.sh@42 -- # trap - SIGINT SIGTERM EXIT 00:30:26.070 04:32:16 -- host/bdevperf.sh@44 -- # nvmftestfini 00:30:26.070 04:32:16 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:26.070 04:32:16 -- nvmf/common.sh@116 -- # sync 00:30:26.070 04:32:16 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:26.070 04:32:16 -- nvmf/common.sh@119 -- # set +e 00:30:26.070 04:32:16 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:26.070 04:32:16 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:26.070 rmmod nvme_tcp 00:30:26.070 rmmod nvme_fabrics 00:30:26.070 rmmod nvme_keyring 00:30:26.070 04:32:16 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:26.070 04:32:16 -- nvmf/common.sh@123 -- # set -e 00:30:26.070 04:32:16 -- nvmf/common.sh@124 -- # return 0 00:30:26.070 04:32:16 -- nvmf/common.sh@477 -- # '[' -n 2490538 ']' 00:30:26.070 04:32:16 -- nvmf/common.sh@478 -- # killprocess 2490538 00:30:26.070 04:32:16 -- common/autotest_common.sh@936 -- # '[' -z 2490538 ']' 00:30:26.070 04:32:16 -- common/autotest_common.sh@940 -- # kill -0 2490538 00:30:26.070 04:32:16 -- common/autotest_common.sh@941 -- # uname 00:30:26.070 04:32:16 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:26.070 04:32:16 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2490538 00:30:26.070 04:32:16 -- common/autotest_common.sh@942 -- # process_name=reactor_1 00:30:26.070 04:32:16 -- common/autotest_common.sh@946 -- # '[' reactor_1 = sudo ']' 00:30:26.070 04:32:16 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2490538' 00:30:26.070 killing process with pid 2490538 00:30:26.070 04:32:16 -- common/autotest_common.sh@955 -- # kill 2490538 00:30:26.070 04:32:16 -- common/autotest_common.sh@960 -- # wait 2490538 00:30:26.328 04:32:16 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:26.328 04:32:16 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:26.328 04:32:16 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:26.328 04:32:16 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:26.328 04:32:16 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:26.328 04:32:16 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:26.328 04:32:16 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:26.328 04:32:16 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:28.862 04:32:18 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:28.862 00:30:28.862 real 0m23.205s 00:30:28.862 user 1m2.254s 00:30:28.862 sys 0m4.402s 00:30:28.862 04:32:18 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:28.862 04:32:18 -- common/autotest_common.sh@10 -- # set +x 00:30:28.862 ************************************ 00:30:28.862 END TEST nvmf_bdevperf 00:30:28.862 ************************************ 00:30:28.862 04:32:18 -- nvmf/nvmf.sh@124 -- # run_test nvmf_target_disconnect /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:28.862 04:32:18 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:28.862 04:32:18 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:28.862 04:32:18 -- common/autotest_common.sh@10 -- # set +x 00:30:28.862 ************************************ 00:30:28.862 START TEST nvmf_target_disconnect 00:30:28.862 ************************************ 00:30:28.862 04:32:18 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh --transport=tcp 00:30:28.862 * Looking for test storage... 00:30:28.862 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host 00:30:28.862 04:32:18 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:28.862 04:32:18 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:28.862 04:32:18 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:28.862 04:32:19 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:28.862 04:32:19 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:28.862 04:32:19 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:28.862 04:32:19 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:28.862 04:32:19 -- scripts/common.sh@335 -- # IFS=.-: 00:30:28.862 04:32:19 -- scripts/common.sh@335 -- # read -ra ver1 00:30:28.862 04:32:19 -- scripts/common.sh@336 -- # IFS=.-: 00:30:28.862 04:32:19 -- scripts/common.sh@336 -- # read -ra ver2 00:30:28.862 04:32:19 -- scripts/common.sh@337 -- # local 'op=<' 00:30:28.862 04:32:19 -- scripts/common.sh@339 -- # ver1_l=2 00:30:28.862 04:32:19 -- scripts/common.sh@340 -- # ver2_l=1 00:30:28.862 04:32:19 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:28.862 04:32:19 -- scripts/common.sh@343 -- # case "$op" in 00:30:28.862 04:32:19 -- scripts/common.sh@344 -- # : 1 00:30:28.862 04:32:19 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:28.862 04:32:19 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:28.862 04:32:19 -- scripts/common.sh@364 -- # decimal 1 00:30:28.862 04:32:19 -- scripts/common.sh@352 -- # local d=1 00:30:28.862 04:32:19 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:28.862 04:32:19 -- scripts/common.sh@354 -- # echo 1 00:30:28.862 04:32:19 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:28.862 04:32:19 -- scripts/common.sh@365 -- # decimal 2 00:30:28.862 04:32:19 -- scripts/common.sh@352 -- # local d=2 00:30:28.862 04:32:19 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:28.862 04:32:19 -- scripts/common.sh@354 -- # echo 2 00:30:28.862 04:32:19 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:28.862 04:32:19 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:28.862 04:32:19 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:28.862 04:32:19 -- scripts/common.sh@367 -- # return 0 00:30:28.862 04:32:19 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:28.862 04:32:19 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:28.862 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.862 --rc genhtml_branch_coverage=1 00:30:28.862 --rc genhtml_function_coverage=1 00:30:28.862 --rc genhtml_legend=1 00:30:28.862 --rc geninfo_all_blocks=1 00:30:28.862 --rc geninfo_unexecuted_blocks=1 00:30:28.862 00:30:28.862 ' 00:30:28.862 04:32:19 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:28.862 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.862 --rc genhtml_branch_coverage=1 00:30:28.862 --rc genhtml_function_coverage=1 00:30:28.862 --rc genhtml_legend=1 00:30:28.862 --rc geninfo_all_blocks=1 00:30:28.862 --rc geninfo_unexecuted_blocks=1 00:30:28.862 00:30:28.862 ' 00:30:28.862 04:32:19 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:28.862 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.862 --rc genhtml_branch_coverage=1 00:30:28.862 --rc genhtml_function_coverage=1 00:30:28.862 --rc genhtml_legend=1 00:30:28.862 --rc geninfo_all_blocks=1 00:30:28.862 --rc geninfo_unexecuted_blocks=1 00:30:28.862 00:30:28.862 ' 00:30:28.862 04:32:19 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:28.862 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:28.862 --rc genhtml_branch_coverage=1 00:30:28.862 --rc genhtml_function_coverage=1 00:30:28.862 --rc genhtml_legend=1 00:30:28.862 --rc geninfo_all_blocks=1 00:30:28.862 --rc geninfo_unexecuted_blocks=1 00:30:28.862 00:30:28.862 ' 00:30:28.862 04:32:19 -- host/target_disconnect.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:28.862 04:32:19 -- nvmf/common.sh@7 -- # uname -s 00:30:28.862 04:32:19 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:28.862 04:32:19 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:28.862 04:32:19 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:28.862 04:32:19 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:28.862 04:32:19 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:28.862 04:32:19 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:28.862 04:32:19 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:28.862 04:32:19 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:28.862 04:32:19 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:28.862 04:32:19 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:28.862 04:32:19 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:28.862 04:32:19 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:28.862 04:32:19 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:28.862 04:32:19 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:28.862 04:32:19 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:28.862 04:32:19 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:28.862 04:32:19 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:28.862 04:32:19 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:28.862 04:32:19 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:28.862 04:32:19 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.863 04:32:19 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.863 04:32:19 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.863 04:32:19 -- paths/export.sh@5 -- # export PATH 00:30:28.863 04:32:19 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:28.863 04:32:19 -- nvmf/common.sh@46 -- # : 0 00:30:28.863 04:32:19 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:28.863 04:32:19 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:28.863 04:32:19 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:28.863 04:32:19 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:28.863 04:32:19 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:28.863 04:32:19 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:28.863 04:32:19 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:28.863 04:32:19 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:28.863 04:32:19 -- host/target_disconnect.sh@11 -- # PLUGIN_DIR=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/app/fio/nvme 00:30:28.863 04:32:19 -- host/target_disconnect.sh@13 -- # MALLOC_BDEV_SIZE=64 00:30:28.863 04:32:19 -- host/target_disconnect.sh@14 -- # MALLOC_BLOCK_SIZE=512 00:30:28.863 04:32:19 -- host/target_disconnect.sh@77 -- # nvmftestinit 00:30:28.863 04:32:19 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:30:28.863 04:32:19 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:30:28.863 04:32:19 -- nvmf/common.sh@436 -- # prepare_net_devs 00:30:28.863 04:32:19 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:30:28.863 04:32:19 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:30:28.863 04:32:19 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:28.863 04:32:19 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:28.863 04:32:19 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:28.863 04:32:19 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:30:28.863 04:32:19 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:30:28.863 04:32:19 -- nvmf/common.sh@284 -- # xtrace_disable 00:30:28.863 04:32:19 -- common/autotest_common.sh@10 -- # set +x 00:30:30.766 04:32:21 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:30:30.766 04:32:21 -- nvmf/common.sh@290 -- # pci_devs=() 00:30:30.766 04:32:21 -- nvmf/common.sh@290 -- # local -a pci_devs 00:30:30.766 04:32:21 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:30:30.766 04:32:21 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:30:30.766 04:32:21 -- nvmf/common.sh@292 -- # pci_drivers=() 00:30:30.766 04:32:21 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:30:30.766 04:32:21 -- nvmf/common.sh@294 -- # net_devs=() 00:30:30.766 04:32:21 -- nvmf/common.sh@294 -- # local -ga net_devs 00:30:30.766 04:32:21 -- nvmf/common.sh@295 -- # e810=() 00:30:30.766 04:32:21 -- nvmf/common.sh@295 -- # local -ga e810 00:30:30.766 04:32:21 -- nvmf/common.sh@296 -- # x722=() 00:30:30.766 04:32:21 -- nvmf/common.sh@296 -- # local -ga x722 00:30:30.766 04:32:21 -- nvmf/common.sh@297 -- # mlx=() 00:30:30.766 04:32:21 -- nvmf/common.sh@297 -- # local -ga mlx 00:30:30.766 04:32:21 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:30:30.766 04:32:21 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:30:30.766 04:32:21 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:30:30.766 04:32:21 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:30:30.766 04:32:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:30.766 04:32:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:30:30.766 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:30:30.766 04:32:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:30:30.766 04:32:21 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:30:30.766 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:30:30.766 04:32:21 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:30:30.766 04:32:21 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:30.766 04:32:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:30.766 04:32:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:30.766 04:32:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:30.766 04:32:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:30:30.766 Found net devices under 0000:0a:00.0: cvl_0_0 00:30:30.766 04:32:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:30.766 04:32:21 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:30:30.766 04:32:21 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:30:30.766 04:32:21 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:30:30.766 04:32:21 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:30:30.766 04:32:21 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:30:30.766 Found net devices under 0000:0a:00.1: cvl_0_1 00:30:30.766 04:32:21 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:30:30.766 04:32:21 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:30:30.766 04:32:21 -- nvmf/common.sh@402 -- # is_hw=yes 00:30:30.766 04:32:21 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:30:30.766 04:32:21 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:30:30.766 04:32:21 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:30:30.766 04:32:21 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:30:30.766 04:32:21 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:30:30.766 04:32:21 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:30:30.766 04:32:21 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:30:30.766 04:32:21 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:30:30.766 04:32:21 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:30:30.766 04:32:21 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:30:30.766 04:32:21 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:30:30.766 04:32:21 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:30:30.766 04:32:21 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:30:30.766 04:32:21 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:30:30.766 04:32:21 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:30:30.766 04:32:21 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:30:30.767 04:32:21 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:30:30.767 04:32:21 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:30:30.767 04:32:21 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:30:30.767 04:32:21 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:30:30.767 04:32:21 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:30:30.767 04:32:21 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:30:30.767 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:30:30.767 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.298 ms 00:30:30.767 00:30:30.767 --- 10.0.0.2 ping statistics --- 00:30:30.767 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:30.767 rtt min/avg/max/mdev = 0.298/0.298/0.298/0.000 ms 00:30:30.767 04:32:21 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:30:30.767 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:30:30.767 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.094 ms 00:30:30.767 00:30:30.767 --- 10.0.0.1 ping statistics --- 00:30:30.767 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:30:30.767 rtt min/avg/max/mdev = 0.094/0.094/0.094/0.000 ms 00:30:30.767 04:32:21 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:30:30.767 04:32:21 -- nvmf/common.sh@410 -- # return 0 00:30:30.767 04:32:21 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:30:30.767 04:32:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:30:30.767 04:32:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:30:30.767 04:32:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:30:30.767 04:32:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:30:30.767 04:32:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:30:30.767 04:32:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:30:30.767 04:32:21 -- host/target_disconnect.sh@78 -- # run_test nvmf_target_disconnect_tc1 nvmf_target_disconnect_tc1 00:30:30.767 04:32:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:30.767 04:32:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:30.767 04:32:21 -- common/autotest_common.sh@10 -- # set +x 00:30:30.767 ************************************ 00:30:30.767 START TEST nvmf_target_disconnect_tc1 00:30:30.767 ************************************ 00:30:30.767 04:32:21 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc1 00:30:30.767 04:32:21 -- host/target_disconnect.sh@32 -- # set +e 00:30:30.767 04:32:21 -- host/target_disconnect.sh@33 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:30.767 EAL: No free 2048 kB hugepages reported on node 1 00:30:31.025 [2024-11-30 04:32:21.398820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.025 [2024-11-30 04:32:21.399020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:31.025 [2024-11-30 04:32:21.399050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x12abdf0 with addr=10.0.0.2, port=4420 00:30:31.026 [2024-11-30 04:32:21.399085] nvme_tcp.c:2596:nvme_tcp_ctrlr_construct: *ERROR*: failed to create admin qpair 00:30:31.026 [2024-11-30 04:32:21.399109] nvme.c: 821:nvme_probe_internal: *ERROR*: NVMe ctrlr scan failed 00:30:31.026 [2024-11-30 04:32:21.399123] nvme.c: 898:spdk_nvme_probe: *ERROR*: Create probe context failed 00:30:31.026 spdk_nvme_probe() failed for transport address '10.0.0.2' 00:30:31.026 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect: errors occurred 00:30:31.026 Initializing NVMe Controllers 00:30:31.026 04:32:21 -- host/target_disconnect.sh@33 -- # trap - ERR 00:30:31.026 04:32:21 -- host/target_disconnect.sh@33 -- # print_backtrace 00:30:31.026 04:32:21 -- common/autotest_common.sh@1142 -- # [[ hxBET =~ e ]] 00:30:31.026 04:32:21 -- common/autotest_common.sh@1142 -- # return 0 00:30:31.026 04:32:21 -- host/target_disconnect.sh@37 -- # '[' 1 '!=' 1 ']' 00:30:31.026 04:32:21 -- host/target_disconnect.sh@41 -- # set -e 00:30:31.026 00:30:31.026 real 0m0.096s 00:30:31.026 user 0m0.040s 00:30:31.026 sys 0m0.055s 00:30:31.026 04:32:21 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:31.026 04:32:21 -- common/autotest_common.sh@10 -- # set +x 00:30:31.026 ************************************ 00:30:31.026 END TEST nvmf_target_disconnect_tc1 00:30:31.026 ************************************ 00:30:31.026 04:32:21 -- host/target_disconnect.sh@79 -- # run_test nvmf_target_disconnect_tc2 nvmf_target_disconnect_tc2 00:30:31.026 04:32:21 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:30:31.026 04:32:21 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:31.026 04:32:21 -- common/autotest_common.sh@10 -- # set +x 00:30:31.026 ************************************ 00:30:31.026 START TEST nvmf_target_disconnect_tc2 00:30:31.026 ************************************ 00:30:31.026 04:32:21 -- common/autotest_common.sh@1114 -- # nvmf_target_disconnect_tc2 00:30:31.026 04:32:21 -- host/target_disconnect.sh@45 -- # disconnect_init 10.0.0.2 00:30:31.026 04:32:21 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:31.026 04:32:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:31.026 04:32:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:31.026 04:32:21 -- common/autotest_common.sh@10 -- # set +x 00:30:31.026 04:32:21 -- nvmf/common.sh@469 -- # nvmfpid=2493737 00:30:31.026 04:32:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:31.026 04:32:21 -- nvmf/common.sh@470 -- # waitforlisten 2493737 00:30:31.026 04:32:21 -- common/autotest_common.sh@829 -- # '[' -z 2493737 ']' 00:30:31.026 04:32:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:31.026 04:32:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:31.026 04:32:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:31.026 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:31.026 04:32:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:31.026 04:32:21 -- common/autotest_common.sh@10 -- # set +x 00:30:31.026 [2024-11-30 04:32:21.491361] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:31.026 [2024-11-30 04:32:21.491442] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:31.026 EAL: No free 2048 kB hugepages reported on node 1 00:30:31.026 [2024-11-30 04:32:21.563089] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:31.026 [2024-11-30 04:32:21.653032] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:31.026 [2024-11-30 04:32:21.653188] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:31.026 [2024-11-30 04:32:21.653206] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:31.026 [2024-11-30 04:32:21.653219] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:31.026 [2024-11-30 04:32:21.653303] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:31.026 [2024-11-30 04:32:21.653373] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:31.026 [2024-11-30 04:32:21.653407] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:31.026 [2024-11-30 04:32:21.653411] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:31.972 04:32:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:31.972 04:32:22 -- common/autotest_common.sh@862 -- # return 0 00:30:31.972 04:32:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:31.972 04:32:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:31.972 04:32:22 -- common/autotest_common.sh@10 -- # set +x 00:30:31.972 04:32:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:31.972 04:32:22 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:31.972 04:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.972 04:32:22 -- common/autotest_common.sh@10 -- # set +x 00:30:31.972 Malloc0 00:30:31.972 04:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.973 04:32:22 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:31.973 04:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.973 04:32:22 -- common/autotest_common.sh@10 -- # set +x 00:30:31.973 [2024-11-30 04:32:22.496046] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:31.973 04:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.973 04:32:22 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:31.973 04:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.973 04:32:22 -- common/autotest_common.sh@10 -- # set +x 00:30:31.973 04:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.973 04:32:22 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:31.973 04:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.973 04:32:22 -- common/autotest_common.sh@10 -- # set +x 00:30:31.973 04:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.973 04:32:22 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:31.973 04:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.973 04:32:22 -- common/autotest_common.sh@10 -- # set +x 00:30:31.973 [2024-11-30 04:32:22.524332] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:31.973 04:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.973 04:32:22 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:31.973 04:32:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:31.973 04:32:22 -- common/autotest_common.sh@10 -- # set +x 00:30:31.973 04:32:22 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:31.973 04:32:22 -- host/target_disconnect.sh@50 -- # reconnectpid=2493893 00:30:31.973 04:32:22 -- host/target_disconnect.sh@48 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/reconnect -q 32 -o 4096 -w randrw -M 50 -t 10 -c 0xF -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:30:31.973 04:32:22 -- host/target_disconnect.sh@52 -- # sleep 2 00:30:31.973 EAL: No free 2048 kB hugepages reported on node 1 00:30:34.536 04:32:24 -- host/target_disconnect.sh@53 -- # kill -9 2493737 00:30:34.536 04:32:24 -- host/target_disconnect.sh@55 -- # sleep 2 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 [2024-11-30 04:32:24.547919] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Write completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.536 Read completed with error (sct=0, sc=8) 00:30:34.536 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 [2024-11-30 04:32:24.548285] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 [2024-11-30 04:32:24.548608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Read completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.537 Write completed with error (sct=0, sc=8) 00:30:34.537 starting I/O failed 00:30:34.538 [2024-11-30 04:32:24.549022] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:34.538 [2024-11-30 04:32:24.549166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.549355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.549397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.549532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.549661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.549689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.549808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.549937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.549995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.550099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.550194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.550220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.550362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.550511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.550536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.550696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.550817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.550843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.550980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.551069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.551095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.551200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.551358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.551385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.551511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.551665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.551691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.551841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.551973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.552005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.552101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.552201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.552227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.552364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.552488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.552514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.552666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.552791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.552817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.552918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.553079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.553106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.553231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.553357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.553383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.553523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.553638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.553665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.553757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.553900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.553928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.554062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.554161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.554186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.554311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.554460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.554502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.554651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.554739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.554769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.554897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.555028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.538 [2024-11-30 04:32:24.555055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.538 qpair failed and we were unable to recover it. 00:30:34.538 [2024-11-30 04:32:24.555180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.555338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.555364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.555493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.555615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.555641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.555780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.555916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.555962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.556079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.556194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.556219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.556326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.556439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.556479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.556591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.556741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.556766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.556916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.557052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.557079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.557197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.557341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.557367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.557490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.557622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.557649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.557812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.557918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.557955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.558080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.558246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.558275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.558408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.558599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.558623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.558790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.558892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.558918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.559021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.559140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.559166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.559286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.559424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.559450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.559598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.559736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.559777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.559895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.560017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.560043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.560131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.560281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.560306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.560423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.560546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.560571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.560672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.560817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.560843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.561030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.561204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.561230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.539 [2024-11-30 04:32:24.561412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.561591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.539 [2024-11-30 04:32:24.561631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.539 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.561764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.561887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.561912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.562085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.562229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.562255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.562386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.562497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.562524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.562679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.562859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.562885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.563002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.563120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.563146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.563266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.563380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.563405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.563524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.563645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.563671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.563782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.563872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.563897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.564005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.564132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.564157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.564248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.564371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.564397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.564618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.564811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.564839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.564984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.565136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.565161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.565286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.565397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.565422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.565548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.565670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.565695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.565849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.565943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.565975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.566093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.566186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.566212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.566337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.566431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.566457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.566602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.566776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.566802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.566930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.567085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.567112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.567237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.567368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.567394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.567519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.567646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.567673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.540 qpair failed and we were unable to recover it. 00:30:34.540 [2024-11-30 04:32:24.567821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.567943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.540 [2024-11-30 04:32:24.567984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.568078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.568175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.568201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.568346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.568467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.568493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.568609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.568728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.568754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.568851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.569003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.569029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.569153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.569245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.569271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.569422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.569507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.569533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.569652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.569737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.569763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.569883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.570002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.570029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.570177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.570295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.570321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.570447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.570539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.570565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.570684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.570785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.570811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.570962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.571053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.571080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.571197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.571290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.571316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.571403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.571514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.571540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.571661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.571776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.571802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.571929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.572054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.572081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.572202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.572321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.572348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.572445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.572591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.572617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.572744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.572865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.572892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.573027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.573147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.573174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.541 [2024-11-30 04:32:24.573271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.573392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.541 [2024-11-30 04:32:24.573418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.541 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.573544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.573670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.573697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.573785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.573968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.573996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.574087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.574184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.574212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.574360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.574507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.574533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.574656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.574769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.574795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.574894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.575059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.575086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.575234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.575328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.575354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.575447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.575544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.575571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.575687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.575812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.575838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.575990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.576141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.576167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.576280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.576431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.576457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.576550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.576697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.576723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.576845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.576989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.577017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.577115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.577206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.577233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.577367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.577517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.577543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.577677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.577825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.577851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.577949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.578071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.542 [2024-11-30 04:32:24.578098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.542 qpair failed and we were unable to recover it. 00:30:34.542 [2024-11-30 04:32:24.578212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.578335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.578363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.578483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.578613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.578640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.578764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.578912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.578938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.579067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.579197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.579224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.579373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.579488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.579514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.579647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.579772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.579798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.579912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.580035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.580062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.580206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.580327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.580353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.580474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.580617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.580645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.580797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.580917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.580944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.581088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.581208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.581235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.581350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.581466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.581493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.581619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.581763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.581789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.581875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.581990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.582017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.582169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.582309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.582335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.582456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.582589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.582616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.582767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.582914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.582940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.583042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.583167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.583194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.583288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.583388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.583416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.583541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.583663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.583691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.583782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.583885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.583912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.584066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.584211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.584237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.543 qpair failed and we were unable to recover it. 00:30:34.543 [2024-11-30 04:32:24.584333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.543 [2024-11-30 04:32:24.584453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.584480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.584603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.584720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.584746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.584871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.585020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.585047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.585196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.585315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.585342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.585489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.585636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.585662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.585758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.585879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.585906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.586032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.586157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.586184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.586275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.586423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.586449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.586573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.586660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.586688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.586775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.586896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.586923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.587086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.587173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.587200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.587322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.587469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.587494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.587589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.587709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.587736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.587901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.588038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.588065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.588189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.588282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.588308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.588431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.588555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.588584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.588702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.588819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.588845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.588977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.589069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.589095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.589196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.589317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.589344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.589446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.589561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.589587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.589703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.589803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.589829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.589920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.590040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.590066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.544 qpair failed and we were unable to recover it. 00:30:34.544 [2024-11-30 04:32:24.590191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.544 [2024-11-30 04:32:24.590308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.590333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.590457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.590575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.590600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.590754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.590904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.590931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.591062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.591155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.591185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.591279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.591428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.591454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.591604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.591691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.591718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.591862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.591956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.591989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.592113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.592235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.592261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.592386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.592475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.592502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.592620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.592734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.592761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.592875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.592985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.593013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.593140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.593289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.593316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.593411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.593525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.593551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.593671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.593763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.593795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.593973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.594098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.594125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.594273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.594362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.594389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.594527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.594645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.594672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.594757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.594873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.594899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.595016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.595131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.595157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.595307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.595420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.595447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.595585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.595711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.595738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.595863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.595952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.595984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.545 qpair failed and we were unable to recover it. 00:30:34.545 [2024-11-30 04:32:24.596081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.545 [2024-11-30 04:32:24.596197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.596224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.596374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.596494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.596525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.596658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.596748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.596774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.596922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.597110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.597138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.597221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.597383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.597410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.597558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.597676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.597704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.597826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.597917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.597955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.598076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.598227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.598257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.598348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.598500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.598527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.598664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.598786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.598812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.598923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.599088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.599116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.599241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.599369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.599396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.599532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.599650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.599679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.599801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.599917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.599954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.600465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.600654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.600685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.600808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.600918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.600945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.601104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.601255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.601282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.601407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.601510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.601545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.601668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.601793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.601819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.601915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.602075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.602102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.602226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.602355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.602382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.602503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.602600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.602628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.602756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.602880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.602907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.546 [2024-11-30 04:32:24.603070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.603167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.546 [2024-11-30 04:32:24.603193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.546 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.603291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.603422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.603448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.603573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.603698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.603725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.603850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.603943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.603982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.604104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.604223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.604253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.604409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.604523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.604556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.604648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.604793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.604820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.604976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.605063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.605089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.605187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.605286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.605312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.605441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.605592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.605618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.605739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.605861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.605888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.606048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.606170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.606196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.606323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.606446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.606474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.606594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.606715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.606743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.606864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.606994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.607021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.607122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.607282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.607317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.607409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.607559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.607585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.607675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.607826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.607852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.607943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.608086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.608113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.608214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.608339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.608366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.608462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.608575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.608601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.608700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.608791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.608816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.608932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.609030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.609057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.547 qpair failed and we were unable to recover it. 00:30:34.547 [2024-11-30 04:32:24.609158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.547 [2024-11-30 04:32:24.609255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.609283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.609400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.609509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.609535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.609657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.609801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.609827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.609978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.610077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.610103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.610227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.610391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.610418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.610541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.610652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.610678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.610836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.610926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.610979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.611101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.611193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.611219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.611301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.611416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.611443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.611555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.611676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.611703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.611846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.611962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.611993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.612103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.612190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.612216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.612355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.612582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.612614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.612742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.612892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.612920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.613029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.613121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.613148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.613248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.613399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.613426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.613567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.613662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.613688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.613815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.613908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.613934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.548 [2024-11-30 04:32:24.614080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.614170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.548 [2024-11-30 04:32:24.614196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.548 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.614314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.614424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.614450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.614576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.614721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.614747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.614866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.614970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.614998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.615117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.615201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.615229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.615366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.615481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.615508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.615630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.615715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.615742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.615861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.615951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.615988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.616083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.616173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.616200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.616352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.616443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.616469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.616595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.616684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.616710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.616800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.616900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.616926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.617066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.617211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.617238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.617371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.617517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.617544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.617646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.617761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.617787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.617908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.618008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.618035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.618162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.618282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.618309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.618398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.618532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.618558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.618696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.618829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.618858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.619013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.619156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.619184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.619332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.619471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.619502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.619652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.619736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.619762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.619909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.620014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.620042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.620214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.620359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.549 [2024-11-30 04:32:24.620401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.549 qpair failed and we were unable to recover it. 00:30:34.549 [2024-11-30 04:32:24.620528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.620664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.620693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.620801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.620975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.621002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.621130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.621281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.621307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.621451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.621587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.621615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.621777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.621914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.621955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.622136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.622229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.622264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.622388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.622538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.622567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.622678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.622784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.622814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.622920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.623101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.623145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.623286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.623416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.623443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.623567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.623691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.623717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.623865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.624021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.624048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.624177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.624308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.624335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.624482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.624642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.624671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.624807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.624933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.624968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.625088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.625232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.625267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.625364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.625511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.625537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.625664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.625760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.625786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.625912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.626011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.626038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.626154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.626238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.626270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.626358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.626470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.626497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.626629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.626758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.550 [2024-11-30 04:32:24.626787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.550 qpair failed and we were unable to recover it. 00:30:34.550 [2024-11-30 04:32:24.626900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.627016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.627042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.627158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.627285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.627310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.627422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.627582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.627611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.627743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.627914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.627941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.628097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.628254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.628281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.628413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.628565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.628591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.628720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.628814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.628840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.628954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.629056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.629082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.629200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.629356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.629382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.629473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.629584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.629611] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.629700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.629846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.629873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.629994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.630108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.630135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.630260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.630387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.630414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.630512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.630604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.630631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.630751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.630871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.630897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.631022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.631142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.631168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.631291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.631440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.631466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.631603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.631748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.631776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.631904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.632043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.632071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.632176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.632309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.632335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.632487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.632633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.632659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.632792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.632925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.632968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.551 qpair failed and we were unable to recover it. 00:30:34.551 [2024-11-30 04:32:24.633112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.633232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.551 [2024-11-30 04:32:24.633268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.633413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.633537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.633563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.633690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.633778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.633805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.633900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.634071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.634098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.634220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.634334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.634362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.634488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.634607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.634633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.634758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.634876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.634902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.635039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.635157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.635184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.635308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.635430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.635457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.635555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.635670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.635696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.635819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.635933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.635981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.636070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.636191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.636216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.636355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.636490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.636519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.636615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.636754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.636783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.636879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.637009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.637054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.637139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.637223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.637260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.637408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.637557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.637583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.637706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.637882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.637908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.638046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.638139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.638164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.638257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.638362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.638389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.638494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.638658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.638687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.638834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.638956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.638998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.639118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.639238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.639271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.552 [2024-11-30 04:32:24.639382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.639461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.552 [2024-11-30 04:32:24.639486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.552 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.639578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.639702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.639729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.639881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.640037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.640063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.640193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.640315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.640340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.640456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.640543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.640569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.640685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.640812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.640840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.640964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.641057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.641084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.641180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.641348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.641374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.641509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.641660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.641686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.641802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.641936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.641974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.642121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.642295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.642321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.642446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.642590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.642616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.642760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.642894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.642923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.643080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.643213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.643238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.643400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.643514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.643541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.643685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.643782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.643809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.643932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.644075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.644101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.644199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.644351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.644377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.644474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.644592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.644618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.644710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.644860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.644887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.644972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.645098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.645124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.645222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.645398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.645426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.553 qpair failed and we were unable to recover it. 00:30:34.553 [2024-11-30 04:32:24.645539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.645678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.553 [2024-11-30 04:32:24.645704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.645871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.646011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.646038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.646128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.646239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.646270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.646415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.646507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.646533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.646679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.646773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.646800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.646918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.647046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.647073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.647172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.647301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.647337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.647435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.647525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.647551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.647702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.647797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.647823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.647968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.648063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.648089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.648178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.648299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.648326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.648512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.648626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.648652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.648801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.648932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.648983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.649117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.649232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.649268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.649448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.649600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.649625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.649748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.649871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.649896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.650017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.650136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.650166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.650316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.650462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.554 [2024-11-30 04:32:24.650489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.554 qpair failed and we were unable to recover it. 00:30:34.554 [2024-11-30 04:32:24.650614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.650703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.650747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.650857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.651012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.651039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.651178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.651291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.651319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.651422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.651551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.651582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.651726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.651841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.651866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.651967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.652087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.652127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.652229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.652368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.652396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.652569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.652691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.652717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.652839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.652929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.652991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.653184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.653307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.653333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.653432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.653548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.653573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.653696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.653883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.653910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.654007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.654091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.654116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.654245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.654371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.654397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.654521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.654665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.654690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.654814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.654972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.654999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.655119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.655237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.655271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.655397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.655524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.655554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.655648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.655787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.655813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.655916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.656051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.656077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.656192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.656295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.656322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.656473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.656669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.656695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.555 qpair failed and we were unable to recover it. 00:30:34.555 [2024-11-30 04:32:24.656822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.555 [2024-11-30 04:32:24.656948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.656983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.657082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.657165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.657191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.657317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.657433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.657458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.657607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.657722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.657749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.657895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.658007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.658037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.658141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.658236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.658269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.658380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.658477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.658504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.658651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.658802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.658828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.658948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.659078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.659104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.659200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.659327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.659353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.659471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.659613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.659655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.659800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.659891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.659916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.660039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.660138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.660163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.660284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.660383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.660409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.660521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.660671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.660696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.660817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.660907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.660932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.661058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.661206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.661232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.661378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.661528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.661555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.661677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.661764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.661791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.661914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.662066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.662095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.662263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.662382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.662408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.662504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.662617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.662643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.556 [2024-11-30 04:32:24.662764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.662884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.556 [2024-11-30 04:32:24.662910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.556 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.663067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.663187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.663213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.663378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.663529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.663555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.663708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.663819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.663845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.663993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.664091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.664116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.664214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.664363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.664389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.664510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.664653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.664682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.664839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.664973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.665021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.665122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.665216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.665242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.665359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.665481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.665508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.665612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.665703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.665729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.665863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.666023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.666051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.666171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.666314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.666339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.666491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.666608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.666634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.666754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.666876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.666902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.667006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.667146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.667176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.667317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.667425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.667451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.667580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.667665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.667690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.667815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.667983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.668012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.668147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.668236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.668262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.668413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.668529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.668555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.668677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.668767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.668793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.668919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.669074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.669104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.557 qpair failed and we were unable to recover it. 00:30:34.557 [2024-11-30 04:32:24.669218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.557 [2024-11-30 04:32:24.669337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.669363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.669560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.669706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.669732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.669830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.669978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.670023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.670175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.670279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.670304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.670421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.670541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.670566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.670732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.670839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.670867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.671023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.671172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.671198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.671291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.671401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.671427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.671555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.671739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.671764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.671910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.672030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.672057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.672149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.672265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.672291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.672412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.672525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.672551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.672668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.672783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.672810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.672990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.673141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.673167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.673269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.673369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.673395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.673486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.673605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.673632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.673774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.673918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.673944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.674043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.674190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.674216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.674341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.674496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.674521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.674664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.674756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.674782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.674907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.675022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.675048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.675168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.675283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.675308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.675464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.675574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.675599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.558 qpair failed and we were unable to recover it. 00:30:34.558 [2024-11-30 04:32:24.675746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.558 [2024-11-30 04:32:24.675849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.675877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.675996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.676142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.676168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.676307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.676445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.676471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.676615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.676737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.676762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.676854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.676969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.676995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.677085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.677201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.677226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.677320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.677438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.677463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.677600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.677697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.677722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.677833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.677964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.678007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.678161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.678287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.678312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.678462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.678585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.678612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.678788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.678901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.678927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.679073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.679156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.679182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.679304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.679390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.679418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.679511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.679603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.679629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.679752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.679898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.679923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.680063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.680183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.680209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.680361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.680457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.680483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.680606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.680692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.680718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.680830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.680952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.680987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.681134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.681245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.681276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.681398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.681524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.681550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.681700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.681818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.559 [2024-11-30 04:32:24.681846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.559 qpair failed and we were unable to recover it. 00:30:34.559 [2024-11-30 04:32:24.682029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.682155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.682182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.682319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.682461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.682489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.682608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.682730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.682757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.682903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.683006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.683034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.683160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.683272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.683298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.683451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.683568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.683594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.683683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.683827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.683853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.684000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.684085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.684112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.684262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.684383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.684409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.684507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.684623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.684650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.684778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.684899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.684926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.685028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.685147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.685173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.685300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.685478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.685503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.685628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.685719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.685746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.685896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.686045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.686073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.686232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.686316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.686342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.686432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.686575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.686601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.560 qpair failed and we were unable to recover it. 00:30:34.560 [2024-11-30 04:32:24.686724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.560 [2024-11-30 04:32:24.686839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.686865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.687009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.687165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.687192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.687292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.687416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.687442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.687570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.687683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.687709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.687797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.687914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.687940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.688062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.688190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.688234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.688359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.688479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.688511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.688632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.688777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.688803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.688891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.689005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.689032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.689123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.689238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.689265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.689409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.689545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.689572] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.689666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.689826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.689853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.689973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.690123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.690149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.690251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.690335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.690361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.690479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.690595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.690621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.690742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.690890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.690916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.691101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.691232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.691268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.691388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.691497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.691526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.691661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.691817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.691843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.691963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.692093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.692121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.692287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.692428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.692456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.692609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.692734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.692760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.692862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.693008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.693038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.561 qpair failed and we were unable to recover it. 00:30:34.561 [2024-11-30 04:32:24.693165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.561 [2024-11-30 04:32:24.693337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.693363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.693460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.693579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.693605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.693723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.693869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.693895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.694043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.694181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.694210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.694379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.694524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.694549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.694734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.694830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.694857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.695008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.695156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.695183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.695329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.695476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.695501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.695622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.695788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.695824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.695985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.696116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.696161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.696310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.696456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.696483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.696671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.696790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.696815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.696935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.697064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.697093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.697207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.697352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.697377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.697498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.697593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.697619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.697742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.697866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.697892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.698039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.698184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.698210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.698362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.698483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.698510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.698651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.698782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.698816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.698996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.699099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.699125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.699247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.699333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.699358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.699504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.699648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.699674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.699801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.699897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.699923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.700047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.700149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.562 [2024-11-30 04:32:24.700175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.562 qpair failed and we were unable to recover it. 00:30:34.562 [2024-11-30 04:32:24.700299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.700388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.700413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.700506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.700619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.700645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.700760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.700878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.700904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.700998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.701145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.701170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.701272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.701414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.701440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.701571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.701693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.701719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.701878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.702026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.702053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.702199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.702355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.702381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.702519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.702650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.702678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.702778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.702908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.702936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.703092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.703239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.703265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.703393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.703490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.703533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.703677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.703797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.703822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.703969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.704108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.704135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.704232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.704380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.704410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.704529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.704673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.704700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.704795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.704917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.704943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.705068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.705214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.705241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.705380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.705527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.705554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.705694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.705814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.705840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.705991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.706099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.706128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.563 [2024-11-30 04:32:24.706260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.706410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.563 [2024-11-30 04:32:24.706437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.563 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.706562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.706685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.706711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.706861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.706995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.707039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.707187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.707333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.707359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.707485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.707580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.707606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.707751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.707899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.707925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.708082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.708208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.708237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.708404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.708502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.708528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.708649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.708792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.708822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.708999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.709092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.709119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.709240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.709387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.709413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.709559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.709686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.709712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.709851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.709986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.710016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.710156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.710303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.710329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.710445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.710547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.710573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.710721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.710808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.710834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.710989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.711122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.711149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.711299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.711420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.711447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.711609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.711743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.711772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.711909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.712033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.712060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.712207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.712361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.712390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.712527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.712667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.712694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.712815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.712909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.712935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.564 qpair failed and we were unable to recover it. 00:30:34.564 [2024-11-30 04:32:24.713064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.713151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.564 [2024-11-30 04:32:24.713178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.713282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.713420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.713454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.713599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.713749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.713776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.713919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.714064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.714094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.714204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.714300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.714344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.714543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.714704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.714734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.714865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.715026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.715056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.715180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.715350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.715376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.715504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.715626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.715653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.715796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.715969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.715998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.716127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.716232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.716258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.716350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.716467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.716493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.716621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.716740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.716766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.716911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.717030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.717058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.717156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.717300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.717326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.717468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.717596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.717624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.717756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.717859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.717887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.718003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.718100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.718125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.718265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.718389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.718417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.718558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.718680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.718708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.718843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.718997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.719041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.719135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.719244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.719270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.565 qpair failed and we were unable to recover it. 00:30:34.565 [2024-11-30 04:32:24.719404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.719526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.565 [2024-11-30 04:32:24.719552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.719670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.719754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.719781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.719869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.719981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.720008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.720102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.720223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.720249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.720334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.720420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.720445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.720557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.720651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.720676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.720794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.720914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.720965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.721107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.721231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.721258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.721436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.721579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.721604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.721729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.721851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.721877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.722004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.722130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.722159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.722271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.722415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.722441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.722559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.722684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.722710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.722896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.723055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.723082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.723273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.723362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.723388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.723537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.723661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.723686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.723811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.723900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.723926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.724062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.724201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.724230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.566 qpair failed and we were unable to recover it. 00:30:34.566 [2024-11-30 04:32:24.724397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.724541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.566 [2024-11-30 04:32:24.724567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.724667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.724778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.724805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.724944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.725095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.725122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.725220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.725361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.725387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.725563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.725723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.725751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.725887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.726018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.726045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.726147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.726310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.726339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.726473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.726612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.726638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.726790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.726944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.726983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.727101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.727211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.727238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.727388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.727583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.727624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.727793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.727910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.727937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.728111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.728319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.728378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.728549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.728693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.728735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.728919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.729018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.729044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.729262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.729464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.729515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.729610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.729744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.729770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.729864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.729994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.730021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.730169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.730260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.730285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.730384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.730503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.730551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.730726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.730881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.730907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.731065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.731156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.731182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.567 qpair failed and we were unable to recover it. 00:30:34.567 [2024-11-30 04:32:24.731324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.567 [2024-11-30 04:32:24.731451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.731479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.731614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.731788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.731813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.731964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.732100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.732129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.732251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.732373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.732400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.732499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.732639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.732668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.732826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.732985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.733014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.733179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.733320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.733346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.733498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.733615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.733640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.733763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.733931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.733969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.734120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.734241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.734267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.734447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.734596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.734622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.734812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.734967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.735013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.735162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.735257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.735284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.735406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.735517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.735543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.735666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.735810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.735838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.735981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.736107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.736132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.736291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.736441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.736467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.736604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.736735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.736764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.736897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.737002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.737032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.737175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.737296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.737323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.737419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.737547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.737576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.737706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.737839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.737865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.738022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.738147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.738172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.738274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.738418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.738444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.738577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.738702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.568 [2024-11-30 04:32:24.738731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.568 qpair failed and we were unable to recover it. 00:30:34.568 [2024-11-30 04:32:24.738831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.738954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.739024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.739120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.739210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.739236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.739324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.739438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.739464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.739587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.739752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.739781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.739945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.740130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.740155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.740255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.740419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.740447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.740589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.740740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.740767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.740920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.741083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.741112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.741245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.741389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.741414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.741512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.741591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.741632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.741803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.741918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.741945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.742099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.742231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.742260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.742394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.742491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.742521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.742633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.742804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.742831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.742929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.743060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.743087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.743207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.743351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.743379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.743512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.743646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.743679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.743836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.743970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.744001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.744165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.744289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.744316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.744459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.744612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.744640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.744794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.744920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.744946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.745117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.745253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.745281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.745397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.745513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.745539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.745681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.745785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.745816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.569 [2024-11-30 04:32:24.745989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.746111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.569 [2024-11-30 04:32:24.746138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.569 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.746253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.746376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.746402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.746547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.746630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.746661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.746786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.746924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.746953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.747118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.747277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.747306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.747468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.747641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.747667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.747813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.747929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.747955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.748113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.748244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.748273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.748429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.748606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.748632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.748765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.748943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.748976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.749129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.749245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.749272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.749421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.749550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.749579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.749721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.749812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.749839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.749972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.750097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.750124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.750248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.750338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.750364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.750483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.750629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.750655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.750800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.750933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.750989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.751156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.751252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.751281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.751448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.751561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.751591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.751744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.751876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.751906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.752018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.752122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.752151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.752249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.752366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.752395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.752533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.752633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.752659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.752780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.752915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.752944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.753138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.753259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.753285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.570 [2024-11-30 04:32:24.753455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.753593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.570 [2024-11-30 04:32:24.753622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.570 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.753747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.753846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.753872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.753998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.754144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.754173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.754306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.754439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.754468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.754601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.754704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.754746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.754909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.755026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.755053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.755182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.755275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.755301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.755431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.755602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.755631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.755733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.755874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.755903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.756049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.756174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.756201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.756320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.756424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.756453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.756607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.756732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.756758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.756858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.756936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.756967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.757052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.757167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.757192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.757303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.757415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.757444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.757576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.757746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.757776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.757943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.758082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.758111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.758256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.758382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.758408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.758600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.758690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.758720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.758897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.759033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.759063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.759222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.759358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.759387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.571 qpair failed and we were unable to recover it. 00:30:34.571 [2024-11-30 04:32:24.759532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.571 [2024-11-30 04:32:24.759651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.759678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.759826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.759941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.759979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.760117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.760250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.760278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.760406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.760556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.760581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.760702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.760841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.760867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.761035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.761139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.761182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.761310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.761438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.761465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.761592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.761692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.761725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.761860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.762017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.762044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.762165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.762310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.762339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.762474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.762639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.762667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.762803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.762968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.762997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.763142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.763266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.763292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.763387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.763503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.763528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.763665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.763804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.763831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.763964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.764130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.764159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.764303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.764428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.764453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.764602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.764747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.764776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.764913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.765050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.765079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.765209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.765308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.765351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.765499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.765594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.765621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.765809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.765922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.765947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.766044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.766239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.766265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.766450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.766561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.766587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.766732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.766852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.766877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.766983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.767147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.767176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.572 qpair failed and we were unable to recover it. 00:30:34.572 [2024-11-30 04:32:24.767385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.572 [2024-11-30 04:32:24.767586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.767615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.767745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.767890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.767916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.768044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.768141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.768167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.768258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.768369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.768394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.768522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.768644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.768670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.768791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.768911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.768937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.769088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.769227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.769259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.769389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.769517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.769564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.769688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.769813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.769841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.769939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.770087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.770115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.770203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.770322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.770350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.770438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.770561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.770587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.770715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.770860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.770887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.770987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.771084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.771111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.771227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.771377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.771403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.771525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.771685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.771712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.771807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.771964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.771992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.772143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.772276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.772320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.772438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.772552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.772580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.772670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.772796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.772823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.772974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.773077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.773106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.773267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.773385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.773412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.773540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.773693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.773720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.573 qpair failed and we were unable to recover it. 00:30:34.573 [2024-11-30 04:32:24.773848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.774012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.573 [2024-11-30 04:32:24.774039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.774158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.774252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.774281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.774407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.774531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.774558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.774654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.774768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.774795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.774913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.775046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.775074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.775193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.775281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.775308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.775463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.775584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.775612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.775736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.775831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.775860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.775987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.776136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.776163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.776255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.776406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.776432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.776560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.776706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.776733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.776828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.776953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.776988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.777082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.777233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.777261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.777382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.777499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.777526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.777647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.777757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.777784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.777900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.778023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.778068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.778166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.778286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.778313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.778434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.778550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.778576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.778674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.778785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.778811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.778943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.779060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.779087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.779186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.779304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.779331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.779427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.779570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.779597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.779686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.779830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.779857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.779983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.780068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.780095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.780222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.780383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.780409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.780503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.780654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.780681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.574 qpair failed and we were unable to recover it. 00:30:34.574 [2024-11-30 04:32:24.780798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.780893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.574 [2024-11-30 04:32:24.780920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.781028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.781120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.781146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.781302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.781440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.781469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.781611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.781732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.781758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.781889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.782038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.782083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.782229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.782389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.782432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.782578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.782676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.782703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.782854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.782950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.782985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.783107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.783232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.783278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.783430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.783552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.783580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.783702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.783827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.783853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.783983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.784123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.784166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.784337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.784478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.784504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.784626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.784716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.784748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.784899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.785041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.785087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.785221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.785340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.785370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.785535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.785680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.785707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.785831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.785951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.785987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.786125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.786278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.786307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.786503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.786622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.786649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.786771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.786862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.786888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.787006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.787095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.787122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.787276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.787424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.787450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.787571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.787684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.787715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.787875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.788019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.788049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.788211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.788369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.788413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.788528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.788675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.575 [2024-11-30 04:32:24.788701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.575 qpair failed and we were unable to recover it. 00:30:34.575 [2024-11-30 04:32:24.788822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.788931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.788965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.789119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.789243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.789270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.789389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.789504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.789531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.789622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.789707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.789733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.789813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.789907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.789934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.790068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.790169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.790196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.790310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.790463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.790495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.790585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.790707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.790733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.790854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.790938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.790983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.791089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.791183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.791208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.791331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.791479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.791505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.791622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.791747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.791775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.791894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.792016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.792045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.792145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.792244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.792272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.792416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.792543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.792569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.792686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.792796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.792822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.792936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.793083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.793132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.793300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.793435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.793462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.793607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.793724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.793750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.793862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.793990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.794024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.794144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.794232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.794258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.794403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.794521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.794547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.794664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.794756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.794783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.794904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.795021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.576 [2024-11-30 04:32:24.795048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.576 qpair failed and we were unable to recover it. 00:30:34.576 [2024-11-30 04:32:24.795138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.795258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.795285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.795414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.795531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.795557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.795702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.795848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.795875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.796025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.796209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.796252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.796423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.796560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.796587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.796709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.796831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.796857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.796984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.797073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.797101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.797193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.797340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.797367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.797492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.797611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.797638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.797783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.797887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.797913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.798039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.798208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.798234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.798382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.798502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.798528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.798649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.798796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.798823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.798945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.799104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.799131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.799253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.799385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.799411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.799505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.799625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.799654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.799779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.799871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.799900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.800041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.800208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.800236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.800362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.800487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.800516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.800642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.800763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.800790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.800946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.801045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.801073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.801193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.801280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.801307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.801410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.801535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.801563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.801662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.801780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.801806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.801932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.802070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.802097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.802198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.802328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.802354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.802507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.802605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.802632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.802780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.802897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.802924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.803093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.803244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.577 [2024-11-30 04:32:24.803272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.577 qpair failed and we were unable to recover it. 00:30:34.577 [2024-11-30 04:32:24.803365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.803487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.803513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.803635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.803725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.803752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.803851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.803978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.804006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.804155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.804280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.804308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.804440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.804582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.804609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.804702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.804799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.804825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.804911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.805038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.805065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.805194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.805347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.805375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.805466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.805587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.805616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.805733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.805828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.805854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.805981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.806101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.806129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.806225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.806376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.806403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.806525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.806647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.806674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.806798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.806886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.806913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.807042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.807166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.807194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.807321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.807463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.807489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.807601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.807750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.807777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.807881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.807976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.808005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.808093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.808231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.808275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.808369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.808509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.808535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.808661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.808790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.808818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.808936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.809068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.809096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.809248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.809374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.809401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.809563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.809683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.809708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.809839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.809925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.809952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.810084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.810230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.810257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.810380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.810469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.810498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.810643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.810786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.810814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.578 qpair failed and we were unable to recover it. 00:30:34.578 [2024-11-30 04:32:24.810935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.811073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.578 [2024-11-30 04:32:24.811100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.811221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.811370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.811397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.811518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.811631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.811658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.811753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.811904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.811931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.812052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.812217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.812243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.812341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.812484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.812514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.812654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.812763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.812794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.812926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.813058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.813091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.813228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.813361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.813389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.813497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.813658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.813690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.813852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.813997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.814024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.814184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.814329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.814358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.814459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.814592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.814621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.814755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.814888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.814919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.815072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.815223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.815250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.815353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.815480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.815508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.815617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.815773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.815802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.815938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.816084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.816111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.816232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.816331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.816360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.816477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.816606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.816631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.816772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.816906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.816934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.817113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.817238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.817266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.817414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.817572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.817603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.817745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.817880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.817908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.818053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.818144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.818169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.818322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.818421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.818450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.818564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.818700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.818730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.818862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.819033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.579 [2024-11-30 04:32:24.819060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.579 qpair failed and we were unable to recover it. 00:30:34.579 [2024-11-30 04:32:24.819218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.819405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.819434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.819567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.819733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.819764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.819939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.820063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.820090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.820221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.820346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.820374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.820525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.820643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.820677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.820815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.820953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.820992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.821142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.821240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.821268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.821430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.821539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.821569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.821696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.821814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.821844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.821944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.822092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.822126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.822266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.822433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.822463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.822599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.822731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.822761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.822865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.823035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.823064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.823197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.823302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.823330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.823462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.823621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.823651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.823778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.823909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.823939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.824096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.824257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.824286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.824406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.824554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.824584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.824779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.824886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.824915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.825104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.825226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.825271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.825406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.825507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.825536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.825671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.825822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.825852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.826005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.826096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.826124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.826248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.826344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.826372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.826545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.826634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.826660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.826826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.826913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.826939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.827108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.827228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.827272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.827388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.827519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.827548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.580 qpair failed and we were unable to recover it. 00:30:34.580 [2024-11-30 04:32:24.827688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.827881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.580 [2024-11-30 04:32:24.827916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.828120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.828244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.828274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.828416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.828551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.828582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.828740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.828899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.828928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.829107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.829280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.829310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.829413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.829548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.829578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.829775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.829941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.829981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.830122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.830216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.830243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.830371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.830534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.830564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.830696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.830826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.830855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.831000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.831122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.831153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.831299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.831423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.831452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.831545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.831652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.831681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.831792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.831946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.831987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.832088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.832211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.832239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.832332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.832469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.832498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.832670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.832785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.832811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.832940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.833049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.833078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.833229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.833352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.833379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.833536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.833631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.833662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.833798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.833965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.834001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.834161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.834331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.834358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.834446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.834569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.834596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.581 [2024-11-30 04:32:24.834690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.834837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.581 [2024-11-30 04:32:24.834868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.581 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.835022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.835151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.835178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.835332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.835463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.835492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.835629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.835748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.835776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.835875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.836027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.836055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.836228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.836326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.836356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.836515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.836638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.836664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.836751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.836874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.836907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.837040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.837177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.837208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.837308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.837438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.837468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.837629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.837751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.837780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.837905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.838005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.838031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.838160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.838248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.838273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.838364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.838446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.838472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.838595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.838756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.838799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.838921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.839089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.839134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.839267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.839371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.839414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.839540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.839672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.839705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.839857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.840023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.840054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.840169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.840282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.840308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.840415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.840574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.840604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.840769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.840901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.840930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.841094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.841262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.841293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.841424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.841549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.841576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.841703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.841846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.841875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.842029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.842158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.842185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.842330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.842460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.842490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.842659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.842786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.842816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.842968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.843105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.843131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.843240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.843387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.843414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.582 qpair failed and we were unable to recover it. 00:30:34.582 [2024-11-30 04:32:24.843533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.582 [2024-11-30 04:32:24.843700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.843729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.843877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.843997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.844024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.844254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.844473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.844525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.844699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.844845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.844870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.844989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.845115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.845140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.845268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.845386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.845412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.845651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.845838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.845869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.846056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.846176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.846203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.846370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.846477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.846565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.846672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.846815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.846842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.846969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.847185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.847222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.847397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.847523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.847552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.847708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.847842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.847884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.848005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.848092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.848119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.848204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.848337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.848381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.848568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.848717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.848744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.848883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.848986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.849037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.849154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.849268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.849294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.849439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.849577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.849604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.849717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.849840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.849866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.849985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.850112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.850138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.850292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.850437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.850463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.850586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.850707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.850733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.850834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.850951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.850983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.851118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.851209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.851238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.851330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.851443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.851470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.851573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.851661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.851686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.851776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.851916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.851944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.852078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.852203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.852234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.852358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.852501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.852528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.852663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.852790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.583 [2024-11-30 04:32:24.852819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.583 qpair failed and we were unable to recover it. 00:30:34.583 [2024-11-30 04:32:24.852979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.853115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.853141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.853289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.853444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.853470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.853622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.853737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.853763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.853946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.854101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.854127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.854222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.854302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.854329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.854451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.854596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.854623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.854748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.854864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.854890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.855088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.855205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.855235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.855374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.855519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.855545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.855689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.855807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.855834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.855925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.856048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.856075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.856187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.856326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.856354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.856494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.856608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.856634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.856814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.856972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.857004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.857146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.857272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.857298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.857413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.857539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.857564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.857693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.857826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.857854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.857995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.858115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.858141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.858271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.858361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.858387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.858530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.858698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.858740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.858888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.859019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.859049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.859152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.859318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.859344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.859442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.859573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.859600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.859746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.859896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.859925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.860088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.860208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.860235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.860337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.860484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.860511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.860681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.860853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.860883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.861016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.861111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.861138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.861269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.861426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.861452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.861568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.861675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.861705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.861859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.861951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.861986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.862161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.862285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.862329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.862474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.862572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.862598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.584 qpair failed and we were unable to recover it. 00:30:34.584 [2024-11-30 04:32:24.862740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.862829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.584 [2024-11-30 04:32:24.862855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.862982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.863108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.863133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.863281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.863402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.863427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.863578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.863704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.863731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.863880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.863971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.864007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.864148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.864292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.864321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.864469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.864586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.864613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.864734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.864878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.864908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.865059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.865176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.865202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.865331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.865452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.865480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.865580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.865730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.865759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.865905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.866066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.866094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.866231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.866382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.866409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.866562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.866712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.866741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.866874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.867033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.867061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.867231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.867385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.867416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.867558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.867705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.867734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.867886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.868022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.868048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.868180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.868311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.868346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.868478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.868634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.868664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.868775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.868936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.868978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.869116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.869276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.869310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.871973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.872137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.872165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.872328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.872503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.872534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.872675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.872765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.872793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.872937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.873089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.873117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.873260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.873382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.873409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.585 [2024-11-30 04:32:24.873533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.873624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.585 [2024-11-30 04:32:24.873651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.585 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.873781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.873877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.873931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.874125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.874213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.874247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.874373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.874476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.874504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.874652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.874825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.874854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.875014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.875133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.875161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.875265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.875451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.875478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.875630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.875778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.875805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.875903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.876027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.876054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.876174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.876273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.876298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.876444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.877971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.878015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.878187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.878320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.878364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.878510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.878642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.878672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.878815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.878998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.879027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.879226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.879386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.879414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.879547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.879705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.879733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.879883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.880044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.880072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.880159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.880298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.880325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.880537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.880735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.880765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.881036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.881164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.881200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.881443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.881598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.881636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.881847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.881987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.882033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.882181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.882345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.882376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.882518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.882610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.882636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.882724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.882829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.882857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.883038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.883157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.883184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.883351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.883503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.883529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.883648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.883746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.883773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.883898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.884003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.884037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.884136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.884325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.884352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.884481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.884618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.884650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.884796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.884895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.884921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.586 [2024-11-30 04:32:24.885044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.885187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.586 [2024-11-30 04:32:24.885213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.586 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.885364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.885486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.885514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.885606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.885750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.885778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.885905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.886009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.886036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.886162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.886265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.886291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.886410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.886574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.886602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.886707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.886845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.886871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.887003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.887091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.887116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.887212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.887308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.887334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.887426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.887541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.887568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.887676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.887803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.887828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.887929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.888058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.888085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.888173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.888265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.888292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.888389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.888532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.888559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.888682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.888826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.888852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.888974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.889074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.889099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.889192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.889313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.889339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.889440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.889528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.889555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.889713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.889860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.889885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.889986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.890084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.890115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.890217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.890360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.890385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.890481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.890601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.890628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.890732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.890850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.890876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.890996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.891086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.891112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.891214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.891370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.891397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.891514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.891630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.891656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.891807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.891931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.891964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.892066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.892187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.892212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.892298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.892422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.892448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.892573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.892697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.892723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.892824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.892941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.892971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.893063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.893176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.893202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.893301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.893421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.893447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.893572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.893694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.893719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.587 qpair failed and we were unable to recover it. 00:30:34.587 [2024-11-30 04:32:24.893812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.587 [2024-11-30 04:32:24.893956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.893991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.894090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.894187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.894212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.894332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.894451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.894477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.894628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.894726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.894751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.894846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.894929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.894956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.895064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.895182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.895208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.895362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.895459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.895486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.895597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.895683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.895709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.895799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.895885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.895908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.896056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.896197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.896224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.896354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.896576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.896603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.896725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.896813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.896839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.896936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.897060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.897087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.897185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.897330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.897361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.897493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.897580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.897607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.897702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.897847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.897873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.898001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.898124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.898150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.898271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.898476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.898502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.898623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.898768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.898795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.898919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.899045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.899073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.899191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.899309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.899335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.899458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.899556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.899583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.899703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.899854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.899881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.900077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.900220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.900252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.900399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.900520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.900546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.900693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.900815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.900841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.900986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.901110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.901136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.901228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.901347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.901375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.901495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.901719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.901746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.901869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.901969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.901997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.902113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.902233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.902260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.902390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.902511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.902537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.902622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.902768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.902795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.902918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.903048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.903076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.903203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.903323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.903350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.588 qpair failed and we were unable to recover it. 00:30:34.588 [2024-11-30 04:32:24.903452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.903541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.588 [2024-11-30 04:32:24.903568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.903661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.903782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.903809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.903929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.904060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.904088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.904209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.904353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.904380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.904499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.904601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.904628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.904775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.904900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.904926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.905085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.905210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.905238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.905388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.905508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.905537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.905663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.905792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.905821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.905983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.906079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.906106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.906233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.906359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.906386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.906561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.906683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.906709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.906828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.906964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.906991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.907109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.907225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.907251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.907371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.907461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.907487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.907591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.907684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.907712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.907887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.908001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.908028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.908123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.908252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.908279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.908396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.908516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.908542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.908663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.908774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.908804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.908973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.909105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.909132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.909256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.909373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.909400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.909485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.909582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.909608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.909732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.909822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.909849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.909974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.910101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.910127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.910249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.910369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.910395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.910490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.910569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.910594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.910684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.910802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.910828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.910953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.911076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.911103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.911252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.911343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.911370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.911491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.911575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.911602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.589 qpair failed and we were unable to recover it. 00:30:34.589 [2024-11-30 04:32:24.911694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.911812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.589 [2024-11-30 04:32:24.911839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.912010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.912138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.912164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.912287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.912435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.912462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.912640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.912759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.912786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.912927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.913073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.913100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.913216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.913360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.913386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.913583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.913699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.913725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.913845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.913964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.913991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.914112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.914230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.914261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.914388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.914481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.914508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.914629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.914753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.914780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.914903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.915029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.915057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.915161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.915307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.915333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.915460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.915583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.915610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.915731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.915825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.915852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.915940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.916042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.916068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.916162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.916311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.916355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.916490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.916664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.916691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.916836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.916955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.916990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.917121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.917324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.917350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.917473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.917588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.917614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.917709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.917790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.917815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.590 [2024-11-30 04:32:24.917953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.918095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.590 [2024-11-30 04:32:24.918125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.590 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.918234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.918357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.918385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.918532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.918714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.918741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.918841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.918937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.919000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.919137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.919287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.919313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.919440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.919526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.919553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.919700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.919826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.919852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.919963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.920107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.920134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.920226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.920346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.920372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.920470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.920616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.920643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.920791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.920915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.920944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.921065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.921157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.921183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.921300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.921446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.921473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.921624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.921720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.921747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.921851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.921998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.922025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.922119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.922222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.922249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.922366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.922510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.922537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.922690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.922813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.922838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.922969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.923095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.923122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.923264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.923384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.923411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.923555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.923758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.923788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.923904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.924052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.924079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.924166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.924251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.924278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.924396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.924524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.924551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.924645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.924736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.924763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.924882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.924988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.925015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.925213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.925304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.925330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.925474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.925600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.925626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.925751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.925865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.925891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.591 qpair failed and we were unable to recover it. 00:30:34.591 [2024-11-30 04:32:24.925981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.591 [2024-11-30 04:32:24.926128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.926156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.926356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.926489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.926518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.926677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.926850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.926877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.926978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.927063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.927090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.927285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.927406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.927443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.927565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.927678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.927712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.927831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.927923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.927949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.928072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.928217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.928243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.928393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.928502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.928531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.928729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.928851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.928877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.928981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.929078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.929103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.929225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.929351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.929377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.929464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.929574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.929600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.929724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.929849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.929876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.929998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.930091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.930118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.930230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.930320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.930349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.930465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.930579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.930605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.930697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.930806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.930832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.930946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.931036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.931063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.931162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.931251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.931277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.931427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.931527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.931554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.931678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.931771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.931798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.931891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.932004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.932032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.932127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.932216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.932241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.932393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.932543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.932586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.932687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.932858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.932885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.932997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.933084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.933111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.933232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.933321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.933363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.933507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.933654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.933680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.592 qpair failed and we were unable to recover it. 00:30:34.592 [2024-11-30 04:32:24.933840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.592 [2024-11-30 04:32:24.933937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.933971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.934070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.934161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.934187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.934285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.934368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.934393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.934479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.934596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.934624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.934725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.934817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.934843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.934993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.935084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.935111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.935236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.935324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.935350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.935500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.935591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.935618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.935732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.935820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.935847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.935939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.936066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.936094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.936223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.936319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.936346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.936497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.936651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.936676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.936780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.936860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.936886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.937008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.937126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.937152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.937244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.937362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.937389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.937509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.937622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.937648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.937741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.937867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.937893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.938016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.938110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.938136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.938279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.938415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.938444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.938609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.938725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.938752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.938853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.938977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.939013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.939135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.939266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.939293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.939409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.939530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.939557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.939651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.939762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.939788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.939930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.940130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.940157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.940340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.940464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.593 [2024-11-30 04:32:24.940491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.593 qpair failed and we were unable to recover it. 00:30:34.593 [2024-11-30 04:32:24.940615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.940700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.940726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.940840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.940964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.940991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.941122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.941252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.941279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.941477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.941594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.941621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.941715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.941826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.941857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.941981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.942105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.942131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.942217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.942329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.942355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.942504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.942635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.942663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.942790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.942921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.942973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.943109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.943233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.943260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.943457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.943569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.943595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.943696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.943818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.943844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.944004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.944096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.944121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.944287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.944408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.944434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.944567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.944700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.944747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.944906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.945036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.945063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.945185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.945285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.945312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.945431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.945627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.945671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.945843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.945985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.946023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.946142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.946266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.946292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.946414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.946533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.946559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.946682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.946775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.946801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.946893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.947021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.947048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.594 qpair failed and we were unable to recover it. 00:30:34.594 [2024-11-30 04:32:24.947198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.594 [2024-11-30 04:32:24.947306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.947333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.947445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.947560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.947586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.947708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.947841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.947867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.947997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.948107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.948133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.948255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.948351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.948381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.948504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.948652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.948681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.948851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.948942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.948973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.949069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.949161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.949187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.949279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.949396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.949423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.949570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.949684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.949711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.949834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.949948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.949982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.950079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.950176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.950202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.950344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.950449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.950479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.950613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.950783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.950812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.951016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.951144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.951170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.951294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.951468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.951497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.951641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.951740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.951766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.951914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.952073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.952100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.952193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.952338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.952364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.952600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.952782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.952811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.952905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.953055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.953083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.953206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.953361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.953388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.953534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.953659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.953686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.953851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.954000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.954030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.954180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.954322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.954349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.954478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.954596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.954623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.954769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.954915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.954941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.955069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.955170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.955196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.955321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.955432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.955458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.595 qpair failed and we were unable to recover it. 00:30:34.595 [2024-11-30 04:32:24.955574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.955694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.595 [2024-11-30 04:32:24.955721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.955844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.956002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.956029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.956214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.956309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.956336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.956478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.956626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.956673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.956795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.956940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.956972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.957073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.957220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.957246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.957419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.957626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.957653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.957772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.957895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.957929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.958046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.958134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.958160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.958283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.958399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.958426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.958570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.958707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.958735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.958912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.959047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.959074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.959215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.959364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.959391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.959492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.959615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.959648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.959763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.959886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.959930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.960050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.960196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.960222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.960312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.960456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.960482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.960569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.960661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.960688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.960804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.960938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.960977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.961122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.961218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.961245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.961335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.961480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.961506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.961604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.961700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.961726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.961873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.961955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.961992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.962119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.962241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.962267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.962410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.962538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.962568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.962686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.962807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.962833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.962926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.963028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.963055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.963152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.963268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.963294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.963387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.963506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.963533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.596 qpair failed and we were unable to recover it. 00:30:34.596 [2024-11-30 04:32:24.963684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.963829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.596 [2024-11-30 04:32:24.963873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.964016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.964143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.964172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.964303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.964441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.964470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.964583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.964695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.964722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.964845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.964986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.965014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.965112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.965227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.965254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.965372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.965484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.965510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.965596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.965737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.965763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.965931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.966093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.966135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.966263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.966404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.966433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.966586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.966732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.966758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.966907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.967006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.967031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.967122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.967207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.967234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.967387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.967533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.967560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.967710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.967830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.967857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.967991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.968087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.968114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.968264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.968358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.968385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.968559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.968690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.968719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.968857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.968984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.969014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.969115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.969280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.969307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.969430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.969525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.969552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.969637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.969780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.969806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.969951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.970129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.970159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.970302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.970425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.970453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.970586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.970713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.970739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.970834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.970963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.970990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.971090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.971180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.971207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.971331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.971421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.971448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.971567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.971661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.971688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.597 qpair failed and we were unable to recover it. 00:30:34.597 [2024-11-30 04:32:24.971824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.971911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.597 [2024-11-30 04:32:24.971937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.972042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.972157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.972184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.972308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.972424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.972450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.972574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.972687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.972713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.972818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.972980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.973008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.973102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.973247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.973273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.973398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.973516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.973547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.973695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.973863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.973905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.974055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.974182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.974209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.974344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.974492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.974518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.974666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.974786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.974812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.974929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.975060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.975087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.975271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.975392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.975419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.975561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.975702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.975728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.975877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.975988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.976015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.976133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.976219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.976246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.976362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.976452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.976479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.976574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.976687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.976714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.976863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.976986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.977013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.977101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.977187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.977213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.977332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.977456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.977500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.977670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.977782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.977808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.977900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.978011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.978038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.978158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.978281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.978307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.978452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.978548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.978578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.978721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.978873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.978900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.978994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.979107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.979134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.979229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.979319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.979346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.979512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.979644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.979674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.598 qpair failed and we were unable to recover it. 00:30:34.598 [2024-11-30 04:32:24.979832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.598 [2024-11-30 04:32:24.979933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.979970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.980108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.980217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.980246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.980388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.980539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.980565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.980681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.980772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.980799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.980921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.981066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.981094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.981241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.981386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.981413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.981565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.981683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.981709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.981806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.981925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.981951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.982093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.982223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.982266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.982423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.982568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.982594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.982708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.982854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.982880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.983038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.983131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.983158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.983310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.983402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.983429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.983546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.983693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.983719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.983812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.983909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.983936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.984042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.984177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.984220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.984341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.984470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.984497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.984595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.984707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.984734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.984858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.985009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.985036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.985160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.985249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.985275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.985366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.985497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.985524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.985647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.985744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.985771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.985891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.985989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.986017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.986103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.986184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.986211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.986333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.986450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.986477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.986578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.986695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.986722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.599 qpair failed and we were unable to recover it. 00:30:34.599 [2024-11-30 04:32:24.986835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.599 [2024-11-30 04:32:24.986931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.986966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.987066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.987182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.987209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.987297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.987390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.987421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.987537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.987661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.987687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.987807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.988020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.988048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.988140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.988287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.988315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.988437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.988550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.988576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.988667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.988759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.988786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.988878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.988968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.988995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.989110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.989240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.989266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.989404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.989502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.989531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.989660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.989798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.989825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.989919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.990046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.990073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.990191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.990278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.990305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.990393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.990535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.990562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.990652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.990741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.990769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.990885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.991000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.991028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.991144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.991241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.991267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.991412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.991561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.991588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.991708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.991831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.991858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.991986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.992132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.992158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.992375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.992472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.992498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.992647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.992761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.992787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.992935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.993076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.993105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.993263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.993405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.993432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.993555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.993671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.993698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.993826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.993990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.994020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.994190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.994311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.994338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.994472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.994589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.994615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.600 qpair failed and we were unable to recover it. 00:30:34.600 [2024-11-30 04:32:24.994792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.600 [2024-11-30 04:32:24.994916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.994942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.995047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.995192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.995219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.995344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.995458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.995484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.995574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.995666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.995694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.995848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.995991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.996019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.996131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.996248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.996275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.996387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.996504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.996548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.996665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.996789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.996815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.996942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.997127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.997155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.997255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.997339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.997366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.997500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.997631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.997657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.997774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.997887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.997914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.998050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.998136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.998163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.998285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.998398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.998425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.998551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.998666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.998693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.998827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.998940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.998974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.999125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.999266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.999292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.999412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.999556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.999582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.999689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.999792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:24.999821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:24.999935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.000067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.000095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:25.000241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.000387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.000413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:25.000510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.000659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.000686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:25.000857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.001002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.001030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:25.001151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.001267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.001294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:25.001409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.001528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.001562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:25.001682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.001803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.001829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:25.001949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.002080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.002106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:25.002227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.002346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.002372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:25.002540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.002705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.002731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.601 qpair failed and we were unable to recover it. 00:30:34.601 [2024-11-30 04:32:25.002944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.601 [2024-11-30 04:32:25.003130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.003157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.003301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.003439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.003468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.003634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.003782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.003808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.003904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.004057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.004084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.004180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.004261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.004288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.004410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.004533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.004564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.004682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.004793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.004819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.004939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.005066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.005093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.005292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.005466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.005493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.005615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.005810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.005837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.006034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.006153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.006180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.006297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.006494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.006559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.006687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.006825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.006851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.006974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.007098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.007125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.007224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.007340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.007366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.007516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.007660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.007687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.007818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.007911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.007937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.008136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.008286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.008312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.008429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.008576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.008603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.008796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.008933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.008967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.009090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.009224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.009253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.009400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.009543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.009570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.009697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.009787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.009814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.009949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.010053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.010081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.010207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.010292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.010318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.010449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.010564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.010590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.010728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.010820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.010847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.010982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.011118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.011148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.011315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.011439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.011465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.602 qpair failed and we were unable to recover it. 00:30:34.602 [2024-11-30 04:32:25.011560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.011706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.602 [2024-11-30 04:32:25.011732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.011816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.011985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.012013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.012166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.012259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.012286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.012410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.012523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.012550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.012694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.012785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.012829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.012991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.013165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.013194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.013353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.013519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.013547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.013667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.013815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.013842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.013990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.014105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.014131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.014252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.014340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.014367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.014463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.014576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.014603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.014773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.014880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.014909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.015021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.015157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.015184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.015306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.015455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.015482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.015631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.015720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.015747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.015867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.016025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.016052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.016165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.016258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.016285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.016410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.016506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.016533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.016671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.016796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.016826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.017006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.017127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.017155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.017282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.017386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.017416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.017563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.017657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.017683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.017815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.017908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.017934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.018035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.018231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.018257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.018403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.018525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.018552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.603 [2024-11-30 04:32:25.018648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.018762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.603 [2024-11-30 04:32:25.018788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.603 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.018940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.019059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.019087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.019185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.019296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.019327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.019413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.019535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.019561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.019683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.019809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.019837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.020004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.020099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.020129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.020291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.020420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.020449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.020598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.020689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.020716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.020834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.021032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.021060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.021155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.021248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.021274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.021402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.021546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.021575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.021687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.021850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.021880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.022026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.022221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.022248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.022402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.022525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.022552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.022680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.022785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.022811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.022905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.023048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.023076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.023172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.023262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.023289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.023404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.023519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.023548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.023751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.023888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.023914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.024071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.024194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.024220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.024318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.024434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.024461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.024578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.024671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.024698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.024823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.024971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.025001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.025154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.025274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.025298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.025386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.025531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.025555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.025728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.025887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.025915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.026051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.026187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.026212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.026305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.026399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.026424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.026549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.026667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.026691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.604 [2024-11-30 04:32:25.026802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.026921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.604 [2024-11-30 04:32:25.026949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.604 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.027076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.027203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.027231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.027360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.027488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.027513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.027636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.027758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.027782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.027910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.028036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.028061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.028187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.028309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.028335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.028477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.028607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.028635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.028782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.028928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.028953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.029101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.029230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.029272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.029356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.029451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.029476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.029603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.029722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.029747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.029902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.030024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.030050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.030174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.030254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.030278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.030428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.030545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.030569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.030689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.030818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.030843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.030941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.031064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.031090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.031209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.031317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.031342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.031441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.031562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.031588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.031682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.031800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.031827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.031948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.032080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.032106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.032200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.032316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.032342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.032459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.032542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.032568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.032714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.032835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.032861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.032985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.033129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.033155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.033300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.033456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.033490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.033624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.033741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.033768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.033916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.034042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.034070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.034195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.034284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.034311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.034426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.034537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.034564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.605 qpair failed and we were unable to recover it. 00:30:34.605 [2024-11-30 04:32:25.034654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.605 [2024-11-30 04:32:25.034823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.034852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.035019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.035141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.035169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.035318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.035465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.035492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.035598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.035720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.035746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.035870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.036021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.036048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.036181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.036334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.036377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.036526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.036612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.036638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.036774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.036916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.036942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.037077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.037208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.037234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.037325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.037453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.037479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.037566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.037680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.037706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.037824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.037912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.037939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.038089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.038203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.038229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.038364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.038500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.038529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.038646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.038772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.038798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.038915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.039021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.039050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.039178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.039275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.039301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.039432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.039522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.039547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.039697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.039817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.039845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.039972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.040095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.040121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.040240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.040368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.040395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.040535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.040709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.040735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.040909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.041064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.041091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.041215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.041339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.041365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.041489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.041586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.041613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.041730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.041827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.041853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.042009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.042132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.042175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.042319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.042502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.042529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.042643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.042734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.042761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.606 qpair failed and we were unable to recover it. 00:30:34.606 [2024-11-30 04:32:25.042847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.606 [2024-11-30 04:32:25.042987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.043015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.043105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.043198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.043225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.043346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.043492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.043518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.043639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.043782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.043811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.043920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.044171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.044202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.044344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.044467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.044495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.044622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.044737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.044763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.044856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.044950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.044985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.045103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.045248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.045275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.045396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.045515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.045541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.045692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.045825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.045854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.045991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.046086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.046115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.046241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.046377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.046403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.046529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.046646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.046673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.046763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.046876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.046903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.047024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.047113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.047139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.047288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.047414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.047440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.047563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.047658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.047688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.047800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.047922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.047951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.048096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.048225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.048269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.048432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.048544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.048571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.048662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.048790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.048817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.048935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.049035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.049062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.049149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.049263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.049289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.049388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.049507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.049537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.049661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.049815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.049845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.049981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.050141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.050167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.050300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.050455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.050486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.050617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.050737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.050763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.607 qpair failed and we were unable to recover it. 00:30:34.607 [2024-11-30 04:32:25.050849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.050934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.607 [2024-11-30 04:32:25.050982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.051075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.051221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.051247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.051389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.051532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.051562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.051710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.051857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.051883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.051972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.052091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.052118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.052246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.052423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.052452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.052578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.052713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.052743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.052892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.053025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.053053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.053148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.053269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.053296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.053395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.053517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.053543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.053682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.053817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.053847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.053995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.054167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.054196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.054293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.054422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.054449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.054567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.054694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.054720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.054840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.054946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.054983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.055154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.055240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.055269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.055404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.055526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.055553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.055702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.055841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.055870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.056037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.056171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.056213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.056334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.056467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.056497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.056670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.056791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.056817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.056942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.057102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.057129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.057223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.057336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.057362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.057486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.057568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.057594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.057740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.057823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.057848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.057973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.058099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.058125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.608 [2024-11-30 04:32:25.058252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.058420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.608 [2024-11-30 04:32:25.058449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.608 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.058588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.058758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.058802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.059040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.059155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.059181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.059272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.059370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.059397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.059484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.059630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.059656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.059747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.059860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.059886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.059983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.060131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.060157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.060243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.060397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.060439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.060587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.060708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.060735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.060828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.060988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.061015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.061140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.061261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.061288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.061402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.061562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.061590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.061724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.061827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.061871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.062020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.062119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.062146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.062266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.062353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.062381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.062519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.062690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.062716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.062842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.063015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.063046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.063185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.063276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.063303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.063427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.063571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.063598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.063738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.063878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.063904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.064006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.064121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.064148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.064241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.064326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.064354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.064500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.064631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.064657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.064779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.064867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.064898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.065006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.065126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.065152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.065301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.065424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.065451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.065539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.065684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.065711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.065830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.065970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.065998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.066127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.066249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.609 [2024-11-30 04:32:25.066276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.609 qpair failed and we were unable to recover it. 00:30:34.609 [2024-11-30 04:32:25.066425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.066521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.066548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.066665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.066744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.066771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.066856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.066948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.067003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.067102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.067214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.067240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.067326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.067449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.067476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.067605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.067701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.067728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.067837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.067974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.068004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.068145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.068288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.068315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.068411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.068502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.068530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.068617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.068746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.068772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.068931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.069056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.069083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.069221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.069324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.069353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.069496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.069614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.069641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.069794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.069912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.069938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.070083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.070182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.070209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.070337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.070456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.070483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.070608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.070725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.070751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.070865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.070969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.070996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.071113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.071226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.071252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.071367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.071530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.071556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.071678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.071801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.071827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.071917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.072052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.072080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.072228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.072391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.072417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.072514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.072637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.072664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.072780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.072863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.072889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.072991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.073100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.073127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.073265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.073405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.073434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.073569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.073685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.073712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.073829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.073926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.610 [2024-11-30 04:32:25.073953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.610 qpair failed and we were unable to recover it. 00:30:34.610 [2024-11-30 04:32:25.074062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.074213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.074239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.074385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.074510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.074540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.074670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.074776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.074802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.074921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.075059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.075087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.075208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.075337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.075364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.075515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.075633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.075660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.075801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.075952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.075985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.076150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.076308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.076334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.076434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.076547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.076573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.076746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.076918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.076943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.077078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.077193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.077219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.077365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.077513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.077539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.077687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.077808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.077835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.077925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.078025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.078052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.078207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.078369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.078399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.078527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.078661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.078690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.078834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.078983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.079015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.079122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.079259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.079288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.079436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.079557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.079584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.079671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.079808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.079837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.079974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.080058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.080084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.080208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.080355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.080380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.080482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.080665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.080691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.080841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.081000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.081031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.081182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.081271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.081299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.081448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.081591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.081618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.081742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.081846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.081876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.081989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.082164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.082193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.082369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.082492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.611 [2024-11-30 04:32:25.082519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.611 qpair failed and we were unable to recover it. 00:30:34.611 [2024-11-30 04:32:25.082698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.082789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.082818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.082978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.083073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.083102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.083214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.083343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.083372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.083516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.083633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.083661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.083812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.083984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.084012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.084114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.084257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.084284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.084424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.084521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.084550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.084695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.084820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.084846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.084973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.085094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.085121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.085209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.085294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.085321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.085445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.085567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.085594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.085692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.085815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.085842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.085968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.086089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.086116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.086270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.086417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.086443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.086609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.086750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.086777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.086891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.086989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.087018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.087191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.087372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.087425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.087600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.087713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.087741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.087879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.088031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.088059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.088212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.088302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.088329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.088442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.088598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.088624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.088720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.088818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.088861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.088998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.089158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.089187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.089322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.089445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.089471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.089606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.089705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.089748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.612 [2024-11-30 04:32:25.089841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.089967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.612 [2024-11-30 04:32:25.089994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.612 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.090089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.090208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.090234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.090326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.090421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.090447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.090565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.090689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.090718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.090813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.090928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.090955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.091115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.091247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.091276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.091424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.091547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.091574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.091698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.091794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.091836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.091933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.092073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.092100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.092193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.092342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.092369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.092517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.092630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.092657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.092821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.092971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.092999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.093101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.093222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.093267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.093416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.093566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.093597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.093723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.093874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.093900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.094073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.094220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.094246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.094394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.094520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.094549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.094689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.094853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.094879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.095021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.095142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.095169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.095285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.095404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.095430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.095519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.095634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.095660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.095759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.095843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.095869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.095964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.096084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.096111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.096198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.096287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.096313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.096468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.096647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.096674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.096769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.096869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.096898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.097049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.097173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.097211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.097333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.097417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.097443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.097540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.097653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.097680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.613 [2024-11-30 04:32:25.097774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.097923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.613 [2024-11-30 04:32:25.097952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.613 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.098098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.098213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.098240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.098325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.098470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.098496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.098623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.098745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.098771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.098893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.099004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.099031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.099159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.099280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.099306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.099420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.099550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.099579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.099688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.099822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.099849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.099939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.100076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.100103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.100222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.100348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.100374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.100513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.100649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.100678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.100825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.100921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.100949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.101107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.101227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.101254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.101348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.101443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.101470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.101588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.101714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.101741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.101855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.101969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.102006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.102099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.102226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.102256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.102407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.102546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.102573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.102697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.102816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.102843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.102940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.103073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.103102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.103206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.103337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.103366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.103500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.103596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.103623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.103713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.103837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.103863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.103949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.104102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.104129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.104248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.104361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.104387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.104508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.104664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.104691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.104778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.104926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.104955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.105107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.106203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.106241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.614 [2024-11-30 04:32:25.106403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.106515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.614 [2024-11-30 04:32:25.106540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.614 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.106694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.106816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.106857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.107006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.107130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.107156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.107322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.107428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.107458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.107593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.107720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.107749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.107893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.107992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.108029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.108123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.108225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.108254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.108395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.108484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.108514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.108647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.108745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.108787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.108884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.108997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.109024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.109114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.109205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.109231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.109353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.109481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.109507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.109627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.109756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.109785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.109908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.110020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.110047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.110184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.110301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.110330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.110433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.110541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.110567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.110713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.110803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.110830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.110923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.111051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.111083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.111220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.111380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.111409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.111554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.111647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.111673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.111794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.111972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.112014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.112131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.112238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.112264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.112361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.112453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.112479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.112595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.112690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.112731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.112864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.113019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.113046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.113142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.113241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.113268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.113357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.113439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.113466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.113596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.113729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.113773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.113873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.114003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.114030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.615 [2024-11-30 04:32:25.114115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.114269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.615 [2024-11-30 04:32:25.114295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.615 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.114418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.114503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.114546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.114681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.114813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.114842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.114971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.115090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.115117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.115278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.115400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.115427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.115546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.115661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.115687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.115785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.115868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.115894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.116031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.116127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.116155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.116279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.116400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.116426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.116569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.116703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.116733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.116867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.117001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.117032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.117167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.117282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.117308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.117434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.117551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.117577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.117703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.117790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.117832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.117936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.118081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.118111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.118239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.118401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.118430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.118545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.118667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.118693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.118811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.118934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.118966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.119088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.119218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.119247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.119400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.119525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.119552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.119675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.119796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.119823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.119916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.120054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.120099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.120197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.120326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.120352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.120498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.120647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.120674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.120796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.120893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.120920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.121023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.121135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.121164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.121302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.121468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.121496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.121600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.121703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.121733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.616 [2024-11-30 04:32:25.121848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.121944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.616 [2024-11-30 04:32:25.121990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.616 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.122093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.122185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.122223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.122315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.122437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.122463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.122594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.122713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.122739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.122828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.122940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.122976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.123094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.123258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.123284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.123430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.123552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.123594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.123713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.123805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.123831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.123933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.124049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.124075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.124177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.124311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.124339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.124463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.124588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.124621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.124783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.124997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.125029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.125154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.125258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.125284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.125374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.125495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.125521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.125618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.125708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.125734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.125856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.125990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.126018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.126120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.126249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.126275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.126399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.126490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.126518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.126640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.126761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.126788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.126936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.127052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.127082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.127195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.127335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.127361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.127452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.127569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.127596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.127692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.127814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.127840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.127938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.128037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.617 [2024-11-30 04:32:25.128080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.617 qpair failed and we were unable to recover it. 00:30:34.617 [2024-11-30 04:32:25.128196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.128284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.128310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.128450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.128573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.128600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.128745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.128891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.128917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.129049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.129142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.129169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.129264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.129357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.129383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.129479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.129567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.129593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.129719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.129839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.129866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.129975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.130117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.130146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.130281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.130370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.130396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.130520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.130611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.130638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.130755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.130847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.130874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.131032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.131128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.131155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.131286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.131392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.131418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.131562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.131684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.131711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.131845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.131976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.132030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.132125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.132259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.132286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.132412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.132567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.132608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.132745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.132882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.132909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.133065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.133168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.133195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.133300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.133455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.133481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.133603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.133718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.133744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.133864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.133988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.134023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.134159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.134300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.134329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.134489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.134610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.134639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.134785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.134907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.134933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.135045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.135136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.135162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.135291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.135412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.135438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.135582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.135718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.618 [2024-11-30 04:32:25.135745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.618 qpair failed and we were unable to recover it. 00:30:34.618 [2024-11-30 04:32:25.135893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.136014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.136042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.136182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.136277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.136304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.136394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.136516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.136542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.136668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.136761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.136787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.136909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.136998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.137025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.137117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.137212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.137237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.137334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.137478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.137504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.137629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.137721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.137747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.137843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.137970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.137996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.138093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.138178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.138205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.138358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.138501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.138531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.138621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.138718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.138744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.138888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.139009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.139036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.139134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.139224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.139251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.139344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.139496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.139522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.139681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.139793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.139823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.139938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.140041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.140067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.619 qpair failed and we were unable to recover it. 00:30:34.619 [2024-11-30 04:32:25.140163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.619 [2024-11-30 04:32:25.140264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.908 [2024-11-30 04:32:25.140290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.908 qpair failed and we were unable to recover it. 00:30:34.908 [2024-11-30 04:32:25.140420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.908 [2024-11-30 04:32:25.140515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.908 [2024-11-30 04:32:25.140541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.908 qpair failed and we were unable to recover it. 00:30:34.908 [2024-11-30 04:32:25.140634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.908 [2024-11-30 04:32:25.140729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.140756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.140880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.140977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.141012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.141112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.141198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.141251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.141355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.141454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.141482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.141581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.141738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.141765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.141921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.142040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.142068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.142163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.142281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.142307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.142408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.142497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.142524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.142639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.142748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.142778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.142890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.142990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.143016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.143113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.143206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.143233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.143321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.143407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.143433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.143534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.143655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.143682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.143796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.143893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.143923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.144075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.144170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.144197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.144314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.144404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.144430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.144535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.144642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.144672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.144858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.144967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.144993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.145093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.145183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.145208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.145307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.145394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.145420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.145509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.145593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.145637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.145771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.145903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.145933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.146056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.146175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.146202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.146343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.146433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.146462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.146600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.146722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.146751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.146906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.147061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.147088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.147174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.147269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.147296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.147470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.147563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.147591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.909 [2024-11-30 04:32:25.147716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.147812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.909 [2024-11-30 04:32:25.147841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.909 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.147981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.148072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.148097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.148196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.148308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.148337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.148444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.148543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.148573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.148696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.148805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.148836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.148971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.149058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.149085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.149172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.149310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.149340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.149443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.149537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.149566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.149656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.149765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.149794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.149938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.150042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.150069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.150156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.150260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.150312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.150443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.150599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.150631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.150800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.150902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.150932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.151061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.151151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.151176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.151264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.151432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.151466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.151619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.151728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.151771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.151906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.152006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.152034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.152124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.152217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.152242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.152337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.152458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.152483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.152600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.152692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.152717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.152799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.152915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.152941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.153042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.153159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.153185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.153277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.153378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.153402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.153517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.153610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.153636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.153736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.153854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.153884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.154002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.154095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.154121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.154207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.154336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.154361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.154481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.154560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.154585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.154683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.154805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.154831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.910 qpair failed and we were unable to recover it. 00:30:34.910 [2024-11-30 04:32:25.154976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.910 [2024-11-30 04:32:25.155073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.155099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.155189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.155274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.155306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.155413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.155530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.155556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.155704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.155823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.155848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.155943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.156049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.156094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.156198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.156345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.156370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.156495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.156588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.156613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.156697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.156784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.156810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.156935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.157031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.157057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.157152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.157297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.157322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.157420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.157540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.157565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.157683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.157804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.157829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.157921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.158027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.158052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.158173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.158255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.158280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.158371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.158493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.158519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.158600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.158717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.158742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.158876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.158992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.159018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.159111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.159198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.159224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.159323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.159409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.159435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.159524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.159643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.159668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.159764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.159851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.159877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.160027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.160111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.160136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.160248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.160359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.160384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.160506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.160598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.160624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.160721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.160837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.160862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.160982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.161076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.161101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.161192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.161298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.161324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.161441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.161565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.161590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.911 qpair failed and we were unable to recover it. 00:30:34.911 [2024-11-30 04:32:25.161681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.161798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.911 [2024-11-30 04:32:25.161824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.161913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.162040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.162066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.162185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.162291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.162320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.162424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.162542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.162568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.162695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.162812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.162837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.162942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.163046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.163071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.163184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.163275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.163300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.163424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.163552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.163577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.163669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.163753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.163779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.163896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.163987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.164013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.164108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.164195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.164220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.164369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.164485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.164511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.164603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.164723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.164748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.164894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.164986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.165030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.165201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.165355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.165383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.165525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.165652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.165677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.165770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.165887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.165914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.166023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.166123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.166148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.166266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.166380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.166410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.166534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.166656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.166681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.166829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.166950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.167015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.167110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.167206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.167230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.167320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.167429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.167454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.167573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.167701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.167727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.167874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.168004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.168030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.168115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.168293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.168320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.168459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.168612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.168636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.168760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.168847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.168873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.168974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.169105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.169131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.912 qpair failed and we were unable to recover it. 00:30:34.912 [2024-11-30 04:32:25.169230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.912 [2024-11-30 04:32:25.169356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.169381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.169484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.169583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.169609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.169703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.169816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.169841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.169971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.170099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.170125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.170222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.170333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.170358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.170470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.170558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.170601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.170718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.170804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.170829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.170951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.171079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.171105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.171254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.171359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.171384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.171524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.171690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.171718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.171836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.171971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.172018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.172115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.172204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.172229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.172361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.172481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.172506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.172596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.172707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.172732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.172916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.173047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.173074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.173163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.173273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.173298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.173406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.173521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.173550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.173710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.173809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.173837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.173950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.174077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.174102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.174227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.174357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.174388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.174528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.174655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.174684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.174812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.174904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.174932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.175111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.175213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.175239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.175369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.175459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.175487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.175590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.175722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.175751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.913 qpair failed and we were unable to recover it. 00:30:34.913 [2024-11-30 04:32:25.175891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.913 [2024-11-30 04:32:25.176049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.176075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.176188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.176345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.176373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.176502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.176629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.176657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.176782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.176936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.176973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.177093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.177187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.177213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.177372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.177507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.177533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.177712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.177842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.177869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.178015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.178099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.178123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.178245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.178354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.178382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.178526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.178661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.178689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.178841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.178981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.179025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.179110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.179229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.179273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.179401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.179514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.179557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.179704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.179858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.179886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.180048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.180137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.180163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.180270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.180394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.180445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.180558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.180726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.180754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.180893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.181015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.181040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.181130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.181234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.181262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.181371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.181524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.181552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.181655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.181783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.181811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.181946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.182071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.182097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.182189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.182337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.182362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.182473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.182601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.182626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.182716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.182832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.182857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.182970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.183088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.183132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.183300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.183419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.183444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.183557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.183684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.183712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.183842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.184018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.914 [2024-11-30 04:32:25.184044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.914 qpair failed and we were unable to recover it. 00:30:34.914 [2024-11-30 04:32:25.184130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.184219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.184261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.184398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.184526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.184554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.184693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.184833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.184858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.184949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.185100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.185125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.185225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.185362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.185391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.185557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.185718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.185747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.185877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.186010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.186036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.186137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.186266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.186291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.186399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.186510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.186553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.186679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.186794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.186822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.187008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.187110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.187135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.187251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.187376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.187404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.187539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.187673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.187701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.187840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.187917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.187942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.188042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.188125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.188161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.188287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.188415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.188440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.188556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.188673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.188699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.188895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.189024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.189049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.189146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.189238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.189266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.189364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.189479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.189509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.189676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.189793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.189822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.189940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.190048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.190075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.190193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.190315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.190341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.190434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.190546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.190574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.190704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.190836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.190865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.191002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.191105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.191130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.191216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.191300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.191343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.191477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.191607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.191635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.191786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.191912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.915 [2024-11-30 04:32:25.191937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.915 qpair failed and we were unable to recover it. 00:30:34.915 [2024-11-30 04:32:25.192074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.192171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.192196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.192295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.192440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.192466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.192583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.192711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.192739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.192872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.192999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.193026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.193151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.193245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.193271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.193410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.193550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.193591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.193697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.193829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.193858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.194007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.194098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.194123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.194246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.194343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.194373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.194529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.194668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.194695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.194809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.194922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.194950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.195078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.195201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.195227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.195347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.195490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.195532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.195643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.195741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.195769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.195873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.196013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.196039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.196170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.196305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.196333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.196552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.196682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.196710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.196877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.196995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.197021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.197116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.197222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.197254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.197362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.197519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.197547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.197676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.197806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.197833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.197938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.198084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.198110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.198204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.198331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.198359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.198456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.198559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.198588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.198701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.198838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.198865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.199016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.199120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.199145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.199259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.199387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.199415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.199513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.199696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.199724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.916 [2024-11-30 04:32:25.199842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.199968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.916 [2024-11-30 04:32:25.199994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.916 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.200086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.200171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.200196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.200296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.200376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.200401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.200499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.200645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.200671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.200791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.200884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.200910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.201023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.201122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.201147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.201299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.201443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.201479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.201581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.201707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.201742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.201922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.202048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.202074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.202842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.203024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.203052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.203158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.203255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.203280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.203399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.203530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.203558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.203782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.203914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.203944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.204099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.204185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.204210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.204333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.204456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.204480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.204607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.204695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.204721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.204818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.204925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.204955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.205090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.205179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.205204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.205293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.205413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.205456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.205566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.205723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.205751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.205860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.205950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.205983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.206088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.206191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.206216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.206302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.206420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.206464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.206628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.206724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.206752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.206857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.206973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.207025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.207150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.207242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.207267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.207375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.207497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.207526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.207628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.207716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.207744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.207873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.208009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.208035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.917 [2024-11-30 04:32:25.208130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.208222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.917 [2024-11-30 04:32:25.208247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.917 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.208346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.208439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.208481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.208623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.208738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.208768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.208901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.209033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.209059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.209149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.209265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.209293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.209402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.209541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.209569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.209672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.209828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.209856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.210017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.210113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.210138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.210230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.210308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.210333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.210448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.210552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.210579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.210678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.210809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.210837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.210937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.211075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.211101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.211186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.211306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.211335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.211428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.211524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.211549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.211668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.211805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.211833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.211933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.212059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.212085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.212183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.212274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.212299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.212415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.212519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.212547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.212678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.212799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.212824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.212974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.213063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.213088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.213187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.213300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.213340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.213460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.213555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.213585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.213733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.213855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.213883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.214009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.214103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.214128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.214226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.214343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.214368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.918 [2024-11-30 04:32:25.214481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.214574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.918 [2024-11-30 04:32:25.214602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.918 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.214732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.214829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.214858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.214972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.215073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.215098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.215194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.215278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.215302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.215453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.215570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.215595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.215719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.215851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.215893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.216015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.216105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.216130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.216230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.216377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.216402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.216488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.216622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.216649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.216789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.216897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.216926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.217042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.217136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.217161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.217285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.217403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.217428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.217556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.217691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.217719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.217854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.217978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.218020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.218135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.218256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.218281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.219221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.219373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.219403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.219549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.219681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.219709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.219843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.219948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.220037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.220167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.220309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.220353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.220525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.220697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.220730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.220885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.221051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.221079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.221230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.221360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.221386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.221529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.221629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.221659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.221789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.221921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.221949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.222073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.222160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.222185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.222371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.222512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.222555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.222666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.222799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.222827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.222949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.223058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.223083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.223180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.223274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.223299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.919 qpair failed and we were unable to recover it. 00:30:34.919 [2024-11-30 04:32:25.223432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.919 [2024-11-30 04:32:25.223588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.223613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.223732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.223827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.223856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.224017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.224135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.224161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.224331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.224501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.224529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.224670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.224783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.224811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.224943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.225048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.225073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.225168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.225299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.225328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.225433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.225528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.225556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.225687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.225783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.225811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.225919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.226020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.226050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.226142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.226236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.226267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.226417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.226542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.226589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.226761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.226883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.226912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.227089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.227189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.227214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.227362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.227511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.227536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.227679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.227783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.227811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.227919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.228081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.228107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.228226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.228316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.228341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.228488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.228603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.228628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.228722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.228888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.228915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.229077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.229175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.229200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.229286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.229453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.229481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.229637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.229735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.229762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.229891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.230018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.230045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.230146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.230245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.230271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.230374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.230531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.230558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.230672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.230816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.230842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.230938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.231098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.231124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.231259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.231362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.231391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.920 qpair failed and we were unable to recover it. 00:30:34.920 [2024-11-30 04:32:25.231527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.231664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.920 [2024-11-30 04:32:25.231692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.231830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.231968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.232011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.232101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.232225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.232250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.232412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.232543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.232570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.232740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.232844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.232872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.232986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.233082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.233108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.233217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.233362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.233408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.233532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.233699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.233727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.233838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.233990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.234033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.234126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.234244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.234269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.234413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.234563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.234591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.234724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.234846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.234873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.234974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.235115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.235140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.235251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.235348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.235373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.235492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.235642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.235667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.235781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.235926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.235951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.236078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.236191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.236216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.236356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.236442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.236470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.236562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.236702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.236730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.236824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.236944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.236981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.237091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.237244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.237269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.237413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.237550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.237578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.237695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.237827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.237855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.238008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.238133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.238159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.238290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.238400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.238428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.238559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.238661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.238690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.238812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.238908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.238933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.239087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.239177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.239203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.239382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.239510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.921 [2024-11-30 04:32:25.239539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.921 qpair failed and we were unable to recover it. 00:30:34.921 [2024-11-30 04:32:25.239727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.239882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.239910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.240031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.240149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.240174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.240323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.240450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.240484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.240642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.240798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.240826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.241000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.241163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.241189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.241318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.241452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.241480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.241586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.241682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.241710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.241809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.241953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.241987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.242093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.242186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.242211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.242380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.242546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.242574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.242710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.242839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.242867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.242985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.243094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.243120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.243240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.243356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.243381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.243572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.243711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.243740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.243859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.243973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.244000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.244159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.244321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.244360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.244495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.244627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.244655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.244802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.244946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.244982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.245105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.245201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.245226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.245319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.245437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.245463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.245634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.245723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.245751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.245884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.246021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.246046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.246200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.246314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.246339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.246459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.246579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.246609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.246767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.246893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.246921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.247066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.247193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.247233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.922 qpair failed and we were unable to recover it. 00:30:34.922 [2024-11-30 04:32:25.247359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.922 [2024-11-30 04:32:25.247462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.247490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.247598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.247732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.247772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.247910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.248024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.248050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.248137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.248232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.248256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.248379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.248504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.248529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.248696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.248789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.248818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.249008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.249116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.249141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.249249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.249378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.249404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.249526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.249611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.249636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.249791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.249920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.249948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.250069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.250160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.250186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.250297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.250435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.250463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.250572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.250725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.250754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.250912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.251105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.251132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.251232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.251366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.251393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.251529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.251668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.251695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.251793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.251904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.251930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.252028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.252176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.252202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.252312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.252412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.252441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.252573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.252695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.252723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.252825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.252951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.253005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.253158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.253264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.253291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.253486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.253583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.253610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.253743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.253847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.253875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.254025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.254146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.254172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.254327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.254445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.254473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.254636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.254793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.254821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.254968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.255135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.255165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.255286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.255422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.255447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.923 qpair failed and we were unable to recover it. 00:30:34.923 [2024-11-30 04:32:25.255575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.255713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.923 [2024-11-30 04:32:25.255741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.255925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.256073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.256099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.256201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.256330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.256358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.256518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.256649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.256676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.256840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.256971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.257015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.257105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.257228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.257253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.257343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.257483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.257510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.257622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.257753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.257781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.257893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.257976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.258017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.258106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.258229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.258255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.258339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.258461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.258486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.258571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.258674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.258702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.258805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.258907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.258937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.259113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.259282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.259309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.259449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.259609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.259638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.259797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.259928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.259956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.260116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.260239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.260264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.260378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.260521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.260547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.260671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.260789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.260813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.260986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.261121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.261149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.261291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.261453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.261478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.261568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.261679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.261704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.261826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.261945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.261980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.262101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.262217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.262246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.262401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.262541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.262583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.262715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.262832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.262858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.262954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.263093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.263118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.263248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.263428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.263453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.263608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.263726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.263751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.924 qpair failed and we were unable to recover it. 00:30:34.924 [2024-11-30 04:32:25.263875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.924 [2024-11-30 04:32:25.263987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.264017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.264104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.264253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.264280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.264374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.264505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.264543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.264654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.264801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.264826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.264943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.265041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.265065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.265210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.265305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.265330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.265451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.265567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.265592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.265706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.265888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.265914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.266075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.266223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.266248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.266364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.266517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.266545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.266670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.266777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.266802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.266950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.267081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.267107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.267240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.267354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.267380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.267526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.267648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.267676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.267813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.267910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.267938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.268067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.268241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.268269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.268417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.268558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.268583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.268702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.268845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.268886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.269034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.269149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.269174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.269289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.269398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.269423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.269551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.269672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.269697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.269818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.269940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.269978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.270092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.270222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.270247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.270370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.270488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.270513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.270602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.270725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.270750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.270847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.271031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.271056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.271187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.271317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.271343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.271483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.271593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.271619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.271733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.271855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.925 [2024-11-30 04:32:25.271880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.925 qpair failed and we were unable to recover it. 00:30:34.925 [2024-11-30 04:32:25.272003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.272122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.272147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.272289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.272419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.272452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.272613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.272751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.272779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.272913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.273028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.273054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.273145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.273270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.273312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.273443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.273552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.273580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.273682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.273769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.273797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.273942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.274053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.274080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.274234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.274385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.274409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.274501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.274625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.274651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.274742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.274856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.274881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.275008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.275098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.275125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.275270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.275380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.275408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.275509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.275614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.275655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.275745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.275861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.275886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.276001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.276085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.276109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.276234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.276324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.276363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.276483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.276640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.276667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.276755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.276852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.276880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.277017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.277162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.277187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.277314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.277429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.277455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.277599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.277689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.277714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.277841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.277972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.278001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.278144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.278241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.278266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.278411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.278538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.278566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.278665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.278760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.278788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.278913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.279072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.279098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.279230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.279356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.279381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.279486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.279607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.279636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.926 qpair failed and we were unable to recover it. 00:30:34.926 [2024-11-30 04:32:25.279745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.926 [2024-11-30 04:32:25.279890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.279915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.280082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.280234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.280259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.280404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.280523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.280553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.280720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.280871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.280896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.281001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.281109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.281137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.281298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.281436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.281464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.281636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.281739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.281764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.281877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.281968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.282004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.282088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.282166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.282208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.282337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.282495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.282523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.282668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.282796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.282821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.282977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.283123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.283151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.283281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.283415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.283442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.283591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.283706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.283731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.283876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.283986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.284013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.284103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.284235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.284262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.284433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.284587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.284617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.284722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.284843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.284868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.284997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.285119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.285144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.285270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.285372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.285415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.285523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.285663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.285692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.285798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.285906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.285935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.286099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.286222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.286262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.286395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.286537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.286569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.286709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.286835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.286863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.927 [2024-11-30 04:32:25.286955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.287092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.927 [2024-11-30 04:32:25.287120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.927 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.287268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.287390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.287416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.287503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.287649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.287674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.287804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.287971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.288006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.288130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.288248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.288276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.288434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.288536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.288562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.288700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.288793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.288818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.288954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.289093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.289122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.289281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.289371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.289406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.289527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.289653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.289678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.289803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.289924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.289949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.290122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.290286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.290314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.290463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.290561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.290586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.290673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.290761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.290785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.290898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.290993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.291019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.291108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.291200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.291226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.291349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.291488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.291513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.291594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.291719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.291745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.291865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.291996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.292025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.292191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.292325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.292353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.292514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.292654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.292683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.292826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.292940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.292973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.293073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.293169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.293195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.293321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.293441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.293465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.293592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.293765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.293793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.293987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.294123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.294148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.294267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.294362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.294387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.294476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.294622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.294647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.294787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.294949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.294982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.928 [2024-11-30 04:32:25.295078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.295166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.928 [2024-11-30 04:32:25.295202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.928 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.295299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.295448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.295473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.295617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.295763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.295788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.296000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.296125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.296150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.296282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.296405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.296430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.296575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.296696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.296725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.296867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.297002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.297028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.297127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.297227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.297252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.297375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.297501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.297527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.297672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.297849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.297877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.298036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.298149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.298177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.298282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.298411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.298440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.298604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.298694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.298720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.298857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.298944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.298976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.299068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.299169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.299194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.299313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.299427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.299451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.299602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.299719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.299744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.299851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.299948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.299981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.300082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.300199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.300224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.300343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.300448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.300475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.300627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.300710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.300750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.300848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.300969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.300996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.301119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.301260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.301285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.301407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.301550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.301575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.301706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.301861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.301885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.302006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.302127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.302151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.302250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.302337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.302362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.302486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.302604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.302629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.302784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.302897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.302923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.929 qpair failed and we were unable to recover it. 00:30:34.929 [2024-11-30 04:32:25.303021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.303119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.929 [2024-11-30 04:32:25.303144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.303238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.303351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.303382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.303524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.303688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.303713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.303835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.303952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.303984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.304082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.304201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.304226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.304349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.304478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.304503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.304592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.304681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.304706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.304806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.304922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.304947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.305047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.305135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.305160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.305281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.305403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.305428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.305553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.305669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.305694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.305783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.305927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.305952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.306097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.306208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.306233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.306406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.306520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.306545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.306690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.306830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.306855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.306972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.307063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.307087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.307236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.307388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.307415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.307595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.307764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.307793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.307920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.308089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.308116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.308243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.308348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.308373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.308502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.308626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.308652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.308771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.308892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.308917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.309052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.309180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.309207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.309368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.309514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.309540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.309635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.309765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.309791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.309908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.310051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.310077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.310224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.310313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.310339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.310443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.310593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.310619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.310746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.310862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.310889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.930 qpair failed and we were unable to recover it. 00:30:34.930 [2024-11-30 04:32:25.311021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.311182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.930 [2024-11-30 04:32:25.311207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.311329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.311461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.311486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.311585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.311674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.311700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.311811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.311909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.311937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.312115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.312237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.312263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.312415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.312539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.312566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.312667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.312780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.312806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.312932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.313053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.313079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.313237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.313360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.313385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.313506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.313588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.313620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.313763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.313896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.313924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.314050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.314171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.314198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.314312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.314470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.314496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.314644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.314792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.314825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.314975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.315105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.315136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.315265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.315419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.315453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.315609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.315783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.315817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.315980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.316133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.316167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.316322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.316491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.316521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.316686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.316835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.316868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.317086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.317219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.317249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.317421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.317533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.317566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.317755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.317907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.317937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.318075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.318206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.318236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.318379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.318551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.318584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.318745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.318891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.931 [2024-11-30 04:32:25.318925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.931 qpair failed and we were unable to recover it. 00:30:34.931 [2024-11-30 04:32:25.319105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.319269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.319299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.319449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.319551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.319581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.319751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.319871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.319915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.320054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.320176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.320204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.320351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.320467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.320492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.320667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.320831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.320857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.321004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.321095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.321121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.321239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.321362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.321387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.321509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.321598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.321623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.321744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.321854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.321881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.322008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.322131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.322157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.322301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.322422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.322447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.322566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.322661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.322686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.322825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.322986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.323015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.323156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.323323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.323351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.323490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.323619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.323644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.323791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.323911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.323936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.324040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.324188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.324218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.324336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.324455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.324480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.324639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.324783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.324811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.324931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.325049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.325075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.325206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.325322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.325347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.325495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.325613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.325638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.325738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.325913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.325941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.326103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.326227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.326254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.326374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.326509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.326552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.326673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.326802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.326830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.326926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.327047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.327072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.932 qpair failed and we were unable to recover it. 00:30:34.932 [2024-11-30 04:32:25.327198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.327315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.932 [2024-11-30 04:32:25.327340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.327494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.327636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.327665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.327795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.327915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.327944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.328105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.328225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.328251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.328370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.328517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.328552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.328649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.328779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.328807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.328973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.329110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.329135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.329255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.329392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.329420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.329536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.329653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.329679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.329777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.329890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.329914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.330023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.330106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.330133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.330257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.330364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.330390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.330482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.330573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.330599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.330719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.330838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.330865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.330996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.331089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.331115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.331239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.331329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.331354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.331457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.331551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.331577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.331700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.331845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.331873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.332015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.332110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.332137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.332226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.332336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.332365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.332512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.332630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.332656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.332745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.332836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.332861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.332977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.333103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.333132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.333249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.333394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.333420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.333541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.333668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.333693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.333846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.333969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.333995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.334145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.334273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.334300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.334433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.334556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.334584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.334749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.334893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.334918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.933 qpair failed and we were unable to recover it. 00:30:34.933 [2024-11-30 04:32:25.335080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.933 [2024-11-30 04:32:25.335187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.335216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.335393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.335539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.335566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.335700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.335826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.335854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.335986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.336134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.336160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.336309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.336404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.336430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.336580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.336698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.336723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.336866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.336990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.337019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.337152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.337257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.337287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.337383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.337501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.337527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.337681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.337860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.337886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.338029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.338145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.338170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.338291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.338407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.338437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.338578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.338681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.338711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.338831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.339013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.339040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.339160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.339306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.339334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.339446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.339589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.339614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.339737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.339858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.339882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.339993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.340152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.340180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.340311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.340402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.340430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.340565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.340691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.340716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.340842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.340936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.340967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.341080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.341221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.341250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.341367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.341480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.341523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.341640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.341740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.341765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.341915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.342065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.342099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.342255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.342369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.342394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.342524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.342695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.342720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.342852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.342943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.342976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.343102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.343252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.934 [2024-11-30 04:32:25.343277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.934 qpair failed and we were unable to recover it. 00:30:34.934 [2024-11-30 04:32:25.343408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.343588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.343613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.343698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.343820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.343845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.344015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.344100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.344129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.344246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.344364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.344388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.344481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.344600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.344626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.344747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.344840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.344864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.344981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.345129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.345155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.345273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.345391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.345417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.345616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.345767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.345791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.345970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.346077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.346111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.346217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.346340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.346365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.346510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.346643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.346685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.346807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.346890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.346915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.347080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.347196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.347223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.347393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.347512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.347537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.347652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.347740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.347765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.347950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.348078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.348114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.348208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.348316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.348341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.348436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.348516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.348541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.348695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.348836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.348864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.348997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.349121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.349149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.349294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.349425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.349450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.349600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.349722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.349747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.349904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.350023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.350053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.350166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.350334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.350358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.350501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.350611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.350638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.350747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.350850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.350875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.350968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.351067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.351104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.351227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.351316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.935 [2024-11-30 04:32:25.351342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.935 qpair failed and we were unable to recover it. 00:30:34.935 [2024-11-30 04:32:25.351433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.351565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.351592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.351694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.351846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.351874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.352049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.352144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.352169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.352257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.352338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.352363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.352455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.352561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.352587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.352701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.352820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.352845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.352970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.353136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.353161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.353303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.353480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.353506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.353627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.353793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.353820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.353990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.354117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.354142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.354264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.354410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.354436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.354582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.354729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.354754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.354859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.354985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.355016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.355165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.355292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.355317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.355470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.355573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.355606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.355771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.355875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.355903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.356078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.356235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.356261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.356346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.356480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.356507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.356630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.356721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.356752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.356874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.356996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.357022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.357129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.357251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.357295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.357406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.357537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.357562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.357686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.357786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.357811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.357921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.358061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.358091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.358189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.358347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.358374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.936 [2024-11-30 04:32:25.358551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.358674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.936 [2024-11-30 04:32:25.358698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.936 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.358843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.358952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.359015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.359134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.359218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.359244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.359393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.359518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.359558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.359703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.359821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.359846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.359992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.360128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.360153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.360271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.360396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.360424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.360563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.360689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.360714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.360836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.360914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.360939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.361075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.361171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.361196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.361293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.361461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.361489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.361614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.361703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.361732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.361910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.362037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.362080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.362189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.362318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.362346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.362479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.362649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.362674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.362792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.362907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.362950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.363055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.363200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.363226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.363350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.363492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.363518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.363633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.363719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.363744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.363892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.364068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.364098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.364251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.364371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.364396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.364575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.364663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.364687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.364785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.364919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.364947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.365093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.365198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.365225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.365370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.365489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.365515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.365615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.365735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.365761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.365910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.366035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.366061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.366189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.366310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.366338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.366478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.366590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.366616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.937 qpair failed and we were unable to recover it. 00:30:34.937 [2024-11-30 04:32:25.366783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.937 [2024-11-30 04:32:25.366912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.366939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.367123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.367265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.367293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.367425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.367603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.367628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.367773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.367865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.367890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.368032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.368183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.368208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.368332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.368450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.368494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.368586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.368750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.368776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.368927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.369059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.369102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.369264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.369410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.369436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.369535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.369655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.369680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.369791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.369969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.370005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.370174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.370295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.370324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.370445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.370542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.370569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.370669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.370798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.370826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.370932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.371122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.371149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.371303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.371430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.371471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.371602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.371728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.371753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.371897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.372067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.372097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.372212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.372389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.372414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.372509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.372654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.372679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.372837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.372933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.372966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.373087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.373205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.373230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.373351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.373456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.373487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.373605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.373688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.373713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.373810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.373950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.373985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.374131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.374267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.374295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.374454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.374556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.374585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.374687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.374806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.374831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.374979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.375118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.938 [2024-11-30 04:32:25.375143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.938 qpair failed and we were unable to recover it. 00:30:34.938 [2024-11-30 04:32:25.375295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.375413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.375438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.375556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.375668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.375693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.375808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.375927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.375952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.376146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.376292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.376317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.376457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.376557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.376583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.376744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.376889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.376914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.377037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.377154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.377179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.377331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.377434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.377461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.377548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.377683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.377707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.377834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.377954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.377988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.378100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.378195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.378222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.378338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.378474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.378499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.378630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.378754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.378797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.378890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.378986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.379012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.379106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.379248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.379274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.379406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.379528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.379556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.379689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.379811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.379839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.379987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.380082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.380108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.380256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.380378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.380402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.380516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.380647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.380675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.380806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.380927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.380955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.381096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.381225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.381253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.381394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.381516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.381541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.381652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.381771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.381797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.381928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.382034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.382063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.382240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.382362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.382387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.382507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.382595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.382620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.382751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.382879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.382907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.939 [2024-11-30 04:32:25.383035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.383152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.939 [2024-11-30 04:32:25.383176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.939 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.383353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.383459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.383488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.383656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.383804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.383829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.383928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.384078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.384120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.384238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.384324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.384367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.384488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.384646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.384678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.384797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.384895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.384920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.385077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.385236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.385262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.385416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.385515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.385542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.385669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.385762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.385789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.385966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.386046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.386071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.386192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.386337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.386363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.386505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.386665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.386694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.386863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.386986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.387023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.387147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.387239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.387265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.387394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.387537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.387566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.387711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.387818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.387862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.387991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.388087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.388112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.388226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.388313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.388338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.388504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.388607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.388635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.388724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.388896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.388920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.389077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.389222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.389250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.389391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.389511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.389536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.389680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.389778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.389802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.389930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.390045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.390071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.390188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.390333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.390360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.940 [2024-11-30 04:32:25.390479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.390574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.940 [2024-11-30 04:32:25.390600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.940 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.390726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.390835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.390859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.390973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.391089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.391114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.391235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.391370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.391398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.391515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.391661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.391685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.391849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.392018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.392044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.392168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.392252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.392277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.392389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.392503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.392528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.392616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.392733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.392758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.392890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.392986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.393012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.393115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.393290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.393318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.393441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.393598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.393625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.393735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.393850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.393876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.394024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.394115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.394140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.394223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.394340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.394381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.394508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.394641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.394666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.394751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.394871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.394897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.395023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.395140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.395168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.395295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.395470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.395495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.395607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.395727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.395772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.395909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.396040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.396066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.396209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.396353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.396378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.396521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.396650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.396679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.396781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.396907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.396935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.397055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.397207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.397233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.397376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.397477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.397502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.397597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.397726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.397751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.397908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.398062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.398088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.398181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.398324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.398349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.941 qpair failed and we were unable to recover it. 00:30:34.941 [2024-11-30 04:32:25.398465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.941 [2024-11-30 04:32:25.398595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.398623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.398740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.398919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.398944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.399073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.399237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.399266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.399431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.399572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.399597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.399727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.399863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.399888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.400048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.400192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.400233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.400337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.400447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.400475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.400588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.400699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.400725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.400851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.400971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.400998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.401123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.401248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.401276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.401455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.401577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.401601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.401692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.401775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.401806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.401947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.402088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.402117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.402241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.402373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.402401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.402532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.402638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.402665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.402781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.402901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.402926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.403088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.403234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.403259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.403417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.403519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.403561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.403645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.403730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.403755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.403924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.404077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.404103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.404217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.404339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.404364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.404499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.404632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.404659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.404840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.404932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.404965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.405091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.405178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.405203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.405300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.405417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.405443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.405610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.405737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.942 [2024-11-30 04:32:25.405765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.942 qpair failed and we were unable to recover it. 00:30:34.942 [2024-11-30 04:32:25.405897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.405993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.406022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.406140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.406257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.406282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.406381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.406512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.406537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.406663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.406777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.406802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.406901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.407080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.407109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.407251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.407363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.407388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.407486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.407582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.407608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.407711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.407843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.407871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.407984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.408126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.408154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.408297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.408410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.408435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.408543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.408706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.408734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.408836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.408970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.408999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.409130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.409256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.409283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.409421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.409565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.409591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.409741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.409870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.409898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.409993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.410128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.410157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.410310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.410429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.410454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.410567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.410686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.410711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.410880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.410984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.411013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.411113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.411208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.411236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.411372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.411508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.943 [2024-11-30 04:32:25.411533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.943 qpair failed and we were unable to recover it. 00:30:34.943 [2024-11-30 04:32:25.411684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.411808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.411851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.411963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.412106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.412132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.412264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.412393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.412421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.412581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.412739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.412767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.412908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.413053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.413079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.413202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.413393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.413419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.413541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.413626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.413652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.413767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.413914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.413940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.414096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.414237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.414280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.414388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.414543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.414570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.414704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.414861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.414889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.415027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.415151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.415176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.415275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.415388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.415413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.415494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.415636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.415661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.415780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.415950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.416007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.416120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.416249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.416282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.416414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.416545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.416571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.416713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.416863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.416888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.417037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.417146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.417173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.417313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.417394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.417419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.417566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.417656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.417681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.944 [2024-11-30 04:32:25.417817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.417948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.944 [2024-11-30 04:32:25.417983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.944 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.418085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.418194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.418219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.418338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.418449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.418475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.418561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.418651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.418678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.418795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.418914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.418941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.419069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.419204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.419232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.419364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.419467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.419508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.419655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.419777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.419802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.419944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.420069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.420096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.420214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.420390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.420418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.420549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.420708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.420737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.420909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.421032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.421058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.421176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.421305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.421347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.421467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.421584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.421628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.421727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.421859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.421888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.421995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.422091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.422117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.422232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.422315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.422340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.422434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.422548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.422573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.422691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.422785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.422810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.422931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.423058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.423084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.423232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.423364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.423391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.423533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.423645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.423670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.423767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.423878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.423903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.423986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.424131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.424156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.945 qpair failed and we were unable to recover it. 00:30:34.945 [2024-11-30 04:32:25.424280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.945 [2024-11-30 04:32:25.424398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.424426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.424534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.424631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.424660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.424819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.424986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.425015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.425192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.425309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.425334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.425498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.425624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.425652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.425759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.425887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.425915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.426039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.426199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.426227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.426345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.426489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.426514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.426643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.426761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.426789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.426921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.427059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.427086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.427199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.427340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.427366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.427482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.427632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.427658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.427833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.427969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.428013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.428128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.428247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.428289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.428418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.428542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.428569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.428731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.428846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.428871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.428992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.429179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.429205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.429352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.429520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.946 [2024-11-30 04:32:25.429547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.946 qpair failed and we were unable to recover it. 00:30:34.946 [2024-11-30 04:32:25.429653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.429751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.429778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.429944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.430054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.430096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.430251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.430340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.430365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.430487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.430582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.430627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.430751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.430874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.430916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.431072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.431182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.431207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.431350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.431450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.431475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.431601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.431733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.431761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.431895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.432051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.432080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.432257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.432376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.432402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.432550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.432634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.432659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.432757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.432837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.432862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.432965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.433052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.433077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.433233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.433350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.433392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.433541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.433686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.433711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.433883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.434028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.434053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.434202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.434338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.434367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.434537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.434654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.434680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.434833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.434945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.434979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.435093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.435209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.435234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.435335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.435478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.435506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.435654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.435738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.435764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.435898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.436001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.436030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.436131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.436264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.436293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.947 [2024-11-30 04:32:25.436477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.436624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.947 [2024-11-30 04:32:25.436649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.947 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.436744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.436888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.436913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.437067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.437200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.437228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.437373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.437490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.437515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.437629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.437752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.437777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.437895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.438010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.438036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.438200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.438333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.438361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.438498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.438639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.438664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.438809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.438931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.438967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.439114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.439205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.439230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.439370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.439531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.439556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.439676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.439791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.439816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.439907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.439993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.440018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.440137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.440252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.440277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.440418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.440531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.440559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.440692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.440821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.440850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.441004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.441122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.441147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.441260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.441377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.441403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.441548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.441640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.441666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.441795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.441943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.441977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.442104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.442206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.442232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.442348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.442463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.442487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.442604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.442683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.442726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.442840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.442996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.443026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.443133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.443279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.443304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.443415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.443529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.443555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.948 qpair failed and we were unable to recover it. 00:30:34.948 [2024-11-30 04:32:25.443698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.948 [2024-11-30 04:32:25.443832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.443860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.444016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.444138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.444167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.444300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.444419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.444446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.444584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.444696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.444721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.444823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.444952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.444998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.445134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.445238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.445263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.445434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.445533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.445561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.445705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.445795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.445820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.445999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.446171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.446197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.446314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.446422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.446450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.446550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.446679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.446707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.446850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.446973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.447000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.447176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.447280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.447329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.447447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.447582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.447610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.447749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.447915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.447948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.448080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.448199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.448224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.448321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.448445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.448473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.448621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.448710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.448737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.448830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.448947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.448981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.449082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.449175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.449202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.449349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.449434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.449460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.449553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.449639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.449666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.449783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.449899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.449925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.450057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.450147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.450173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.450319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.450432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.450458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.949 [2024-11-30 04:32:25.450543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.450685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.949 [2024-11-30 04:32:25.450710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.949 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.450799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.450886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.450911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.451027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.451152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.451178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.451283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.451373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.451401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.451547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.451666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.451692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.451832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.451929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.451966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.452082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.452204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.452228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.452338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.452470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.452498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.452639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.452759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.452784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.452878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.452971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.452997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.453128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.453249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.453275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.453404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.453559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.453588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.453743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.453846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.453875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.454012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.454149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.454178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.454284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.454409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.454440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.454628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.454717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.454742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.454866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.454997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.455024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.455146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.455259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.455284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.455435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.455552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.455577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.455657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.455742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.455767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.455880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.456017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.456046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.456150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.456261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.456289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.456438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.456535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.456562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.456688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.456823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.456851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.457007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.457105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.457132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.457236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.457383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.457409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.457529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.457643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.457668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.457759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.457917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.457945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.458066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.458188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.458213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.458305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.458399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.458423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.458591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.458694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.458720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.458803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.458900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.458926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.459074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.459168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.950 [2024-11-30 04:32:25.459193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.950 qpair failed and we were unable to recover it. 00:30:34.950 [2024-11-30 04:32:25.459299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.459416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.459441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.459572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.459658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.459683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.459802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.459934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.459969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.460103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.460229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.460256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.460392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.460482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.460510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.460628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.460775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.460801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.460923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.461031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.461057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.461197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.461292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.461325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.461459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.461584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.461612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.461724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.461873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.461898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.462045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.462212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.462241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.462397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.462545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.462570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.462669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.462774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.462803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.462972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.463092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.463118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.463235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.463362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.463390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.463520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.463642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.463670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.463773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.463942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.463975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.464125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.464240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.464265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.464467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.464614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.464640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.464755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.464846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.464872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.464993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.465117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.465142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.465263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.465383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.465410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.465608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.465764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.465791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.465935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.466089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.466115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.466241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.466366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.951 [2024-11-30 04:32:25.466391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.951 qpair failed and we were unable to recover it. 00:30:34.951 [2024-11-30 04:32:25.466484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.466596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.466622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.466741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.466881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.466909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.467093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.467214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.467240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.467389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.467522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.467550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.467684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.467801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.467826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.467986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.468081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.468107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.468218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.468346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.468374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.468518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.468610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.468636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.468782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.468899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.468923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.469075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.469175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.469207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.469340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.469470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.469495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.469691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.469785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.469811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.469932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.470079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.470105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.470222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.470321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.470351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.470476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.470610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.470638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.470744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.470889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.470914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.471047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.471204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.471245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.471364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.471528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.471556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.471661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.471789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.471815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.471913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.472057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.472086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.472202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.472319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.472345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.472459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.472577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.472601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.472776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.472897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.472925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.473103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.473200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.473225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.473381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.473491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.473517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.473715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.473827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.473853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.473974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.474061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.474086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.474207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.474315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.474343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.952 [2024-11-30 04:32:25.474486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.474606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.952 [2024-11-30 04:32:25.474631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.952 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.474774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.474929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.474965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.475098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.475222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.475250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.475383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.475523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.475552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.475720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.475816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.475841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.475935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.476028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.476058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.476183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.476278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.476303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.476448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.476563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.476590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.476733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.476824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.476850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.476994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.477086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.477115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.477248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.477372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.477401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.477519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.477629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.477654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.477747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.477830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.477855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.478003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.478119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.478161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.478261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.478392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.478434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.478633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.478767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.478795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.478941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.479076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.479103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.479265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.479351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.479376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.479575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.479731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.479759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.479890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.479986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.480029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.480154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.480274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.480300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.480417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.480572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.480600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.480751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.480838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.480863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.480987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.481107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.481132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.481256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.481403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.481428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.481513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.481651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.481679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.481841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.481973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.482016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.482165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.482298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.482325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.953 [2024-11-30 04:32:25.482524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.482636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.953 [2024-11-30 04:32:25.482662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.953 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.482804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.483002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.483028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.483151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.483271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.483300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.483403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.483499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.483527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.483687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.483807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.483832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.483983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.484086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.484114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.484240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.484366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.484394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.484526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.484652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.484680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.484806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.484925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.484952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.485096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.485236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.485262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.485382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.485467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.485509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.485638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.485766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.485795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.485911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.486033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.486059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.486152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.486269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.486294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.486389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.486477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.486502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.486584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.486695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.486720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.486826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.487003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.487029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.487123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.487210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.487235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.487396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.487530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.487559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.487661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.487872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.487897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.488041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.488189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.488214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.488333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.488491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.488519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.488646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.488763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.488791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.488948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.489077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.489103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.489230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.489325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.489350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.489468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.489679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.489705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.489872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.490020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.490049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.490207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.490373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.954 [2024-11-30 04:32:25.490398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.954 qpair failed and we were unable to recover it. 00:30:34.954 [2024-11-30 04:32:25.490491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.490640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.490669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.490809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.490936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.490970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.491119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.491234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.491259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.491454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.491546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.491571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.491716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.491837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.491862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.492028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.492151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.492176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.492310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.492476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.492504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.492644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.492739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.492767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.492908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.493118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.493148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.493288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.493417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.493445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.493571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.493701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.493734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.493936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.494094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.494124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.494286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.494405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.494431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.494558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.494669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.494695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.494864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.494977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.495021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.495147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.495235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.495262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.495376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.495493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.495519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.495662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.495802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.495830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.495934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.496047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.496073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.496198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.496282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.496307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.496430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.496552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.496576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.496679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.496835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.496863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.497003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.497145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.497170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.497260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.497381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.497405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.497551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.497666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.497690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.497907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.498070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.498099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.498186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.498294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.498323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.498484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.498660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.498685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.498794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.498916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.498942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.955 qpair failed and we were unable to recover it. 00:30:34.955 [2024-11-30 04:32:25.499080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.955 [2024-11-30 04:32:25.499202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.499227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.499347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.499461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.499486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.499596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.499724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.499752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.499920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.500045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.500071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.500187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.500310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.500351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.500495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.500584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.500609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.500752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.500867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.500893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.501077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.501221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.501247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.501399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.501563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.501589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.501700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.501815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.501857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.501946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.502078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.502104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.502219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.502337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.502363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.502474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.502623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.502649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.502797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.502918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.502943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.503063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.503147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.503172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.503264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.503381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.503407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.503520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.503650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.503677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.503775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.503885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.503910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.504023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.504118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.504143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.504240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.504326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.504352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.504450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.504565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.504591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.504709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.504841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.504866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.504987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.505140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.505165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.505315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.505459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.505485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.505614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.505717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.505745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.505923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.506083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.506108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.956 [2024-11-30 04:32:25.506204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.506323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.956 [2024-11-30 04:32:25.506367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.956 qpair failed and we were unable to recover it. 00:30:34.957 [2024-11-30 04:32:25.506484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.957 [2024-11-30 04:32:25.506604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.957 [2024-11-30 04:32:25.506628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.957 qpair failed and we were unable to recover it. 00:30:34.957 [2024-11-30 04:32:25.506746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.957 [2024-11-30 04:32:25.506837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.957 [2024-11-30 04:32:25.506863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.957 qpair failed and we were unable to recover it. 00:30:34.957 [2024-11-30 04:32:25.507063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.957 [2024-11-30 04:32:25.507203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.957 [2024-11-30 04:32:25.507231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.957 qpair failed and we were unable to recover it. 00:30:34.957 [2024-11-30 04:32:25.507355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.957 [2024-11-30 04:32:25.507471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:34.957 [2024-11-30 04:32:25.507496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:34.957 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.507620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.507736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.507761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.507848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.507966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.507996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.508088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.508184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.508209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.508323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.508468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.508497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.508615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.508734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.508759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.508875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.509017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.509046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.509182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.509293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.509319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.509420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.509521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.509546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.509748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.509842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.509884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.510014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.510145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.510173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.510302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.510406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.510447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.510565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.510683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.510709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.510853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.510975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.511020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.511220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.511391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.511419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.511549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.511715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.511743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.511872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.511998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.512027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.512165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.512255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.512280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.512393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.512513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.512538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.512673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.512802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.249 [2024-11-30 04:32:25.512831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.249 qpair failed and we were unable to recover it. 00:30:35.249 [2024-11-30 04:32:25.512965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.513065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.513092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.513237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.513386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.513411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.513549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.513679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.513722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.513844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.513986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.514013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.514138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.514286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.514311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.514495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.514614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.514639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.514766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.514902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.514929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.515088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.515183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.515209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.515334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.515531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.515559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.515695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.515837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.515862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.515964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.516117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.516145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.516283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.516387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.516415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.516545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.516652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.516681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.516858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.517003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.517030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.517129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.517219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.517262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.517421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.517558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.517583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.517679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.517797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.517839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.517978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.518074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.518099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.518219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.518311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.518337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.518424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.518577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.518602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.518782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.518880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.518909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.519082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.519206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.519231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.519354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.519447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.519473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.519617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.519753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.519781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.519887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.520017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.520045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.520156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.520274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.520300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.520390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.520555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.520583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.250 qpair failed and we were unable to recover it. 00:30:35.250 [2024-11-30 04:32:25.520711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.250 [2024-11-30 04:32:25.520885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.520928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.521083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.521196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.521222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.521314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.521434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.521460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.521583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.521719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.521747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.521854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.521994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.522023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.522230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.522352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.522379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.522519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.522713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.522743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.522848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.522981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.523010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.523140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.523271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.523297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.523398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.523542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.523570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.523729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.523819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.523845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.523989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.524132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.524160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.524268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.524401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.524426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.524531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.524656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.524698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.524819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.524932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.524978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.525180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.525295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.525320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.525464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.525579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.525605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.525724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.525870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.525897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.526032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.526180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.526205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.526356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.526448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.526474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.526637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.526796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.526822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.526928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.527056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.527084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.527255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.527380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.527405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.527554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.527696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.527721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.527897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.528017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.528044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.528167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.528301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.528329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.528496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.528615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.528640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.528743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.528864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.528889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.529034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.529184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.529212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.251 qpair failed and we were unable to recover it. 00:30:35.251 [2024-11-30 04:32:25.529321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.251 [2024-11-30 04:32:25.529450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.529480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.529598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.529698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.529724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.529843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.529988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.530017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.530143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.530287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.530313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.530409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.530525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.530566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.530708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.530864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.530889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.531050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.531140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.531165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.531263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.531411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.531435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.531561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.531700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.531728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.531856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.531978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.532004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.532105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.532193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.532218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.532305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.532417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.532442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.532555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.532697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.532725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.532840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.532931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.532965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.533164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.533330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.533357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.533516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.533684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.533708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.533829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.533948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.534003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.534095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.534217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.534242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.534383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.534519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.534547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.534654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.534789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.534814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.534946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.535085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.535112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.535313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.535457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.535482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.535606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.535699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.535724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.535817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.535907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.535933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.536055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.536227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.536255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.536404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.536516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.536541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.536638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.536775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.536803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.536932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.537105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.252 [2024-11-30 04:32:25.537131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.252 qpair failed and we were unable to recover it. 00:30:35.252 [2024-11-30 04:32:25.537273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.537377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.537409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.537528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.537652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.537678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.537780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.537866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.537892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.538038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.538235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.538263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.538423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.538512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.538539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.538687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.538784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.538809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.538954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.539107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.539135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.539235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.539365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.539393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.539527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.539625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.539652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.539789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.539904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.539929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.540068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.540190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.540219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.540337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.540456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.540481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.540598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.540744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.540784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.540903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.541025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.541052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.541200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.541317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.541359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.541499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.541646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.541671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.541791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.541879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.541904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.542050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.542144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.542169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.542341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.542480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.542506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.542628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.542744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.542785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.542902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.543062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.543090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.543218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.543364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.543390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.543543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.543686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.543710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.543826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.543926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.543953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.544105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.544227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.544253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.253 qpair failed and we were unable to recover it. 00:30:35.253 [2024-11-30 04:32:25.544398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.544517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.253 [2024-11-30 04:32:25.544544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.544718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.544834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.544860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.545057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.545187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.545215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.545349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.545489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.545517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.545682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.545790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.545815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.545979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.546105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.546133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.546283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.546409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.546434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.546572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.546730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.546756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.546871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.547027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.547053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.547230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.547373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.547398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.547544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.547679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.547707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.547871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.547963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.547990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.548116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.548208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.548233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.548335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.548458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.548482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.548595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.548732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.548758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.548986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.549155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.549184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.549314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.549410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.549436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.549532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.549650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.549675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.549833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.549983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.550009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.550140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.550235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.550260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.550354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.550499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.550524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.550658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.550779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.550806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.550908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.551054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.551079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.551206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.551332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.551358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.551472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.551588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.551613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.551757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.551882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.551910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.254 qpair failed and we were unable to recover it. 00:30:35.254 [2024-11-30 04:32:25.552027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.552158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.254 [2024-11-30 04:32:25.552191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.552349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.552484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.552512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.552654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.552777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.552802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.552894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.553053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.553082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.553212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.553363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.553388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.553537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.553678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.553702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.553823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.553915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.553940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.554050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.554138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.554163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.554307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.554462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.554497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.554600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.554759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.554788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.554928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.555082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.555112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.555301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.555420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.555445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.555560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.555762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.555789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.555924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.556042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.556070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.556212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.556333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.556358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.556492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.556636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.556661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.556754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.556894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.556921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.557109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.557229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.557254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.557397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.557487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.557513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.557645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.557803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.557831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.557973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.558081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.558108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.558247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.558394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.558419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.558534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.558678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.558703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.558823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.558913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.558938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.559136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.559249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.559275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.559412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.559504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.559531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.559633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.559762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.559788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.559900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.560032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.560061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.255 qpair failed and we were unable to recover it. 00:30:35.255 [2024-11-30 04:32:25.560197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.255 [2024-11-30 04:32:25.560330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.560373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.560468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.560589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.560614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.560710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.560797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.560823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.560950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.561056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.561082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.561203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.561362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.561390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.561548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.561704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.561731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.561844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.561971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.561998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.562173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.562270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.562297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.562412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.562527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.562552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.562719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.562847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.562877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.562992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.563137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.563162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.563302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.563416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.563441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.563560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.563639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.563664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.563745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.563874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.563899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.563988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.564080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.564105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.564227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.564364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.564392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.564523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.564682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.564710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.564834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.564970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.564999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.565109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.565254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.565279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.565413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.565569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.565597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.565758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.565919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.565946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.566057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.566191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.566218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.566363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.566480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.566505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.566645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.566772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.566800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.566952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.567074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.567100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.567244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.567352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.567380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.567549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.567645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.567670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.567782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.567918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.567946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.568094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.568215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.568240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.256 qpair failed and we were unable to recover it. 00:30:35.256 [2024-11-30 04:32:25.568395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.256 [2024-11-30 04:32:25.568549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.568574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.568687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.568804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.568829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.568944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.569058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.569083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.569179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.569293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.569318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.569432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.569576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.569609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.569719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.569866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.569890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.569995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.570150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.570177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.570300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.570415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.570440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.570586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.570708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.570733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.570849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.570948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.571003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.571129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.571270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.571298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.571407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.571531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.571559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.571710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.571792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.571816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.571941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.572068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.572093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.572216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.572319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.572344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.572471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.572586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.572614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.572753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.572842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.572867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.572987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.573114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.573140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.573284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.573416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.573444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.573535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.573665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.573689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.573822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.573981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.574010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.574152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.574269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.574294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.574440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.574559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.574584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.574743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.574830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.574856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.574973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.575109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.575136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.575280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.575393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.575418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.575540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.575672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.575698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.575831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.575966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.575996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.257 qpair failed and we were unable to recover it. 00:30:35.257 [2024-11-30 04:32:25.576138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.257 [2024-11-30 04:32:25.576263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.576289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.576420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.576533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.576558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.576674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.576792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.576817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.576908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.577022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.577048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.577152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.577257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.577285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.577423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.577542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.577569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.577676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.577820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.577844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.577981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.578096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.578121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.578216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.578306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.578332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.578450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.578566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.578591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.578734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.578837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.578864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.578987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.579085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.579114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.579247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.579415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.579443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.579584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.579702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.579727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.579847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.579967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.579993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.580161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.580286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.580314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.580443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.580543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.580571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.580712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.580838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.580864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.580987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.581128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.581155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.581331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.581428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.581454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.581582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.581724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.581752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.581872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.581992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.582019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.582195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.582332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.582357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.582479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.582605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.582631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.582772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.582901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.582926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.258 qpair failed and we were unable to recover it. 00:30:35.258 [2024-11-30 04:32:25.583088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.258 [2024-11-30 04:32:25.583208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.583233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.583379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.583539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.583566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.583695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.583865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.583895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.584018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.584112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.584154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.584300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.584415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.584441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.584590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.584709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.584736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.584825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.584920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.584945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.585043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.585140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.585165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.585257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.585375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.585401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.585549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.585691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.585719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.585826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.585998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.586024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.586142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.586259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.586303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.586421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.586551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.586575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.586725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.586829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.586858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.587017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.587149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.587177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.587334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.587459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.587487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.587629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.587759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.587784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.587921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.588049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.588075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.588208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.588303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.588329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.588455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.588617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.588645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.588784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.588938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.588973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.589138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.589258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.589283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.589422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.589550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.589579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.589739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.589834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.589860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.589982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.590100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.590126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.590224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.590341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.590369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.590469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.590615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.590641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.259 [2024-11-30 04:32:25.590789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.590907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.259 [2024-11-30 04:32:25.590932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.259 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.591085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.591196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.591221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.591374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.591510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.591535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.591668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.591838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.591863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.591987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.592112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.592137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.592226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.592374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.592400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.592496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.592591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.592616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.592731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.592825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.592851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.592972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.593074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.593099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.593215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.593309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.593334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.593484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.593576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.593600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.593722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.593856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.593883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.594009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.594130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.594155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.594258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.594355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.594380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.594468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.594639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.594667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.594764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.594911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.594936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.595062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.595197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.595226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.595366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.595512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.595537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.595632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.595751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.595778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.595882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.596001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.596027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.596142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.596239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.596282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.596430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.596554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.596580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.596777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.596875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.596900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.597029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.597142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.597170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.597295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.597424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.597465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.597589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.597702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.597728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.597856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.598039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.598070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.598220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.598346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.598370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.260 [2024-11-30 04:32:25.598517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.598603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.260 [2024-11-30 04:32:25.598628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.260 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.598754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.598897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.598922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.599074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.599181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.599208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.599310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.599401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.599429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.599560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.599694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.599723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.599890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.600010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.600036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.600158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.600295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.600324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.600454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.600610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.600638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.600739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.600834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.600867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.601008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.601124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.601149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.601260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.601393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.601435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.601553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.601645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.601669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.601754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.601840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.601866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.601967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.602082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.602107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.602202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.602316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.602341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.602465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.602623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.602651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.602781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.602903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.602931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.603080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.603204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.603230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.603352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.603451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.603479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.603586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.603695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.603722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.603855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.603952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.603986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.604121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.604236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.604261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.604404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.604536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.604564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.604700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.604877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.604903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.604989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.605104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.605131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.605249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.605398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.605423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.605566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.605683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.605709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.605811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.605894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.605920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.606054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.606174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.261 [2024-11-30 04:32:25.606199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.261 qpair failed and we were unable to recover it. 00:30:35.261 [2024-11-30 04:32:25.606307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.606460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.606485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.606672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.606787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.606812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.606987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.607113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.607138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.607257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.607391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.607420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.607562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.607684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.607709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.607845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.607937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.607973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.608139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.608271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.608298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.608454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.608553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.608581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.608704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.608790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.608816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.608971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.609073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.609099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.609197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.609298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.609324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.609443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.609580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.609608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.609761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.609888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.609916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.610055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.610146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.610171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.610283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.610433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.610458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.610541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.610627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.610652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.610760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.610863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.610888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.611018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.611109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.611135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.611254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.611348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.611373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.611570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.611718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.611743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.611893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.612092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.612118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.612214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.612373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.612398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.612574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.612696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.612722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.612819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.612909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.612935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.613047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.613142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.613168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.613338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.613474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.613501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.613646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.613824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.613852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.613970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.614096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.614121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.262 [2024-11-30 04:32:25.614257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.614377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.262 [2024-11-30 04:32:25.614401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.262 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.614491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.614612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.614636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.614754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.614871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.614901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.615033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.615130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.615156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.615284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.615433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.615458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.615591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.615786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.615811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.615970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.616077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.616102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.616217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.616348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.616373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.616496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.616615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.616640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.616765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.616899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.616924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.617039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.617187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.617212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.617296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.617386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.617412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.617530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.617676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.617701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.617813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.617914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.617940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.618073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.618200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.618225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.618348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.618439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.618463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.618564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.618656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.618681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.618775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.618900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.618926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.619057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.619151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.619177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.619298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.619415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.619439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.619537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.619633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.619658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.619773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.619864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.619890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.620030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.620126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.620151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.620331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.620469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.620497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.620616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.620733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.620758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.263 qpair failed and we were unable to recover it. 00:30:35.263 [2024-11-30 04:32:25.620876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.263 [2024-11-30 04:32:25.620995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.621023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.621132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.621306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.621332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.621452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.621599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.621624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.621755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.621846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.621872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.622008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.622115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.622144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.622277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.622366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.622392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.622511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.622606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.622631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.622723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.622844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.622869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.622997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.623116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.623141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.623227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.623351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.623377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.623491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.623641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.623666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.623808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.623954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.623990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.624090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.624216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.624262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.624364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.624489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.624516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.624651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.624787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.624815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.624930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.625085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.625112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.625211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.625334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.625359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.625546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.625686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.625711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.625822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.625949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.625987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.626095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.626177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.626202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.626321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.626474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.626503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.626610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.626738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.626766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.626894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.626990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.627024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.627152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.627254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.627279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.627370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.627534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.627563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.627659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.627812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.627840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.627944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.628063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.628091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.628199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.628284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.628320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.628467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.628621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.628654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.264 qpair failed and we were unable to recover it. 00:30:35.264 [2024-11-30 04:32:25.628787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.264 [2024-11-30 04:32:25.628890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.628917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.629060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.629192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.629220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.629345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.629457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.629483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.629608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.629775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.629800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.629930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.630062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.630090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.630191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.630298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.630325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.630476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.630593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.630619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.630765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.630877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.630905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.631020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.631150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.631175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.631300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.631390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.631417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.631551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.631671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.631695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.631854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.631946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.631982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.632118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.632218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.632259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.632351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.632439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.632465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.632584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.632731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.632756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.632868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.633016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.633042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.633134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.633220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.633261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.633397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.633476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.633502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.633652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.633782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.633823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.633980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.634109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.634137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.634280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.634449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.634477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.634608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.634731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.634759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.634898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.634993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.635028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.635166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.635265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.635294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.635438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.635562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.635587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.635706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.635793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.635818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.635937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.636088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.636114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.636240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.636359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.636387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.265 qpair failed and we were unable to recover it. 00:30:35.265 [2024-11-30 04:32:25.636495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.265 [2024-11-30 04:32:25.636618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.636646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.636773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.636888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.636913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.637092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.637179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.637204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.637316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.637455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.637483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.637579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.637759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.637784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.637907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.638006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.638031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.638118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.638214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.638250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.638344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.638487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.638512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.638657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.638804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.638829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.638948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.639071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.639097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.639188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.639338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.639363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.639490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.639614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.639640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.639763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.639882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.639908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.640042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.640163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.640188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.640352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.640472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.640497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.640626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.640712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.640738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.640890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.641012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.641038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.641152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.641271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.641296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.641389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.641485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.641510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.641612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.641729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.641754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.641875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.641974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.642000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.642094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.642184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.642209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.642302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.642415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.642445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.642598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.642709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.642734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.642822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.642943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.642976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.643099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.643189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.643214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.643310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.643422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.643447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.643563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.643660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.643685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.266 qpair failed and we were unable to recover it. 00:30:35.266 [2024-11-30 04:32:25.643804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.266 [2024-11-30 04:32:25.643949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.643982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.644134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.644242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.644270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.644388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.644511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.644536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.644624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.644769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.644794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.644900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.645040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.645070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.645220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.645354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.645396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.645516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.645633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.645658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.645788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.645928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.645955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.646067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.646189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.646214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.646352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.646469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.646495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.646588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.646715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.646740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.646874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.647005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.647035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.647137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.647266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.647293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.647396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.647567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.647592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.647684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.647799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.647824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.647972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.648103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.648131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.648259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.648384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.648409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.648495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.648577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.648602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.648691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.648835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.648860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.648986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.649094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.649120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.649206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.649339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.649383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.649496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.649651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.649679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.649799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.649914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.649938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.650067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.650212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.650237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.650383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.650512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.650540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.650670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.650772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.650800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.650943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.651078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.651104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.651194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.651314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.267 [2024-11-30 04:32:25.651339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.267 qpair failed and we were unable to recover it. 00:30:35.267 [2024-11-30 04:32:25.651460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.651607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.651635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.651770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.651927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.651955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.652115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.652206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.652231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.652791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.652931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.652971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.653115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.653249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.653277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.653417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.653551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.653579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.653730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.653875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.653901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.654030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.654154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.654181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.654330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.654451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.654476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.654596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.654794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.654822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.654945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.655073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.655100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.655243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.655344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.655372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.655495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.655667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.655692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.655788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.655909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.655953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.656134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.656229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.656255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.656349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.656445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.656470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.656613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.656741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.656769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.656864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.657041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.657067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.657156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.657258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.657284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.657381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.657536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.657562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.657683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.657896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.657924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.658063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.658198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.658223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.658313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.658431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.658456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.268 [2024-11-30 04:32:25.658551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.658676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.268 [2024-11-30 04:32:25.658701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.268 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.658836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.658968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.658997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.659198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.659310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.659336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.659483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.659640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.659665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.659781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.659893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.659926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.660048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.660132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.660158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.660277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.660397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.660422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.660546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.660688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.660713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.660835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.660929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.660955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.661088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.661179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.661204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.661299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.661431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.661456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.661544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.661659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.661684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.661808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.661980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.662009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.662169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.662328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.662356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.662483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.662590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.662617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.662793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.662911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.662937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.663095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.663214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.663242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.663422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.663517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.663544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.663668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.663804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.663831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.663947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.664093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.664119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.664253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.664382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.664409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.664539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.664670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.664699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.664812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.664941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.664981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.665154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.665245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.665270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.665362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.665491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.665516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.665607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.665726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.665751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.665846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.665966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.665992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.666086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.666164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.666189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.666291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.666408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.666451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.269 qpair failed and we were unable to recover it. 00:30:35.269 [2024-11-30 04:32:25.666550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.666648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.269 [2024-11-30 04:32:25.666690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.666786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.666935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.667005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.667130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.667220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.667246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.667360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.667472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.667497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.667588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.667687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.667713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.667795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.667916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.667941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.668070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.668163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.668189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.668285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.668399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.668425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.668519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.668616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.668642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.668802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.668939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.668976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.669119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.669208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.669232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.669347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.669435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.669460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.669597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.669734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.669759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.669880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.670004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.670046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.670189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.670304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.670330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.670478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.670603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.670631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.670773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.670902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.670931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.671074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.671195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.671223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.671331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.671478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.671502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.671620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.671741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.671766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.671861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.671975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.672001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.672098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.672195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.672221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.672321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.672443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.672468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.672577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.672684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.672712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.672851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.672948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.672997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.673148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.673243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.673268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.673363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.673499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.673528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.673670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.673830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.673857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.270 qpair failed and we were unable to recover it. 00:30:35.270 [2024-11-30 04:32:25.673973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.270 [2024-11-30 04:32:25.674117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.674142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.674277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.674416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.674440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.674529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.674677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.674702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.674857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.674943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.675000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.675135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.675249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.675274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.675372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.675507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.675535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.675705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.675853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.675878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.676005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.676150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.676175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.676298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.676388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.676412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.676590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.676715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.676740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.676835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.676951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.676984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.677127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.677229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.677257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.677416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.677571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.677598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.677705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.677838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.677865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.677989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.678106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.678132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.678282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.678422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.678449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.678575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.678714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.678739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.678858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.679000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.679026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.679110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.679231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.679256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.679376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.679493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.679518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.679667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.679754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.679779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.679871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.680017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.680060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.680203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.680321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.680346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.680451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.680575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.680603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.680739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.680868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.680895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.681039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.681153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.681178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.681263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.681385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.681410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.681524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.681638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.681663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.681847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.681939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.681975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.682108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.682241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.682266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.682384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.682531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.271 [2024-11-30 04:32:25.682556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.271 qpair failed and we were unable to recover it. 00:30:35.271 [2024-11-30 04:32:25.682669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.682789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.682814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.682952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.683111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.683137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.683255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.683350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.683374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.683460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.683583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.683608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.683692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.683802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.683827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.683948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.684043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.684069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.684189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.684337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.684362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.684481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.684595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.684620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.684730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.684886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.684914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.685044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.685192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.685217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.685309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.685394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.685420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.685567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.685658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.685683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.685806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.685928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.685953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.686061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.686150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.686175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.686261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.686349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.686373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.686497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.686592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.686617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.686721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.686905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.686931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.687055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.687198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.687224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.687371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.687480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.687525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.687611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.687758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.687783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.687903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.687991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.688017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.688183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.688304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.688330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.688421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.688513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.688538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.688685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.688778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.688803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.688927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.689028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.689054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.689167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.689303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.689332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.689444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.689608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.272 [2024-11-30 04:32:25.689636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.272 qpair failed and we were unable to recover it. 00:30:35.272 [2024-11-30 04:32:25.689778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.689894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.689919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.690097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.690231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.690258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.690407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.690554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.690579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.690671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.690764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.690807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.690945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.691089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.691115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.691207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.691296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.691321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.691464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.691570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.691598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.691724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.691824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.691849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.691930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.692082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.692108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.692253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.692351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.692379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.692559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.692708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.692733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.692848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.692972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.692998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.693125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.693239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.693264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.693397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.693526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.693554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.693685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.693787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.693815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.693953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.694103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.694128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.694251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.694342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.694366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.694490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.694634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.694658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.694776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.694899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.694924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.695069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.695214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.695239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.695387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.695506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.695531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.695651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.695793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.695817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.695936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.696031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.696057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.696198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.696356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.696384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.696503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.696595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.696620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.696719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.696857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.696884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.697058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.697149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.697174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.697292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.697384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.697425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.697569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.697685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.697710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.697795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.697876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.697917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.698099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.698235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.698263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.698421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.698558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.698586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.273 [2024-11-30 04:32:25.698735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.698884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.273 [2024-11-30 04:32:25.698909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.273 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.699023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.699166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.699194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.699315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.699418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.699444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.699541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.699676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.699704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.699817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.699937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.699986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.700130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.700264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.700291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.700418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.700550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.700577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.700681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.700777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.700805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.700943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.701100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.701126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.701294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.701386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.701414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.701584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.701729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.701758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.701904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.701989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.702015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.702112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.702258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.702283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.702371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.702503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.702530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.702618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.702754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.702779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.702922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.703026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.703074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.703191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.703288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.703314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.703460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.703549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.703574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.703668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.703757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.703782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.703902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.704019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.704063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.704180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.704302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.704333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.704456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.704604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.704630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.704755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.704843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.704868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.704971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.705057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.705086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.705203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.705351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.705376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.705517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.705617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.705645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.705807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.705929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.705966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.706108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.706231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.706256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.706379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.706467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.706492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.706672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.706791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.706816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.706932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.707093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.707120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.707274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.707431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.707459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.707585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.707733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.707758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.707855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.707939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.274 [2024-11-30 04:32:25.707973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.274 qpair failed and we were unable to recover it. 00:30:35.274 [2024-11-30 04:32:25.708074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.708236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.708264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.708395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.708525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.708553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.708732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.708848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.708873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.708996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.709082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.709108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.709203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.709322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.709348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.709489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.709592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.709621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.709764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.709876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.709902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.710080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.710181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.710209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.710341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.710507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.710536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.710650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.710746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.710773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.710888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.711007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.711032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.711169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.711325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.711352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.711511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.711668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.711695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.711801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.711945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.711978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.712098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.712187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.712212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.712304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.712392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.712417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.712592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.712684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.712712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.712823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.712984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.713013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.713182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.713295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.713320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.713433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.713546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.713571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.713668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.713790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.713830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.713954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.714100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.714126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.714254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.714374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.714400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.714545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.714661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.714685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.714804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.714925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.714950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.715094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.715237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.715265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.715433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.715517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.715542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.715681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.715819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.715847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.715948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.716087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.716112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.716259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.716415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.716440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.716558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.716646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.716670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.716789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.716891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.716916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.717044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.717138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.717164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.275 [2024-11-30 04:32:25.717300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.717393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.275 [2024-11-30 04:32:25.717421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.275 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.717587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.717748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.717776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.717900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.718045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.718071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.718161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.718250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.718275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.718371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.718464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.718492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.718621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.718742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.718768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.718863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.718945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.718977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.719072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.719191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.719216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.719345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.719519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.719544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.719654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.719740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.719765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.719864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.719951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.719985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.720126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.720274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.720299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.720417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.720586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.720614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.720781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.720899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.720924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.721028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.721119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.721146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.721274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.721368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.721394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.721479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.721597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.721622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.721778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.721893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.721918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.722056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.722167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.722192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.722284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.722367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.722392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.722488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.722629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.722657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.722772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.722891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.722917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.723065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.723185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.723210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.723352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.723448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.723490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.723610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.723731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.723757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.723883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.724011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.724038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.724149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.724312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.724340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.724468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.724572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.724600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.724730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.724836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.724864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.725005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.725101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.725127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.725249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.725397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.725425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.725582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.725713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.725741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.725872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.726027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.276 [2024-11-30 04:32:25.726053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.276 qpair failed and we were unable to recover it. 00:30:35.276 [2024-11-30 04:32:25.726163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.726252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.726277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.726398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.726514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.726539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.726628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.726792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.726821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.726951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.727103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.727128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.727220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.727344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.727370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.727466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.727585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.727610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.727700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.727812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.727837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.727964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.728143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.728168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.728312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.728484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.728512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.728611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.728767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.728807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.728964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.729134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.729162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.729276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.729409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.729437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.729553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.729706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.729731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.729844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.729977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.730018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.730147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.730265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.730290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.730409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.730509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.730534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.730627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.730716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.730740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.730861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.730947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.731001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.731124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.731271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.731297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.731401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.731565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.731590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.731710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.731831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.731857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.731948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.732059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.732087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.732220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.732315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.732362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.732499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.732661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.732686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.732819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.732938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.732972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.733121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.733255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.733284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.733384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.733540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.733569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.733704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.733838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.733866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.734006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.734132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.734157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.734301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.734401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.734428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.734569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.734684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.734710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.734820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.734954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.734989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.735106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.735230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.735254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.735347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.735434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.735459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.735577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.735722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.735747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.735833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.735955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.735986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.277 qpair failed and we were unable to recover it. 00:30:35.277 [2024-11-30 04:32:25.736067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.277 [2024-11-30 04:32:25.736208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.736233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.736375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.736496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.736524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.736661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.736761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.736790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.736921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.737104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.737130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.737277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.737394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.737419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.737530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.737658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.737683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.737776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.737892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.737918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.738072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.738216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.738241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.738389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.738501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.738526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.738692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.738788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.738816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.738993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.739143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.739169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.739256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.739348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.739374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.739491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.739634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.739659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.739814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.739971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.740015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.740161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.740274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.740299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.740394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.740540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.740565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.740714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.740860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.740885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.741038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.741138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.741168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.741327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.741459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.741502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.741605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.741767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.741795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.741939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.742062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.742088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.742208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.742332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.742358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.742477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.742640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.742668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.742795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.742895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.742923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.743102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.743216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.743242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.743339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.743448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.743473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.743627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.743744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.743768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.743910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.744037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.744064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.744163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.744308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.744333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.744484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.744632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.744656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.744780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.744874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.744902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.745011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.745208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.745236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.745351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.745447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.745472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.745598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.745685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.745727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.745855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.745966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.746009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.746131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.746245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.746273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.278 qpair failed and we were unable to recover it. 00:30:35.278 [2024-11-30 04:32:25.746386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.746538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.278 [2024-11-30 04:32:25.746563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.746680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.746795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.746824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.746917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.747060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.747087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.747188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.747299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.747324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.747409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.747517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.747542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.747630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.747711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.747736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.747930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.748027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.748052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.748200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.748318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.748342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.748460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.748555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.748579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.748671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.748789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.748813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.748980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.749067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.749093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.749242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.749337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.749367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.749518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.749639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.749665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.749805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.749939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.749975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.750115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.750206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.750231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.750349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.750473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.750498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.750587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.750682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.750709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.750877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.751011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.751041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.751169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.751301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.751343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.751457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.751600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.751624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.751740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.751861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.751886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.752007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.752107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.752133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.752231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.752376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.752402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.752543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.752683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.752708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.752821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.752930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.752955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.753088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.753208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.753233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.753319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.753416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.753441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.753597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.753722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.753747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.753872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.753998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.754023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.754182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.754267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.754292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.754390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.754562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.754588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.754686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.754869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.754895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.755044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.755170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.755195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.755283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.755395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.755421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.755536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.755622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.755647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.755795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.755969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.755998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.279 [2024-11-30 04:32:25.756142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.756237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.279 [2024-11-30 04:32:25.756262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.279 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.756401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.756510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.756550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.756668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.756755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.756781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.756881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.756996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.757023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.757144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.757255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.757280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.757374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.757544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.757571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.757701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.757838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.757867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.757978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.758110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.758138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.758309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.758403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.758428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.758547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.758668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.758693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.758814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.758906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.758932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.759089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.759222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.759250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.759397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.759508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.759533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.759676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.759774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.759798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.759923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.760076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.760102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.760197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.760283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.760308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.760392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.760475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.760501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.760648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.760786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.760814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.760971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.761088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.761113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.761236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.761323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.761348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.761444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.761565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.761590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.761678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.761801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.761841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.761950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.762087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.762115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.762221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.762340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.762367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.762483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.762580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.762607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.762728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.762852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.762877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.763015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.763175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.763208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.763314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.763415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.763443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.763592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.763738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.763763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.763862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.763998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.764028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.764136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.764239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.764269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.764404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.764534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.764562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.764739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.764829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.764855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.765001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.765157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.280 [2024-11-30 04:32:25.765186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.280 qpair failed and we were unable to recover it. 00:30:35.280 [2024-11-30 04:32:25.765310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.765445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.765472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.765618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.765706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.765731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.765875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.765992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.766018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.766141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.766235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.766261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.766387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.766514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.766542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.766675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.766807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.766835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.766940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.767049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.767075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.767196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.767311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.767336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.767454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.767593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.767623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.767760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.767891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.767934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.768060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.768167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.768197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.768316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.768421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.768447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.768538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.768627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.768653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.768752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.768881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.768907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.769067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.769155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.769181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.769287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.769380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.769406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.769508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.769629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.769654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.769774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.769891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.769917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.770016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.770137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.770165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.770294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.770392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.770418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.770513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.770599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.770627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.770772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.770866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.770894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.770993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.771086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.771112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.771249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.771366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.771392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.771540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.771682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.771710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.771833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.771921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.771948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.772106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.772249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.772276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.772394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.772496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.772522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.772673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.772769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.772795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.772891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.772994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.773021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.773148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.773277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.773303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.773419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.773515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.773542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.773667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.773815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.773841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.773969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.774096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.774121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.774237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.774369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.774394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.774542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.774659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.774686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.281 qpair failed and we were unable to recover it. 00:30:35.281 [2024-11-30 04:32:25.774769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.774890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.281 [2024-11-30 04:32:25.774916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.775072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.775195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.775221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.775374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.775495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.775521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.775650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.775774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.775800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.775893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.775977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.776004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.776146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.776271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.776319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.776439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.776588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.776614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.776722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.776868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.776893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.777009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.777167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.777213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.777302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.777448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.777474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.777577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.777688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.777713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.777806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.777896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.777922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.778019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.778140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.778167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.778284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.778406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.778432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.778553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.778698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.778724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.778853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.778974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.779001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.779148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.779337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.779380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.779498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.779648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.779674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.779772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.779932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.779970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.780066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.780205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.780249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.780380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.780550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.780594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.780692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.780837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.780863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.781014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.781113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.781138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.781258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.781374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.781401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.781521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.781667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.781693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.781810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.781955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.781986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.782099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.782235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.782261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.782385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.782479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.782505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.782596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.782691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.782720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.782820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.782943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.782975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.783105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.783226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.783252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.783397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.783490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.783515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.783607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.783726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.783751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.783900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.784044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.784090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.784238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.784374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.784418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.784548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.784671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.784697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.784815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.784930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.784956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.282 qpair failed and we were unable to recover it. 00:30:35.282 [2024-11-30 04:32:25.785086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.785239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.282 [2024-11-30 04:32:25.785265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.785384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.785466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.785494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.785643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.785797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.785824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.785973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.786109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.786153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.786319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.786483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.786509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.786630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.786747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.786774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.786869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.786962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.786990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.787113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.787232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.787257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.787375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.787485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.787511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.787629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.787724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.787751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.787846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.788002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.788030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.788155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.788301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.788327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.788420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.788569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.788596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.788698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.788849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.788874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.789010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.789164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.789208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.789363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.789527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.789554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.789675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.789795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.789822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.789914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.790066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.790111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.790209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.790325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.790351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.790482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.790626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.790652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.790798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.790889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.790920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.791076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.791215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.791259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.791433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.791577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.791603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.791723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.791816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.791843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.791991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.792132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.792176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.792273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.792390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.792416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.792516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.792637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.792663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.792786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.792933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.792968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.793118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.793235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.793261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.793380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.793500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.793533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.793685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.793784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.793818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.793976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.794095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.794120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.794257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.794425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.794451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.794574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.794698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.794724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.794817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.794901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.794926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.795072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.795213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.795240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.283 qpair failed and we were unable to recover it. 00:30:35.283 [2024-11-30 04:32:25.795334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.283 [2024-11-30 04:32:25.795455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.795481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.795634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.795749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.795775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.795899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.795993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.796019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.796157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.796291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.796321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.796503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.796662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.796691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.796786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.796909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.796936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.797047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.797195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.797220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.797360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.797527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.797553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.797654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.797774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.797799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.797942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.798036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.798065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.798210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.798359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.798388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.798525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.798645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.798673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.798835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.798923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.798950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.799092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.799217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.799247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.799394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.799515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.799545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.799692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.799814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.799840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.799972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.800105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.800148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.800281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.800421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.800451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.800564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.800681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.800707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.800865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.800965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.800991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.801112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.801230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.801255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.801375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.801496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.801525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.801619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.801729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.801755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.801874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.801987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.802014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.802137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.802263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.802290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.802413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.802531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.802557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.802707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.802800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.802825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.802946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.803036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.803061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.803152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.803304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.803331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.803446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.803564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.803590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.803736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.803824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.803850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.803987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.804130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.804175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.804320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.804464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.804490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.804585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.804729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.804754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.804876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.804995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.805021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.805168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.805331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.805374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.805529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.805654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.805680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.805801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.805919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.805947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.806055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.806152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.806178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.806297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.806419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.806444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.284 [2024-11-30 04:32:25.806576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.806665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.284 [2024-11-30 04:32:25.806691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.284 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.806783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.806935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.806968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.807093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.807185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.807211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.807354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.807458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.807486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.807651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.807770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.807795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.807970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.808066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.808093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.808250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.808362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.808391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.808552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.808714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.808740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.808857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.808953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.808986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.809097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.809263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.809310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.809459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.809606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.809632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.809753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.809870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.809896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.810030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.810213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.810257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.810397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.810533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.810559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.810678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.810775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.810802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.810928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.811062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.811089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.811202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.811319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.811344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.811438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.811551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.811580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.811738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.811857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.811884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.812002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.812147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.812173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.812316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.812429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.812471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.812597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.812719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.812746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.812898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.813039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.813083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.813224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.813409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.813453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.813579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.813755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.813781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.813918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.814072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.814115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.814286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.814440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.814469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.814610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.814753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.814779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.814901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.815045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.815089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.815178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.815375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.815401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.815529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.815679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.815705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.815806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.815901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.815926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.816097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.816229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.816274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.816366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.816527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.816554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.816677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.816796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.816822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.816979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.817123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.817166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.817322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.817418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.817444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.817561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.817678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.817705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.817830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.817955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.817987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.818073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.818216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.818242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.285 qpair failed and we were unable to recover it. 00:30:35.285 [2024-11-30 04:32:25.818337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.285 [2024-11-30 04:32:25.818479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.818506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.818591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.818707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.818735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.818858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.819004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.819031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.819148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.819265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.819292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.819416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.819534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.819559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.819680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.819801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.819827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.819924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.820055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.820082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.820235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.820321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.820347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.820497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.820620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.820645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.820765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.820889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.820914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.821057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.821212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.821255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.821416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.821539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.821565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.821686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.821806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.821833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.821952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.822082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.822109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.822263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.822408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.822434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.822560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.822661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.822688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.822815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.822941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.822975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.823098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.823197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.823223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.823310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.823433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.823459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.823605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.823743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.823769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.823920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.824118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.824163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.824298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.824479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.824522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.824642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.824753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.824779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.824863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.825008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.825036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.825163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.825289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.825318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.825466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.825593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.825620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.825709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.825797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.825824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.825944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.826067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.826093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.826184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.826303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.826328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.826452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.826581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.826609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.826726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.826847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.826874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.826988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.827165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.827209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.827348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.827484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.827511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.827637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.827757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.827784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.827881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.828005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.828032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.828178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.828301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.828328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.828460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.828573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.828600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.828711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.828833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.828858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.829003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.829109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.829136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.286 qpair failed and we were unable to recover it. 00:30:35.286 [2024-11-30 04:32:25.829233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.286 [2024-11-30 04:32:25.829352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.829379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.829500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.829614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.829641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.829763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.829852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.829879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.830009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.830107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.830134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.830253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.830398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.830425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.830546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.830669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.830697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.830844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.830942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.830973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.831103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.831223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.831253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.831378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.831527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.831553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.831668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.831787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.831812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.831930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.832062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.832089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.832218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.832339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.832365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.832514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.832637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.832662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.832814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.832929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.832965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.833098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.833198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.833225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.833346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.833464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.833490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.833612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.833732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.833758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.833887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.834051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.834095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.834242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.834429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.834473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.834576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.834687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.834713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.834815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.834934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.834967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.835075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.835229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.835256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.835348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.835448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.835474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.835580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.835699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.835725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.835838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.835927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.835953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.836086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.836208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.836234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.836358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.836457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.836488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.836591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.836716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.836741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.836858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.836980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.837006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.837105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.837201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.837227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.837317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.837432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.837458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.837605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.837724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.837751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.837873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.837975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.838002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.838126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.838274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.838300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.838424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.838572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.838598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.838714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.838859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.838884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.839033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.839155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.839185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.839274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.839390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.839416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.839534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.839622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.839651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.839740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.839862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.839888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.287 [2024-11-30 04:32:25.840008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.840154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.287 [2024-11-30 04:32:25.840180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.287 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.840304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.840422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.840448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.840568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.840718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.840744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.840834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.840980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.841010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.841131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.841255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.841281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.841432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.841537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.841562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.841650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.841749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.841779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.841905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.842050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.842099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.842215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.842352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.842379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.842471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.842619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.842646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.842730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.842852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.842878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.842975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.843095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.843122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.843249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.843368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.843395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.843522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.843628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.843653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.843743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.843861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.843887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.844037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.844136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.844165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.844270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.844362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.844388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.844520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.844616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.844641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.844729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.844904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.844929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.845086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.845210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.845237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.845360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.845482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.845508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.288 [2024-11-30 04:32:25.845606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.845712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.288 [2024-11-30 04:32:25.845739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.288 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.845857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.845951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.845986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.846116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.846235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.846261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.846367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.846490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.846516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.846610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.846730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.846755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.846856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.846942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.846975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.847075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.847200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.847227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.847353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.847475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.847502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.847620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.847743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.847769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.847868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.847991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.848019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.848133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.848259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.848285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.848375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.848459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.848485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.848578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.848664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.848689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.848811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.848902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.848927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.849032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.849126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.849152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.849302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.849425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.849451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.849584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.849703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.849729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.849852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.849975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.850002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.850133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.850274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.850300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.850450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.850572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.850599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.850723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.850837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.850863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.850981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.851161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.851204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.851341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.851462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.851490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.851619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.851714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.851741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.851890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.852035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.852079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.852201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.852344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.852371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.852519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.852648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.852674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.852831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.852951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.852983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.853108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.853227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.579 [2024-11-30 04:32:25.853254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.579 qpair failed and we were unable to recover it. 00:30:35.579 [2024-11-30 04:32:25.853375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.853499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.853525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.853647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.853768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.853794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.853907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.854053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.854082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.854232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.854416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.854463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.854588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.854711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.854737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.854837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.854986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.855013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.855149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.855308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.855351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.855475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.855594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.855623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.855746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.855844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.855871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.855991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.856109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.856135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.856260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.856378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.856403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.856490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.856640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.856666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.856792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.856934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.856966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.857091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.857225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.857268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.857408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.857535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.857579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.857693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.857788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.857814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.857926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.858019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.858046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.858176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.858263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.858290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.858410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.858504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.858531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.858650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.858776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.858801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.858925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.859045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.859088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.859212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.859343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.859386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.859522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.859640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.859666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.859784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.859882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.859909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.860053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.860180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.860207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.860340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.860487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.860513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.860650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.860746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.860773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.860925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.861058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.861086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.861206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.861358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.861385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.861517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.861676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.861702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.861817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.861966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.861993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.862091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.862191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.862222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.862351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.862472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.862498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.862620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.862734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.862760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.862879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.863052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.863100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.863228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.863316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.863342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.863462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.863599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.863625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.863755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.863884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.863913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.580 qpair failed and we were unable to recover it. 00:30:35.580 [2024-11-30 04:32:25.864046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.864142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.580 [2024-11-30 04:32:25.864169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.864255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.864400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.864426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.864553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.864651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.864682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.864831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.864928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.864955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.865112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.865205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.865233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.865379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.865494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.865523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.865643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.865728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.865755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.865878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.865994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.866020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.866105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.866230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.866256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.866404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.866530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.866555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.866704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.866823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.866849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.866942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.867091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.867117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.867261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.867400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.867427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.867555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.867651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.867677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.867773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.867899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.867925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.868082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.868210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.868239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.868367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.868503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.868529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.868678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.868827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.868852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.868952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.869080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.869108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.869229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.869325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.869353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.869449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.869568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.869595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.869714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.869866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.869892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.869987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.870077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.870104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.870249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.870413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.870439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.870560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.870683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.870711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.870860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.870964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.870990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.871159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.871349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.871394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.871521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.871615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.871640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.871759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.871850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.871877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.871982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.872132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.872175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.872324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.872462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.872490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.872588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.872680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.872706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.872825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.872944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.872980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.873112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.873269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.873313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.873405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.873501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.873527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.873672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.873761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.873787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.873937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.874065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.874092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.874214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.874337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.874363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.874455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.874548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.874576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.581 qpair failed and we were unable to recover it. 00:30:35.581 [2024-11-30 04:32:25.874727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.581 [2024-11-30 04:32:25.874854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.874880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.874997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.875144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.875170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.875294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.875409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.875435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.875550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.875641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.875671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.875804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.875948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.875979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.876116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.876266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.876308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.876443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.876562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.876588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.876683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.876801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.876828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.876979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.877095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.877121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.877266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.877385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.877410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.877501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.877620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.877650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.877776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.877874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.877901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.877997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.878114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.878147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.878302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.878423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.878448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.878560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.878677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.878704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.878824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.878970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.878997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.879112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.879275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.879302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.879447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.879602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.879628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.879724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.879845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.879873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.879985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.880152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.880195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.880310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.880445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.880475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.880577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.880662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.880688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.880813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.880929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.880956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.881059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.881182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.881208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.881334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.881454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.881480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.881620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.881742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.881768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.881920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.882064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.882107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.882226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.882416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.882461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.882581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.882675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.882702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.882822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.882939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.882971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.883119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.883248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.883280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.883430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.883550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.883577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.883667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.883764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.883791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.582 qpair failed and we were unable to recover it. 00:30:35.582 [2024-11-30 04:32:25.883941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.884093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.582 [2024-11-30 04:32:25.884138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.884268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.884426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.884475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.884599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.884721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.884746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.884872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.885024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.885051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.885171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.885264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.885290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.885409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.885529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.885556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.885677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.885795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.885822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.885912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.886037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.886068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.886220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.886366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.886392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.886505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.886596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.886623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.886716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.886838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.886866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.887013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.887135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.887161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.887319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.887409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.887435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.887541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.887632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.887661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.887782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.887903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.887930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.888033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.888181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.888206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.888354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.888471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.888496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.888614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.888710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.888738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.888868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.888965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.888993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.889085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.889209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.889235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.889387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.889474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.889499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.889617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.889710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.889737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.889842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.889967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.889994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.890131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.890263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.890289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.890414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.890567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.890592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.890793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.890909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.890935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.891094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.891215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.891259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.891460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.891585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.891612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.891716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.891913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.891938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.892109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.892270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.892296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.892392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.892524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.892568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.892725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.892822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.892851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.892975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.893116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.893159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.893301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.893501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.893527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.893673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.893794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.893820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.893941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.894093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.894137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.894263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.894403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.894429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.894548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.894671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.894697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.894826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.895028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.895055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.583 qpair failed and we were unable to recover it. 00:30:35.583 [2024-11-30 04:32:25.895181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.583 [2024-11-30 04:32:25.895378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.895404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.895530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.895670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.895696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.895814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.895935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.895977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.896191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.896326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.896358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.896504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.896654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.896680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.896831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.896978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.897005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.897136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.897284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.897313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.897445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.897564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.897589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.897735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.897866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.897893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.898082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.898242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.898285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.898405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.898525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.898552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.898683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.898797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.898824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.898973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.899090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.899134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.899284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.899400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.899427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.899548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.899677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.899703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.899831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.899980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.900007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.900121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.900227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.900253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.900372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.900517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.900542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.900663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.900782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.900809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.900931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.901097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.901141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.901288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.901392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.901418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.901542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.901661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.901687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.901809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.901898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.901925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.902030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.902123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.902150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.902300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.902419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.902445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.902586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.902705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.902734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.902882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.903019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.903049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.903201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.903354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.903396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.903509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.903656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.903682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.903809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.903932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.903963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.904097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.904239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.904265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.904390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.904482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.904509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.904653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.904775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.904800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.904950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.905076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.905102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.905223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.905346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.905372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.905469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.905562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.905588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.905714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.905837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.905862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.905978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.906129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.906155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.906275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.906371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.906398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.584 [2024-11-30 04:32:25.906549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.906670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.584 [2024-11-30 04:32:25.906695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.584 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.906822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.906965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.906992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.907112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.907239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.907266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.907364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.907483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.907509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.907660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.907816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.907842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.907941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.908087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.908114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.908204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.908324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.908350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.908473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.908627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.908653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.908804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.908919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.908945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.909052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.909172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.909197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.909345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.909470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.909496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.909584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.909704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.909731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.909880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.910012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.910042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.910205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.910367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.910393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.910513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.910632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.910657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.910802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.910921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.910947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.911052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.911197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.911240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.911381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.911518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.911544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.911666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.911817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.911842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.911981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.912117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.912147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.912299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.912441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.912468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.912588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.912701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.912728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.912846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.912939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.912973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.913104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.913247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.913273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.913403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.913523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.913549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.913646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.913790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.913815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.913934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.914054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.914080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.914183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.914302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.914329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.914453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.914548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.914574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.914718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.914861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.914887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.915012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.915219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.915246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.915413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.915574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.915600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.915748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.915894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.915920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.916069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.916227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.916272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.916418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.916594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.916637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.916734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.916886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.916912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.917085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.917249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.917296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.917441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.917579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.917605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.585 qpair failed and we were unable to recover it. 00:30:35.585 [2024-11-30 04:32:25.917727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.917819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.585 [2024-11-30 04:32:25.917846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.917995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.918085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.918112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.918281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.918431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.918458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.918551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.918668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.918694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.918817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.918899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.918929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.919028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.919179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.919205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.919333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.919481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.919508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.919602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.919801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.919827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.919949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.920101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.920129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.920252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.920352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.920378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.920523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.920638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.920663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.920816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.920929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.920954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.921087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.921212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.921238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.921363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.921450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.921476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.921621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.921744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.921771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.921890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.922038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.922069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.922231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.922351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.922377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.922498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.922620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.922646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.922735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.922883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.922909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.923017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.923111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.923137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.923262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.923350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.923376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.923497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.923622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.923648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.923739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.923858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.923888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.924024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.924159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.924185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.924306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.924426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.924452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.924574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.924688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.924713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.924855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.924977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.925004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.925122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.925268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.925294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.925416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.925536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.925563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.925685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.925777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.925803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.925917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.926045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.926072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.926172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.926292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.926317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.926440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.926585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.926615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.926736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.926866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.926892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.927043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.927232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.927275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.927369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.927480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.927523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.586 qpair failed and we were unable to recover it. 00:30:35.586 [2024-11-30 04:32:25.927645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.586 [2024-11-30 04:32:25.927737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.927762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.927883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.928001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.928028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.928125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.928242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.928268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.928415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.928538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.928563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.928653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.928797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.928822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.928917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.929027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.929054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.929176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.929272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.929303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.929427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.929517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.929544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.929638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.929735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.929763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.929889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.930019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.930046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.930193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.930292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.930318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.930405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.930530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.930555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.930647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.930767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.930795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.930918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.931067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.931093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.931184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.931277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.931302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.931424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.931514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.931542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.931663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.931782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.931813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.931934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.932065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.932092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.932229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.932369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.932395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.932506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.932626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.932652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.932767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.932914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.932941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.933042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.933203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.933228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.933324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.933470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.933496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.933598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.933748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.933774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.933867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.933987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.934013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.934138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.934237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.934262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.934423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.934536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.934562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.934690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.934810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.934838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.934938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.935062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.935090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.935185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.935276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.935301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.935391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.935518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.935543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.935642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.935764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.935789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.935940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.936065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.936092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.936216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.936356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.936404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.936549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.936696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.936722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.936871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.936986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.937012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.937125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.937290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.937316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.937470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.937590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.937618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.937745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.937864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.937890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.587 qpair failed and we were unable to recover it. 00:30:35.587 [2024-11-30 04:32:25.938018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.587 [2024-11-30 04:32:25.938111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.938136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.938258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.938381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.938407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.938553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.938668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.938695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.938830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.938925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.938951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.939059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.939199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.939243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.939385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.939519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.939544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.939690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.939837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.939863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.940002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.940162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.940206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.940350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.940479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.940505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.940621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.940742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.940767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.940916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.941029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.941059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.941225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.941379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.941425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.941578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.941699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.941726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.941832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.941976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.942004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.942127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.942280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.942307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.942427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.942525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.942550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.942642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.942763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.942790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.942887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.943009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.943038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.943168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.943255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.943282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.943431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.943554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.943579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.943683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.943801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.943831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.943930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.944055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.944083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.944175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.944294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.944320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.944469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.944562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.944589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.944739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.944885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.944911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.945027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.945175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.945202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.945347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.945443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.945469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.945594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.945709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.945735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.945866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.946015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.946043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.946165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.946326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.946351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.946481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.946602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.946627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.946726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.946815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.946841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.946952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.947051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.947077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.947166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.947313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.947339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.947467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.947587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.947613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.947738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.947857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.947885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.948010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.948128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.948154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.948280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.948402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.948428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.948555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.948679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.948706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.588 [2024-11-30 04:32:25.948831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.948954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.588 [2024-11-30 04:32:25.948997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.588 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.949093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.949189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.949214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.949366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.949458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.949484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.949605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.949723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.949749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.949874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.949991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.950018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.950146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.950268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.950295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.950420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.950506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.950532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.950686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.950804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.950830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.950920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.951016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.951043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.951168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.951290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.951317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.951469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.951624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.951650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.951775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.951904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.951929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.952062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.952181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.952206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.952332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.952445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.952471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.952616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.952737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.952763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.952882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.953030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.953057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.953183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.953331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.953357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.953502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.953626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.953652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.953748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.953871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.953899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.954058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.954209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.954234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.954355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.954449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.954476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.954567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.954684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.954710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.954833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.954964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.954992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.955123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.955209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.955235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.955333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.955492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.955518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.955674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.955772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.955797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.955893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.956010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.956036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.956135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.956259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.956286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.956407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.956535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.956563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.956681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.956809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.956835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.956983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.957105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.957132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.957256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.957389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.957415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.957515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.957609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.957635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.957759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.957884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.957911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.958036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.958169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.958195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.958319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.958417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.958443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.589 qpair failed and we were unable to recover it. 00:30:35.589 [2024-11-30 04:32:25.958541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.958631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.589 [2024-11-30 04:32:25.958656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.958787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.958909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.958936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.959043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.959186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.959213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.959335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.959437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.959464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.959579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.959701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.959727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.959823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.959940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.959973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.960098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.960217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.960242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.960337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.960456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.960483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.960630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.960760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.960786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.960910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.961028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.961054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.961173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.961286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.961311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.961431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.961552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.961581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.961700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.961848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.961874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.961976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.962077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.962102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.962224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.962314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.962341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.962453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.962572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.962599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.962719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.962839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.962865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.962968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.963087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.963112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.963197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.963319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.963346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.963437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.963548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.963576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.963726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.963815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.963841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.963968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.964059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.964085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.964180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.964301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.964327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.964459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.964575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.964605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.964723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.964842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.964868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.965018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.965165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.965192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.965310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.965456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.965484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.965616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.965736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.965762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.965856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.965972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.965999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.966146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.966293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.966322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.966475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.966570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.966598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.966722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.966816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.966842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.966967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.967088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.967113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.967244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.967393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.967423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.967570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.967689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.967715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.967863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.967983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.968009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.968107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.968199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.968226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.968325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.968447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.968473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.968594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.968712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.968739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.968887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.968987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.590 [2024-11-30 04:32:25.969015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.590 qpair failed and we were unable to recover it. 00:30:35.590 [2024-11-30 04:32:25.969140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.969253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.969278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.969376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.969522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.969548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.969698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.969794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.969819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.969947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.970100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.970130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.970254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.970369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.970396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.970518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.970637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.970663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.970779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.970870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.970896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.971053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.971203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.971229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.971347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.971442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.971469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.971615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.971708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.971733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.971854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.972002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.972028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.972157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.972250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.972277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.972396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.972570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.972596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.972715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.972842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.972874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.972992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.973078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.973103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.973230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.973327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.973353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.973500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.973623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.973649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.973778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.973874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.973900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.973993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.974140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.974167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.974317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.974463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.974492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.974616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.974764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.974790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.974918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.975024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.975052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.975140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.975259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.975285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.975409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.975555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.975581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.975741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.975832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.975859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.975994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.976111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.976137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.976290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.976416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.976442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.976546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.976671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.976697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.976784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.976908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.976935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.977037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.977151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.977178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.977273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.977420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.977447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.977600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.977721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.977746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.977900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.978022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.978048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.978171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.978320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.978345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.978471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.978628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.978653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.978776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.978909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.978935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.979062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.979154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.979180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.979307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.979452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.979478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.979629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.979747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.979773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.591 qpair failed and we were unable to recover it. 00:30:35.591 [2024-11-30 04:32:25.979901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.591 [2024-11-30 04:32:25.979994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.980021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.980188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.980348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.980390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.980546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.980700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.980726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.980819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.980935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.980976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.981127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.981291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.981335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.981429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.981545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.981570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.981686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.981798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.981823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.981947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.982047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.982073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.982223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.982344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.982373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.982476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.982623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.982648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.982798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.982938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.982970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.983140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.983288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.983333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.983489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.983659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.983685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.983830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.983950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.983985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.984111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.984233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.984258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.984384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.984504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.984529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.984664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.984808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.984834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.984984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.985119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.985145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.985285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.985419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.985445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.985565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.985715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.985741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.985870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.986038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.986068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.986204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.986330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.986356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.986491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.986636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.986662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.986816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.986941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.986973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.987106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.987215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.987244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.987409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.987544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.987569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.987701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.987821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.987847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.987995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.988087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.988113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.988269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.988388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.988413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.988514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.988635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.988662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.988805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.988949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.988984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.989125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.989315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.989358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.989495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.989632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.989659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.989757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.989904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.989930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.990076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.990169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.990195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.592 [2024-11-30 04:32:25.990300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.990442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.592 [2024-11-30 04:32:25.990468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.592 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.990594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.990710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.990736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.990854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.990970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.990996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.991130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.991246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.991272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.991397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.991528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.991554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.991647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.991769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.991796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.991899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.992051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.992078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.992173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.992293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.992319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.992466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.992588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.992614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.992710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.992826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.992852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.992992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.993114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.993140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.993290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.993389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.993415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.993537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.993624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.993649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.993751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.993870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.993896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.994010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.994101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.994126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.994220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.994366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.994394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.994488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.994607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.994633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.994756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.994905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.994930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.995060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.995179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.995206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.995333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.995453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.995480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.995593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.995722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.995759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.995856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.996000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.996031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.996166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.996299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.996329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.996457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.996641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.996672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.996820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.996939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.996974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.997128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.997216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.997243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.997365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.997476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.997506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.997647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.997780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.997810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.997955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.998116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.998143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.998271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.998396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.998422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.998536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.998711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.998739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.998869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.999038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.999065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.999163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.999259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.999285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.999423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.999520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.999550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.999685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.999820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:25.999851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:25.999954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.000084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.000110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:26.000212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.000348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.000377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:26.000502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.000617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.000648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:26.000752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.000854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.000895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:26.001008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.001097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.001122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.593 qpair failed and we were unable to recover it. 00:30:35.593 [2024-11-30 04:32:26.001241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.593 [2024-11-30 04:32:26.001371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.001398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.001511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.001696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.001740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.001867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.001979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.002005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.002097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.002216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.002242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.002335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.002460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.002488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.002605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.002688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.002739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.002868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.003012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.003040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.003161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.003339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.003368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.003514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.003678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.003707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.003795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.003929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.003954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.004085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.004197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.004226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.004352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.004496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.004521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.004664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.004852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.004880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.005005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.005097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.005122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.005285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.005391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.005418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.005574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.005750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.005795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.005931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.006033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.006058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.006157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.006245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.006270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.006432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.006564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.006593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.006687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.006818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.006845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.006962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.007111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.007141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.007262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.007374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.007399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.007516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.007606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.007631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.007737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.007862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.007890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.008032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.008157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.008182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.008298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.008394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.008435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.008564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.008689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.008717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.008847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.008979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.009024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.009155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.009278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.009303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.009406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.009524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.009553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.009647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.009742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.009770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.009874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.010014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.010041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.010164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.010248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.010273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.010399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.010485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.010510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.010606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.010770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.010797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.010924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.011101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.011126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.011247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.011332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.011357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.011474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.011591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.011619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.011785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.011888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.011916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.594 qpair failed and we were unable to recover it. 00:30:35.594 [2024-11-30 04:32:26.012040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.012152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.594 [2024-11-30 04:32:26.012177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.012328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.012416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.012443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.012573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.012673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.012698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.012789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.012873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.012898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.013012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.013128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.013153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.013257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.013378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.013403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.013494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.013589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.013615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.013756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.013908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.013934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.014056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.014174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.014199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.014292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.014390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.014415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.014552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.014721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.014750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.014976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.015090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.015115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.015205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.015391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.015439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.015576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.015667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.015694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.015818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.015934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.015965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.016063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.016144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.016169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.016307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.016430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.016458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.016602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.016722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.016747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.016832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.016929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.016955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.017049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.017144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.017169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.017265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.017384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.017409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.017530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.017620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.017644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.017736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.017857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.017883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.017998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.018083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.018109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.018221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.018355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.018381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.018550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.018740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.018768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.018877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.018997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.019023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.019119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.019203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.019229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.019321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.019410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.019435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.019580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.019671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.019714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.019845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.019949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.019998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.020121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.020224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.020249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.020346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.020437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.020466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.020589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.020706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.020732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.020852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.020939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.020975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.021101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.021184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.021209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.021313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.021442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.021467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.021566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.021660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.021685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.021817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.021908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.021935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.595 qpair failed and we were unable to recover it. 00:30:35.595 [2024-11-30 04:32:26.022082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.595 [2024-11-30 04:32:26.022222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.022269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.022375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.022532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.022559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.022710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.022832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.022858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.022987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.023112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.023145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.023273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.023395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.023421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.023542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.023681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.023710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.023824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.023942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.023977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.024107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.024197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.024224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.024341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.024442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.024468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.024594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.024716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.024741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.024872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.024991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.025019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.025145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.025260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.025287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.025437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.025527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.025554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.025720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.025867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.025898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.026000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.026116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.026142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.026281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.026417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.026442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.026546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.026647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.026673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.026771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.026871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.026896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.027058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.027175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.027200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.027289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.027469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.027495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.027622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.027708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.027734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.027827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.027942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.027992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.028117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.028241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.028266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.028365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.028477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.028519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.028656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.028831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.028856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.028993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.029092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.029118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.029214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.029335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.029361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.029449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.029540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.029582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.029709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.029829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.029857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.029955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.030077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.030102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.030249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.030371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.030396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.030523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.030640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.030665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.030756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.030892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.030917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.031072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.031171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.031196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.031317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.031410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.596 [2024-11-30 04:32:26.031435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.596 qpair failed and we were unable to recover it. 00:30:35.596 [2024-11-30 04:32:26.031554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.031641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.031665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.031756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.031842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.031869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.032018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.032132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.032157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.032257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.032374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.032400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.032516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.032658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.032684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.032805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.032913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.032938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.033097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.033190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.033215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.033331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.033453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.033478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.033590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.033745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.033772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.033860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.033984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.034028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.034174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.034322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.034347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.034471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.034562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.034589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.034691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.034773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.034800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.034914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.035024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.035050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.035176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.035267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.035291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.035386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.035464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.035489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.035578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.035661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.035686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.035835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.035966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.035994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.036097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.036241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.036285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.036398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.036520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.036545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.036672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.036783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.036809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.036890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.037008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.037034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.037161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.037272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.037298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.037410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.037558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.037583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.037688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.037807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.037832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.037951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.038077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.038102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.038196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.038290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.038314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.038434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.038576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.038601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.038740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.038920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.038946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.039116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.039215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.039244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.039365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.039454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.039480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.039627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.039714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.039740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.039873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.039987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.040029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.040153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.040289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.040317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.040426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.040570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.040594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.040688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.040805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.040830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.040929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.041076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.041102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.041247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.041340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.041366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.041459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.041563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.597 [2024-11-30 04:32:26.041589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.597 qpair failed and we were unable to recover it. 00:30:35.597 [2024-11-30 04:32:26.041732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.041873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.041898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.042052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.042140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.042166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.042301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.042445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.042470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.042557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.042673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.042712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.042812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.042931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.042962] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.043052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.043143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.043168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.043251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.043393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.043419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.043517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.043610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.043652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.043743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.043832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.043857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.043954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.044061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.044088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.044170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.044283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.044309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.044429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.044524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.044548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.044648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.044766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.044791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.044979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.045063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.045089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.045203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.045319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.045344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.045457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.045575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.045600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.045720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.045835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.045859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.045971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.046127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.046155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.046310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.046403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.046429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.046551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.046692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.046717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.046833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.046954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.046984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.047174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.047349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.047379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.047515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.047615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.047641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.047741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.047843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.047871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.047995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.048120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.048146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.048263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.048392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.048418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.048544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.048673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.048698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.048806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.048926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.048951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.049064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.049165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.049190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.049279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.049428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.049454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.049604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.049729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.049755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.049881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.050034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.050061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.050187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.050286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.050312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.050408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.050529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.050556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.050651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.050740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.050767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.050893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.052986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.053030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.053159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.053283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.053308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.053414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.053539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.053565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.053722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.053846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.598 [2024-11-30 04:32:26.053871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.598 qpair failed and we were unable to recover it. 00:30:35.598 [2024-11-30 04:32:26.053975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.054075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.054100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.054198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.054347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.054373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.054500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.054605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.054630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.054753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.054875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.054901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.055029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.055120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.055146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.055272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.055395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.055420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.055572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.055723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.055748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.055873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.055998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.056024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.056176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.056323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.056358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.056499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.056664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.056699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.056841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.057006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.057041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.057215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.057350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.057384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.057552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.057671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.057706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.057820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.057986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.058021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.058146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.058253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.058288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.058433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.058541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.058575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.058684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.058819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.058852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.058998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.059140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.059175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.059312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.059445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.059479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.059623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.059784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.059818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.059924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.060068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.060102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.060246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.060381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.060416] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.060548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.060713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.060747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.060890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.061008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.061046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.061176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.061327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.061376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.061548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.061673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.061703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.061802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.061949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.061986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.062087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.062207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.062232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.062354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.062441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.062469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.062591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.062676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.062702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.062851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.062976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.063003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.063117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.063257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.063286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.063559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.063723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.063755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.063874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.063994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.064020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.064111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.064235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.064261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.599 qpair failed and we were unable to recover it. 00:30:35.599 [2024-11-30 04:32:26.064446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.064622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.599 [2024-11-30 04:32:26.064648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.064767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.064890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.064915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.065048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.065164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.065190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.065309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.065418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.065444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.065560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.065680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.065706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.065805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.065924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.065950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.066106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.066227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.066254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.066395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.066536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.066566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.066712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.066834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.066859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.066950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.067044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.067069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.067190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.067312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.067337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.067430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.067547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.067573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.067665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.067784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.067809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.067964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.068086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.068112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.068233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.068325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.068351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.068471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.068586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.068612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.068710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.068828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.068854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.069003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.069126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.069156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.069248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.069364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.069391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.069487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.069575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.069600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.069748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.069895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.069921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.070013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.070101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.070126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.070246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.070341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.070367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.070480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.070601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.070626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.070748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.070899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.070925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.071025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.071113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.071139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.071227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.071344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.071369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.071516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.071612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.071643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.071728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.071874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.071900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.072049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.072172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.072198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.072290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.072413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.072439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.072559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.072654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.072679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.072802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.072947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.072987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.073107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.073198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.073224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.073343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.073463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.073488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.073609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.073707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.073732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.073854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.073989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.074015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.074167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.074286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.074313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.074462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.074575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.074600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.600 qpair failed and we were unable to recover it. 00:30:35.600 [2024-11-30 04:32:26.074747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.600 [2024-11-30 04:32:26.074868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.074894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.075022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.075173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.075216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.075342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.075504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.075547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.075665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.075816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.075841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.075967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.076058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.076084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.076183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.076294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.076338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.076443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.076564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.076590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.076715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.076812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.076837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.077035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.077229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.077254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.077378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.077471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.077498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.077620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.077741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.077766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.077863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.077981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.078008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.078126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.078253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.078279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.078425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.078538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.078564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.078654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.078777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.078802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.078919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.079044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.079088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.079184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.079314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.079339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.079433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.079579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.079604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.079724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.079818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.079843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.079948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.080113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.080138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.080320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.080474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.080500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.080619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.080764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.080790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.080941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.081098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.081142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.081275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.081382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.081409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.081537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.081631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.081656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.081774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.081862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.081887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.081983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.082098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.082124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.082219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.082361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.082387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.082505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.082653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.082678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.082780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.082932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.082964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.083055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.083203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.083228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.083349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.083445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.083472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.083598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.083694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.083720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.083816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.083904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.083930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.084034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.084156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.084182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.084281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.084370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.084395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.084487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.084611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.084637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.084758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.084904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.084929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.085033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.085124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.601 [2024-11-30 04:32:26.085149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.601 qpair failed and we were unable to recover it. 00:30:35.601 [2024-11-30 04:32:26.085270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.085362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.085387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.085480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.085606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.085632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.085759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.085847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.085873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.085992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.086079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.086106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.086229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.086376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.086401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.086494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.086639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.086665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.086782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.086873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.086898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.087017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.087133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.087158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.087249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.087369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.087395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.087515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.087626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.087652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.087778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.087880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.087905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.087999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.088112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.088138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.088226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.088318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.088344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.088493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.088642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.088668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.088759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.088906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.088932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.089059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.089156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.089182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.089301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.089405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.089431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.089523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.089641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.089667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.089787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.089932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.089965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.090086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.090167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.090192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.090292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.090381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.090405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.090506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.090653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.090678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.090766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.090858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.090883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.090986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.091113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.091139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.091259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.091380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.091405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.091498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.091588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.091614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.091704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.091824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.091850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.091980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.092068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.092093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.092216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.092309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.092334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.092458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.092544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.092570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.092676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.092843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.092872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.092979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.093071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.093097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.093223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.093364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.093392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.093524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.093697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.093723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.093844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.093972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.602 [2024-11-30 04:32:26.093999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.602 qpair failed and we were unable to recover it. 00:30:35.602 [2024-11-30 04:32:26.094096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.094184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.094209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.094372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.094490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.094514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.094660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.094766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.094794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.094964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.095083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.095109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.095229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.095396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.095424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.095552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.095701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.095727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.095877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.096042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.096068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.096158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.096238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.096263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.096396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.096518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.096543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.096647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.096801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.096828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.096970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.097107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.097132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.097222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.097311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.097353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.097483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.097609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.097650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.097821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.097948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.098001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.098088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.098187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.098212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.098349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.098482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.098510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.098609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.098722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.098747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.098891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.098998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.099025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.099150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.099289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.099331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.099519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.099648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.099676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.099816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.099920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.099947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.100096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.100218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.100244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.100334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.100457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.100482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.100615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.100770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.100798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.100896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.101003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.101029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.101131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.101231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.101258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.101422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.101568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.101608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.101737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.101834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.101875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.101991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.102081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.102107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.102203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.102374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.102402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.102558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.102686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.102714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.102821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.102931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.102964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.103080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.103199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.103224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.103319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.103415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.103440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.103537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.103683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.103708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.103838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.103977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.104025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.104120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.104235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.104260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.104379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.104513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.603 [2024-11-30 04:32:26.104541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.603 qpair failed and we were unable to recover it. 00:30:35.603 [2024-11-30 04:32:26.104684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.104812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.104841] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.104986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.105089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.105114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.105203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.105327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.105351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.105466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.105595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.105622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.105763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.105905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.105932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.106054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.106176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.106201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.106320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.106488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.106515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.106676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.106817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.106847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.107008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.107127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.107152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.107295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.107413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.107438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.107536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.107676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.107704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.107842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.107952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.107986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.108105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.108221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.108245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.108369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.108488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.108512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.108602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.108720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.108748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.108850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.109006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.109034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.109151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.109274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.109299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.109444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.109538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.109569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.109734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.109863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.109893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.110014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.110155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.110183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.110322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.110425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.110453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.110594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.110714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.110739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.110874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.110984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.111014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.111177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.111267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.111292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.111436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.111564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.111588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.111730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.111847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.111873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.111977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.112067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.112109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.112209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.112300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.112347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.112462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.112623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.112650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.112798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.112939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.112973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.113121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.113287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.113311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.113461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.113596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.113624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.113717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.113842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.113871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.114007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.114124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.114149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.114291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.114422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.114450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.114556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.114654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.114682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.114782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.114952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.114984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.115083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.115177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.115202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.115367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.115473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.115501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.604 qpair failed and we were unable to recover it. 00:30:35.604 [2024-11-30 04:32:26.115620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.115734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.604 [2024-11-30 04:32:26.115759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.115907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.116008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.116039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.116179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.116324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.116349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.116439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.116536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.116562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.116654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.116757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.116785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.116912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.117042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.117086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.117238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.117337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.117362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.117480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.117621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.117650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.117787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.117906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.117930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.118049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.118195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.118224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.118348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.118461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.118486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.118578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.118698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.118723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.118867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.119042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.119068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.119155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.119292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.119320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.119462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.119581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.119606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.119744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.119862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.119889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.120010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.120144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.120169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.120254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.120391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.120418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.120564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.120708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.120733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.120842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.120946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.120980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.121085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.121172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.121197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.121310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.121474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.121498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.121621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.121738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.121763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.121950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.122049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.122076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.122175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.122275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.122300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.122413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.122535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.122559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.122681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.122799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.122823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.122916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.123042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.123068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.123186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.123321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.123362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.123522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.123654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.123682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.123806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.123951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.123986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.124108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.124201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.124226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.124352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.124469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.124498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.124642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.124790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.124816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.124941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.125068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.125094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.125193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.125280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.125305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.125472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.125599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.125643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.125788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.125878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.125921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.126079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.126169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.126194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.605 [2024-11-30 04:32:26.126317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.126446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.605 [2024-11-30 04:32:26.126472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.605 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.126594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.126681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.126706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.126822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.126951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.126990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.127128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.127246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.127271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.127355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.127502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.127545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.127640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.127806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.127834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.127980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.128129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.128154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.128244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.128353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.128378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.128500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.128619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.128644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.128738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.128879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.128907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.129027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.129130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.129160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.129278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.129396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.129423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.129559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.129665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.129693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.129830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.129928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.129954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.130086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.130202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.130242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.130382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.130503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.130529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.130667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.130793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.130822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.130949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.131094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.131120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.131218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.131360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.131388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.131527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.131650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.131675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.131832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.131966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.131992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.132114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.132210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.132251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.132405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.132528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.132553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.132670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.132788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.132814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.132982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.133090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.133116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.133206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.133343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.133371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.133508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.133688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.133713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.133835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.133983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.134009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.134141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.134234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.134259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.134405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.134522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.134547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.134640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.134731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.134758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.134879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.134998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.135024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.135120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.135216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.135257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.135420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.135568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.135593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.135736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.135846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.135871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.135989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.136076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.136101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.606 qpair failed and we were unable to recover it. 00:30:35.606 [2024-11-30 04:32:26.136196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.136313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.606 [2024-11-30 04:32:26.136338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.136480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.136643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.136668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.136762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.136898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.136928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.137115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.137230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.137255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.137373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.137502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.137536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.137755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.137927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.137952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.138080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.138202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.138228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.138323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.138438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.138463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.138605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.138744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.138774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.138885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.138982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.139026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.139117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.139264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.139290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.139386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.139512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.139538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.139660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.139742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.139767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.139860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.140033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.140062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.140196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.140294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.140328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.140443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.140560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.140586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.140707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.140818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.140842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.140934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.141053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.141078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.141201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.141325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.141369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.141514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.141630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.141657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.141756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.141875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.141900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.141995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.142120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.142163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.142253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.142389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.142414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.142534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.142623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.142649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.142761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.142886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.142916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.143061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.143176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.143204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.143301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.143428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.143456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.143580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.143716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.143741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.143835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.143953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.144006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.144157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.144252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.144278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.144372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.144463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.144488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.144601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.144729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.144755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.144899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.145044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.145070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.145187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.145305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.145330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.145418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.145568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.145598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.145718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.145802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.145827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.145952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.146119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.146144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.146245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.146340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.146365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.146528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.146681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.146709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.607 qpair failed and we were unable to recover it. 00:30:35.607 [2024-11-30 04:32:26.146851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.607 [2024-11-30 04:32:26.146997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.147023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.147134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.147272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.147298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.147390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.147532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.147557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.147676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.147794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.147819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.147936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.148075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.148101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.148195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.148329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.148356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.148491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.148616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.148645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.148774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.148919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.148947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.149076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.149168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.149193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.149306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.149470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.149495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.149611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.149746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.149774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.149919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.150023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.150049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.150172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.150296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.150323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.150498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.150644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.150669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.150790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.150929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.150966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.151076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.151180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.151222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.151349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.151439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.151463] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.151581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.151725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.151750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.151841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.151940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.151993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.152125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.152299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.152325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.152435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.152553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.152578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.152702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.152835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.152864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.152995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.153130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.153158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.153294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.153453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.153481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.153627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.153772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.153797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.153981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.154105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.154130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.154249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.154380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.154420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.154509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.154632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.154656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.154806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.154924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.154949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.155052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.155214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.155241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.155368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.155533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.155558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.155703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.155795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.155821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.155943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.156041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.156067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.156181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.156299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.156325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.156445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.156597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.156622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.156757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.156859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.156887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.157053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.157143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.157169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.157317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.157471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.157498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.157670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.157782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.157806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.608 qpair failed and we were unable to recover it. 00:30:35.608 [2024-11-30 04:32:26.157940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.608 [2024-11-30 04:32:26.158056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.158084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.158254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.158351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.158377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.158465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.158627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.158655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.158827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.158915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.158940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.159079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.159229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.159257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.159397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.159541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.159566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.159710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.159868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.159896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.160061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.160217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.160244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.160374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.160468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.160497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.160618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.160759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.160784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.160870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.160968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.160994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.161114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.161220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.161249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.161348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.161490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.161515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.161608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.161699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.161725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.161819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.161931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.161956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.162087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.162227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.162255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.162383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.162514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.162543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.162656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.162771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.162795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.162917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.163033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.163060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.163230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.163360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.163388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.163560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.163702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.163727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.163846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.163973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.164000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.164120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.164266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.164291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.164440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.164542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.164569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.164696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.164834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.164859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.164979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.165072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.165097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.165217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.165372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.165399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.165564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.165706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.165731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.165854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.166001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.166027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.166178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.166298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.166324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.166501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.166596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.166623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.166764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.166905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.166930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.167032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.167172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.167213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.167334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.167433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.167458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.167593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.167716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.167745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.609 qpair failed and we were unable to recover it. 00:30:35.609 [2024-11-30 04:32:26.167849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.609 [2024-11-30 04:32:26.167977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.168006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.168149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.168298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.168323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.168427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.168539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.168564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.168653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.168790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.168817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.168947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.169122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.169147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.169266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.169417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.169442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.169565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.169654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.169679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.169779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.169928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.169953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.170054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.170138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.170164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.170251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.170370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.170395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.170514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.170634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.170660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.170802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.170907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.170934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.171070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.171220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.171253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.171389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.171521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.171551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.171691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.171837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.171863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.171969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.172057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.172084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.172188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.172279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.172306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.172406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.172497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.172522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.172620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.172772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.172797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.172897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.173005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.173032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.173128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.173248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.173274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.173358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.173439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.173465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.173551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.173659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.173686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.173810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.173888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.173913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.174018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.174133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.174159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.174284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.174375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.174401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.174547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.174634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.174659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.174755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.174879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.174906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.175011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.175106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.175133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.175255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.175342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.175369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.175486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.175574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.175601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.175684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.175778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.175804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.175897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.176001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.176027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.176120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.176240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.176266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.176359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.176504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.176529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.176618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.176731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.176757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.610 [2024-11-30 04:32:26.176875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.176974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.610 [2024-11-30 04:32:26.177000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.610 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.177119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.177205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.177230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.177311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.177406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.177431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.177575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.177690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.177716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.177859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.177952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.177984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.178109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.178211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.178236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.178328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.178423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.178451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.178550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.178640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.178666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.178781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.178906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.178931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.179061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.179182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.179207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.179297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.179409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.179434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.179551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.179663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.179689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.179786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.179905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.179931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.901 [2024-11-30 04:32:26.180039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.180157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.901 [2024-11-30 04:32:26.180183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.901 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.180336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.180455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.180480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.180570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.180650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.180676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.180773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.180916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.180946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.181076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.181170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.181196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.181318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.181441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.181466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.181561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.181678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.181703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.181795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.181909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.181935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.182068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.182158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.182184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.182330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.182477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.182502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.182623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.182716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.182742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.182836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.182949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.182986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.183105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.183248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.183274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.183419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.183551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.183586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.183680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.183770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.183796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.183942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.184041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.184067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.184215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.184334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.184359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.184486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.184634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.184659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.184775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.184895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.184922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.185029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.185117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.185142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.185262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.185355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.185381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.185531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.185614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.185639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.185753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.185878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.185905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.186074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.186200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.186230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.186351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.186474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.186500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.186614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.186715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.186740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.186832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.186923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.186949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.187081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.187175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.187200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.187319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.187438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.187465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.187582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.187698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.187723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.187820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.187931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.187963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.902 [2024-11-30 04:32:26.188063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.188147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.902 [2024-11-30 04:32:26.188172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.902 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.188264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.188353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.188379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.188525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.188679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.188709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.188803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.188921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.188946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.189048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.189146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.189171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.189286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.189373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.189399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.189518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.189630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.189656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.189752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.189841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.189867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.189995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.190088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.190113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.190207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.190328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.190354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.190444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.190563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.190589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.190707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.190826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.190851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.190941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.191089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.191115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.191262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.191411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.191437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.191537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.191626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.191652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.191768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.191888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.191914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.192038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.192192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.192218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.192334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.192452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.192478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.192599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.192718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.192745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.192837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.192951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.192981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.193108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.193190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.193215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.193304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.193404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.193430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.193546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.193633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.193658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.193784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.193868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.193895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.193990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.194112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.194137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.194283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.194379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.194404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.194529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.194646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.194671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.194799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.194918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.194943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.195071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.195185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.195209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.195328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.195412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.195436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.195527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.195638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.195663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.903 [2024-11-30 04:32:26.195784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.195880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.903 [2024-11-30 04:32:26.195906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.903 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.196028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.196149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.196174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.196327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.196448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.196475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.196596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.196716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.196741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.196834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.196946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.196978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.197099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.197220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.197246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.197363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.197456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.197483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.197598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.197723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.197748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.197867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.197980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.198007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.198126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.198219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.198245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.198366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.198456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.198483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.198631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.198748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.198773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.198895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.198988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.199014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.199140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.199236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.199262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.199355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.199444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.199470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.199619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.199740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.199766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.199862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.199987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.200013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.200138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.200284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.200309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.200404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.200528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.200553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.200675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.200795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.200821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.200914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.201043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.201070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.201192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.201291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.201317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.201444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.201590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.201616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.201733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.201852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.201877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.202003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.202126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.202151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.202246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.202362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.202389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.202510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.202611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.202636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.202760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.202873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.202898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.203026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.203145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.203170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.203258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.203378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.203403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.203520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.203637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.203662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.904 [2024-11-30 04:32:26.203756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.203897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.904 [2024-11-30 04:32:26.203922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.904 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.204088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.204206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.204232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.204327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.204435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.204460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.204577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.204728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.204753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.204904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.205024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.205050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.205173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.205268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.205295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.205410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.205535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.205561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.205646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.205739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.205764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.205884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.206000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.206027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.206145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.206235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.206261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.206382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.206489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.206515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.206645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.206763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.206788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.206887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.207032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.207059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.207189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.207306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.207332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.207449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.207571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.207596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.207688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.207806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.207831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.207920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.208053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.208080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.208177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.208293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.208318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.208435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.208518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.208543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.208692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.208812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.208839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.208933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.209031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.209058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.209160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.209284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.209311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.209412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.209493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.209519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.209616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.209728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.209754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.209903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.210005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.210032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.210122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.210222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.210248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.210397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.210481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.905 [2024-11-30 04:32:26.210507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.905 qpair failed and we were unable to recover it. 00:30:35.905 [2024-11-30 04:32:26.210596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.210681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.210706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.210827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.210971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.210998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.211106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.211217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.211242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.211342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.211433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.211460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.211583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.211709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.211735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.211856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.211979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.212006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.212130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.212230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.212256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.212375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.212490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.212516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.212630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.212748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.212775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.212901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.213008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.213036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.213185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.213278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.213304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.213449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.213541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.213566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.213653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.213778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.213804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.213923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.214076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.214102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.214224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.214376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.214401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.214524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.214640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.214666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.214758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.214875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.214900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.215044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.215128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.215153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.215277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.215392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.215418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.215569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.215657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.215684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.215776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.215902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.215927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.216084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.216169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.216195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.216316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.216463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.216489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.216602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.216720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.216745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.216836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.216969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.216995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.217110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.217203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.217228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.217343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.217461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.217486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.217599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.217682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.217707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.217828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.217972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.217998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.218123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.218243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.218269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.218352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.218451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.906 [2024-11-30 04:32:26.218476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.906 qpair failed and we were unable to recover it. 00:30:35.906 [2024-11-30 04:32:26.218600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.218717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.218742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.218833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.218952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.219004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.219104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.219258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.219283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.219413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.219510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.219536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.219658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.219776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.219803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.219921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.220054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.220080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.220231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.220357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.220382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.220504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.220588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.220613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.220736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.220844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.220869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.220967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.221053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.221079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.221209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.221302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.221329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.221455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.221540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.221565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.221713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.221803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.221830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.221912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.222036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.222070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.222190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.222275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.222300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.222393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.222514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.222540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.222637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.222758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.222783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.222896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.222989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.223017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.223166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.223256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.223281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.223403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.223518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.223544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.223663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.223779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.223805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.223892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.224019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.224046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.224176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.224290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.224316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.224409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.224534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.224565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.224716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.224831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.224856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.224991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.225108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.225133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.225256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.225350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.225376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.225470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.225561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.225587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.225705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.225850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.225876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.225975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.226098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.226124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.226222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.226346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.226371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.907 qpair failed and we were unable to recover it. 00:30:35.907 [2024-11-30 04:32:26.226520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.907 [2024-11-30 04:32:26.226602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.226627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.226710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.226833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.226858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.226943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.227080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.227110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.227234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.227333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.227360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.227456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.227576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.227601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.227726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.227813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.227838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.227990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.228116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.228142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.228236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.228356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.228381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.228532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.228653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.228679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.228781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.228872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.228898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.229022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.229139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.229165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.229321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.229412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.229438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.229553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.229664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.229690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.229797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.229914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.229940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.230069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.230198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.230224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.230343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.230488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.230513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.230632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.230714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.230740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.230860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.231006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.231033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.231151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.231273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.231298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.231413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.231534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.231559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.231674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.231789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.231815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.231969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.232058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.232084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.232173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.232285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.232310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.232469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.232618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.232643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.232761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.232845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.232871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.232991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.233163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.233189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.233309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.233398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.233423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.233544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.233660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.233685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.233778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.233874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.233900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.234003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.234093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.234120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.234217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.234363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.234389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.908 qpair failed and we were unable to recover it. 00:30:35.908 [2024-11-30 04:32:26.234537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.908 [2024-11-30 04:32:26.234650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.234675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.234795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.234886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.234913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.235017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.235161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.235187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.235311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.235438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.235464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.235567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.235712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.235737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.235827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.235970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.235997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.236122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.236214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.236240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.236356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.236471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.236497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.236595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.236720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.236745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.236863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.237004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.237030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.237116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.237205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.237230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.237346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.237490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.237515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.237642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.237767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.237793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.237889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.237982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.238010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.238113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.238214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.238240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.238329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.238445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.238471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.238591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.238682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.238709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.238855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.238986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.239013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.239101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.239188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.239214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.239336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.239426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.239450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.239542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.239663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.239689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.239818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.239967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.239995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.240115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.240198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.240225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.240323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.240444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.240470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.240593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.240735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.240761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.240907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.241001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.241027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.241145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.241264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.241289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.241407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.241533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.241559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.241646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.241796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.241821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.909 qpair failed and we were unable to recover it. 00:30:35.909 [2024-11-30 04:32:26.241942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.242096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.909 [2024-11-30 04:32:26.242123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.242236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.242333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.242358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.242473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.242597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.242622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.242717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.242839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.242865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.242974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.243058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.243084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.243176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.243294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.243319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.243435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.243530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.243556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.243642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.243762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.243788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.243906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.243993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.244020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.244117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.244242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.244268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.244421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.244541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.244566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.244684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.244811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.244838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.244966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.245091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.245117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.245254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.245348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.245374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.245492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.245636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.245661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.245788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.245904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.245931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.246034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.246151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.246177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.246269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.246412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.246437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.246540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.246628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.246654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.246801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.246890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.246915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.247015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.247139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.247165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.247303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.247457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.247482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.247600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.247717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.247743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.247864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.247985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.248012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.248128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.248241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.248266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.248409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.248529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.248554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.248705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.248822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.248847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.248942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.249075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.249101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.249221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.249339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.249364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.249453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.249544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.249570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.910 qpair failed and we were unable to recover it. 00:30:35.910 [2024-11-30 04:32:26.249664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.910 [2024-11-30 04:32:26.249779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.249804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.249896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.249991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.250017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.250134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.250225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.250251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.250334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.250455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.250481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.250571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.250665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.250690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.250836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.250986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.251013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.251132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.251256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.251281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.251404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.251523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.251549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.251664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.251783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.251809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.251928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.252046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.252073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.252193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.252283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.252309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.252437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.252558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.252583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.252732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.252881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.252906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.253021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.253128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.253155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.253245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.253389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.253415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.253515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.253635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.253661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.253782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.253927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.253953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.254090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.254188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.254214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.254361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.254447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.254474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.254586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.254703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.254728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.254858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.254987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.255013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.255103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.255196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.255222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.255369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.255514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.255539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.255639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.255732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.255758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.255877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.255999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.256026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.256113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.256196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.256221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.256342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.256427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.256459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.256580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.256697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.256722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.256844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.256971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.256997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.257087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.257233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.257259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.257405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.257524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.257550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.911 qpair failed and we were unable to recover it. 00:30:35.911 [2024-11-30 04:32:26.257665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.911 [2024-11-30 04:32:26.257753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.257779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.257871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.257967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.257994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.258113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.258212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.258238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.258333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.258444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.258469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.258591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.258708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.258734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.258823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.258945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.258981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.259127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.259215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.259240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.259366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.259484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.259509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.259593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.259681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.259707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.259822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.259972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.259999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.260144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.260232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.260258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.260377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.260494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.260519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.260636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.260726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.260759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.260883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.261004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.261031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.261124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.261243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.261269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.261390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.261511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.261536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.261656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.261756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.261781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.261902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.262030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.262057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.262184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.262275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.262303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.262394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.262543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.262569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.262669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.262790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.262815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.262902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.263001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.263028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.263126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.263271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.263300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.263419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.263539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.263565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.263660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.263768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.263794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.263913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.264026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.264052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.264157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.264242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.264267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.264364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.264459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.264484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.264564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.264674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.264699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.264825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.264950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.264985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.265085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.265211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.265237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.912 qpair failed and we were unable to recover it. 00:30:35.912 [2024-11-30 04:32:26.265329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.265431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.912 [2024-11-30 04:32:26.265460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.265608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.265723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.265753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.265846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.265968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.265995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.266115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.266203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.266228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.266331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.266444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.266469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.266558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.266654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.266680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.266799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.266946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.266981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.267101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.267194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.267220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.267310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.267431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.267457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.267576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.267692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.267717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.267799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.267919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.267946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.268085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.268175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.268205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.268328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.268473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.268499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.268658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.268753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.268779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.268869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.269019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.269046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.269164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.269281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.269307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.269454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.269595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.269620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.269769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.269889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.269914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.270043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.270195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.270221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.270348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.270468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.270493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.270610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.270707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.270733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.270849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.270943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.270977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.271103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.271225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.271251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.271400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.271528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.271554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.271678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.271768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.271793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.271883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.272000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.272027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.272153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.272272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.272297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.272419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.272564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.272589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.272705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.272855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.272882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.273006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.273098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.273125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.273245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.273363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.273388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.913 [2024-11-30 04:32:26.273534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.273656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.913 [2024-11-30 04:32:26.273681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.913 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.273784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.273901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.273926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.274055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.274181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.274207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.274330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.274412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.274437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.274559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.274683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.274708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.274861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.275002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.275030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.275125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.275215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.275240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.275387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.275505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.275530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.275655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.275752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.275779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.275876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.275997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.276024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.276114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.276233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.276259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.276388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.276511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.276537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.276623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.276766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.276791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.276876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.276997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.277024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.277113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.277224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.277250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.277371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.277516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.277542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.277659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.277776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.277801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.277928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.278020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.278046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.278138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.278261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.278287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.278409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.278553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.278578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.278700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.278791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.278818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.278985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.279134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.279161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.279277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.279427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.279452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.279553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.279642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.279668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.279789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.279879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.279904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.280013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.280131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.280157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.280276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.280368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.280394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.280492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.280589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.280615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.280705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.280799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.280824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.914 qpair failed and we were unable to recover it. 00:30:35.914 [2024-11-30 04:32:26.280911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.914 [2024-11-30 04:32:26.281033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.281061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.281159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.281285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.281310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.281404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.281552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.281577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.281691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.281809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.281835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.281950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.282081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.282107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.282222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.282309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.282334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.282457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.282549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.282575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.282697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.282817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.282844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.282994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.283086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.283112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.283261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.283383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.283408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.283530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.283616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.283642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.283760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.283848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.283875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.284004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.284127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.284153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.284272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.284412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.284437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.284519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.284601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.284627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.284777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.284865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.284890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.284988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.285083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.285108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.285235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.285322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.285348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.285469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.285616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.285641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.285770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.285893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.285919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.286056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.286149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.286176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.286269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.286383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.286408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.286547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.286727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.286773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.286908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.287013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.287041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.287161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.287310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.287335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.287465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.287582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.287608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.287729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.287852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.287877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.287996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.288117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.288142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.288272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.288389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.288414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.288563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.288680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.288705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.288795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.288910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.288936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.915 qpair failed and we were unable to recover it. 00:30:35.915 [2024-11-30 04:32:26.289091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.915 [2024-11-30 04:32:26.289180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.289207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.289372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.289482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.289511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.289634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.289750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.289776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.289862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.289993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.290020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.290139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.290256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.290284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.290387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.290520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.290550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.290684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.290821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.290849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.291001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.291121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.291146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.291267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.291411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.291440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.291628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.291785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.291813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.291941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.292086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.292112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.292201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.292295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.292321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.292458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.292612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.292640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.292820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.292914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.292939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.293061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.293153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.293178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.293339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.293455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.293483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.293591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.293758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.293804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.293944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.294091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.294117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.294261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.294368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.294396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.294525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.294619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.294649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.294783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.294894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.294923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.295078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.295228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.295253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.295404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.295574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.295599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.295778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.295878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.295905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.296025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.296146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.296172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.296293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.296379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.296404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.296518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.296604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.296632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.296751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.296868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.296898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.297081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.297206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.297231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.297340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.297444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.297471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.297637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.297740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.297769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.916 qpair failed and we were unable to recover it. 00:30:35.916 [2024-11-30 04:32:26.297942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.916 [2024-11-30 04:32:26.298077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.298103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.298209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.298301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.298341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.298458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.298553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.298582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.298707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.298858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.298884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.299012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.299158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.299183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.299314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.299432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.299462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.299592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.300433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.300478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.300636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.300758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.300794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.300907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.301069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.301096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.301191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.301309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.301335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.301489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.301628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.301657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.301753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.301874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.301913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.302032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.302153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.302178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.302325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.302464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.302510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.303292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.303444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.303473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.303626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.303765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.303794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.303937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.304060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.304087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.304244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.304390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.304415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.304533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.304694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.304723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.304851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.305004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.305031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.305117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.305213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.305244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.305334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.305422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.305449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.305611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.305743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.305773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.305901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.306073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.306102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.306206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.306360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.306389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.306504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.306614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.306643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.306790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.306889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.306915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.307061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.307173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.307199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.307340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.307516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.307542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.307637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.307754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.307780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.307906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.308037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.308069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.917 qpair failed and we were unable to recover it. 00:30:35.917 [2024-11-30 04:32:26.308163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.917 [2024-11-30 04:32:26.308254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.308280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.308384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.308468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.308494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.308622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.308707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.308736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.308841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.308955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.308988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.309112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.309194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.309219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.309349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.309450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.309480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.309637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.309726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.309751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.309866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.309984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.310010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.310126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.310210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.310235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.310354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.310449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.310489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.310577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.310696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.310721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.310841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.310931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.310966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.311095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.311208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.311234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.311358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.311449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.311475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.311662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.311827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.311856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.312008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.312129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.312156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.312277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.312409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.312438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.312583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.312690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.312720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.312836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.312955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.312986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.313110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.313240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.313282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.313387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.313543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.313573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.313717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.313832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.313857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.313980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.314078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.314103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.314206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.314301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.314327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.314408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.314492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.314518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.314669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.314768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.314797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.314966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.315066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.315093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.315189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.315342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.315369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.315464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.315560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.918 [2024-11-30 04:32:26.315585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.918 qpair failed and we were unable to recover it. 00:30:35.918 [2024-11-30 04:32:26.315666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.315760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.315788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.315913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.316006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.316033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.316158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.316250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.316281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.316406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.316527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.316554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.316676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.316806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.316833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.316964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.317067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.317093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.317204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.317344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.317374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.317512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.317606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.317633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.317726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.317828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.317854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.317951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.318056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.318083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.318188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.318323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.318348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.318458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.318551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.318577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.318672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.318789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.318814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.318913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.319023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.319050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.319148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.319241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.319277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.319367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.319488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.319514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.319601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.319725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.319752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.319901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.320020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.320048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.320145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.320274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.320304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.320435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.320564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.320590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.320677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.320795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.320821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.320920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.321089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.321115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.321234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.321325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.321350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.321474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.321570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.321596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.321687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.321772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.321797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.321898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.321996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.322022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.322121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.322240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.322296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.322414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.322506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.322534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.322624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.322749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.322774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.322868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.322984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.919 [2024-11-30 04:32:26.323016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.919 qpair failed and we were unable to recover it. 00:30:35.919 [2024-11-30 04:32:26.323118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.323212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.323238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.323363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.323495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.323520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.323637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.323740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.323765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.323865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.323966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.323993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.324116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.324209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.324235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.324359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.324447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.324473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.324645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.324774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.324803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.324933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.325044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.325071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.325178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.325298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.325330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.325468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.325622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.325648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.325760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.325851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.325877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.326004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.326138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.326163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.326276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.326445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.326470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.326600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.326735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.326760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.326859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.326977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.327003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.327105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.327188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.327214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.327311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.327401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.327426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.327543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.327639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.327664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.327783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.327876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.327902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.328000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.328092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.328118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.328249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.328354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.328379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.328477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.328593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.328618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.328701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.328788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.328813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.328935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.329041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.329067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.329159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.329284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.329309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.329414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.329509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.329535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.329683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.329808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.329833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.329929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.330054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.330080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.330170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.330259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.330284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.330375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.330459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.330483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.920 [2024-11-30 04:32:26.330599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.330715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.920 [2024-11-30 04:32:26.330740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.920 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.330835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.330954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.330991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.331079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.331172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.331197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.331323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.331426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.331452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.331578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.331706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.331730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.331823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.331937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.331970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.332075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.332164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.332189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.332282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.332381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.332407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.332545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.332642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.332667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.332816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.332922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.332947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.333160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.333256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.333280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.333370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.333476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.333505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.333603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.333691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.333715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.333803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.333914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.333939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.334054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.334147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.334172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.334255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.334341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.334366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.334462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.334542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.334568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.334663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.334778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.334803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.334924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.335027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.335053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.335799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.335942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.335995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.336102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.336199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.336225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.336357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.336444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.336469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.336674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.336771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.336796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.336895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.337063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.337089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.337177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.337307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.337333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.337444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.337533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.337559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.337690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.337789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.337815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.337939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.338043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.338068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.338188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.338301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.338326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.338474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.338604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.338632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.338835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.338953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.338986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.921 [2024-11-30 04:32:26.339087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.339175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.921 [2024-11-30 04:32:26.339201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.921 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.339297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.339394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.339429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.339542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.339633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.339658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.339757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.339837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.339862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.340016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.340149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.340175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.340295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.340489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.340514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.340669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.340761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.340786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.340879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.341002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.341028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.341125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.341209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.341234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.341370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.341479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.341504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.341622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.341710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.341735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.341828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.341921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.341947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.342089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.342183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.342209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.342378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.342499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.342525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.342642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.342773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.342803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.342922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.343018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.343044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.343144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.343238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.343272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.343428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.343554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.343579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.343674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.343858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.343883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.343988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.344083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.344108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.344200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.344290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.344315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.344439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.344574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.344602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.344752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.344845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.344870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.344985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.345074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.345100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.345233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.345362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.345387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.345524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.345645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.345672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.345805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.345911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.345970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.346063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.346150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.346175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.346321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.346431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.346460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.346664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.346762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.346790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.346885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.347032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.347058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.922 qpair failed and we were unable to recover it. 00:30:35.922 [2024-11-30 04:32:26.347159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.922 [2024-11-30 04:32:26.347284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.347313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.347402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.347551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.347591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.347701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.347888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.347913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.348025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.348116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.348142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.348234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.348385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.348413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.348545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.348673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.348716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.348851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.348945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.348982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.349070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.349159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.349184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.349306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.349396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.349421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.349555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.349648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.349674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.349840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.349950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.349986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.350098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.350189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.350214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.350304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.350389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.350414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.350527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.350659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.350687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.350795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.350899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.350927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.351052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.351150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.351175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.351308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.351395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.351438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.351574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.351676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.351703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.351808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.351968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.351997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.352114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.352207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.352232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.352442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.352533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.352558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.352677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.352814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.352842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.352943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.353058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.353084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.353175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.353267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.353293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.353395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.353518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.353546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.353683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.353777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.353806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.353950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.354062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.354087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.354175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.354341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.354366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.354561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.354657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.354682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.354784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.354892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.354917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.355038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.355154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.355184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.355291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.355397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.355423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.355527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.355619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.355646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.355751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.356472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.356503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.923 qpair failed and we were unable to recover it. 00:30:35.923 [2024-11-30 04:32:26.356644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.923 [2024-11-30 04:32:26.356749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.356775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.356898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.357001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.357028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.357128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.357216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.357244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.357380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.357472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.357499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.357621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.357707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.357742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.357860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.357984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.358011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.358212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.358370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.358398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.358526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.358660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.358686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.358814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.358929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.358973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.359069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.359169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.359197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.359337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.359458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.359485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.359607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.359722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.359749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.359902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.360009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.360035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.360127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.360325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.360351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.360508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.360627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.360653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.360754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.360875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.360903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.361042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.361134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.361159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.361247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.361523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.361551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.361707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.361824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.361862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.361956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.362055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.362081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.362174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.362287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.362313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.362513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.362820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.362861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.362989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.363088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.363114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.363212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.363341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.363367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.363513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.363623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.363649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.363733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.363849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.363874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.363997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.364094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.364120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.364284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.364410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.364437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.364537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.364663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.364690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.364810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.364927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.364953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.365073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.365170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.365198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.365321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.365421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.365452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.365572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.365690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.365716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.924 qpair failed and we were unable to recover it. 00:30:35.924 [2024-11-30 04:32:26.365835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.924 [2024-11-30 04:32:26.365948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.365980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.366068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.366183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.366209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.366325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.366474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.366504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.366627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.366725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.366752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.366843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.366995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.367023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.367145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.367345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.367372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.367541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.367689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.367716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.367812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.367934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.367980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.368082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.368180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.368206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.368421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.368530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.368555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.368717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.368833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.368858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.369003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.369096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.369122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.369216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.369335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.369361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.369483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.369588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.369614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.369712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.369811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.369837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.369990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.370113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.370138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.370230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.370322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.370348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.370446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.370567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.370592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.370693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.370784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.370813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.370903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.371002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.371029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.371173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.371300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.371326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.371447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.371543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.371570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.371691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.371809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.371834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.371986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.372076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.372105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.372193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.372288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.372321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.372444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.372530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.372556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.372655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.372778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.372806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.372895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.373005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.373031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.373125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.373209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.373235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.373336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.373433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.373458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.373593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.373743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.373769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.373857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.373994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.374022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.374122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.374213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.374239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.374437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.374590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.374617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.374737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.374887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.374917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.375069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.375180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.375208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.925 qpair failed and we were unable to recover it. 00:30:35.925 [2024-11-30 04:32:26.375394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.925 [2024-11-30 04:32:26.375536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.375562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.375711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.375809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.375834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.375926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.376056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.376084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.376235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.376391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.376417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.376513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.376624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.376649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.376745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.376829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.376856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.376956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.377117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.377144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.377268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.377386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.377413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.377562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.377759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.377790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.377915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.378121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.378148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.378333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.378450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.378476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.378607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.378726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.378751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.378837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.378972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.379009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.379154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.379247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.379274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.379375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.379466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.379493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.379621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.379739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.379768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.379893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.380015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.380042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.380160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.380284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.380310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.380442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.380642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.380671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.380776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.380896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.380922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.381100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.381238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.381270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.381400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.381520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.381546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.381669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.381762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.381789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.381911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.382037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.382063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.382172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.382327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.382357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.382468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.382565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.382594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.382731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.382863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.382891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.383025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.383121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.383148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.383315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.383445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.383474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.383627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.383743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.383769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.383887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.384031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.384057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.384147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.384249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.384276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.384421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.384553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.926 [2024-11-30 04:32:26.384597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.926 qpair failed and we were unable to recover it. 00:30:35.926 [2024-11-30 04:32:26.384691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.384774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.384800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.384910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.385078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.385104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.385200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.385347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.385374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.385479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.385576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.385604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.385707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.385848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.385876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.386010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.386111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.386138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.386253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.386377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.386410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.386608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.386760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.386786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.386936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.387068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.387095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.387194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.387333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.387360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.387509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.387666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.387694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.387801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.387917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.387945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.388098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.388227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.388253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.388354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.388477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.388520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.388692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.388817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.388844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.388981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.389127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.389152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.389297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.389476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.389501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.389622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.389769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.389795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.389900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.390046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.390072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.390159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.390283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.390316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.390452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.390553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.390595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.390726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.390812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.390853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.390970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.391107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.391134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.391283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.391417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.391443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.391562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.391680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.391707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.391822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.391945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.391985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.392136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.392233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.392259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.392372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.392510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.392538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.392670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.392842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.392867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.392968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.393064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.393090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.393214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.393339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.393367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.393485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.393655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.393682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.393782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.393870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.393896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.394045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.394171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.394198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.394367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.394506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.394536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.927 [2024-11-30 04:32:26.394661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.394755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.927 [2024-11-30 04:32:26.394780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.927 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.394911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.395035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.395061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.395147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.395233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.395268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.395388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.395506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.395531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.395641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.395775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.395803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.395904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.396021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.396048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.396248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.396414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.396442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.396540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.396663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.396692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.396886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.397016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.397042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.397191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.397293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.397318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.397435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.397521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.397547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.397707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.397854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.397882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.397999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.398125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.398151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.398243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.398359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.398384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.398491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.398629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.398655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.398777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.398975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.399001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.399107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.399192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.399217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.399369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.399562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.399604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.399771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.399876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.399904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.400046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.400131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.400156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.400274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.400391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.400417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.400566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.400689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.400714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.400824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.401033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.401060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.401161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.401278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.401303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.401419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.401518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.401543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.401657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.401804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.401829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.401929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.402033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.402060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.402203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.402318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.402343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.402463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.402609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.402634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.402733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.402861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.402887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.402981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.403066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.403091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.403287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.403377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.403408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.403497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.403620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.403645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.403733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.403850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.403874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.403970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.404083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.404108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.404198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.404282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.404307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.404399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.404519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.928 [2024-11-30 04:32:26.404545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.928 qpair failed and we were unable to recover it. 00:30:35.928 [2024-11-30 04:32:26.404706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.404839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.404867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.405013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.405132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.405157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.405288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.405417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.405443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.405568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.405654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.405679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.405773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.405860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.405885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.406004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.406117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.406141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.406257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.406371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.406396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.406519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.406605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.406631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.406779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.406916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.406941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.407055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.407161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.407185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.407284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.407427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.407453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.407575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.407658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.407683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.407812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.407941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.407972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.408065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.408187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.408212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.408393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.408481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.408508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.408640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.408742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.408768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.408888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.409020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.409047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.409143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.409262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.409306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.409488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.409589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.409618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.409787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.409911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.409936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.410032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.410119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.410145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.410238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.410348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.410373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.410501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.410620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.410645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.410787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.410875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.410901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.411018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.411150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.411175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.411300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.411388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.411413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.411543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.411631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.411657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.411807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.411896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.411922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.412087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.412188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.412213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.412298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.412388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.412412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.412515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.412605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.412631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.412752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.412837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.412862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.412986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.413102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.413127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.929 qpair failed and we were unable to recover it. 00:30:35.929 [2024-11-30 04:32:26.413326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.413480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.929 [2024-11-30 04:32:26.413507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.413645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.413803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.413828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.413923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.414025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.414052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.414214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.414341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.414385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.414579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.414702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.414727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.414849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.414984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.415012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.415153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.415266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.415291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.415414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.415505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.415531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.415626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.415738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.415764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.415852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.415982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.416023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.416168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.416286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.416312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.416404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.416486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.416512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.416642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.416759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.416788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.416908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.417027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.417054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.417204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.417319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.417345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.417429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.417517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.417542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.417691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.417806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.417831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.417969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.418098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.418124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.418214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.418409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.418434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.418522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.418701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.418727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.418849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.418974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.419000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.419093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.419287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.419323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.419444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.419563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.419588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.419733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.419886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.419914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.420018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.420116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.420144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.420273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.420383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.420425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.420574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.420713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.420739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.420858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.421002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.421029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.421122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.421243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.421269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.421389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.421504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.421529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.421645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.421766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.421791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.421910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.422022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.422047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.422164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.422259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.422302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.422463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.422558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.422585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.422720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.422842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.422867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.422986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.423091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.423120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.423278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.423378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.423406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.423533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.423633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.423658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.423790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.423903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.423928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.930 qpair failed and we were unable to recover it. 00:30:35.930 [2024-11-30 04:32:26.424054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.930 [2024-11-30 04:32:26.424214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.424239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.424387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.424543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.424569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.424654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.424750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.424775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.424932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.425055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.425080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.425245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.425376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.425405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.425552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.425690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.425715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.425838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.425933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.425969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.426070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.426158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.426184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.426297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.426433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.426461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.426592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.426721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.426749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.426867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.426986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.427011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.427126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.427246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.427271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.427458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.427609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.427634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.427728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.427837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.427863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.427969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.428060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.428087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.428204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.428300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.428325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.428446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.428536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.428562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.428684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.428815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.428839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.428956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.429053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.429077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.429166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.429283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.429309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.429476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.429611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.429639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.429776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.429899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.429927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.430127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.430252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.430277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.430410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.430556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.430581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.430674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.430764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.430792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.430883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.431010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.431053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.431187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.431346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.431371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.431492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.431616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.431641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.431736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.431818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.431843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.432012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.432160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.432186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.432305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.432397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.432422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.432539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.432633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.432658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.432787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.432879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.432905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.433030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.433152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.433177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.433290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.433421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.433453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.433582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.433725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.433750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.433912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.434033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.434059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.434152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.434245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.434270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.931 [2024-11-30 04:32:26.434389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.434478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.931 [2024-11-30 04:32:26.434503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.931 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.434599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.434684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.434710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.434831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.434927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.434952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.435077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.435157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.435183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.435297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.435459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.435486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.435611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.435731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.435756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.435851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.435940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.435972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.436124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.436257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.436285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.436390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.436501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.436527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.436617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.436700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.436725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.436866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.436973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.436999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.437092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.437217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.437245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.437365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.437495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.437520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.437652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.437739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.437764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.437891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.438029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.438055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.438186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.438269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.438294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.438393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.438511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.438536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.438661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.438749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.438774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.438976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.439108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.439134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.439217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.439344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.439370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.439465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.439588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.439631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.439744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.439874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.439898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.440025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.440119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.440143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.440236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.440364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.440389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.440484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.440596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.440621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.440812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.440964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.440990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.441081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.441169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.441195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.441323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.441415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.441440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.441531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.441645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.441674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.441820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.441906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.441932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.442063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.442153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.442178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.442299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.442392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.442417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.442505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.442624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.442649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.442772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.442854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.442879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.443000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.443124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.443148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.443275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.443364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.443389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.443510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.443592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.443617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.443710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.443860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.443885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.443992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.444116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.444158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.444277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.444422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.444447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.444597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.444696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.932 [2024-11-30 04:32:26.444725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.932 qpair failed and we were unable to recover it. 00:30:35.932 [2024-11-30 04:32:26.444835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.444956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.444986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.445073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.445200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.445225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.445375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.445551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.445579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.445724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.445878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.445903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.446021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.446145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.446170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.446295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.446413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.446437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.446573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.446738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.446768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.446889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.446990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.447016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.447135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.447281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.447306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.447424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.447510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.447534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.447623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.447707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.447733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.447840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.447986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.448012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.448132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.448287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.448312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.448432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.448599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.448627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.448754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.448869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.448894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.448991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.449105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.449130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.449225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.449313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.449338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.449450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.449631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.449656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.449780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.449926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.449951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.450081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.450234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.450259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.450382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.450508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.450534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.450675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.450776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.450803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.450910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.451042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.451068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.451156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.451273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.451299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.451388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.451500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.451525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.451609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.451705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.451729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.451812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.451898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.451924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.452093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.452181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.452206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.452334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.452419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.452445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.452561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.452678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.452704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.452790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.452934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.452964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.453100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.453224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.453251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.453425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.453510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.453534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.453657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.453750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.453776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.453890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.453985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.454011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.454140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.454281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.454306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.454397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.454519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.454544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.454684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.454813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.933 [2024-11-30 04:32:26.454839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.933 qpair failed and we were unable to recover it. 00:30:35.933 [2024-11-30 04:32:26.454946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.455079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.455108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.455201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.455320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.455345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.455463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.455613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.455638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.455729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.455843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.455870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.456009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.456123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.456147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.456259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.456345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.456369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.456491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.456585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.456610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.456752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.456874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.456902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.456997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.457150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.457177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.457295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.457400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.457426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.457550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.457644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.457668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.457818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.457934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.457979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.458101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.458203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.458230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.458381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.458503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.458528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.458621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.458746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.458771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.458892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.458985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.459009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.459105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.459223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.459248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.459373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.459489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.459513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.459598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.459705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.459731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.459825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.459984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.460018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.460147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.460294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.460318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.460443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.460560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.460584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.460699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.460790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.460814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.460905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.461014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.461040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.461161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.461284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.461308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.461490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.461599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.461623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.461772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.461886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.461910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.462034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.462128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.462168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.462299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.462392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.462419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.462524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.462658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.462683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.462806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.462951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.462982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.463103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.463226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.463251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.463408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.463513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.463540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.463686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.463800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.463824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.463946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.464041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.464065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.464149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.464240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.464264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.464349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.464435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.464459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.464582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.464695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.464720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.464807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.464922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.464946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.465074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.465186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.465210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.465333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.465454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.934 [2024-11-30 04:32:26.465479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.934 qpair failed and we were unable to recover it. 00:30:35.934 [2024-11-30 04:32:26.465601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.465689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.465714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.465859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.465942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.465973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.466140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.466266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.466294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.466394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.466535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.466576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.466702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.466806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.466831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.466991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.467111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.467136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.467278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.467410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.467436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.467595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.467698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.467725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.467882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.468006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.468035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.468182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.468316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.468341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.468459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.468573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.468597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.468753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.468843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.468868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.469029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.469147] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.469171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.469293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.469380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.469406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.469553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.469645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.469680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.469772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.469885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.469910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.470012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.470103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.470127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.470213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.470330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.470356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.470453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.470572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.470605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.470710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.470825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.470850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.470954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.471089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.471114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.471234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.471385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.471410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.471538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.471642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.471682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.471800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.471896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.471921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.472024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.472143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.472167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.472289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.472405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.472430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.472580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.472751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.472775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.472884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.472983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.473009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.473107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.473253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.473278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.473367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.473486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.473515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.473650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.473752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.473780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.473881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.473991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.474020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.474122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.474216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.474244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.474359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.474480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.474505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.474597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.474694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.474724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.474818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.474968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.474993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.475094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.475183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.475207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.475337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.475508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.475533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.475651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.475765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.475791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.475917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.476007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.935 [2024-11-30 04:32:26.476032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.935 qpair failed and we were unable to recover it. 00:30:35.935 [2024-11-30 04:32:26.476151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.476231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.476255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.476417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.476533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.476556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.476674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.476792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.476816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.476970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.477091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.477117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.477257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.477354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.477382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.477497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.477582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.477606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.477724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.477828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.477856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.477995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.478115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.478140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.478269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.478383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.478408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.478526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.478618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.478643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.478772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.478891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.478916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.479044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.479160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.479186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.479290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.479383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.479408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.479523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.479646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.479679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.479827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.479974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.480002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.480104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.480229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.480256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.480389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.480523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.480551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.480705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.480850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.480874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.480976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.481093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.481119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.481239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.481355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.481380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.481473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.481566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.481591] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.481711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.481826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.481851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.482022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.482155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.482183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.482316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.482449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.482476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.482578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.482701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.482729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.482878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.483029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.483053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.483153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.483247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.483272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.483388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.483475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.483499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.483623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.483771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.483798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.483912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.484028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.484053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.484207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.484304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.484328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.484429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.484599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.484626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.484752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.484853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.484880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.485015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.485112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.485136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.485229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.485341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.485382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.485475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.485596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.485624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.485740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.485872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.485902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.486057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.486150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.486175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.486320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.486461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.936 [2024-11-30 04:32:26.486487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.936 qpair failed and we were unable to recover it. 00:30:35.936 [2024-11-30 04:32:26.486610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.486722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.486746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.486869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.487017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.487051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.487196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.487311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.487336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.487484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.487606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.487631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.487751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.487871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.487896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.487984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.488112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.488137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.488283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.488399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.488425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.488573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.488740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.488765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.488896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.488981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.489007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.489146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.489273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.489316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.489407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.489528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.489554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.489719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.489862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.489891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.490036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.490169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.490196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.490331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.490455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.490482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.490619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.490712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.490738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.490886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.491016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.491045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.491141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.491276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.491304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.491457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.491548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.491576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.491684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.491829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.491854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.491992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.492087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.492115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.492252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.492422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.492447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.492598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.492719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.492746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.492867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.492978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.493004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.493114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.493213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.493247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.493345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.493456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.493480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.493582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.493698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.493722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.493839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.493934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.493963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.494121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.494241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.494265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.494392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.494507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.494531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.494657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.494816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.494843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.494989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.495113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.495137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.495240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.495399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.495426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.495582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.495708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.495733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.495826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.495926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.495950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.496079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.496193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.496217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.496330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.496450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.496476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.496582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.496725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.496749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.496866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.496948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.497009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.497142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.497224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.497248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.497355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.497482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.497523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.497642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.497801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.497828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.497997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.498079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.498103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.498195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.498353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.498377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.937 qpair failed and we were unable to recover it. 00:30:35.937 [2024-11-30 04:32:26.498518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.937 [2024-11-30 04:32:26.498634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.938 [2024-11-30 04:32:26.498661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.938 qpair failed and we were unable to recover it. 00:30:35.938 [2024-11-30 04:32:26.498781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.938 [2024-11-30 04:32:26.498908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.938 [2024-11-30 04:32:26.498936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.938 qpair failed and we were unable to recover it. 00:30:35.938 [2024-11-30 04:32:26.499101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.938 [2024-11-30 04:32:26.499230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.938 [2024-11-30 04:32:26.499258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.938 qpair failed and we were unable to recover it. 00:30:35.938 [2024-11-30 04:32:26.499369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.938 [2024-11-30 04:32:26.499518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:35.938 [2024-11-30 04:32:26.499543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:35.938 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.499658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.499785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.499812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.499905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.500022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.500050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.500158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.500283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.500310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.500478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.500560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.500584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.500724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.500830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.500854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.500948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.501077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.501101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.501195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.501343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.501367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.501452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.501563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.501587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.501678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.501816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.501843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.501974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.502074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.502100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.502195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.502302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.502330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.502447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.502569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.502594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.502683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.502799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.502823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.502912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.503056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.503084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.503248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.503422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.503448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.503567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.503687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.503715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.503837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.503930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.503955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.504060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.504174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.504199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.504318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.504417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.504445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.504558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.504710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.504735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.504873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.505017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.505043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.505139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.505291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.505315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.505396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.505485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.505525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.505668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.505759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.505784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.505953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.506102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.506126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.506221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.506381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.506450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.506589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.506751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.506776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.506870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.507015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.507041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.507135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.507256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.507280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.507415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.507510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.507537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.507633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.507763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.507789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.507927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.508076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.508102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.508254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.508351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.508378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.508479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.508579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.508607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.508738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.508905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.508930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.509189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.509354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.509382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.509483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.509611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.509639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.509765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.509896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.509924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.510072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.510164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.510189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.510283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.510400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.510425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.230 qpair failed and we were unable to recover it. 00:30:36.230 [2024-11-30 04:32:26.510537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.510644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.230 [2024-11-30 04:32:26.510671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.510798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.510888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.510915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.511038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.511153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.511178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.511300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.511414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.511439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.511583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.511730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.511754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.511872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.511991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.512035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.512145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.512269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.512296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.512405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.512495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.512520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.512654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.512793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.512819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.512992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.513074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.513098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.513190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.513318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.513344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.513453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.513542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.513566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.513682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.513820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.513861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.513980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.514120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.514147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.514281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.514440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.514464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.514608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.514704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.514729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.514843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.514937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.514968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.515090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.515251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.515278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.515452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.515544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.515568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.515719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.515807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.515831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.515953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.516048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.516073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.516233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.516363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.516390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.516518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.516645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.516671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.516837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.516963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.516988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.517114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.517209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.517236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.517392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.517518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.517545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.517689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.517831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.517860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.517978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.518126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.518150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.518298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.518396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.518423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.518559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.518669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.518697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.518821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.518990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.519018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.519139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.519261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.519286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.519382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.519574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.519598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.519687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.519806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.519831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.519985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.520090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.520117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.520255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.520381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.520405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.520502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.520600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.520627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.520734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.520895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.520921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.521051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.521196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.521221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.521315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.521406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.521430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.521522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.521665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.521689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.521823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.521952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.521987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.522127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.522264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.522292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.522413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.522504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.522530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.522657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.522744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.522768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.522929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.523065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.523091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.523185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.523280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.523306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.231 [2024-11-30 04:32:26.523407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.523524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.231 [2024-11-30 04:32:26.523548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.231 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.523657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.523749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.523776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.523901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.524006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.524034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.524166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.524296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.524323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.524433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.524523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.524547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.524643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.524748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.524776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.524904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.525035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.525064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.525204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.525331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.525359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.525478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.525568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.525593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.525740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.525865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.525892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.526034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.526157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.526185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.526285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.526412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.526440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.526560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.526675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.526700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.526802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.526914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.526939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.527092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.527221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.527249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.527371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.527493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.527520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.527644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.527732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.527757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.527846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.527968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.527993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.528081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.528163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.528187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.528272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.528389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.528414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.528562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.528682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.528708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.528853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.528987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.529013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.529107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.529242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.529271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.529408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.529540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.529582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.529700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.529783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.529808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.529897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.530016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.530042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.530131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.530251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.530275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.530365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.530466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.530492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.530628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.530710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.530734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.530820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.530993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.531022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.531155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.531253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.531286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.531424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.531552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.531592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.531713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.531828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.531852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.532000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.532127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.532154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.532254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.532349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.532376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.532539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.532644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.532671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.532783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.532864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.532889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.533020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.533146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.533170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.533319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.533450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.533477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.533614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.533718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.533746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.533865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.533980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.534010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.534126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.534267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.534293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.534452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.534606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.534633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.232 qpair failed and we were unable to recover it. 00:30:36.232 [2024-11-30 04:32:26.534765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.232 [2024-11-30 04:32:26.534899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.534924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.535015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.535108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.535132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.535226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.535386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.535413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.535541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.535668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.535697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.535798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.535964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.535993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.536136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.536223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.536248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.536346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.536433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.536457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.536635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.536773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.536800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.536933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.537100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.537128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.537274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.537394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.537418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.537517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.537633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.537657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.537748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.537917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.537944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.538060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.538187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.538214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.538334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.538443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.538467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.538588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.538706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.538731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.538820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.538935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.538967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.539086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.539177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.539201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.539310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.539423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.539447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.539590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.539720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.539747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.539856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.539997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.540022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.540152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.540293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.540317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.540441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.540560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.540584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.540669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.540837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.540864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.540971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.541096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.541124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.541250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.541412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.541439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.541580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.541695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/host/target_disconnect.sh: line 44: 2493737 Killed "${NVMF_APP[@]}" "$@" 00:30:36.233 [2024-11-30 04:32:26.541719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.541873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.542009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.542037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 04:32:26 -- host/target_disconnect.sh@56 -- # disconnect_init 10.0.0.2 00:30:36.233 [2024-11-30 04:32:26.542159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 04:32:26 -- host/target_disconnect.sh@17 -- # nvmfappstart -m 0xF0 00:30:36.233 [2024-11-30 04:32:26.542286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.542318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 04:32:26 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:30:36.233 [2024-11-30 04:32:26.542445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 04:32:26 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:36.233 [2024-11-30 04:32:26.542580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.542606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 04:32:26 -- common/autotest_common.sh@10 -- # set +x 00:30:36.233 [2024-11-30 04:32:26.542740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.542822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.542847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.542945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.543070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.543094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.543244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.543373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.543401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.543528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.543631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.543673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.543827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.543908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.543932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.544088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.544219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.544243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.544338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.544498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.544523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.544671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.544779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.544808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.544952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.545116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.545141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.545268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.545436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.545461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.545589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.545751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.545779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.545906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.546046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.546072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 04:32:26 -- nvmf/common.sh@469 -- # nvmfpid=2494434 00:30:36.233 [2024-11-30 04:32:26.546195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 04:32:26 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF0 00:30:36.233 04:32:26 -- nvmf/common.sh@470 -- # waitforlisten 2494434 00:30:36.233 [2024-11-30 04:32:26.546298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.546324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.546447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 04:32:26 -- common/autotest_common.sh@829 -- # '[' -z 2494434 ']' 00:30:36.233 [2024-11-30 04:32:26.546566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 04:32:26 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:36.233 [2024-11-30 04:32:26.546590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.546694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 04:32:26 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:36.233 [2024-11-30 04:32:26.546797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 [2024-11-30 04:32:26.546823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 04:32:26 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:36.233 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:36.233 [2024-11-30 04:32:26.546917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 04:32:26 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:36.233 [2024-11-30 04:32:26.547075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.233 04:32:26 -- common/autotest_common.sh@10 -- # set +x 00:30:36.233 [2024-11-30 04:32:26.547117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.233 qpair failed and we were unable to recover it. 00:30:36.233 [2024-11-30 04:32:26.547271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.547367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.547392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.547513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.547654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.547681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.547785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.547891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.547918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.548051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.548140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.548165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.548272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.548419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.548443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.548602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.548729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.548757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.548866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.553002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.553043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.553232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.553364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.553393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.553546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.553638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.553665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.553826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.553967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.553995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.554116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.554235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.554274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.554405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.554546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.554576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.554733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.554866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.554893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.555065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.555181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.555209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.555342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.555466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.555497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.555634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.555774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.555804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.555943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.556108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.556136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.556271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.556411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.556442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.556584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.556729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.556760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.556896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.557080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.557112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.557264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.557392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.557421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.557548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.557692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.557723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.557918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.558054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.558082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.558225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.558346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.558374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.558520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.558616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.558642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.558776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.558867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.558892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.559099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.559229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.559256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.559356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.559518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.559546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.559671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.559827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.559856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.560014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.560159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.560189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.560352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.560504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.560532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.560660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.562685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.562721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.562879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.563021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.563048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.563203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.563336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.563364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.563512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.563631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.563657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.563846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.563999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.564025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.564172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.564274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.564300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.564419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.564508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.564533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.564627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.564744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.564770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.564898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.565006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.565033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.565157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.565251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.565276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.565379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.565525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.565551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.565638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.565787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.565812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.565907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.566030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.566056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.566151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.566295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.566319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.566417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.566507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.566533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.566625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.566770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.566795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.566889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.567002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.567027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.234 qpair failed and we were unable to recover it. 00:30:36.234 [2024-11-30 04:32:26.567113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.567234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.234 [2024-11-30 04:32:26.567259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.567379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.567505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.567530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.567631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.567782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.567807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.567901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.568038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.568064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.568183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.568295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.568320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.568435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.568527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.568552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.568676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.568801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.568826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.568946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.569070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.569096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.569190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.569294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.569319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.569410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.569515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.569539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.569686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.569805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.569829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.569925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.570024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.570049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.570146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.570258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.570282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.570442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.570532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.570561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.570677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.570795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.570819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.570914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.571059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.571085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.571211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.571326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.571350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.571474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.571560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.571584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.571703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.571845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.571869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.571996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.572119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.572143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.572235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.572320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.572344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.572438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.572552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.572576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.572698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.572788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.572813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.572966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.573098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.573127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.573245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.573363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.573388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.573537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.573652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.573676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.573774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.573891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.573916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.574043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.574167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.574191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.574312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.574431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.574456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.574619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.574735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.574761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.574908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.574997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.575023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.575120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.575235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.575260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.575355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.575468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.575493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.575585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.575673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.575697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.575823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.575941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.575975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.576078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.576199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.576224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.576344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.576431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.576456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.576576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.576669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.576693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.576811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.576922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.576947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.577050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.577167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.577192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.577283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.577403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.577427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.577548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.577661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.577686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.577813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.577900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.577924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.578066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.578214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.578239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.578362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.578480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.578505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.235 qpair failed and we were unable to recover it. 00:30:36.235 [2024-11-30 04:32:26.578628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.235 [2024-11-30 04:32:26.578719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.578746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.578862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.578974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.579000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.579088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.579204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.579228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.579359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.579471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.579495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.579589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.579734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.579759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.579848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.579935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.579965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.580097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.580188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.580213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.580334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.580448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.580474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.580619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.580737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.580762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.580855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.580965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.580992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.581139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.581261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.581286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.581382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.581470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.581495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.581643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.581790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.581815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.581934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.582025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.582051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.582169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.582313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.582339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.582486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.582573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.582597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.582744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.582863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.582888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.583012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.583158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.583182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.583287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.583403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.583427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.583549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.583644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.583674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.583821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.583915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.583939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.584098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.584190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.584214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.584329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.584449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.584474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.584569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.584656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.584680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.584771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.584885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.584909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.585031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.585148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.585171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.585291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.585415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.585439] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.585587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.585738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.585763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.585911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.586038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.586021] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:36.236 [2024-11-30 04:32:26.586063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.586094] [ DPDK EAL parameters: nvmf -c 0xF0 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:30:36.236 [2024-11-30 04:32:26.586186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.586280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.586304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.586448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.586575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.586600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.586718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.586838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.586863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.586984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.587113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.587138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.587259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.587345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.587372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.587496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.587615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.587639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.587755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.587846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.587873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.587995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.588088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.588113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.588228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.588323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.588348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.588435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.588527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.588552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.588708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.588848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.588874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.588999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.589114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.589140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.589236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.589352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.589377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.589496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.589639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.589664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.589812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.589903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.589929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.590083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.590199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.590224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.590315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.590435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.590461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.590584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.590702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.590727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.236 [2024-11-30 04:32:26.590846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.590980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.236 [2024-11-30 04:32:26.591006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.236 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.591128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.591238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.591264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.591365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.591478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.591504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.591627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.591743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.591768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.591918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.592041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.592067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.592195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.592282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.592306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.592450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.592570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.592595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.592713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.592835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.592859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.592985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.593102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.593128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.593277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.593372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.593398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.593548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.593663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.593687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.593841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.593934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.593978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.594068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.594167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.594193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.594293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.594376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.594402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.594502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.594618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.594643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.594786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.594878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.594903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.595044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.595142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.595168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.595294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.595409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.595434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.595552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.595640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.595665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.595783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.595869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.595894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.596026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.596114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.596138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.596283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.596390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.596415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.596537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.596670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.596700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.596823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.596953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.596989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.597118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.597210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.597235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.597391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.597512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.597537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.597624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.597715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.597740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.597859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.597980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.598006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.598101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.598221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.598246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.598363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.598482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.598506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.598622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.598769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.598794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.598891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.599036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.599061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.599146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.599244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.599270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.599402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.599519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.599543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.599693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.599779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.599804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.599921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.600085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.600110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.600206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.600297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.600321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.600423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.600509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.600535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.600624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.600742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.600767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.600853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.600971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.600996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.601082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.601198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.601222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.601339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.601454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.601478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.601629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.601752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.601776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.601936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.602082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.602107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.602226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.602347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.602371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.602494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.602577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.602601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.602719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.602811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.602835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.602929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.603021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.603046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.237 [2024-11-30 04:32:26.603144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.603263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.237 [2024-11-30 04:32:26.603289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.237 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.603375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.603496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.603520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.603673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.603772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.603798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.603886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.603979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.604004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.604108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.604222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.604246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.604343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.604456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.604480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.604594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.604739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.604764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.604911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.605056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.605081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.605191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.605304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.605328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.605445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.605532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.605556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.605648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.605730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.605755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.605872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.606021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.606047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.606135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.606257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.606281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.606373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.606489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.606513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.606658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.606774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.606798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.606918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.607011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.607036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.607132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.607277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.607302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.607437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.607587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.607612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.607706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.607828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.607852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.607941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.608092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.608116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.608216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.608301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.608325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.608441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.608553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.608577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.608720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.608821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.608845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.608938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.609067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.609092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.609211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.609315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.609339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.609456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.609601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.609631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.609747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.609849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.609874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.610009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.610131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.610156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.610247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.610367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.610392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.610485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.610604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.610629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.610779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.610870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.610895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.611018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.611140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.611165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.611295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.611417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.611443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.611555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.611652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.611677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.611768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.611911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.611936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.612069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.612187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.612217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.612337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.612451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.612475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.612568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.612723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.612749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.612866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.612990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.613016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.613140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.613259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.613284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.613410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.613555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.613580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.613679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.613796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.613821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.613920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.614072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.614097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.614186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.614334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.614358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.614451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.614591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.614616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.614737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.614878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.238 [2024-11-30 04:32:26.614903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.238 qpair failed and we were unable to recover it. 00:30:36.238 [2024-11-30 04:32:26.615030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.615174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.615200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.615331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.615421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.615446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.615592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.615730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.615755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.615841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.615941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.615979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.616073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.616166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.616191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.616307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.616402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.616428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.616523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.616642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.616667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.616785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.616876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.616901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.617005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.617097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.617123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.617239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.617356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.617381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.617501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.617611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.617636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.617720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.617806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.617830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.617921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.618020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.618045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.618165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.618288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.618312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.618409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.618530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.618554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.618654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.618771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.618795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.618913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.619028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.619054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.619177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.619289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.619314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.619445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.619535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.619560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.619704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.619829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.619853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.619998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.620098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.620123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 EAL: No free 2048 kB hugepages reported on node 1 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.620217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.620377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.620401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.620496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.620610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.620635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.620781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.620900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.620924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.621025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.621143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.621168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.621292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.621435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.621459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.621552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.621664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.621688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.621778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.621897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.621921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.622018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.622113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.622137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.622253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.622340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.622363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.622509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.622630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.622654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.622774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.622872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.622896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.623000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.623144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.623170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.623308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.623451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.623477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.623602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.623719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.623745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.623865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.624012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.624038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.624161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.624298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.624322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.624448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.624540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.624564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.624692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.624808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.624832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.624952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.625058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.625086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.625185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.625284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.625314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.625446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.625534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.625558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.625709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.625833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.625857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.625961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.626078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.626103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.626203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.626330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.626355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.626461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.626557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.626583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.626732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.626851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.626877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.626980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.627065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.627091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.627187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.627308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.239 [2024-11-30 04:32:26.627333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.239 qpair failed and we were unable to recover it. 00:30:36.239 [2024-11-30 04:32:26.627479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.627596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.627621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.627712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.627832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.627862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.627989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.628109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.628134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.628220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.628347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.628371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.628516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.628630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.628655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.628758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.628903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.628939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.629048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.629167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.629192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.629359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.629450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.629474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.629603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.629709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.629734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.629879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.629974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.629999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.630112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.630192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.630217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.630345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.630434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.630459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.630556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.630634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.630660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.630746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.630895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.630921] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.631053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.631133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.631157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.631274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.631380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.631406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.631494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.631587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.631613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.631739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.631839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.631864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.631988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.632137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.632163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.632320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.632408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.632433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.632530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.632648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.632674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.632795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.632873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.632897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.633021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.633137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.633164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.633266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.633355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.633379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.633506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.633646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.633670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.633791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.633910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.633934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.634061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.634156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.634182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.634316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.634460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.634484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.634578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.634726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.634751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.634874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.634967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.634992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.635121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.635213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.635238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.635404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.635519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.635544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.635645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.635745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.635769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.635887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.636005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.636031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.636118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.636237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.636264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.636388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.636486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.636511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.636613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.636733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.636758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.636905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.637029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.637055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.637187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.637281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.637305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.637457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.637547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.637571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.637662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.637783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.637809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.637930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.638089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.638114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.638248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.638395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.638421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.638515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.638602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.638627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.638749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.638841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.638866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.639012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.639128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.639152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.639263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.639355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.639379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.639466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.639558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.639585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.639706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.639834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.240 [2024-11-30 04:32:26.639859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.240 qpair failed and we were unable to recover it. 00:30:36.240 [2024-11-30 04:32:26.639975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.640076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.640101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.640222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.640369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.640394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.640508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.640621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.640646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.640766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.640883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.640913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.641020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.641166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.641190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.641294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.641421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.641445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.641559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.641683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.641707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.641827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.641972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.641997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.642139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.642286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.642311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.642462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.642549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.642573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.642673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.642785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.642810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.642907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.643010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.643035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.643125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.643244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.643268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.643417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.643541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.643566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.643693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.643788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.643813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.643986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.644140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.644164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.644258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.644343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.644368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.644491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.644585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.644610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.644707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.644828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.644852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.644968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.645113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.645137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.645230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.645360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.645384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.645512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.645653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.645677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.645797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.645916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.645941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.646049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.646134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.646158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.646289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.646386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.646412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.646508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.646627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.646651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.646799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.646922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.646947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.647089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.647208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.647233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.647356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.647452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.647478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.647598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.647717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.647743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.647836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.647927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.647952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.648077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.648199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.648224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.648352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.648470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.648494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.648616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.648763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.648787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.648886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.648989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.649023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.649138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.649285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.649309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.649400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.649512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.649536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.649658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.649782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.649806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.649922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.650025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.650050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.650142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.650225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.650249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.650333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.650461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.650486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.650574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.650656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.650681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.650776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.650889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.650914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.651073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.651188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.651214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.651311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.651433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.651460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.241 qpair failed and we were unable to recover it. 00:30:36.241 [2024-11-30 04:32:26.651578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.241 [2024-11-30 04:32:26.651664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.651688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.651802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.651920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.651944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.652086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.652207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.652231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.652351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.652467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.652491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.652590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.652709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.652734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.652852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.652970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.652996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.653117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.653244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.653269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.653411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.653496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.653521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.653634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.653750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.653775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.653903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.654022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.654053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.654176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.654271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.654296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.654382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.654480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.654506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.654596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.654741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.654765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.654884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.654939] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:30:36.242 [2024-11-30 04:32:26.654986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.655011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.655099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.655216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.655248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.655336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.655428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.655452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.655544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.655633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.655657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.655805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.655926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.655950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.656109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.656221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.656246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.656353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.656445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.656473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.656559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.656702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.656726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.656849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.656970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.656996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.657094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.657177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.657202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.657347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.657472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.657496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.657590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.657681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.657707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.657825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.657940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.657971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.658126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.658218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.658243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.658369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.658463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.658487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.658605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.658717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.658741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.658860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.658979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.659004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.659169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.659257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.659281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.659375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.659500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.659524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.659621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.659743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.659767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.659867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.659991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.660017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.660139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.660226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.660250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.660373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.660455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.660479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.660626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.660717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.660742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.660831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.660949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.660983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.661113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.661227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.661252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.661355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.661452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.661478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.661605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.661694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.661719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.661837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.661989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.662024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.662173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.662295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.662320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.662413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.662530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.662554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.662702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.662828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.662853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.663004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.663123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.663147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.663310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.663427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.663451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.663597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.663687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.663711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.663832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.663980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.664013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.664102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.664224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.664249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.242 [2024-11-30 04:32:26.664346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.664467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.242 [2024-11-30 04:32:26.664492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.242 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.664618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.664731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.664756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.664877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.664986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.665013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.665137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.665230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.665254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.665379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.665525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.665550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.665642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.665762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.665788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.665889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.666020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.666046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.666166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.666319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.666344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.666440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.666560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.666586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.666712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.666791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.666817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.666917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.667036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.667063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.667224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.667325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.667349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.667475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.667590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.667615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.667738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.667859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.667884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.668001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.668122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.668147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.668240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.668340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.668366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.668460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.668541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.668565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.668678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.668822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.668848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.668970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.669086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.669111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.669236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.669331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.669356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.669475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.669620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.669650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.669753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.669850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.669874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.669996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.670093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.670119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.670241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.670370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.670395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.670516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.670633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.670658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.670782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.670899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.670924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.671079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.671222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.671247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.671339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.671487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.671511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.671652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.671774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.671799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.671922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.672054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.672079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.672200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.672288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.672317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.672419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.672538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.672562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.672682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.672829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.672853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.672950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.673045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.673069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.673213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.673329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.673353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.673477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.673593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.673618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.673768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.673886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.673910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.674016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.674102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.674127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.674247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.674339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.674364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.674473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.674595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.674619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.674738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.674829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.674855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.674945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.675109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.675134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.675222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.675337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.675362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.675486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.675601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.675628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.675778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.675863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.675889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.676011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.676126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.676152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.243 qpair failed and we were unable to recover it. 00:30:36.243 [2024-11-30 04:32:26.676267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.243 [2024-11-30 04:32:26.676381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.676407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.676535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.676658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.676684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.676805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.676932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.676963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.677083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.677200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.677225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.677346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.677491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.677516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.677639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.677761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.677787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.677912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.678041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.678067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.678193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.678313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.678338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.678454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.678577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.678603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.678698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.678786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.678812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.678907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.678995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.679020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.679168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.679288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.679314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.679437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.679558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.679583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.679677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.679767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.679792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.679891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.680012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.680039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.680160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.680284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.680310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.680428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.680520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.680545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.680693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.680786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.680812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.680934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.681033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.681059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.681162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.681261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.681287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.681379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.681468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.681493] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.681582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.681699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.681724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.681850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.681939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.681971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.682090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.682212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.682237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.682385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.682504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.682531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.682651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.682772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.682798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.682891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.683012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.683037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.683159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.683303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.683328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.683422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.683537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.683562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.683678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.683799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.683824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.683941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.684080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.684105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.684229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.684340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.684364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.684458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.684602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.684627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.684738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.684832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.684857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.684965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.685087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.685111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.685231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.685378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.685407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.685532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.685656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.685680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.685823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.685939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.685981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.686103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.686192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.686217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.686340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.686430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.686454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.686556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.686675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.686699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.686823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.686901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.686926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.687039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.687153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.687177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.687297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.687388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.687412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.687506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.687594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.687618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.687767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.687886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.687910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.688010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.688101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.688127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.688253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.688403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.688428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.688555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.688651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.244 [2024-11-30 04:32:26.688675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.244 qpair failed and we were unable to recover it. 00:30:36.244 [2024-11-30 04:32:26.688776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.688867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.688893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.689038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.689151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.689176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.689270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.689359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.689385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.689534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.689628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.689653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.689756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.689846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.689871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.689979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.690095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.690120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.690267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.690354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.690378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.690476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.690595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.690620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.690741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.690835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.690859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.690991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.691114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.691140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.691262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.691360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.691385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.691480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.691624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.691648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.691747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.691837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.691861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.691967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.692112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.692137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.692255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.692339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.692363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.692506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.692626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.692650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.692743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.692857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.692881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.693004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.693120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.693145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.693259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.693380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.693405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.693499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.693590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.693614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.693720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.693864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.693889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.694014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.694171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.694195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.694316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.694434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.694459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.694581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.694703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.694728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.694816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.694933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.694965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.695093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.695210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.695236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.695336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.695435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.695459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.695578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.695693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.695718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.695846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.695936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.695966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.696065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.696155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.696179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.696301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.696415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.696440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.696561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.696654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.696679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.696800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.696945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.696978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.697103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.697245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.697269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.697367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.697484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.697508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.697630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.697726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.697750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.697894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.698020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.698045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.698172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.698292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.698325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.698416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.698506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.698530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.698625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.698744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.698768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.698855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.698981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.699007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.699130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.699275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.699300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.699397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.699514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.699539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.699635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.699723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.699749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.699867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.699985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.700013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.700156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.700239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.700264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.700354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.700437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.700461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.700579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.700694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.700718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.700821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.700913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.700937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.245 qpair failed and we were unable to recover it. 00:30:36.245 [2024-11-30 04:32:26.701069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.245 [2024-11-30 04:32:26.701217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.701241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.701342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.701433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.701457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.701579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.701698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.701722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.701845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.701970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.701996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.702120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.702213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.702237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.702359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.702443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.702467] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.702571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.702691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.702715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.702845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.702936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.702985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.703106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.703229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.703253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.703349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.703471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.703495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.703588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.703704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.703729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.703828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.703944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.703975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.704121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.704215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.704239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.704331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.704450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.704474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.704560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.704671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.704696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.704813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.704910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.704936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.705067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.705151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.705176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.705305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.705400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.705425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.705545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.705691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.705716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.705839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.705967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.705993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.706137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.706282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.706306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.706395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.706510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.706534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.706651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.706776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.706801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.706917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.707052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.707079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.707200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.707344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.707369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.707493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.707611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.707635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.707740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.707829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.707855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.707981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.708076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.708100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.708217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.708306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.708330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.708449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.708538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.708562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.708644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.708753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.708777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.708875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.708983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.709010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.709113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.709200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.709224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.709315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.709400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.709424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.709519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.709633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.709658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.709778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.709878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.709904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.710011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.710130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.710156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.710253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.710334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.710359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.710504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.710647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.710672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.710795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.710883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.710912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.711071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.711216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.711240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.711326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.711464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.711489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.711574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.711670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.711695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.711822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.711935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.711966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.712093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.712217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.712242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.712391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.712477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.246 [2024-11-30 04:32:26.712502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.246 qpair failed and we were unable to recover it. 00:30:36.246 [2024-11-30 04:32:26.712652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.712766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.712790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.712890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.713009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.713035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.713182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.713292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.713316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.713456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.713550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.713579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.713699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.713790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.713814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.713941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.714067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.714094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.714222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.714342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.714367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.714492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.714653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.714679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.714797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.714889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.714914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.715059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.715178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.715203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.715291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.715406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.715431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.715542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.715624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.715648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.715770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.715862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.715887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.715997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.716158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.716183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.716308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.716434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.716459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.716555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.716666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.716691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.716781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.716870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.716894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.717038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.717130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.717154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.717247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.717365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.717390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.717535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.717630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.717654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.717805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.717928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.717952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.718073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.718193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.718217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.718313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.718422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.718446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.718558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.718698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.718722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.718819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.718987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.719013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.719138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.719222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.719246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.719341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.719456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.719481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.719577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.719725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.719750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.719871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.719968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.719993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.720117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.720231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.720255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.720370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.720471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.720496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.720639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.720728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.720753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.720849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.720982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.721008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.721127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.721210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.721235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.721351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.721479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.721504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.721623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.721714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.721739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.721860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.721943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.721974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.722097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.722176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.722201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.722293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.722382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.722406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.722493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.722585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.722609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.722704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.722847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.722872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.722984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.723102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.723126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.723218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.723333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.723359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.723486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.723607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.723632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.723748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.723867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.723892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.723997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.724095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.724120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.724203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.724323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.724348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.724433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.724578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.724603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.247 qpair failed and we were unable to recover it. 00:30:36.247 [2024-11-30 04:32:26.724727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.247 [2024-11-30 04:32:26.724822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.724847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.724932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.725062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.725087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.725181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.725329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.725354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.725473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.725590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.725615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.725735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.725828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.725854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.725971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.726070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.726095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.726186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.726302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.726330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.726416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.726534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.726558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.726678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.726771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.726797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.726893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.727009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.727035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.727129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.727222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.727248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.727365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.727489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.727513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.727628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.727723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.727747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.727831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.727950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.727981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.728102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.728214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.728239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.728329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.728444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.728469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.728563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.728681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.728706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.728805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.728918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.728943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.729079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.729198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.729222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.729341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.729458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.729483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.729610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.729717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.729742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.729860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.729946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.729980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.730100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.730220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.730245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.730337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.730434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.730459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.730569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.730660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.730686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.730807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.730927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.730952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.731055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.731141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.731166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.731259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.731379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.731403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.731497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.731586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.731610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.731712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.731833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.731858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.732004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.732094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.732119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.732217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.732361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.732386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.732518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.732606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.732631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.732780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.732897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.732922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.733077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.733226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.733251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.733343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.733429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.733455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.733576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.733659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.733684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.733833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.733933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.733963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.734110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.734203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.734228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.734320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.734450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.734475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.734597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.734720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.734745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.734902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.735015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.735041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.735165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.735277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.735303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.735391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.735511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.735536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.735655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.735771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.735796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.735891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.735983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.736010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.736096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.736220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.736244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.736339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.736436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.736462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.736573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.736654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.736679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.736801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.736896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.736922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.248 qpair failed and we were unable to recover it. 00:30:36.248 [2024-11-30 04:32:26.737032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.248 [2024-11-30 04:32:26.737131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.737156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.737249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.737362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.737387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.737473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.737590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.737614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.737701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.737790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.737815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.737933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.738050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.738075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.738193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.738339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.738363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.738480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.738619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.738644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.738739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.738862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.738892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.738980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.739103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.739128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.739223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.739312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.739336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.739466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.739583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.739608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.739733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.739852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.739876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.739996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.740140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.740164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.740311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.740426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.740451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.740538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.740651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.740675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.740761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.740880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.740904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.741001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.741106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.741130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.741255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.741376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.741400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.741492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.741611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.741635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.741760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.741861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.741886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.741974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.742091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.742116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.742230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.742373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.742398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.742491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.742582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.742606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.742727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.742816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.742842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.742932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.743053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.743078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.743181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.743330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.743354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.743473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.743562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.743586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.743685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.743811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.743835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.743935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.744059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.744083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.744181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.744294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.744318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.744441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.744560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.744584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.744713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.744837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.744861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.744991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.745084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.745108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.745196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.745339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.745363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.745456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.745598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.745623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.745713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.745806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.745830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.745964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.746116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.746141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.746238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.746328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.746352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.746463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.746553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.746577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.746722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.746839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.746863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.746984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.747098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.747122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.747243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.747336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.747360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.747474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.747573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.747597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.747687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.747802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.747827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.747952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.748046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.748070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.249 qpair failed and we were unable to recover it. 00:30:36.249 [2024-11-30 04:32:26.748158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.249 [2024-11-30 04:32:26.748257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.748282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.748399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.748484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.748508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.748593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.748679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.748676] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:36.250 [2024-11-30 04:32:26.748703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.748793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.748809] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:30:36.250 [2024-11-30 04:32:26.748829] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:30:36.250 [2024-11-30 04:32:26.748842] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:30:36.250 [2024-11-30 04:32:26.748879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.748902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.749024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.749061] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 5 00:30:36.250 [2024-11-30 04:32:26.749128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.749153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.749083] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 6 00:30:36.250 [2024-11-30 04:32:26.749121] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 7 00:30:36.250 [2024-11-30 04:32:26.749124] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 4 00:30:36.250 [2024-11-30 04:32:26.749245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.749328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.749352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.749452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.749573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.749597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.749720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.749808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.749832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.749922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.750067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.750092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.750181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.750266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.750290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.750382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.750472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.750497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.750586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.750706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.750731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.750860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.750947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.750979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.751075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.751187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.751211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.751291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.751386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.751410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.751496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.751582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.751608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.751696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.751808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.751834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.751955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.752086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.752110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.752204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.752288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.752313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.752407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.752493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.752517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.752617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.752708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.752732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.752820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.752936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.752972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.753099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.753190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.753214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.753320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.753407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.753432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.753519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.753604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.753630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.753748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.753868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.753892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.754012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.754102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.754126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.754217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.754362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.754386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.754467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.754556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.754581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.754673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.754793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.754817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.754918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.755007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.755032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.755122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.755238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.755263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.755393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.755489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.755513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.755600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.755688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.755713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.755828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.755905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.755929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.756058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.756149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.756173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.756265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.756344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.756368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.756469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.756555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.756579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.756665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.756760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.756785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.756938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.757030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.757056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.757155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.757276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.757301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.757393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.757479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.757503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.757622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.757739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.757763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.757853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.757941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.757974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.758095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.758194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.758219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.758310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.758398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.758423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.758541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.758650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.758674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.250 qpair failed and we were unable to recover it. 00:30:36.250 [2024-11-30 04:32:26.758764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.250 [2024-11-30 04:32:26.758862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.758886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.758978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.759060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.759084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.759172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.759258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.759282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.759412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.759508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.759533] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.759626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.759714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.759740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.759870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.759973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.760000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.760096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.760218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.760243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.760328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.760427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.760451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.760545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.760629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.760653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.760771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.760890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.760914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.761083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.761209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.761235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.761324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.761418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.761444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.761535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.761641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.761665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.761781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.761873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.761898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.762015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.762103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.762127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.762211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.762338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.762362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.762453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.762572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.762597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.762692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.762775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.762800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.762898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.762989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.763016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.763119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.763201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.763226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.763323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.763440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.763464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.763557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.763705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.763729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.763842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.763991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.764017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.764133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.764222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.764246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.764338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.764417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.764442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.764550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.764647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.764677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.764776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.764877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.764901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.765003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.765111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.765135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.765229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.765324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.765349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.765432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.765521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.765545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.765633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.765729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.765753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.765840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.765924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.765949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.766064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.766146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.766172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.766271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.766383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.766407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.766498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.766623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.766647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.766739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.766829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.766858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.767005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.767098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.767123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.767250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.767338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.767362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.767449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.767539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.767565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.767655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.767738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.767763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.767888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.768033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.768060] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.768152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.768247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.768274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.768391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.768484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.768509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.768605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.768713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.768738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.768853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.768961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.768987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.251 qpair failed and we were unable to recover it. 00:30:36.251 [2024-11-30 04:32:26.769107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.251 [2024-11-30 04:32:26.769197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.769221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.769317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.769431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.769455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.769548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.769640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.769665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.769787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.769880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.769905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.770003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.770114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.770140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.770264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.770382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.770407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.770492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.770602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.770626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.770744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.770871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.770897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.770994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.771075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.771099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.771196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.771284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.771310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.771420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.771537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.771561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.771689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.771782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.771806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.771894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.772037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.772063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.772151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.772237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.772261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.772352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.772463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.772488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.772596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.772704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.772729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.772853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.772939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.772974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.773061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.773179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.773204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.773295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.773383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.773407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.773491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.773611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.773636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.773770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.773854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.773879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.773973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.774098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.774123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.774216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.774306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.774331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.774416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.774542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.774568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.774695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.774787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.774812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.774899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.775023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.775049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.775166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.775261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.775286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.775376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.775457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.775482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.775595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.775714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.775738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.775824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.775910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.775934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.776035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.776123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.776150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.776234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.776324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.776349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.776433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.776518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.776544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.776663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.776778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.776803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.776926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.777033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.777058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.777182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.777262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.777287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.777423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.777510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.777534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.777622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.777712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.777736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.777830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.777953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.777987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.778112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.778201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.778226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.778317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.778405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.778430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.778520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.778632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.778661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.778787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.778875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.778900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.779010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.779138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.779163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.779250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.779344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.779368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.779462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.779545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.779569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.779658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.779770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.779795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.779911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.780028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.780054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.780152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.780234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.252 [2024-11-30 04:32:26.780258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.252 qpair failed and we were unable to recover it. 00:30:36.252 [2024-11-30 04:32:26.780347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.780455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.780479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.780569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.780656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.780681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.780770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.780856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.780880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.780984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.781098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.781124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.781208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.781287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.781312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.781407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.781498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.781523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.781611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.781753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.781777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.781886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.781973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.781999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.782098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.782181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.782206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.782301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.782398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.782424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.782521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.782603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.782628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.782721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.782835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.782859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.782944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.783064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.783089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.783196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.783283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.783308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.783408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.783523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.783548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.783651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.783733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.783758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.783853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.783977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.784003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.784104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.784198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.784223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.784308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.784386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.784410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.784500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.784622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.784647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.784739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.784830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.784854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.784940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.785112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.785138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.785288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.785380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.785407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.785537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.785636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.785661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.785777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.785858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.785883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.785977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.786063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.786087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.786176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.786300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.786325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.786447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.786538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.786563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.786656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.786738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.786763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.786887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.786975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.787001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.787120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.787245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.787270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.787366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.787455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.787479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.787595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.787690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.787716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.787802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.787922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.787947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.788059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.788146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.788170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.788262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.788376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.788401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.788484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.788596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.788621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.788708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.788809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.788834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.788927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.789076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.789102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.789190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.789301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.789327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.789416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.789531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.789555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.789668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.789751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.789775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.789894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.789980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.790005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.790128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.790251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.790280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.790394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.790480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.790505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.790597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.790714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.790738] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.790824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.790913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.790939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.791070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.791188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.791212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.253 [2024-11-30 04:32:26.791303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.791389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.253 [2024-11-30 04:32:26.791415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.253 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.791511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.791589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.791614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.791735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.791849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.791873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.791972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.792090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.792114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.792201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.792326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.792351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.792443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.792541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.792566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.792685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.792767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.792792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.792882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.792995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.793020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.793114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.793233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.793258] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.793355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.793449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.793474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.793563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.793645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.793669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.793793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.793881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.793905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.793997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.794084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.794109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.794234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.794324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.794350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.794442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.794529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.794553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.794651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.794734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.794759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.794856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.794961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.794987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.795074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.795187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.795211] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.795300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.795383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.795408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.795494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.795601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.795625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.795751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.795839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.795863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.796016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.796109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.796134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.796221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.796314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.796338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.796446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.796594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.796619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.796714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.796804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.796830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.796928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.797024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.797050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.797144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.797257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.797281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.797366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.797494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.797518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.797630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.797718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.797741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.797865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.797985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.798010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.798110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.798227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.798252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.798340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.798431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.798455] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.798551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.798637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.798662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.798748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.798863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.798888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.799010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.799090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.799115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.799217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.799330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.799355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.799446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.799538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.799563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.799660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.799807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.799831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.799925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.800046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.800072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.800190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.800275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.800300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.800386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.800472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.800496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.800617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.800707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.800732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.800846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.800964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.800990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.801083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.801168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.801194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.801278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.801428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.801453] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.801547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.801630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.801655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.254 qpair failed and we were unable to recover it. 00:30:36.254 [2024-11-30 04:32:26.801749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.254 [2024-11-30 04:32:26.801838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.801866] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.801955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.802111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.802137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.802226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.802324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.802349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.802444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.802563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.802588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.802676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.802795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.802820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.802968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.803064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.803089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.803174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.803253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.803277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.803360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.803445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.803471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.803589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.803700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.803726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.803813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.803903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.803928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.804068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.804151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.804175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.804269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.804352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.804378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.804530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.804625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.804651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.804768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.804859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.804884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.805003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.805100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.805125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.805246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.805341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.805366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.805455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.805541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.805566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.805684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.805802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.805826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.805913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.806008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.806034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.806151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.806236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.806261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.806388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.806505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.806530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.806653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.806744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.806769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.806858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.806946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.806977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.807064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.807210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.807235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.807384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.807502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.807527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.807614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.807695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.807720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.807838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.807928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.807952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.808086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.808178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.808202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.808324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.808418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.808443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.808533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.808619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.808644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.808729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.808819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.808844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.808969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.809065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.809090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.809195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.809315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.809340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.809462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.809549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.809573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.809661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.809752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.809776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.809863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.809974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.810001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.810094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.810191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.810218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.810333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.810421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.810445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.810540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.810622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.810647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.810753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.810846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.810872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.810993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.811086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.811112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.811199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.811316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.811342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.811431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.811535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.811560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.811651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.811767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.811792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.811892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.812011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.812037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.812162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.812245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.812270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.812397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.812517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.812541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.812630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.812717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.812741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.255 [2024-11-30 04:32:26.812834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.812944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.255 [2024-11-30 04:32:26.812975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.255 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.813071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.813162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.813187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.813286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.813377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.813401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.813488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.813579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.813608] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.813704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.813794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.813819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.813935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.814061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.814086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.814177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.814293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.814318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.814438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.814558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.814582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.814703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.814798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.814822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.814939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.815042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.815067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.815152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.815274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.815299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.815391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.815483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.815513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.815638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.815723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.815747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.815838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.815924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.815954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.816125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.816209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.816233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.816321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.816435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.816459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.816577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.816674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.816698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.816787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.816887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.816912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.817039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.817155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.817180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.817271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.817359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.817385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.817481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.817571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.817596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.817740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.817886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.817910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.817998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.818141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.818166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.818251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.818344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.818368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.818465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.818562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.818586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.818700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.818791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.818816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.818937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.819036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.819063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.819162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.819253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.819280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.819376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.819463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.819487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.819573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.819684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.819708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.819801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.819907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.819931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.820037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.820133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.820158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.820275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.820358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.820382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.820501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.820581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.820606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.820701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.820826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.820851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.820936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.821036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.821062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.821181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.821293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.821318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.821410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.821503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.821527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.821622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.821758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.821782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.821895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.821993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.822018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.822114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.822205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.822230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.822423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.822524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.822550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.822681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.822799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.822823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.822944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.823066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.823091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.823213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.823314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.823339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.823432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.823527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.823553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.823641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.823755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.823780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.823872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.823991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.824017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.824142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.824228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.824254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.256 qpair failed and we were unable to recover it. 00:30:36.256 [2024-11-30 04:32:26.824353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.256 [2024-11-30 04:32:26.824482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.824507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-30 04:32:26.824610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.824725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.824750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-30 04:32:26.824838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.824928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.824952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-30 04:32:26.825090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.825180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.825204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-30 04:32:26.825323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.825412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.825437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-30 04:32:26.825561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.825668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.825693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-30 04:32:26.825783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.825884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.825909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-30 04:32:26.826072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.826192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.826217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-30 04:32:26.826310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.826402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.826427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.257 [2024-11-30 04:32:26.826525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.826629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.257 [2024-11-30 04:32:26.826654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.257 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-30 04:32:26.826761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.826878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.826902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-30 04:32:26.826995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.827090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.827115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-30 04:32:26.827205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.827291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.827316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-30 04:32:26.827410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.827497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.827522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-30 04:32:26.827620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.827743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.827768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-30 04:32:26.827869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.827969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.828001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-30 04:32:26.828102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.828191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.828216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-30 04:32:26.828309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.828430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.828459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.539 qpair failed and we were unable to recover it. 00:30:36.539 [2024-11-30 04:32:26.828582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.539 [2024-11-30 04:32:26.828696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.828729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.828830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.828930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.828954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.829064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.829154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.829178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.829280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.829376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.829401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.829523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.829614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.829639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.829744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.829833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.829857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.829950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.830058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.830082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.830178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.830268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.830292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.830424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.830509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.830534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.830624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.830721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.830746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.830842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.830930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.830955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.831088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.831180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.831205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.831301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.831399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.831424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.831526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.831612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.831636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.831731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.831828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.831852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.831947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.832052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.832077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.832174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.832290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.832314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.832407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.832502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.832526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.832630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.832714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.832739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.832836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.832928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.832953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.833061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.833152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.833176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.833275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.833364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.833388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.833474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.833566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.833590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.833691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.833785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.833810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.833903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.834005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.834032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.834127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.834245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.834270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.834372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.834458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.834483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.834578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.834690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.834714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.540 [2024-11-30 04:32:26.834871] nvme_tcp.c: 322:nvme_tcp_qpair_set_recv_state: *ERROR*: The recv state of tqpair=0x1ece980 is same with the state(5) to be set 00:30:36.540 [2024-11-30 04:32:26.835047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.835163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.540 [2024-11-30 04:32:26.835193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.540 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.835305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.835397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.835425] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.835519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.835610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.835636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.835735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.835834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.835859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.835964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.836056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.836082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.836176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.836268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.836295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.836400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.836524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.836551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.836642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.836734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.836759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.836853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.836937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.836968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.837078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.837168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.837194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.837288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.837370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.837395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.837487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.837597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.837624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.837752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.837846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.837873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.837971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.838074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.838099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.838200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.838298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.838323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.838422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.838538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.838563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.838656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.838743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.838768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.838857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.838948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.838980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.839076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.839166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.839192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.839293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.839387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.839412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.839508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.839599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.839623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.839717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.839818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.839844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.839931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.840031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.840061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.840155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.840243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.840268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.840355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.840447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.840472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.840567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.840653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.840678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.840771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.840860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.840887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.840995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.841096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.841122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.841222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.841308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.841333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.541 qpair failed and we were unable to recover it. 00:30:36.541 [2024-11-30 04:32:26.841434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.541 [2024-11-30 04:32:26.841523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.841548] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.841654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.841770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.841795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.841883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.841974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.842009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.842096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.842188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.842214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.842304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.842388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.842413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.842498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.842624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.842649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.842759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.842854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.842879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.842982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.843105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.843130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.843219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.843335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.843359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.843446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.843530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.843554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.843654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.843736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.843761] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.843904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.844033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.844063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.844167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.844265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.844292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.844396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.844507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.844532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.844678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.844760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.844785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.844870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.844953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.844984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.845108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.845194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.845221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.845341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.845429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.845454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.845536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.845628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.845655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.845753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.845869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.845894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.845985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.846086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.846111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.846221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.846344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.846371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.846499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.846597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.846625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.846775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.846871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.846897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.846994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.847083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.847109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.847207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.847321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.847346] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.847440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.847537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.847564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.847663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.847746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.847772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.847873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.847991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.542 [2024-11-30 04:32:26.848021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.542 qpair failed and we were unable to recover it. 00:30:36.542 [2024-11-30 04:32:26.848118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.848210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.848235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.848383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.848496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.848521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.848613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.848756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.848782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.848896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.848983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.849019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.849124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.849216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.849241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.849364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.849480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.849505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.849604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.849703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.849729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.849854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.849951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.849983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.850086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.850213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.850239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.850326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.850417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.850442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.850530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.850648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.850674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.850770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.850886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.850913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.851051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.851148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.851174] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.851296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.851413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.851438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.851579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.851666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.851692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.851839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.851924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.851950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.852056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.852141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.852166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.852285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.852398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.852424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.852516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.852635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.852662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.852752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.852840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.852865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.853018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.853145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.853172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.853290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.853379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.853404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.853535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.853628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.853655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.853752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.853836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.853861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.853952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.854056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.854082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.854209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.854300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.854326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.854418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.854531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.854557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.854670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.854785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.854810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.543 [2024-11-30 04:32:26.854905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.854993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.543 [2024-11-30 04:32:26.855020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.543 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.855127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.855215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.855240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.855337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.855421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.855447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.855573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.855666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.855693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.855813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.855934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.855966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.856060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.856153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.856179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.856380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.856470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.856498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.856625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.856752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.856778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.856868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.856950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.856983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.857092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.857225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.857253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.857383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.857471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.857496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.857612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.857737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.857762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.857852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.857942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.857977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.858089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.858176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.858202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.858290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.858413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.858445] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.858543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.858658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.858684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.858779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.858888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.858914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.859006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.859097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.859127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.859216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.859363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.859388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.859485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.859610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.859636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.859723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.859838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.859863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.859965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.860084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.860110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.860209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.860300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.860326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.860418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.860535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.860562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.544 [2024-11-30 04:32:26.860679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.860828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.544 [2024-11-30 04:32:26.860858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.544 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.861018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.861103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.861128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.861218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.861332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.861358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.861448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.861540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.861565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.861664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.861750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.861776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.861868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.861951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.861985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.862079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.862165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.862192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.862318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.862436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.862461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.862551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.862635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.862661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.862787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.862872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.862897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.863025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.863118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.863147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.863248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.863331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.863357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.863476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.863599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.863624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.863712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.863813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.863840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.863964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.864082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.864108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.864225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.864316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.864343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.864466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.864589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.864615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.864702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.864817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.864843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.864933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.865083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.865109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.865205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.865329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.865357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.865440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.865530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.865561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.865686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.865773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.865799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.865893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.866013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.866040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.866146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.866232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.866257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.866408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.866492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.866518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.866622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.866708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.866734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.866855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.866943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.866976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.867117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.867207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.867234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.867368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.867513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.867539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.545 qpair failed and we were unable to recover it. 00:30:36.545 [2024-11-30 04:32:26.867630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.545 [2024-11-30 04:32:26.867743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.867769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.867861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.867946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.867991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.868101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.868194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.868221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.868359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.868480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.868506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.868628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.868725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.868752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.868875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.868999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.869026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.869151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.869273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.869300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.869449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.869568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.869593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.869691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.869804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.869830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.869948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.870048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.870074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.870166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.870251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.870277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.870374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.870492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.870518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.870610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.870744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.870770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.870888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.871002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.871030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.871184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.871276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.871303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.871393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.871478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.871504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.871595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.871729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.871755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.871895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.872013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.872039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.872132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.872247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.872273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.872367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.872487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.872512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.872605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.872695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.872722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.872843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.872966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.872992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.873087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.873210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.873236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.873328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.873445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.873471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.873594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.873677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.873703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.873795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.873909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.873934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.874037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.874135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.874161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.874255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.874338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.874364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.874483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.874568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.546 [2024-11-30 04:32:26.874593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.546 qpair failed and we were unable to recover it. 00:30:36.546 [2024-11-30 04:32:26.874692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.874806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.874832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.874964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.875061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.875087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.875179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.875266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.875292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.875422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.875509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.875535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.875625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.875741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.875767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.875886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.875984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.876011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.876109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.876228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.876253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.876342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.876485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.876511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.876606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.876691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.876716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.876815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.876898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.876923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.877019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.877165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.877191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.877285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.877402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.877427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.877516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.877662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.877687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.877781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.877874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.877901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.877992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.878080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.878106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.878222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.878336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.878362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.878477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.878569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.878594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.878689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.878803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.878828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.878932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.879069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.879096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.879190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.879275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.879301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.879391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.879517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.879543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.879669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.879786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.879811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.879933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.880025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.880051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.880175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.880272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.880298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.880396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.880478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.880504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.880589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.880707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.880733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.880818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.880909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.880935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.881064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.881187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.881213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.547 [2024-11-30 04:32:26.881304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.881391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.547 [2024-11-30 04:32:26.881417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.547 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.881529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.881648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.881675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.881771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.881889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.881915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.882011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.882133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.882159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.882258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.882372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.882398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.882490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.882589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.882616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.882708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.882796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.882822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.882942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.883096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.883122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.883216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.883298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.883323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.883440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.883559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.883585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.883704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.883817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.883843] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.883938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.884043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.884068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.884187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.884303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.884328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.884419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.884534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.884560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.884648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.884728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.884753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.884852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.885000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.885026] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.885141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.885226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.885252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.885381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.885473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.885498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.885596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.885716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.885742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.885832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.885942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.885982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.886106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.886191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.886216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.886336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.886428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.886454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.886549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.886663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.886689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.886811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.886898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.886925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.887051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.887164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.887190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.887279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.887386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.887412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.548 qpair failed and we were unable to recover it. 00:30:36.548 [2024-11-30 04:32:26.887505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.548 [2024-11-30 04:32:26.887620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.887646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.887773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.887854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.887879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.887973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.888071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.888097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.888219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.888306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.888331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.888418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.888512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.888538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.888626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.888718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.888744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.888837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.888968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.888994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.889119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.889203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.889229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.889354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.889449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.889476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.889604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.889699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.889725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.889812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.889926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.889951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.890051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.890138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.890163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.890289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.890384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.890410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.890511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.890601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.890627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.890716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.890805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.890830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.890953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.891102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.891129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.891217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.891305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.891332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.891418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.891513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.891539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.891623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.891714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.891741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.891831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.891921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.891948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.892058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.892197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.892223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.892320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.892435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.892461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.892557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.892703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.892728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.892813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.892908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.892934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.893040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.893131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.893158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.893256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.893372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.893399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.893487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.893632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.893658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.893753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.893864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.893889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.894013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.894098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.549 [2024-11-30 04:32:26.894125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.549 qpair failed and we were unable to recover it. 00:30:36.549 [2024-11-30 04:32:26.894219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.894308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.894334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.894432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.894512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.894538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.894652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.894739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.894764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.894885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.894974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.895000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.895099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.895193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.895218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.895342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.895426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.895452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.895546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.895641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.895666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.895767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.895882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.895908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.895996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.896087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.896113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.896243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.896356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.896382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.896502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.896586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.896616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.896712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.896811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.896836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.896962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.897051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.897077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.897204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.897315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.897341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.897433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.897521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.897546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.897638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.897756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.897782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.897904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.898060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.898087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.898180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.898261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.898286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.898404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.898487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.898512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.898639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.898760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.898785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.898874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.899005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.899036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.899159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.899242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.899267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.899366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.899480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.899506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.899601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.899682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.899707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.899797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.899880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.899905] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.900005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.900095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.900120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.900209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.900329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.900355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.900451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.900573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.900599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.550 [2024-11-30 04:32:26.900689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.900779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.550 [2024-11-30 04:32:26.900805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.550 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.900893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.901021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.901048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.901142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.901239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.901269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.901358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.901451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.901476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.901567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.901657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.901682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.901779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.901896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.901922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.902024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.902173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.902199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.902287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.902374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.902400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.902521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.902614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.902641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.902740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.902857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.902882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.903003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.903093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.903120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.903240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.903319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.903345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.903445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.903568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.903597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.903698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.903858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.903883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.903990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.904088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.904115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.904206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.904291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.904317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.904440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.904526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.904553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.904669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.904793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.904819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.904940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.905048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.905075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.905166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.905280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.905305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.905454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.905546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.905571] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.905664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.905798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.905823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.905904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.906026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.906052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.906155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.906283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.906308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.906405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.906496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.906521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.906641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.906755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.906780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.906902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.906991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.907018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.907108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.907194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.907220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.907315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.907432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.907460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.551 qpair failed and we were unable to recover it. 00:30:36.551 [2024-11-30 04:32:26.907581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.551 [2024-11-30 04:32:26.907671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.907696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.907823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.907939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.907969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.908059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.908181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.908206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.908299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.908386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.908412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.908515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.908632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.908657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.908777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.908875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.908901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.909026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.909120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.909145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.909263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.909359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.909386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.909538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.909630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.909656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.909746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.909833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.909858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.909979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.910093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.910119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.910242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.910324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.910349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.910472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.910562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.910588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.910682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.910795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.910820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.910915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.911007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.911035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.911123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.911218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.911243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.911339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.911429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.911454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.911580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.911664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.911690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.911772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.911892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.911918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.912018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.912114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.912139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.912284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.912379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.912406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.912532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.912624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.912651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.912750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.912870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.912896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.912990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.913085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.913111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.913265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.913352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.913377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.913500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.913587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.913614] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.913700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.913813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.913839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.913932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.914082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.914108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.914234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.914343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.552 [2024-11-30 04:32:26.914368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.552 qpair failed and we were unable to recover it. 00:30:36.552 [2024-11-30 04:32:26.914488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.914602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.914628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.914721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.914813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.914840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.914929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.915034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.915061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.915148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.915238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.915264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.915353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.915444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.915470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.915576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.915697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.915722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.915806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.915920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.915946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.916042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.916155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.916180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.916274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.916391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.916417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.916566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.916648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.916673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.916771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.916861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.916886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.917005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.917150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.917175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.917291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.917409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.917435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.917523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.917612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.917638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.917767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.917857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.917884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.918005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.918103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.918129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.918217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.918340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.918366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.918490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.918578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.918604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.918698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.918816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.918842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.918932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.919033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.919059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.919155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.919241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.919268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.919381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.919502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.919527] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.919619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.919733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.919758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.919846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.919938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.919969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.920091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.920181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.920207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.920308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.920403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.920430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.553 qpair failed and we were unable to recover it. 00:30:36.553 [2024-11-30 04:32:26.920548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.553 [2024-11-30 04:32:26.920637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.920662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.920752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.920877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.920903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.920999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.921090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.921116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.921241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.921360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.921385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.921480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.921597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.921623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.921742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.921822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.921847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.921998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.922084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.922111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.922227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.922314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.922340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.922431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.922526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.922552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.922672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.922821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.922848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.922971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.923116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.923142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.923233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.923323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.923349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.923436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.923551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.923576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.923696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.923787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.923813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.923935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.924060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.924086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.924190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.924274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.924300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.924393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.924491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.924517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.924605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.924693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.924720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.924812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.924897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.924922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.925048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.925202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.925227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.925313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.925422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.925448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.925545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.925636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.925662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.925755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.925868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.925893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.925982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.926106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.926132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.926250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.926342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.926369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.926457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.926603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.926629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.926720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.926809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.926834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.926931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.927052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.927078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.927202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.927293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.554 [2024-11-30 04:32:26.927318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.554 qpair failed and we were unable to recover it. 00:30:36.554 [2024-11-30 04:32:26.927411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.927534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.927561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.927685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.927799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.927824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.927938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.928058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.928083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.928182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.928269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.928295] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.928386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.928473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.928500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.928618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.928740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.928766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.928862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.928953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.928984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.929075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.929156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.929182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.929274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.929361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.929386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.929503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.929626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.929651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.929770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.929892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.929919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.930016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.930111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.930137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.930283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.930409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.930435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.930521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.930608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.930633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.930724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.930841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.930867] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.930980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.931098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.931124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.931226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.931346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.931372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.931461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.931581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.931606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.931699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.931821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.931848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.931938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.932061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.932088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.932240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.932366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.932396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.932525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.932613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.932639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.932731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.932813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.932839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.932964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.933081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.933106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.933236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.933352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.933377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.933463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.933580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.933605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.933694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.933781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.933807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.933900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.934004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.934031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.555 [2024-11-30 04:32:26.934131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.934219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.555 [2024-11-30 04:32:26.934245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.555 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.934362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.934449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.934475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.934564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.934714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.934745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.934838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.934956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.934998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.935083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.935164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.935190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.935306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.935396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.935421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.935538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.935661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.935688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.935776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.935863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.935890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.935988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.936075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.936101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.936225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.936308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.936334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.936455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.936547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.936574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.936687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.936802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.936828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.936918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.937013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.937044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.937167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.937262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.937287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.937379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.937495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.937520] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.937611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.937696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.937721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.937802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.937897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.937924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.938019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.938137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.938164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.938263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.938354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.938380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.938469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.938562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.938587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.938681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.938772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.938799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.938926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.939023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.939049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.939138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.939233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.939264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.939357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.939446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.939471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.939565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.939648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.939674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.939795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.939884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.939910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.940014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.940111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.940138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.940242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.940330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.940357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.940441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.940530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.940556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.556 qpair failed and we were unable to recover it. 00:30:36.556 [2024-11-30 04:32:26.940674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.940765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.556 [2024-11-30 04:32:26.940791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.940880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.940989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.941016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.941165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.941288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.941313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.941401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.941490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.941516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.941620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.941715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.941740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.941864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.941969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.941996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.942145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.942291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.942316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.942441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.942557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.942583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.942672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.942771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.942796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.942896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.943017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.943043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.943135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.943218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.943244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.943356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.943444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.943469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.943559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.943677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.943703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.943805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.943891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.943917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.944026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.944122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.944148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.944272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.944390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.944415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.944512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.944659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.944684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.944807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.944889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.944915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.945010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.945129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.945157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.945254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.945336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.945361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.945452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.945542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.945568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.945659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.945750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.945775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.945928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.946050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.946076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.946169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.946292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.946317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.946473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.946560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.946587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.946683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.946768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.946793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.557 qpair failed and we were unable to recover it. 00:30:36.557 [2024-11-30 04:32:26.946883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.946969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.557 [2024-11-30 04:32:26.946996] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.947120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.947211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.947237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.947330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.947447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.947474] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.947595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.947683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.947709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.947810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.947904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.947929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.948057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.948148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.948173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.948297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.948412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.948437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.948532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.948622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.948647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.948804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.948890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.948916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.949053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.949168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.949194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.949284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.949373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.949399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.949488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.949607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.949634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.949723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.949814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.949840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.949961] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.950049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.950075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.950166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.950252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.950279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.950405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.950520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.950545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.950670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.950762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.950788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.950913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.951039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.951066] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.951199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.951319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.951344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.951450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.951563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.951588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.951682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.951793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.951819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.951939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.952034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.952061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.952149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.952241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.952266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.952390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.952476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.952502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.952650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.952733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.952758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.952844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.952982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.953009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.953134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.953228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.953254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.953348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.953434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.953461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.953587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.953735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.953760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.558 qpair failed and we were unable to recover it. 00:30:36.558 [2024-11-30 04:32:26.953886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.558 [2024-11-30 04:32:26.953973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.953999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.954120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.954239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.954265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.954359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.954478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.954503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.954652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.954733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.954759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.954871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.955019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.955045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.955137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.955257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.955283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.955402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.955518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.955544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.955663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.955777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.955803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.955895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.955986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.956012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.956161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.956268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.956298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.956398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.956488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.956515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.956724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.956811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.956839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.956992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.957079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.957106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.957191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.957279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.957305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.957456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.957545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.957570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.957652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.957767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.957794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.957911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.957999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.958025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.958155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.958277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.958302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.958423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.958515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.958540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.958635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.958747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.958772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.958872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.958967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.958995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.959081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.959200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.959226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.959349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.959447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.959472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.959592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.959684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.959709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.959802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.959914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.959939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.960146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.960239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.960264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.960360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.960559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.960585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.960677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.960772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.960797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.559 [2024-11-30 04:32:26.960883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.961001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.559 [2024-11-30 04:32:26.961027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.559 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.961124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.961227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.961253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.961456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.961654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.961680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.961769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.961883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.961908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.962015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.962110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.962137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.962233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.962358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.962384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.962480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.962601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.962627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.962755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.962867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.962893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.963016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.963144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.963169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.963256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.963343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.963369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.963489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.963603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.963628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.963723] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.963842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.963868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.963955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.964055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.964081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.964181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.964292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.964318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.964404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.964489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.964514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.964603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.964693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.964719] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.964817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.964927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.964953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.965055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.965152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.965177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.965263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.965386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.965412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.965502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.965625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.965652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.965767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.965887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.965912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.966009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.966108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.966134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.966228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.966351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.966377] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.966492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.966584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.966610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.966734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.966833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.966858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.966956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.967116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.967142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.967238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.967347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.967373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.967462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.967574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.967599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.967694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.967779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.967804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.560 qpair failed and we were unable to recover it. 00:30:36.560 [2024-11-30 04:32:26.967941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.968041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.560 [2024-11-30 04:32:26.968067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.968158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.968261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.968287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.968412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.968551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.968577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.968702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.968819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.968845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.968981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.969095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.969122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.969217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.969351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.969376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.969464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.969581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.969606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.969720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.969845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.969870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.970008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.970098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.970123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.970244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.970331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.970357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.970441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.970534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.970558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.970647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.970759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.970785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.970904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.970997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.971032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.971131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.971219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.971245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.971360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.971447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.971473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.971563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.971658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.971684] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.971776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.971859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.971885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.971983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.972106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.972132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.972236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.972326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.972351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.972440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.972527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.972553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.972650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.972742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.972767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.972892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.973007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.973033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.973171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.973286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.973317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.973450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.973537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.973563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.973654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.973797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.973822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.973937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.974038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.974065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.974184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.974274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.974301] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.974428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.974519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.974545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.974633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.974745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.974770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.561 qpair failed and we were unable to recover it. 00:30:36.561 [2024-11-30 04:32:26.974921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.561 [2024-11-30 04:32:26.975019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.975045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.975158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.975274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.975299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.975418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.975617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.975642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.975764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.975856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.975887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.975974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.976069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.976094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.976188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.976285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.976310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.976432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.976517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.976543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.976744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.976854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.976879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.977010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.977106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.977131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.977253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.977335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.977360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.977480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.977599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.977624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.977753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.977839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.977865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.977981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.978103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.978130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.978218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.978417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.978446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.978594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.978681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.978707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.978826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.978912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.978938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.979065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.979151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.979177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.979297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.979382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.979407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.979529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.979615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.979641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.979759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.979851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.979878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.979979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.980072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.980099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.980199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.980290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.980315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.980406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.980515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.980541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.980641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.980738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.980763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.980863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.980987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.981014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.981105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.981198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.981224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.562 qpair failed and we were unable to recover it. 00:30:36.562 [2024-11-30 04:32:26.981314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.562 [2024-11-30 04:32:26.981462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.981487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.981614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.981703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.981729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.981822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.981909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.981935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.982031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.982116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.982142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.982237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.982319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.982345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.982431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.982524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.982551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.982652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.982768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.982794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.982916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.983011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.983037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.983143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.983262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.983287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.983374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.983497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.983523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.983621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.983739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.983765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.983868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.983990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.984017] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.984110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.984204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.984229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.984324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.984454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.984480] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.984625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.984706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.984732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.984851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.984936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.985075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.985175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.985289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.985314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.985409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.985531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.985557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.985700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.985821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.985847] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.985942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.986081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.986107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.986208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.986295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.986320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.986410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.986496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.986522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.986621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.986769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.986795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.986916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.987010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.987036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.987133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.987268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.987293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.987414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.987506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.987532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.987620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.987769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.987794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.987924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.988048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.988074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.988221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.988310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.563 [2024-11-30 04:32:26.988336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.563 qpair failed and we were unable to recover it. 00:30:36.563 [2024-11-30 04:32:26.988460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.988545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.988570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.988658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.988771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.988796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.989003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.989111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.989137] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.989235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.989325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.989353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.989469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.989556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.989581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.989703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.989902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.989928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.990027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.990224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.990249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.990371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.990493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.990518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.990641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.990765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.990793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.990893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.991013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.991040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.991127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.991246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.991271] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.991393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.991484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.991511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.991600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.991721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.991748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.991865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.991965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.991991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.992084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.992167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.992193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.992315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.992433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.992458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.992576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.992666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.992693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.992825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.992936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.992976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.993070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.993183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.993209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.993310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.993397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.993422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.993513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.993598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.993625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.993713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.993828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.993853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.993942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.994149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.994175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.994293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.994376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.994402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.994529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.994643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.994669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.994754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.994838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.994863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.994963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.995077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.995102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.995222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.995309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.995334] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.564 [2024-11-30 04:32:26.995426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.995517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.564 [2024-11-30 04:32:26.995542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.564 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.995642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.995728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.995755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.995847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.995939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.995974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.996075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.996164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.996189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.996313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.996399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.996424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.996508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.996590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.996615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.996741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.996834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.996860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.996949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.997069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.997094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.997185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.997271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.997297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.997410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.997502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.997529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.997650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.997741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.997766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.997865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.997977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.998003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.998098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.998184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.998209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.998332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.998419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.998444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.998533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.998619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.998646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.998739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.998852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.998877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.998977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.999069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.999094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.999189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.999276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.999303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.999395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.999488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.999513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.999604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.999719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.999745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:26.999832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.999953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:26.999984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:27.000076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.000164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.000190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:27.000308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.000422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.000447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:27.000530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.000627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.000652] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:27.000770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.000886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.000911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:27.001023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.001108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.001134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:27.001254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.001342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.001368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:27.001486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.001574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.001600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:27.001688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.001803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.001829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.565 qpair failed and we were unable to recover it. 00:30:36.565 [2024-11-30 04:32:27.001919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.002043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.565 [2024-11-30 04:32:27.002069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.002188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.002277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.002302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.002397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.002548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.002574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.002664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.002752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.002777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.002867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.003013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.003040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.003190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.003317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.003343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.003465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.003579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.003605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.003695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.003785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.003810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.003904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.004024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.004051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.004149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.004235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.004260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.004380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.004473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.004499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.004618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.004699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.004725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.004872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.004977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.005004] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.005139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.005256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.005282] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.005406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.005529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.005555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.005653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.005737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.005762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.005854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.005968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.005994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.006111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.006203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.006228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.006321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.006438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.006464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.006614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.006707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.006731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.006820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.006907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.006934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.007057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.007145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.007171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.007307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.007427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.007454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.007577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.007689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.007714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.007835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.007926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.007954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.008059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.008141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.566 [2024-11-30 04:32:27.008166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.566 qpair failed and we were unable to recover it. 00:30:36.566 [2024-11-30 04:32:27.008285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.008405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.008432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.008528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.008619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.008644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.008738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.008823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.008849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.008975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.009090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.009115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.009198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.009288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.009315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.009395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.009481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.009506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.009600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.009736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.009766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.009848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.009941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.009972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.010092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.010176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.010202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.010294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.010380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.010407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.010524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.010622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.010648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.010742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.010862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.010887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.010980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.011071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.011097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.011183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.011263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.011288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.011369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.011463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.011488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.011642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.011730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.011757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.011853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.011946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.011983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.012076] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.012192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.012218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.012337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.012448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.012473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.012594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.012704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.012729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.012812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.012907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.012932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.013082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.013218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.013248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.013344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.013470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.013497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.013586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.013675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.013700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.013829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.013915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.013940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.014033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.014150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.014175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.014262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.014379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.014410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.014506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.014593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.014617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.567 qpair failed and we were unable to recover it. 00:30:36.567 [2024-11-30 04:32:27.014712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.014805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.567 [2024-11-30 04:32:27.014831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.014914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.015038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.015064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.015187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.015277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.015302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.015399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.015485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.015510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.015594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.015706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.015730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.015817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.015930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.015955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.016083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.016169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.016194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.016308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.016397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.016422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.016542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.016653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.016678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.016770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.016861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.016888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.016974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.017123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.017148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.017272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.017365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.017392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.017511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.017601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.017627] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.017714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.017794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.017819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.017910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.018005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.018031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.018148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.018238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.018263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.018356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.018443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.018469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.018563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.018641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.018666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.018793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.018892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.018917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.019045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.019133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.019158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.019246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.019335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.019362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.019479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.019570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.019596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.019687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.019784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.019809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.019907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.019996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.020022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.020145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.020237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.020262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.020356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.020497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.020522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.020612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.020732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.020758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.020847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.020935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.020967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.021071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.021163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.021188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.021311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.021419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.021444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.568 [2024-11-30 04:32:27.021538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.021622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.568 [2024-11-30 04:32:27.021647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.568 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.021732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.021852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.021877] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.021970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.022054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.022079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.022201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.022284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.022309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.022423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.022540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.022565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.022685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.022802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.022827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.022915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.023036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.023061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.023178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.023300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.023325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.023448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.023564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.023590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.023711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.023791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.023815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.023927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.024016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.024040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.024130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.024213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.024238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.024334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.024419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.024443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.024562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.024652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.024676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.024775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.024918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.024944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.025069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.025158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.025183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.025277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.025392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.025418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.025516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.025604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.025629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.025745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.025828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.025854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.025949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.026108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.026133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.026252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.026338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.026363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.026455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.026574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.026600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.026704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.026783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.026807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.026922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.027019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.027045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.027165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.027245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.027269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.027357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.027475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.027500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.027622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.027707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.027731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.027875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.027989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.028015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.028106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.028197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.028222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.028329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.028419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.028444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.028539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.028637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.028661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.028775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.028920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.569 [2024-11-30 04:32:27.028945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.569 qpair failed and we were unable to recover it. 00:30:36.569 [2024-11-30 04:32:27.029039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.029123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.029147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.029269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.029357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.029383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.029493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.029607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.029631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.029752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.029867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.029892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.030009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.030126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.030151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.030296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.030380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.030404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.030521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.030614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.030640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.030760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.030847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.030873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.030968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.031085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.031110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.031234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.031320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.031345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.031436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.031553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.031577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.031668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.031775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.031799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.031886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.031978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.032003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.032093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.032214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.032239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.032332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.032416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.032441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.032566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.032685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.032710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.032796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.032910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.032934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.033038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.033129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.033153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.033243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.033369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.033394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.033509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.033596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.033620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.033735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.033877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.033902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.033991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.034108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.034134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.034228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.034322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.034348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.034463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.034549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.034574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.034727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.034809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.034834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.034925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.035043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.035068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.035190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.035285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.035309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.035436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.035564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.035589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.035673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.035769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.035793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.035877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.035969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.035995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.570 [2024-11-30 04:32:27.036094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.036180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.570 [2024-11-30 04:32:27.036204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.570 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.036288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.036407] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.036433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.036546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.036634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.036660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.036756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.036893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.036918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.037061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.037154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.037180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.037271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.037363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.037387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.037474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.037561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.037585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.037709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.037803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.037827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.037921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.038043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.038068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.038192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.038278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.038303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.038392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.038513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.038538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.038635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.038756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.038781] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.038898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.038993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.039021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.039143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.039226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.039251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.039367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.039477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.039502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.039598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.039688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.039712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.039795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.039886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.039911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.040039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.040131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.040156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.040304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.040390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.040415] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.040508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.040604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.040629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.040747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.040832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.040857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.040973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.041095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.041120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.041211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.041322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.041347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.041441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.041557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.041582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.041701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.041783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.041807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.041901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.042019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.042044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.042131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.042226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.042252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.042365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.042456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.042482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.042582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.042679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.042704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.042823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.042935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.042967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.043056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.043135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.571 [2024-11-30 04:32:27.043159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.571 qpair failed and we were unable to recover it. 00:30:36.571 [2024-11-30 04:32:27.043271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.043387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.043411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.043496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.043581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.043605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.043729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.043814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.043838] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.043927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.044018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.044043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.044135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.044230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.044255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.044373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.044452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.044478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.044596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.044710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.044739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.044869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.044955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.044989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.045080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.045199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.045225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.045315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.045404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.045428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.045545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.045657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.045681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.045770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.045858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.045883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.045972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.046065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.046089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.046210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.046297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.046322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.046409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.046498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.046522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.046640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.046728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.046753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.046873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.046969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.046999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.047092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.047179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.047203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.047301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.047392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.047418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.047517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.047622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.047647] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.047736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.047885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.047911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.048032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.048124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.048150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.048248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.048359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.048384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.048508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.048589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.048613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.048700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.048815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.048839] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.048988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.049073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.049098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.049227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.049341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.049371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.049467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.049558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.049582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.049665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.049789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.049814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.049904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.049989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.050015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.050128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.050215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.050241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.050325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.050443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.050468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.050557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.050674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.050700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.572 qpair failed and we were unable to recover it. 00:30:36.572 [2024-11-30 04:32:27.050813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.572 [2024-11-30 04:32:27.050898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.050923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.051022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.051141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.051166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.051255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.051371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.051396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.051486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.051634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.051663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.051784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.051876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.051902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.052026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.052122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.052148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.052234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.052314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.052343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.052432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.052511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.052535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.052627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.052711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.052737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.052824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.052947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.052988] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.053091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.053206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.053230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.053350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.053441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.053466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.053551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.053637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.053663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.053747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.053830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.053854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.053976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.054090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.054114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.054204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.054318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.054342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.054433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.054517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.054542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.054665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.054779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.054805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.054896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.054980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.055005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.055099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.055245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.055269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.055383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.055525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.055550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.055637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.055727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.055752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.055885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.055981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.056006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.056106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.056227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.056252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.056350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.056438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.056464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.056556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.056676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.056702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.056794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.056882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.056906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.056997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.057083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.057107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.057223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.057371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.057396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.057490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.057587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.057616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.057706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.057806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.057832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.057948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.058040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.058065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.573 qpair failed and we were unable to recover it. 00:30:36.573 [2024-11-30 04:32:27.058158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.058241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.573 [2024-11-30 04:32:27.058266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.058388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.058508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.058532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.058657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.058740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.058765] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.058914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.059033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.059058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.059145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.059227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.059252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.059368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.059459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.059485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.059605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.059722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.059748] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.059836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.059925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.059950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.060052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.060143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.060168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.060265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.060382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.060407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.060527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.060619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.060645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.060732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.060820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.060845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.060988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.061135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.061161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.061254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.061340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.061366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.061480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.061565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.061590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.061676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.061759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.061783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.061897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.061990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.062015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.062107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.062189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.062215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.062339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.062424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.062449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.062545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.062629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.062654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.062741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.062836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.062861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.062953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.063045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.063070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.063169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.063253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.063277] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.063401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.063486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.063511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.063633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.063711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.063735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.063853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.063940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.063969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.064061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.064174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.064198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.064295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.064378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.064402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.064498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.064588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.064612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.064696] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.064812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.064837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.064929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.065048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.065075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.065199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.065286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.065312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.065430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.065574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.065600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.065701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.065786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.065810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.065908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.066028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.066053] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.066148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.066263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.066287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.574 qpair failed and we were unable to recover it. 00:30:36.574 [2024-11-30 04:32:27.066378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.574 [2024-11-30 04:32:27.066464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.066490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.066588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.066706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.066731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.066822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.066904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.066929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.067061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.067160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.067185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.067275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.067392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.067420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.067569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.067652] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.067678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.067784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.067907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.067936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.068067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.068162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.068188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.068281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.068366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.068393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.068489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.068575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.068600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.068685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.068809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.068835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.068925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.069019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.069046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.069143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.069265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.069291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.069397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.069490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.069516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.069663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.069809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.069834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.069928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.070050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.070077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.070181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.070297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.070323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.070416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.070496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.070522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.070620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.070707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.070733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.070856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.070971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.070998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.071093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.071181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.071206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.071327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.071412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.071437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.071550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.071641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.071667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.071793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.071942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.071973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.072094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.072183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.072209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.072326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.072408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.072434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.072527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.072677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.072703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.072795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.072910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.072936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.073067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.073182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.073207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.073301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.073420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.073446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.073532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.073648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.073673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.073766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.073860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.073886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.073978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.074099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.074124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.575 qpair failed and we were unable to recover it. 00:30:36.575 [2024-11-30 04:32:27.074219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.575 [2024-11-30 04:32:27.074337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.074363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.074454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.074570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.074596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.074738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.074823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.074848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.074941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.075075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.075101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.075201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.075291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.075318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.075441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.075565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.075590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.075684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.075771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.075796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.075919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.076047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.076073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.076160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.076278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.076305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.076425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.076515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.076540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.076625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.076714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.076740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.076824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.076939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.076977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.077075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.077193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.077218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.077314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.077431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.077457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.077549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.077634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.077659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.077775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.077860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.077885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.078001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.078091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.078116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.078209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.078301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.078327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.078419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.078511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.078537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.078627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.078709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.078734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.078853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.078968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.078995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.079117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.079203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.079229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.079355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.079468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.079494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.079583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.079676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.079702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.079794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.079883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.079908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.079999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.080083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.080109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.080230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.080319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.080345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.080429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.080574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.080600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.080694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.080808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.080832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.080922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.081055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.081082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.081167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.081254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.081280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.081383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.081470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.081494] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.081581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.081699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.081725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.081820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.081907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.081937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.082044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.082127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.082152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.082275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.082392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.576 [2024-11-30 04:32:27.082418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.576 qpair failed and we were unable to recover it. 00:30:36.576 [2024-11-30 04:32:27.082511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.082623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.082648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.082762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.082854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.082879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.082968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.083053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.083079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.083200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.083281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.083305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.083399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.083483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.083509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.083596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.083687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.083712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.083806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.083923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.083949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.084057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.084155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.084184] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.084308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.084423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.084448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.084534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.084657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.084681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.084776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.084887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.084912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.085013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.085098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.085122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.085243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.085331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.085356] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.085505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.085593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.085618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.085735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.085823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.085848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.085984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.086070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.086096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.086187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.086328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.086353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.086448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.086536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.086566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.086689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.086769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.086794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.086888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.087008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.087033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.087122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.087213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.087239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.087327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.087473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.087498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.087620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.087709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.087734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.087827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.087912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.087937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.088079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.088218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.088247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.088344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.088435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.088459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.088572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.088662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.088686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.088773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.088865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.088895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.089021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.089107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.089132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.089226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.089341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.089366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.089452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.089541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.089565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.089668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.089781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.089807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.089908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.090004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.090031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.090128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.090220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.090245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.090341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.090437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.090464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.577 qpair failed and we were unable to recover it. 00:30:36.577 [2024-11-30 04:32:27.090551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.090668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.577 [2024-11-30 04:32:27.090693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.090787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.090875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.090901] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.091003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.091083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.091108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.091207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.091304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.091329] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.091451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.091550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.091575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.091671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.091789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.091814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.091909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.091998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.092023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.092116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.092234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.092259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.092353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.092440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.092465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.092558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.092641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.092666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.092790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.092882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.092908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.093005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.093108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.093133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.093229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.093345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.093371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.093475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.093575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.093600] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.093722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.093809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.093834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.093925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.094026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.094054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.094148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.094243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.094270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.094401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.094488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.094515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.094610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.094706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.094731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.094829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.094945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.094979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.095073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.095163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.095188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.095272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.095360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.095385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.095473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.095586] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.095615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.095720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.095804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.095829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.095915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.096007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.096033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.096127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.096219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.096245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.096343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.096490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.096516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.096603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.096687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.096712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.096806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.096897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.096922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.097025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.097114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.097139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.097238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.097324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.097349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.097482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.097569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.097593] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.097714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.097836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.097863] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.097988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.098078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.098103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.098190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.098274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.098299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.098395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.098483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.578 [2024-11-30 04:32:27.098509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.578 qpair failed and we were unable to recover it. 00:30:36.578 [2024-11-30 04:32:27.098592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.098710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.098735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.098817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.098900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.098924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.099055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.099174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.099200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.099333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.099426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.099452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.099540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.099631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.099657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.099748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.099830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.099855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.099973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.100057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.100082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.100180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.100293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.100318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.100408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.100491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.100515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.100607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.100719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.100744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.100866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.100947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.100981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.101068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.101187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.101212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.101294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.101382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.101409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.101495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.101588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.101612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.101703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.101819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.101844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.101926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.102044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.102070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.102189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.102273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.102299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.102422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.102542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.102567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.102656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.102736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.102762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.102849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.102935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.102968] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.103102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.103190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.103216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.103337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.103422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.103449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.103567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.103662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.103689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.103789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.103873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.103900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.104010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.104112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.104140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.104240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.104333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.104361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.104451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.104563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.104587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.104683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.104782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.104807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.104939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.105046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.105074] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.105229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.105325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.105351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.105435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.105526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.105551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.105648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.105736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.105762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.105850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.105942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.105986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.106072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.106185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.106212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.106331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.106424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.106449] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.106542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.106627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.106653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.106764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.106881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.106907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.107003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.107129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.107155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.579 qpair failed and we were unable to recover it. 00:30:36.579 [2024-11-30 04:32:27.107245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.579 [2024-11-30 04:32:27.107361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.107385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.107471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.107555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.107580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.107701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.107813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.107837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.107936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.108039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.108065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.108200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.108317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.108343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.108434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.108551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.108577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.108667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.108758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.108784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.108904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.108996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.109022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.109108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.109190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.109216] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.109312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.109402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.109428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.109551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.109667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.109691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.109804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.109886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.109911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.110029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.110144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.110169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.110258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.110372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.110398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.110479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.110597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.110623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.110716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.110800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.110824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.110911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.111060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.111086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.111215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.111325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.111351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.111442] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.111522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.111546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.111669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.111754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.111779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.111892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.112007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.112032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.112126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.112245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.112269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.112386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.112484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.112511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.112625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.112719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.112745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.112840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.112929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.112954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.113049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.113170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.113195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.113285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.113371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.113397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.113488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.113574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.113598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.113714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.113836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.113862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.113985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.114075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.114101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.114201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.114287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.114312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.114401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.114489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.114516] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.114614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.114701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.114727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.114845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.114972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.114999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.115081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.115175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.115200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.115289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.115400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.115426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.115515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.115600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.115625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.115745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.115835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.115860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.580 qpair failed and we were unable to recover it. 00:30:36.580 [2024-11-30 04:32:27.115969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.580 [2024-11-30 04:32:27.116102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.116132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.116261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.116348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.116379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.116465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.116579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.116605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.116686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.116768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.116794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.116917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.117008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.117035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.117131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.117264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.117291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.117381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.117464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.117490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.117581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.117705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.117730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.117818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.117904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.117929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.118031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.118157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.118182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.118277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.118358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.118384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.118463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.118582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.118615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.118705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.118793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.118820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.118942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.119044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.119070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.119184] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.119267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.119292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.119382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.119527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.119552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.119648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.119769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.119795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.119914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.120011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.120038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.120120] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.120239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.120264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.120362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.120450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.120476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.120600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.120718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.120744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.120826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.120918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.120947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.121079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.121164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.121189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.121275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.121401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.121427] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.121515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.121603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.121628] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.121728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.121815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.121840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.121929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.122031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.122058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.122178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.122273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.122299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.122391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.122504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.122529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.122619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.122701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.122726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.122808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.122916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.122941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.123063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.123161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.123197] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.123297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.123395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.123422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.123540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.123631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.123657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.123750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.123836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.123862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.123984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.124069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.124096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.124217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.124339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.124365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.124487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.124584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.124610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.581 qpair failed and we were unable to recover it. 00:30:36.581 [2024-11-30 04:32:27.124731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.124821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.581 [2024-11-30 04:32:27.124848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.124934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.125027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.125054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.125175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.125289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.125315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.125434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.125516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.125541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.125664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.125747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.125772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.125859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.125955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.125986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.126075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.126159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.126185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.126275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.126368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.126395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.126522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.126641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.126667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.126756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.126847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.126875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.126962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.127081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.127107] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.127199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.127313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.127340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.127466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.127577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.127603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.127697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.127787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.127812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.127914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.128042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.128069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.128155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.128247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.128273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.128361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.128515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.128541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.128633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.128724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.128750] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.128905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.129011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.129038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.129126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.129212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.129239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.129331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.129451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.129477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.129565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.129648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.129673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.129769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.129882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.129908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.130033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.130123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.130150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.130248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.130335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.130360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.130452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.130566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.130592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.582 [2024-11-30 04:32:27.130714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.130806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.582 [2024-11-30 04:32:27.130832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.582 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.130914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.131006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.131034] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.131155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.131241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.131266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.131390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.131475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.131500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.131628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.131721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.131747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.131873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.131984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.132011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.132136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.132226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.132251] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.132343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.132426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.132452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.132540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.132659] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.132685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.132809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.132927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.132954] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.133082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.133202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.133228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.133320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.133436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.133462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.133582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.133669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.133694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.133813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.133899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.133925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.134051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.134137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.134163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.134284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.134369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.134394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.134510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.134623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.134649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.134775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.134866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.134891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.135024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.135112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.135139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.135235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.135326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.135352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.135470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.135558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.135583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.135678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.135804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.135829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.135920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.136045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.136071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.136193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.136306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.136332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.136482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.136569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.136594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.136678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.136766] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.136792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.136882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.136968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.136994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.137096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.137217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.137244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.583 [2024-11-30 04:32:27.137345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.137429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.583 [2024-11-30 04:32:27.137454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.583 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.137575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.137687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.137712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.137806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.137892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.137918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.138022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.138138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.138164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.138297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.138384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.138410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.138509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.138597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.138624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.138745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.138828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.138854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.138995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.139091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.139118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.139218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.139333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.139358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.139445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.139533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.139558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.139660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.139764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.139794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.139892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.139990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.140018] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.140115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.140205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.140230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.140314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.140398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.140423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.140511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.140595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.140620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.140716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.140808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.140834] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.140962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.141061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.141086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.141186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.141267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.141292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.141380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.141498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.141524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.141643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.141726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.141751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.141844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.141939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.141981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.142080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.142171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.142196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.142320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.142406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.142430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.142543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.142660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.142685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.142765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.142849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.142875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.142996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.143141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.143166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.143284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.143369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.143394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.143481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.143571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.143596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.143680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.143762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.143788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.584 qpair failed and we were unable to recover it. 00:30:36.584 [2024-11-30 04:32:27.143877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.143978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.584 [2024-11-30 04:32:27.144014] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.585 qpair failed and we were unable to recover it. 00:30:36.585 [2024-11-30 04:32:27.144169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.144269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.144294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.585 qpair failed and we were unable to recover it. 00:30:36.585 [2024-11-30 04:32:27.144392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.144510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.144535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.585 qpair failed and we were unable to recover it. 00:30:36.585 [2024-11-30 04:32:27.144623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.144715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.144740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.585 qpair failed and we were unable to recover it. 00:30:36.585 [2024-11-30 04:32:27.144866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.144951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.144982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.585 qpair failed and we were unable to recover it. 00:30:36.585 [2024-11-30 04:32:27.145077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.145200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.145225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.585 qpair failed and we were unable to recover it. 00:30:36.585 [2024-11-30 04:32:27.145314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.145399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.145424] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.585 qpair failed and we were unable to recover it. 00:30:36.585 [2024-11-30 04:32:27.145515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.145597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.145623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.585 qpair failed and we were unable to recover it. 00:30:36.585 [2024-11-30 04:32:27.145724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.145855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.145880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.585 qpair failed and we were unable to recover it. 00:30:36.585 [2024-11-30 04:32:27.145974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.146067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.146092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.585 qpair failed and we were unable to recover it. 00:30:36.585 [2024-11-30 04:32:27.146196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.146312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.585 [2024-11-30 04:32:27.146338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.146465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.146598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.146623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.146757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.146844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.146869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.146962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.147057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.147082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.147173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.147263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.147289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.147406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.147520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.147545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.147634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.147725] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.147752] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.147875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.147971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.147997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.148132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.148245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.148270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.148353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.148444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.148469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.148562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.148677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.148702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.148795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.148887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.148912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.149015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.149135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.149160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.149259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.149377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.149403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.149529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.149612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.149637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.149720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.149810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.149835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.149950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.150050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.150075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.150165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.150254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.150278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.865 [2024-11-30 04:32:27.150400] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.150520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.865 [2024-11-30 04:32:27.150545] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.865 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.150637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.150764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.150788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.150890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.150998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.151028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.151167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.151307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.151336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.151464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.151555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.151581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.151684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.151770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.151795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.151886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.152018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.152047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.152145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.152236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.152261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.152353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.152441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.152465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.152577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.152691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.152717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.152804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.152882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.152907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.153026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.153114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.153138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.153226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.153317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.153341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.153464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.153552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.153581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.153701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.153815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.153840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.153937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.154037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.154062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.154188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.154280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.154306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.154424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.154511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.154536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.154631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.154711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.154736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.154821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.154906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.154930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.155038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.155169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.155194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.155287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.155378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.155402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.155527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.155644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.155670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.155792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.155876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.155899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.866 qpair failed and we were unable to recover it. 00:30:36.866 [2024-11-30 04:32:27.156009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.866 [2024-11-30 04:32:27.156115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.156140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.156232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.156354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.156380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.156473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.156553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.156577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.156674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.156760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.156785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.156878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.156967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.156992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.157098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.157248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.157273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.157367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.157459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.157483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.157571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.157654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.157678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.157770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.157851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.157876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.157967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.158064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.158088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.158186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.158280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.158304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.158398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.158480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.158505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.158649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.158765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.158789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.158878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.158971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.158998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.159096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.159182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.159208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.159325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.159453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.159478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.159592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.159710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.159735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.159826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.159904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.159928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.160036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.160132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.160157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.160277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.160362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.160388] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.160529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.160662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.160692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.160823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.160912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.160938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.161063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.161186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.161212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.867 [2024-11-30 04:32:27.161366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.161460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.867 [2024-11-30 04:32:27.161487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.867 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.161583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.161670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.161695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.161810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.161898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.161924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.162054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.162148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.162173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.162296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.162387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.162412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.162506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.162598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.162622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.162741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.162833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.162859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.162943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.163087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.163113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.163208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.163292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.163316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.163410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.163500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.163526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.163618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.163707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.163732] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.163854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.163970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.163997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.164097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.164183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.164208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.164327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.164412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.164437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.164528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.164640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.164665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.164757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.164845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.164871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.164978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.165080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.165110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.165207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.165305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.165332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.165427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.165544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.165570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.165656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.165744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.165769] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.165864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.165952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.165985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.166084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.166204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.166240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.166356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.166439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.166465] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.166584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.166702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.166727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.868 [2024-11-30 04:32:27.166822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.166908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.868 [2024-11-30 04:32:27.166933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.868 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.167034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.167155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.167181] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.167299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.167386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.167411] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.167533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.167650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.167680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.167775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.167860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.167886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.168019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.168116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.168141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.168245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.168358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.168384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.168474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.168558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.168584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.168702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.168783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.168809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.168923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.169026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.169054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.169171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.169260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.169285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.169375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.169465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.169491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.169607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.169702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.169728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.169817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.169935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.169971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.170063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.170158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.170183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.170331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.170415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.170440] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.170530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.170624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.170651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.170776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.170861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.170886] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.171006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.171088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.171114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.171208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.171296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.171321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.171411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.171528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.171553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.171669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.171752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.171778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.171925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.172022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.172047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.172168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.172249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.172278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.869 qpair failed and we were unable to recover it. 00:30:36.869 [2024-11-30 04:32:27.172371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.869 [2024-11-30 04:32:27.172460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.172486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.172577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.172668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.172694] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.172781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.172867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.172892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.172981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.173074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.173100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.173217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.173339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.173365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.173460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.173549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.173574] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.173669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.173784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.173808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.173892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.174006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.174032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.174153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.174271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.174296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.174413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.174499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.174528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.174643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.174756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.174782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.174869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.174983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.175009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.175103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.175212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.175237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.175332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.175410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.175434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.175548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.175663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.175688] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.175777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.175887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.175912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.176010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.176105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.176131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.176256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.176336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.176360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.176474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.176620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.176644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.870 qpair failed and we were unable to recover it. 00:30:36.870 [2024-11-30 04:32:27.176731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.176809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.870 [2024-11-30 04:32:27.176833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.176931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.177055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.177082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.177168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.177282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.177308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.177427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.177550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.177575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.177666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.177776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.177802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.177921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.178015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.178042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.178139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.178223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.178247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.178335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.178427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.178452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.178565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.178657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.178681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.178761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.178853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.178879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.179030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.179128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.179154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.179306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.179394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.179420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.179541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.179631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.179657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.179759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.179846] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.179872] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.179971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.180085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.180110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.180194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.180285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.180310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.180399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.180490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.180515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.180630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.180718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.180742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.180860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.180940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.180970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.181091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.181209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.181234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.181322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.181467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.181492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.181582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.181672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.181698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.181790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.181872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.181898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.181991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.182124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.182148] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.871 [2024-11-30 04:32:27.182248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.182338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.871 [2024-11-30 04:32:27.182364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.871 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.182455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.182576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.182602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.182718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.182831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.182856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.182976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.183063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.183087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.183181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.183293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.183319] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.183403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.183491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.183517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.183613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.183700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.183724] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.183822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.183903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.183928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.184056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.184140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.184165] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.184254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.184344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.184369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.184461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.184545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.184570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.184684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.184776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.184801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.184962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.185074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.185099] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.185226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.185343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.185368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.185486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.185600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.185625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.185712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.185792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.185816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.185946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.186050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.186075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.186167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.186250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.186275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.186364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.186452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.186476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.186567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.186683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.186708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.186796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.186880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.186906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.187004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.187121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.187147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.187264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.187358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.187383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.187499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.187608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.187633] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.187721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.187864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.187890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.187988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.188085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.872 [2024-11-30 04:32:27.188111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.872 qpair failed and we were unable to recover it. 00:30:36.872 [2024-11-30 04:32:27.188258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.188371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.188395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.188487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.188576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.188603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.188703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.188787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.188811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.188903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.189022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.189047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.189141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.189228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.189254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.189375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.189460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.189485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.189604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.189722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.189747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.189835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.189922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.189948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.190056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.190145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.190171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.190297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.190410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.190436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.190527] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.190612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.190636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.190740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.190899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.190929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.191032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.191127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.191153] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.191273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.191364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.191391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.191511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.191605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.191632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.191749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.191834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.191859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.191973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.192089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.192115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.192207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.192290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.192315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.192413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.192531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.192557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.192678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.192760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.192785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.192906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.193002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.193028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.193139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.193272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.193303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.193426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.193576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.193602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.193698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.193788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.193814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.873 qpair failed and we were unable to recover it. 00:30:36.873 [2024-11-30 04:32:27.193898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.193983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.873 [2024-11-30 04:32:27.194010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.194134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.194248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.194274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.194363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.194475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.194501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.194587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.194702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.194728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.194823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.194942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.194975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.195071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.195153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.195179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.195297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.195386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.195412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.195501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.195623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.195649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.195736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.195858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.195885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.195984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.196086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.196114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.196239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.196325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.196351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.196465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.196553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.196579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.196671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.196761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.196785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.196877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.196970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.197005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.197101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.197218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.197243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.197367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.197459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.197483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.197595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.197720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.197745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.197840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.197967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.197993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.198115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.198205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.198230] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.198315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.198402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.198428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.198546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.198662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.198687] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.198779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.198866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.198893] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.198989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.199083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.199109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.199199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.199287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.199311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.199397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.199516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.874 [2024-11-30 04:32:27.199540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.874 qpair failed and we were unable to recover it. 00:30:36.874 [2024-11-30 04:32:27.199656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.199744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.199768] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.199863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.199978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.200003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.200099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.200221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.200247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.200328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.200411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.200435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.200557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.200679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.200705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.200790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.200879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.200904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.201001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.201123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.201149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.201263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.201356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.201382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.201472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.201585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.201610] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.201703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.201788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.201812] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.201928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.202029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.202056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.202148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.202230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.202255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.202351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.202476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.202501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.202622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.202741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.202766] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.202890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.202981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.203007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.203094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.203180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.203205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.203291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.203373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.203398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.203484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.203569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.203595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.203713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.203831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.203857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.203948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.204038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.204063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.204157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.204299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.204324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.204413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.204522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.204547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.204668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.204750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.204780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.875 [2024-11-30 04:32:27.204893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.204995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.875 [2024-11-30 04:32:27.205025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.875 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.205154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.205242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.205268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.205363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.205450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.205477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.205596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.205715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.205741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.205835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.205955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.205986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.206078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.206164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.206189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.206310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.206425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.206450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.206538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.206624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.206650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.206768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.206854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.206879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.206974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.207091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.207123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.207215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.207329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.207355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.207481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.207565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.207590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.207676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.207765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.207790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.207881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.207970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.207997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.208123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.208208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.208233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.208350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.208437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.208462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.208542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.208649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.208674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.208798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.208883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.208910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.208997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.209084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.209110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.209255] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.209338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.209369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.876 qpair failed and we were unable to recover it. 00:30:36.876 [2024-11-30 04:32:27.209493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.876 [2024-11-30 04:32:27.209585] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.209612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.209697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.209793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.209818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.209908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.210026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.210051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.210174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.210260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.210285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.210377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.210492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.210517] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.210637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.210752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.210777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.210897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.210984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.211010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.211094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.211208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.211234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.211326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.211440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.211466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.211559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.211647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.211678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.211799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.211886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.211911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.212034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.212128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.212155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.212250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.212369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.212395] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.212492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.212591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.212618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.212709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.212823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.212848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.212983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.213072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.213097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.213189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.213277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.213302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.213387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.213480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.213505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.213592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.213673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.213697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.213783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.213863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.213888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.214014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.214139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.214164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.214248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.214344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.214370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.214457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.214576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.214601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.877 [2024-11-30 04:32:27.214685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.214776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.877 [2024-11-30 04:32:27.214801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.877 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.214893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.214985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.215011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.215099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.215185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.215210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.215360] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.215448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.215475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.215566] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.215653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.215679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.215765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.215879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.215904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.215994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.216080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.216106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.216202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.216283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.216309] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.216392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.216506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.216531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.216628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.216740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.216764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.216854] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.216986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.217013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.217110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.217198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.217224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.217309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.217393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.217419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.217538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.217631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.217658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.217774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.217859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.217884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.217983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.218075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.218100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.218192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.218315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.218340] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.218463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.218550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.218576] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.218658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.218747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.218772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.218886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.219003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.219030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.219125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.219219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.219245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.219359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.219472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.219497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.219622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.219710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.219736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.219827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.219913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.219938] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.878 [2024-11-30 04:32:27.220051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.220178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.878 [2024-11-30 04:32:27.220203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.878 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.220323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.220416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.220441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.220559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.220646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.220671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.220761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.220873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.220898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.221016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.221118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.221144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.221226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.221311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.221337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.221427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.221538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.221563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.221685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.221773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.221799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.221888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.222005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.222031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.222128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.222249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.222274] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.222369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.222486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.222511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.222601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.222695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.222720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.222817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.222934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.222964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.223067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.223164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.223189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.223277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.223395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.223420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.223515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.223601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.223626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.223714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.223801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.223826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.223949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.224050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.224075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.224160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.224240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.224265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.224352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.224435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.224460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.224554] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.224674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.224700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.224788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.224905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.224932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.225049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.225137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.225162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.225285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.225373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.225398] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.225522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.225604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.879 [2024-11-30 04:32:27.225629] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.879 qpair failed and we were unable to recover it. 00:30:36.879 [2024-11-30 04:32:27.225727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.225838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.225864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.225963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.226054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.226078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.226172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.226262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.226286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.226375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.226488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.226513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.226594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.226689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.226714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.226802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.226893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.226918] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.227033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.227119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.227144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.227229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.227314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.227339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.227512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.227613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.227642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.227738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.227850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.227874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.227965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.228053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.228077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.228169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.228250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.228275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.228366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.228463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.228489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.228636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.228722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.228747] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.228862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.228944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.228979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.229071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.229156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.229180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.229282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.229389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.229419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.229542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.229664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.229689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.229784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.229882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.229910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.230006] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.230103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.230128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.230215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.230299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.230324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.230415] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.230533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.230560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.230650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.230767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.230793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.880 qpair failed and we were unable to recover it. 00:30:36.880 [2024-11-30 04:32:27.230879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.880 [2024-11-30 04:32:27.230967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.230994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.231085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.231170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.231195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.231311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.231402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.231428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.231546] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.231630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.231656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.231774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.231863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.231888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.231983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.232110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.232135] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.232226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.232343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.232368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.232463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.232545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.232569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.232661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.232742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.232767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.232886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.233004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.233030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.233114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.233201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.233225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.233317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.233399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.233423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.233569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.233653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.233677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.233762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.233879] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.233903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.234033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.234125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.234151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.234244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.234333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.234363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.234490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.234580] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.234605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.234693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.234810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.234837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.234927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.235058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.235084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.881 [2024-11-30 04:32:27.235186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.235279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.881 [2024-11-30 04:32:27.235304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.881 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.235399] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.235516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.235541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.235627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.235711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.235735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.235828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.235917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.235943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.236065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.236190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.236215] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.236306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.236398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.236423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.236512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.236626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.236655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.236750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.236837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.236862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.236977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.237082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.237109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.237201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.237286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.237311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.237398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.237486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.237512] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.237607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.237756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.237780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.237918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.238004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.238030] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.238153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.238237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.238262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.238348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.238433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.238458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.238561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.238674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.238699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.238795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.238891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.238922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.239025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.239118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.239144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.239245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.239325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.239350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.239433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.239520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.239544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.239640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.239759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.239784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.239902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.240018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.240044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.240138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.240254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.240279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.240370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.240484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.240509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.240598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.240710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.240736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.882 qpair failed and we were unable to recover it. 00:30:36.882 [2024-11-30 04:32:27.240822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.240940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.882 [2024-11-30 04:32:27.240975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.241097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.241208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.241234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.241357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.241441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.241466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.241550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.241636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.241662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.241759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.241849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.241874] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.241977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.242077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.242102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.242221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.242341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.242366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.242454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.242568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.242592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.242717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.242832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.242857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.242942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.243079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.243105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.243193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.243279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.243305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.243397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.243476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.243502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.243597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.243720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.243744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.243830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.243914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.243939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.244078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.244168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.244194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.244336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.244422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.244447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.244532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.244616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.244641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.244735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.244856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.244880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.245005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.245099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.245124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.245214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.245298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.245323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.245414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.245556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.245582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.245666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.245747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.245772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.245893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.245981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.246008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.246112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.246234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.246259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.883 [2024-11-30 04:32:27.246361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.246451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.883 [2024-11-30 04:32:27.246476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.883 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.246569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.246653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.246677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.246797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.246888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.246914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.247040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.247133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.247159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.247248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.247361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.247387] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.247510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.247627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.247654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.247740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.247885] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.247911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.248034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.248122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.248147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.248256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.248375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.248401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.248494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.248610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.248636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.248721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.248804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.248828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.248943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.249081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.249106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.249190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.249301] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.249326] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.249447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.249533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.249559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.249678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.249768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.249794] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.249880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.249997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.250023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.250137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.250221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.250246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.250370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.250455] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.250479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.250574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.250661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.250686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.250801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.250883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.250908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.251004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.251117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.251142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.251227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.251336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.251362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.251505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.251620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.251645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.251739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.251862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.251889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.252026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.252124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.884 [2024-11-30 04:32:27.252149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.884 qpair failed and we were unable to recover it. 00:30:36.884 [2024-11-30 04:32:27.252238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.252359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.252384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.252475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.252590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.252616] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.252738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.252816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.252840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.252934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.253104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.253130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.253219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.253309] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.253333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.253420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.253508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.253532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.253615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.253730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.253755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.253877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.253973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.253999] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.254090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.254186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.254212] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.254306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.254403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.254429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.254531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.254646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.254671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.254758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.254847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.254871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.254955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.255095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.255121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.255231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.255355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.255384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.255483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.255573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.255598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.255692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.255779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.255805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.255896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.255988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.256020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.256139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.256257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.256284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.256385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.256473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.256499] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.256589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.256703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.256729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.256850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.256942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.256975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.257104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.257194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.257220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.885 [2024-11-30 04:32:27.257302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.257417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.885 [2024-11-30 04:32:27.257443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.885 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.257537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.257629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.257657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.257757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.257874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.257902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.257998] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.258124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.258150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.258232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.258318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.258344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.258494] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.258610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.258636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.258754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.258871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.258898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.258995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.259116] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.259142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.259231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.259344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.259369] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.259458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.259556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.259582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.259670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.259752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.259777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.259902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.260019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.260046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.260145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.260235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.260261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.260353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.260443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.260470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.260570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.260663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.260689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.260775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.260886] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.260912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.261008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.261108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.261134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.261230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.261348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.261373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.261468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.261597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.261623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.261740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.261824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.261848] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.261970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.262103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.262128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.262246] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.262336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.262361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.262482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.262598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.262622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.262718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.262803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.886 [2024-11-30 04:32:27.262827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.886 qpair failed and we were unable to recover it. 00:30:36.886 [2024-11-30 04:32:27.262920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.263053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.263080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.263181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.263270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.263297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.263392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.263514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.263541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.263632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.263714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.263739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.263851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.263936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.263971] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.264069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.264153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.264178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.264271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.264354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.264380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.264496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.264590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.264617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.264707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.264794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.264820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.264908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.264999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.265025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.265145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.265230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.265256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.265380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.265493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.265519] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.265606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.265698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.265723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.265840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.265926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.265951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.266055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.266198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.266224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.266312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.266393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.266419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.266505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.266637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.266662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.266757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.266874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.266900] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.267005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.267096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.267122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.267209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.267326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.267351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.887 qpair failed and we were unable to recover it. 00:30:36.887 [2024-11-30 04:32:27.267472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.267582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.887 [2024-11-30 04:32:27.267606] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.267691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.267784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.267811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.267928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.268054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.268081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.268178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.268263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.268287] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.268439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.268558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.268584] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.268679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.268796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.268821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.268947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.269054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.269081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.269196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.269340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.269371] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.269458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.269557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.269582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.269669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.269758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.269783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.269898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.269990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.270020] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.270112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.270198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.270224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.270349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.270437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.270464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.270582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.270665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.270691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.270810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.270892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.270917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.271023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.271154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.271179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.271268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.271383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.271408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.271558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.271644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.271674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.271804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.271917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.271942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.272040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.272135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.272162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.272283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.272371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.272397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.272489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.272574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.272599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.272687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.272772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.272798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.272917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.273041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.888 [2024-11-30 04:32:27.273068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.888 qpair failed and we were unable to recover it. 00:30:36.888 [2024-11-30 04:32:27.273157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.273273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.273300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.273422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.273544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.273569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.273690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.273774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.273799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.273947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.274080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.274113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.274228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.274345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.274370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.274453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.274545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.274569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.274663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.274781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.274807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.274889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.274984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.275015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.275106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.275221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.275246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.275366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.275456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.275481] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.275609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.275699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.275725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.275841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.275965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.275991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.276078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.276165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.276189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.276277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.276393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.276423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.276513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.276629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.276653] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.276742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.276835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.276860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.277007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.277098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.277122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.277241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.277332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.277357] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.277453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.277542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.277569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.277658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.277753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.277779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.277926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.278019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.278045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.278140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.278271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.278297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.278377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.278497] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.278524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.278612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.278694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.278720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.889 qpair failed and we were unable to recover it. 00:30:36.889 [2024-11-30 04:32:27.278853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.278939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.889 [2024-11-30 04:32:27.278972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.279095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.279216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.279242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.279334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.279421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.279446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.279532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.279618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.279643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.279731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.279816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.279842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.279934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.280056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.280084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.280210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.280329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.280355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.280448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.280564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.280589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.280677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.280765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.280790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.280909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.281030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.281057] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.281152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.281239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.281264] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.281383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.281474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.281500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.281618] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.281709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.281735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.281827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.281916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.281942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.282038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.282129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.282157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.282249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.282364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.282389] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.282475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.282564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.282590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.282680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.282803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.282829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.282922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.283025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.283052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.283140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.283258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.283285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.283386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.283476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.283501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.283590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.283674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.283700] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.283788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.283899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.283924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.284058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.284144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.890 [2024-11-30 04:32:27.284169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.890 qpair failed and we were unable to recover it. 00:30:36.890 [2024-11-30 04:32:27.284262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.284351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.284375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.284465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.284552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.284579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.284698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.284815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.284840] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.284928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.285053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.285079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.285165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.285279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.285304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.285397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.285480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.285506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.285602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.285721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.285746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.285842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.285928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.285953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.286078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.286166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.286192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.286278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.286396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.286422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.286541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.286633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.286658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.286746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.286830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.286856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.286946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.287071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.287097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.287186] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.287302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.287328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.287447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.287529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.287555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.287677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.287795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.287822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.287919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.288012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.288038] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.288166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.288244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.288270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.288387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.288500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.288525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.288607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.288694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.288721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.288867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.288979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.289005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.289128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.289214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.289240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.289384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.289473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.289498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.891 [2024-11-30 04:32:27.289589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.289685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.891 [2024-11-30 04:32:27.289711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.891 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.289806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.289921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.289946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.290071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.290160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.290185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.290312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.290406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.290431] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.290556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.290646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.290672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.290757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.290872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.290898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.290995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.291083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.291109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.291196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.291312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.291338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.291456] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.291541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.291568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.291657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.291777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.291803] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.291897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.292016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.292043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.292133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.292227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.292253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.292348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.292437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.292462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.292559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.292644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.292669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.292871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.292966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.292993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.293114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.293207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.293232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.293357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.293476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.293502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.293646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.293732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.293758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.293850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.293947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.293981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.294075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.294195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.294220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.294311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.294429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.294454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.892 qpair failed and we were unable to recover it. 00:30:36.892 [2024-11-30 04:32:27.294578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.892 [2024-11-30 04:32:27.294695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.294720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.294840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.294931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.294955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.295092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.295179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.295203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.295293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.295411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.295437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.295528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.295614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.295639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.295728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.295851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.295876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.295997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.296093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.296118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.296240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.296321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.296345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.296430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.296513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.296538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.296683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.296767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.296792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.296891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.296979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.297005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.297098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.297243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.297269] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.297361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.297457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.297483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.297607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.297721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.297746] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.297869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.297954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.297985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.298104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.298197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.298221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.298307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.298392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.298418] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.298541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.298620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.298646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.298772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.298860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.298885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.298988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.299078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.299103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.299185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.299304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.299330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.299428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.299513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.299538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.299630] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.299750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.299774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.299857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.299946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.299979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.893 qpair failed and we were unable to recover it. 00:30:36.893 [2024-11-30 04:32:27.300075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.300218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.893 [2024-11-30 04:32:27.300244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.300344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.300436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.300461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.300604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.300690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.300716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.300803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.300887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.300912] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.301040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.301138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.301163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.301281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.301370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.301396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.301486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.301584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.301609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.301733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.301850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.301875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.301970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.302068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.302093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.302183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.302299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.302325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.302444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.302537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.302563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.302712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.302800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.302825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.302912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.302996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.303022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.303106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.303197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.303222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.303339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.303431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.303458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.303545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.303633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.303658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.303780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.303892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.303917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.304022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.304137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.304162] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.304256] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.304375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.304405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.304502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.304617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.304642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.304743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.304887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.304913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.305012] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.305127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.305151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.305244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.305337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.305364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.305454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.305543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.305568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.305687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.305804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.894 [2024-11-30 04:32:27.305829] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.894 qpair failed and we were unable to recover it. 00:30:36.894 [2024-11-30 04:32:27.305923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.306052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.306077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.306194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.306282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.306307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.306394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.306537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.306563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.306684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.306771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.306801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.306915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.307021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.307047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.307132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.307250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.307275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.307402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.307490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.307515] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.307632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.307719] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.307744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.307841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.307956] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.307990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.308080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.308199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.308224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.308310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.308425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.308450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.308606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.308726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.308751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.308869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.308990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.309016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.309102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.309189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.309222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.309321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.309438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.309464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.309583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.309699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.309725] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.309848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.309965] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.309992] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.310081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.310164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.310188] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.310281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.310434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.310459] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.310556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.310679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.310706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.310806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.310927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.310952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.311089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.311181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.311207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.311353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.311441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.311466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.895 qpair failed and we were unable to recover it. 00:30:36.895 [2024-11-30 04:32:27.311552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.895 [2024-11-30 04:32:27.311642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.311672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.311790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.311935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.311966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.312055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.312142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.312168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.312292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.312381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.312405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.312528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.312609] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.312635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.312726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.312840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.312865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.312988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.313074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.313100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.313196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.313314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.313338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.313421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.313541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.313566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.313684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.313770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.313795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.313894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.314038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.314063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.314160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.314260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.314286] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.314416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.314534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.314560] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.314680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.314793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.314819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.314937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.315069] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.315096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.315221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.315306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.315332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.315461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.315579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.315605] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.315694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.315806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.315832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.315945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.316043] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.316068] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.316158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.316274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.316298] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.316413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.316499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.316523] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.316673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.316764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.316789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.316878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.316975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.317001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.317090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.317181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.317205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.896 qpair failed and we were unable to recover it. 00:30:36.896 [2024-11-30 04:32:27.317294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.896 [2024-11-30 04:32:27.317402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.317428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.317579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.317661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.317686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.317805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.317900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.317925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.318020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.318111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.318136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.318254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.318344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.318368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.318461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.318555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.318580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.318697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.318788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.318813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.318941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.319050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.319075] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.319160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.319247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.319272] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.319392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.319536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.319561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.319684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.319771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.319798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.319897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.319994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.320021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.320140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.320254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.320280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.320405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.320521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.320546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.320661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.320784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.320811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.320931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.321034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.321061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.321190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.321277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.321303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.321426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.321507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.321532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.321650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.321734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.321759] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.321859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.321975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.322002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.322129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.322211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.322237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.322323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.322478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.322503] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.322599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.322715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.322741] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.322842] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.322933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.897 [2024-11-30 04:32:27.322964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.897 qpair failed and we were unable to recover it. 00:30:36.897 [2024-11-30 04:32:27.323084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.323175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.323200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.323321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.323409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.323433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.323516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.323631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.323657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.323776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.323860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.323885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.324005] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.324094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.324120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.324242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.324329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.324355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.324448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.324562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.324588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.324678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.324792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.324817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.324905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.325016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.325041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.325159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.325248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.325273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.325395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.325483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.325508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.325598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.325679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.325704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.325815] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.325912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.325937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.326044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.326152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.326178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.326288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.326404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.326429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.326521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.326635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.326661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.326750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.326835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.326860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.326947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.327058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.327084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.327201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.327313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.327338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.327486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.327569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.327594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.327684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.327776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.327802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.898 qpair failed and we were unable to recover it. 00:30:36.898 [2024-11-30 04:32:27.327923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.898 [2024-11-30 04:32:27.328050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.328076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.328198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.328286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.328311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.328429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.328518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.328544] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.328633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.328751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.328776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.328878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.328993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.329019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.329112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.329199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.329224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.329343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.329429] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.329454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.329571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.329657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.329683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.329799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.329887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.329911] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.330004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.330118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.330143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.330265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.330349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.330374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.330467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.330555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.330582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.330675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.330770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.330796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.330916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.331062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.331088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.331178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.331267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.331292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.331386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.331478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.331505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.331621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.331739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.331764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.331860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.331954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.331986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.332079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.332165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.332191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.332345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.332431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.332456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.332542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.332629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.332654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.332779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.332891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.332916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.333010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.333099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.333124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.333213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.333325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.333351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.899 qpair failed and we were unable to recover it. 00:30:36.899 [2024-11-30 04:32:27.333448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.899 [2024-11-30 04:32:27.333536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.333562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.333664] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.333754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.333779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.333895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.333979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.334005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.334092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.334171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.334196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.334288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.334372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.334396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.334486] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.334600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.334625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.334716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.334835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.334861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.334986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.335100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.335126] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.335238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.335325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.335351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.335439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.335550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.335575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.335692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.335773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.335798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.335944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.336040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.336065] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.336158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.336244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.336270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.336391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.336502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.336528] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.336622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.336732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.336756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.336905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.337052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.337078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.337174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.337287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.337312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.337460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.337540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.337566] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.337663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.337780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.337805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.337935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.338031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.338056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.338149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.338236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.338260] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.338351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.338446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.338472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.338558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.338646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.338672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.338758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.338899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.338925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.900 [2024-11-30 04:32:27.339042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.339163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.900 [2024-11-30 04:32:27.339189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.900 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.339275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.339392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.339417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.339543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.339655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.339680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.339781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.339926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.339951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.340055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.340154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.340179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.340268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.340356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.340381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.340473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.340558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.340583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.340671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.340758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.340785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.340903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.340990] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.341016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.341111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.341225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.341249] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.341369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.341478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.341502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.341598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.341683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.341709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.341831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.341945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.341978] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.342074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.342194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.342219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.342336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.342454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.342484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.342573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.342716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.342742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.342837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.342954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.342993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.343115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.343237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.343262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.343382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.343464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.343490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.343607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.343717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.343743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.343864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.343953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.343984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.344087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.344175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.344200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.344318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.344431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.344456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.344581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.344669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.344693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.344821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.344921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.344953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.901 qpair failed and we were unable to recover it. 00:30:36.901 [2024-11-30 04:32:27.345052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.901 [2024-11-30 04:32:27.345162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.345187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.345300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.345427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.345452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.345571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.345680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.345705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.345793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.345884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.345910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.346041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.346156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.346180] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.346296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.346408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.346432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.346518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.346631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.346656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.346777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.346870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.346896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.347026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.347126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.347151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.347241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.347325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.347354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.347449] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.347531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.347557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.347705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.347816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.347842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.347937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.348024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.348050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.348141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.348226] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.348252] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.348368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.348485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.348509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.348603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.348742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.348767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.348887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.348983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.349010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.349133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.349223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.349248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.349340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.349422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.349447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.349567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.349656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.349686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.349808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.349921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.349945] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.350040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.350127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.350152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.350275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.350365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.902 [2024-11-30 04:32:27.350391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.902 qpair failed and we were unable to recover it. 00:30:36.902 [2024-11-30 04:32:27.350504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.350596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.350620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.350718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.350804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.350830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.350927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.351052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.351079] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.351194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.351310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.351335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.351462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.351544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.351570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.351666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.351755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.351782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.351874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.351974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.352000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.352101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.352215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.352240] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.352340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.352423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.352448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.352561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.352645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.352671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.352784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.352872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.352897] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.352995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.353078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.353104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.353230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.353342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.353367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.353488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.353570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.353594] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.353724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.353813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.353837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.353928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.354025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.354050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.354167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.354252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.354276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.354376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.354462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.354487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.354601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.354689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.354713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.354800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.354880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.903 [2024-11-30 04:32:27.354906] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.903 qpair failed and we were unable to recover it. 00:30:36.903 [2024-11-30 04:32:27.355009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.355102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.355128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.355211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.355306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.355331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.355413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.355533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.355558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.355654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.355734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.355758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.355849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.355972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.356000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.356097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.356216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.356242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.356364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.356459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.356485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.356582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.356669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.356695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.356789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.356908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.356934] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.357065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.357153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.357178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.357271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.357366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.357390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.357482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.357572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.357596] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.357693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.357775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.357800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.357919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.358050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.358077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.358168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.358253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.358279] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.358371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.358505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.358532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.358647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.358734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.358758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.358857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.358941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.358975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.359095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.359185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.359210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.359359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.359447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.359471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.359584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.359668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.359693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.359814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.359925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.359950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.360079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.360164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.360189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.360305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.360450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.360475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.904 [2024-11-30 04:32:27.360570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.360686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.904 [2024-11-30 04:32:27.360710] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.904 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.360803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.360916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.360941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.361037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.361118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.361144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.361266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.361355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.361383] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.361505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.361594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.361621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.361737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.361825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.361850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.361970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.362079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.362105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.362197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.362286] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.362313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.362408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.362495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.362521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.362617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.362707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.362733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.362822] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.362936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.362969] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.363063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.363211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.363236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.363356] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.363445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.363470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.363563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.363653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.363677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.363762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.363880] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.363904] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.363993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.364083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.364109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.364224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.364320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.364344] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.364464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.364604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.364630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.364747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.364862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.364887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.364979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.365075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.365100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.365218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.365307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.365332] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.365423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.365509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.365536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.365628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.365713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.365739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.365834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.365922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.365948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.366055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.366171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.366196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.366282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.366377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.366402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.905 [2024-11-30 04:32:27.366490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.366605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.905 [2024-11-30 04:32:27.366631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.905 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.366720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.366810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.366837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.366966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.367052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.367077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.367171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.370014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.370042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.370134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.370253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.370278] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.370401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.370523] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.370547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.370671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.370751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.370776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.370902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.370983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.371009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.371150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.371269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.371294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.371379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.371462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.371487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.371584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.371672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.371698] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.371799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.371888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.371915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.372052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.372161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.372187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.372308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.372450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.372475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.372564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.372648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.372673] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.372756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.372897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.372922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.373014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.373098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.373123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.373221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.373317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.373343] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.373430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.373518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.373543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.373663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.373749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.373774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.373870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.374015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.374042] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.374128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.374212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.374238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.374325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.374441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.374466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.374556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.374667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.374692] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.374781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.374866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.374892] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.374983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.375095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.375120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.375278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.375373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.375400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.906 [2024-11-30 04:32:27.375495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.375613] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.906 [2024-11-30 04:32:27.375640] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.906 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.375761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.375877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.375902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.376000] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.376096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.376121] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.376208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.376289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.376314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.376437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.376518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.376543] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.376663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.376752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.376777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.376895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.376981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.377007] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.377132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.377249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.377275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.377391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.377476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.377500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.377589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.377670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.377696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.377782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.377902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.377929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.378084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.378212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.378238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.378335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.378481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.378507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.378625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.378747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.378774] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.378897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.378981] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.379008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.379099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.379189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.379213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.379330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.379474] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.379500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.379596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.379687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.379713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.379802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.379925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.379951] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.380079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.380167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.380194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.380285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.380435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.380461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.380556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.380697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.380722] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.380845] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.380968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.380994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.381108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.381223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.381248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.381337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.381446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.381472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.381565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.381655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.381679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.381793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.381917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.381943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.382054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.382141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.382167] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.907 qpair failed and we were unable to recover it. 00:30:36.907 [2024-11-30 04:32:27.382289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.907 [2024-11-30 04:32:27.382375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.382400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.382549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.382639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.382664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.382748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.382866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.382898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.382987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.383102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.383128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.383223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.383304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.383330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.383448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.383538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.383565] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.383682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.383829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.383854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.383977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.384065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.384091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.384206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.384291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.384318] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.384417] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.384504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.384531] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.384649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.384762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.384787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.384906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.384996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.385023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.385118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.385233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.385263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.385355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.385467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.385492] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.385583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.385697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.385723] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.385813] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.385937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.385967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.386065] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.386159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.386185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.386275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.386364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.386391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.386479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.386598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.386624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.386742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.386823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.386849] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.386986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.387080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.387106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.387231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.387366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.387392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.387513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.387605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.387635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.387717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.387808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.387835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.387923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.388124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.388150] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.908 qpair failed and we were unable to recover it. 00:30:36.908 [2024-11-30 04:32:27.388270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.908 [2024-11-30 04:32:27.388385] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.388410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.388501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.388589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.388615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.388737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.388824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.388850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.388940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.389058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.389084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.389207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.389300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.389325] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.389421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.389543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.389569] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.389653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.389744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.389770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.389860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.389996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.390027] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.390118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.390207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.390234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.390351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.390452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.390477] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.390570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.390651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.390677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.390792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.390914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.390940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.391039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.391125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.391151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.391242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.391361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.391385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.391508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.391593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.391617] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.391700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.391788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.391815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.391928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.392062] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.392089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.392176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.392261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.392285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.392380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.392511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.392537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.392624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.392708] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.392733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.392824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.392910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.392937] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.393041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.393138] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.393164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.393261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.393345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.393372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.393493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.393574] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.393599] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.393717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.393810] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.393836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.393924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.394015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.394041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.394160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.394241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.394265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.394379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.394470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.394496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.909 [2024-11-30 04:32:27.394596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.394745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.909 [2024-11-30 04:32:27.394770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.909 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.394861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.395004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.395031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.395153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.395268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.395293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.395383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.395478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.395504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.395596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.395681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.395706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.395823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.395945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.395976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.396067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.396206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.396231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.396319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.396405] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.396430] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.396572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.396690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.396714] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.396800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.396883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.396908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.397013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.397106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.397131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.397221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.397335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.397359] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.397447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.397562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.397587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.397740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.397824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.397850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.397936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.398032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.398058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.398179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.398270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.398296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.398422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.398564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.398590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.398671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.398790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.398818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.398906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.399026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.399052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.399177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.399266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.399292] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.399387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.399505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.399529] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.399625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.399706] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.399731] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.399817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.399909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.399935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.400059] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.400160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.400186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.400277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.400367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.400393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.400517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.400624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.400650] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.400765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.400843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.400868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.401014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.401105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.401130] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.401225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.401342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.401366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.401491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.401608] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.401634] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.910 [2024-11-30 04:32:27.401760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.401894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.910 [2024-11-30 04:32:27.401919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.910 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.402022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.402109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.402136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.402224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.402344] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.402368] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.402459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.402542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.402567] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.402663] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.402776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.402802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.402893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.403010] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.403036] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.403128] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.403263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.403289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.403378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.403496] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.403522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.403639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.403729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.403754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.403838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.403986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.404013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.404115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.404202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.404228] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.404345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.404431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.404457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.404606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.404688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.404713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.404833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.404953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.404985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.405084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.405169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.405194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.405308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.405390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.405417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.405540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.405622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.405648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.405764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.405893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.405919] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.406013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.406093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.406118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.406248] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.406339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.406365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.406461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.406548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.406573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.406691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.406781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.406806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.406899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.407013] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.407039] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.407125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.407244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.407270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.407389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.407511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.407536] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.407653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.407800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.407826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.407909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.407996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.408022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.408141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.408229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.408254] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.408371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.408454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.408478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.408587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.408668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.408693] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.911 [2024-11-30 04:32:27.408785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.408915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.911 [2024-11-30 04:32:27.408941] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.911 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.409071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.409153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.409178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.409294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.409410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.409435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.409583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.409681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.409707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.409829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.409951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.409982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.410127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.410210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.410236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.410322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.410409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.410433] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.410521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.410601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.410625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.410726] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.410838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.410864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.410980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.411095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.411120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.411209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.411305] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.411331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.411424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.411510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.411534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.411625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.411711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.411737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.411858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.411942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.411973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.412070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.412159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.412185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.412288] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.412403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.412428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.412525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.412611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.412638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.412755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.412849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.412873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.412967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.413135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.413161] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.413279] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.413395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.413421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.413537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.413625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.413651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.413770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.413861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.413885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.413975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.414090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.414116] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.414206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.414296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.414322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.414412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.414524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.414550] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.414636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.414716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.414742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.912 qpair failed and we were unable to recover it. 00:30:36.912 [2024-11-30 04:32:27.414829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.414950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.912 [2024-11-30 04:32:27.414985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.415079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.415193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.415219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.415345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.415431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.415456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.415549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.415633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.415659] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.415779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.415882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.415908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.416004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.416085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.416111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.416199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.416311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.416336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.416421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.416536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.416561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.416683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.416768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.416793] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.416908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.417009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.417037] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.417129] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.417242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.417267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.417363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.417482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.417507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.417629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.417710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.417735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.417852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.417935] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.417966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.418090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.418173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.418205] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.418303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.418418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.418443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.418563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.418682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.418707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.418797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.418917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.418943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.419033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.419150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.419175] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.419261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.419355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.419380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.419473] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.419557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.419582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.419694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.419811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.419835] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.419954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.420094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.420120] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.420239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.420357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.420382] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.420470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.420557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.420588] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.420676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.420759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.420784] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.420881] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.420972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.420998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.421092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.421208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.421235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.421329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.421443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.421469] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.421601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.421694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.421720] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.421809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.421898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.421926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.422027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.422117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.422142] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.422263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.422350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.913 [2024-11-30 04:32:27.422375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.913 qpair failed and we were unable to recover it. 00:30:36.913 [2024-11-30 04:32:27.422498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.422611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.422636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.422729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.422820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.422851] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.422975] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.423064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.423090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.423203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.423319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.423345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.423435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.423525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.423552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.423676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.423758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.423783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.423930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.424029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.424055] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.424150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.424236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.424261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.424348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.424428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.424454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.424541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.424637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.424663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.424784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.424866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.424891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.424988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.425078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.425109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.425229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.425315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.425341] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.425430] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.425521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.425546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.425639] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.425727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.425753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.425838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.425949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.425980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.426077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.426165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.426190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.426312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.426397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.426423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.426519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.426637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.426663] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.426811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.426902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.426927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.427058] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.427145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.427171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.427321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.427410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.427435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.427556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.427700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.427726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.427814] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.427905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.427930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.428061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.428148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.428172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.428289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.428409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.428434] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.428555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.428641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.428667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.428760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.428844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.428869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.428964] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.429088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.429114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.429207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.429328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.429355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.429445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.429536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.429561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.914 [2024-11-30 04:32:27.429687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.429801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.914 [2024-11-30 04:32:27.429827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.914 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.429921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.430016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.430043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.430134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.430228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.430253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.430341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.430459] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.430484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.430582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.430701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.430726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.430824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.430906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.430931] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.431034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.431114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.431139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.431234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.431378] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.431403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.431487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.431571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.431597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.431684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.431801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.431828] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.431971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.432057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.432083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.432174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.432297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.432323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.432418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.432536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.432562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.432651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.432728] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.432754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.432868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.432984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.433011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.433104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.433197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.433224] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.433315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.433397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.433422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.433539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.433701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.433726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.433816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.433908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.433935] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.434090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.434176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.434202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.434317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.434406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.434432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.434524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.434612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.434638] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.434735] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.434850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.434876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.434963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.435051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.435077] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.435164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.435274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.435300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.435392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.435476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.435501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.435593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.435682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.435708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.435804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.435923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.435950] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.436054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.436134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.436160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.436259] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.436371] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.436397] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.436514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.436635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.436661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.436785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.436872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.436898] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.437016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.437114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.437139] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.437225] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.437312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.437339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.915 qpair failed and we were unable to recover it. 00:30:36.915 [2024-11-30 04:32:27.437471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.915 [2024-11-30 04:32:27.437560] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.437586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.437681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.437798] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.437824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.437938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.438025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.438051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.438198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.438277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.438303] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.438397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.438526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.438553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.438649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.438744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.438771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.438888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.438980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.439008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.439111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.439204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.439229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.439373] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.439458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.439484] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.439572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.439655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.439681] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.439770] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.439883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.439908] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.439994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.440083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.440108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.440198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.440314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.440339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.440457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.440545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.440570] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.440666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.440755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.440780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.440871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.440992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.441019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.441121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.441213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.441238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.441324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.441441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.441468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.441559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.441651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.441677] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.441825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.441920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.441946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.442041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.442159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.442185] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.442307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.442387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.442412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.442525] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.442606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.442631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.442720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.442865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.442891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.442999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.443091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.443118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.443272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.443382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.443408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.443528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.443646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.443674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.443779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.443884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.443913] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.444055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.444144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.444170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.444287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.444404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.444429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.916 qpair failed and we were unable to recover it. 00:30:36.916 [2024-11-30 04:32:27.444518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.444633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.916 [2024-11-30 04:32:27.444658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.444748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.444841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.444868] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.444966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.445078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.445103] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.445189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.445273] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.445299] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.445389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.445480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.445505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.445603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.445694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.445721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.445804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.445919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.445949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.446049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.446144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.446169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.446284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.446395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.446420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.446508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.446646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.446671] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.446795] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.446891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.446916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.447016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.447131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.447155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.447245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.447338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.447365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.447451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.447537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.447561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.447675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.447760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.447785] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.447901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.448016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.448043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.448165] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.448254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.448280] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.448368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.448458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.448483] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.448600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.448715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.448740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.448858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.448950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.448981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.449101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.449188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.449213] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.449306] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.449394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.449420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.449570] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.449688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.449712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.449802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.449894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.449920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.450014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.450104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.450133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.450220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.450339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.450365] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.450452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.450596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.450621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.450704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.450797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.450822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.450911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.450994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.451019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.451110] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.451189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.451214] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.451334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.451443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.451468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.451594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.451678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.451704] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.917 qpair failed and we were unable to recover it. 00:30:36.917 [2024-11-30 04:32:27.451820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.451913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.917 [2024-11-30 04:32:27.451939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.452037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.452119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.452144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.452276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.452365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.452390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.452488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.452576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.452602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.452691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.452800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.452825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.452911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.453016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.453043] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.453134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.453250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.453275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.453369] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.453461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.453486] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.453607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.453690] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.453715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.453858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.453948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.453982] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.454104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.454194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.454219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.454307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.454453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.454478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.454598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.454686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.454712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.454797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.454884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.454909] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.455021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.455134] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.455159] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.455252] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.455342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.455372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.455470] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.455587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.455613] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.455700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.455821] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.455846] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.455933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.456063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.456089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.456203] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.456296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.456321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.456410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.456526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.456552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.456642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.456727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.456753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.456869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.456963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.456989] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.457135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.457250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.457275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.457386] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.457472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.457498] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.457590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.457704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.457733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.457826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.457944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.457976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.458096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.458178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.458203] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.458285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.458368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.458393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.458482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.458594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.458619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.458705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.458797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.458823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.458938] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.459033] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.459059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.459156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.459302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.459328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.459409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.459500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.459526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.459645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.459731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.459757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.459841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.459925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.459955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.918 [2024-11-30 04:32:27.460079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.460160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.918 [2024-11-30 04:32:27.460186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.918 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.460298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.460380] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.460404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.460505] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.460596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.460622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.460736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.460825] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.460850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.460970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.461063] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.461088] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.461208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.461324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.461350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.461466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.461555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.461579] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.461667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.461750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.461776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.461863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.461952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.461985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.462098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.462211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.462241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.462329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.462421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.462446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.462539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.462624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.462651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.462745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.462866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.462891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.462979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.463067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.463091] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.463180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.463298] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.463323] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.463440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.463561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.463587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.463680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.463792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.463817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.463914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.464002] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.464028] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.464119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.464207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.464232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.464351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.464448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.464473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.464567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.464685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.464712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.464831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.464918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.464944] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.465044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.465133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.465157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.465291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.465377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.465403] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.465518] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.465632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.465657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.465749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.465840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.465865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.465987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.466071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.466096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.466183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.466269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.466294] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.466410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.466526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.466551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.919 qpair failed and we were unable to recover it. 00:30:36.919 [2024-11-30 04:32:27.466647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.919 [2024-11-30 04:32:27.466736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.466760] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.466852] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.466970] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.466997] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.467087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.467170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.467195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.467281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.467368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.467394] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.467512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.467593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.467619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.467707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.467802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.467827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.467922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.468042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.468069] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.468156] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.468303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.468328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.468441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.468555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.468580] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.468676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.468790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.468814] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.468936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.469028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.469054] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.469152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.469245] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.469270] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.469418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.469530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.469555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.469647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.469738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.469763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.469853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.469946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.469981] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.470104] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.470193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.470218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.470337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.470428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.470452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.470573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.470684] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.470708] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.470800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.470915] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.470940] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.471067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.471162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.471187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.471270] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.471361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.471386] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.471484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.471571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.471597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.471687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.471772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.471797] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.471891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.471997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.472023] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.472117] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.472202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.472229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.472314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.472438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.472464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.472551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.472640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:36.920 [2024-11-30 04:32:27.472665] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:36.920 qpair failed and we were unable to recover it. 00:30:36.920 [2024-11-30 04:32:27.472759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.472930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.472963] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.473086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.473178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.473204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.473352] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.473441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.473468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.473557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.473650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.473675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.473771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.473892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.473917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.474016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.474102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.474128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.474223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.474303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.474328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.474424] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.474542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.474568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.474660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.474829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.474855] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.474950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.475046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.475071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.475154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.475251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.475276] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.475366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.475462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.475488] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.475612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.475704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.475730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.475823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.475913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.475939] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.197 qpair failed and we were unable to recover it. 00:30:37.197 [2024-11-30 04:32:27.476042] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.197 [2024-11-30 04:32:27.476137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.476164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.476257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.476345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.476370] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.476460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.476573] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.476598] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.476721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.476807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.476833] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.476922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.477056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.477083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.477173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.477257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.477281] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.477397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.477483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.477508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.477599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.477745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.477770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.477856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.477941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.477976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.478090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.478181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.478208] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.478339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.478425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.478452] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.478540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.478622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.478648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.478771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.478862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.478887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.478983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.479072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.479098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.479190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.479308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.479333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.479432] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.479514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.479539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.479633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.479720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.479745] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.479828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.479943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.479985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.480081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.480171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.480195] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.480287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.480377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.480402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.480508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.480614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.480642] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.480769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.480853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.480878] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.480976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.481072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.481097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.481196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.481283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.481308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.481401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.481487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.481513] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.481638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.481782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.481808] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.481896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.481991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.482016] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.482105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.482221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.482246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.482334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.482422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.198 [2024-11-30 04:32:27.482446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.198 qpair failed and we were unable to recover it. 00:30:37.198 [2024-11-30 04:32:27.482540] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.482624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.482648] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.482761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.482889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.482916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.483014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.483100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.483124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.483214] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.483296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.483320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.483402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.483481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.483505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.483596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.483710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.483735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.483856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.483973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.483998] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.484096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.484215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.484239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.484362] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.484472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.484496] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.484643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.484727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.484751] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.484843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.484933] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.484964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.485073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.485163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.485196] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.485283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.485372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.485396] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.485483] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.485595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.485619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.485713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.485796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.485820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.485906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.486007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.486032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.486153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.486239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.486263] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.486354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.486436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.486461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.486542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.486622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.486646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.486739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.486826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.486850] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.486971] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.487061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.487087] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.487207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.487291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.487316] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.487408] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.487495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.487521] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.487611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.487730] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.487754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.487848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.487931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.487955] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.488047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.488132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.488157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.488282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.488397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.488422] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.488510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.488601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.488625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.488746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.488835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.199 [2024-11-30 04:32:27.488859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.199 qpair failed and we were unable to recover it. 00:30:37.199 [2024-11-30 04:32:27.488947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.489038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.489062] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.489180] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.489267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.489291] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.489383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.489467] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.489491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.489591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.489678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.489702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.489817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.489902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.489927] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.490049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.490131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.490156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.490275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.490357] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.490381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.490478] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.490558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.490583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.490704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.490783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.490809] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.490904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.491019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.491051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.491137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.491222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.491246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.491338] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.491454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.491479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.491572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.491687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.491711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.491844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.491937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.491974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.492064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.492177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.492201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.492313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.492394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.492420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.492537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.492629] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.492654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.492736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.492848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.492873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.492967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.493087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.493111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.493205] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.493323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.493347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.493435] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.493517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.493542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.493675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.493754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.493778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.493864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.493949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.493980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.494098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.494220] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.494245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.494330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.494447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.494472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.494589] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.494670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.494696] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.494787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.494898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.494922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.495014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.495133] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.495158] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.495242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.495328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.495354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.200 qpair failed and we were unable to recover it. 00:30:37.200 [2024-11-30 04:32:27.495440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.200 [2024-11-30 04:32:27.495561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.495586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.495680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.495765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.495789] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.495871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.495966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.495993] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.496082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.496178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.496202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.496295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.496384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.496413] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.496498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.496595] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.496619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.496713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.496797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.496824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.496920] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.497046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.497072] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.497157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.497241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.497265] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.497363] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.497482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.497507] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.497599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.497693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.497718] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.497801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.497889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.497916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.498022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.498114] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.498140] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.498263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.498348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.498372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.498488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.498575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.498604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.498693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.498807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.498832] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.498924] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.499048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.499073] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.499197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.499280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.499305] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.499402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.499484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.499508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.499627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.499712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.499736] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.499853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.499941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.499973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.500061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.500151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.500176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.500294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.500381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.500406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.500495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.500577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.500601] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.500711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.500793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.500818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.500906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.501025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.501051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.501146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.501231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.501255] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.201 qpair failed and we were unable to recover it. 00:30:37.201 [2024-11-30 04:32:27.501368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.201 [2024-11-30 04:32:27.501480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.501505] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.501601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.501691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.501716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.501803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.501948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.501979] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.502071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.502166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.502190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.502280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.502393] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.502417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.502500] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.502583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.502607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.502693] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.502774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.502799] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.502898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.502985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.503011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.503099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.503182] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.503206] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.503318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.503404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.503428] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.503548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.503634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.503658] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.503744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.503860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.503884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.503977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.504061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.504085] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.504210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.504328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.504352] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.504469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.504558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.504583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.504679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.504763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.504788] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.504877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.504986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.505011] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.505095] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.505209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.505234] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.505322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.505422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.505447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.505535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.505655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.505683] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.505806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.505892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.505916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.506036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.506122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.506146] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.506269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.506351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.506375] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.506495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.506577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.506602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.506688] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.506794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.506818] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.506950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.507073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.507097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.202 [2024-11-30 04:32:27.507181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.507271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.202 [2024-11-30 04:32:27.507296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.202 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.507390] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.507485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.507510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.507594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.507709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.507734] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.507824] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.507931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.507964] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.508089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.508176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.508201] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.508293] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.508401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.508426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.508516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.508602] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.508626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.508713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.508800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.508825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.508976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.509092] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.509117] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.509230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.509321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.509348] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.509469] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.509552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.509577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.509671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.509755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.509780] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.509871] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.509994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.510024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.510112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.510197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.510223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.510345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.510457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.510482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.510571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.510657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.510682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.510768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.510855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.510881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.510995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.511077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.511102] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.511197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.511283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.511308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.511394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.511517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.511542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.511660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.511747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.511772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.511857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.511936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.511965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.512049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.512139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.512164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.512295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.512384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.512409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.512493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.512572] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.512597] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.512686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.512776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.512801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.512892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.512996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.513022] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.513146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.513224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.513248] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.513361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.513446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.513471] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.203 [2024-11-30 04:32:27.513562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.513675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.203 [2024-11-30 04:32:27.513699] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.203 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.513784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.513869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.513894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.513984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.514083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.514108] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.514208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.514289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.514313] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.514453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.514537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.514562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.514650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.514781] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.514806] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.514893] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.514983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.515008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.515099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.515213] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.515238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.515323] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.515413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.515438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.515557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.515647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.515672] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.515787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.515897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.515922] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.516054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.516148] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.516173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.516261] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.516347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.516372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.516487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.516605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.516630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.516714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.516829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.516854] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.516939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.517034] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.517059] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.517143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.517227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.517253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.517348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.517464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.517489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.517577] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.517657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.517682] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.517765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.517860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.517885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.518001] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.518093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.518118] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.518249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.518340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.518367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.518460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.518578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.518603] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.518746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.518837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.518862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.518951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.519093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.519119] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.519243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.519333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.519360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.519448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.519564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.519590] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.519712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.519835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.519861] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.519945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.520071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.520096] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.520212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.520325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.204 [2024-11-30 04:32:27.520350] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.204 qpair failed and we were unable to recover it. 00:30:37.204 [2024-11-30 04:32:27.520502] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.520588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.520612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.520710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.520797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.520822] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.520913] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.521031] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.521058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.521145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.521258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.521283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.521404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.521492] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.521522] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.521622] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.521707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.521733] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.521853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.521974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.522001] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.522091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.522179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.522204] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.522321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.522404] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.522429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.522517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.522605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.522631] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.522753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.522839] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.522865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.522984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.523079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.523104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.523193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.523340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.523364] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.523446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.523529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.523553] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.523670] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.523750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.523775] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.523868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.524015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.524041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.524126] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.524209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.524233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.524348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.524434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.524458] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.524541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.524654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.524679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.524773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.524855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.524880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.524994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.525081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.525105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.525221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.525337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.525362] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.525448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.525562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.525587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.525672] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.525789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.525815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.526008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.526097] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.526122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.526221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.526317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.526342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.526463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.526559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.526585] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.526673] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.526759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.526783] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.526872] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.526982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.205 [2024-11-30 04:32:27.527008] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.205 qpair failed and we were unable to recover it. 00:30:37.205 [2024-11-30 04:32:27.527130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.527219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.527244] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.527340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.527451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.527476] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.527562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.527654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.527679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.527759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.527850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.527875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.528038] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.528160] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.528186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.528280] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.528367] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.528393] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.528490] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.528579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.528604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.528695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.528817] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.528842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.528926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.529022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.529047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.529130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.529223] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.529247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.529346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.529462] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.529487] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.529601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.529712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.529737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.529823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.529936] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.529967] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.530053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.530167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.530192] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.530283] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.530401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.530426] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.530530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.530641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.530667] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.530760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.530874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.530899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.530988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.531109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.531134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.531251] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.531339] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.531363] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.531446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.531558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.531583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.531671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.531751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.531776] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.531862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.531980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.532006] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.532102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.532185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.532210] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.532294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.532411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.532436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.532522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.532638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.532664] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.532762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.532876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.206 [2024-11-30 04:32:27.532902] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.206 qpair failed and we were unable to recover it. 00:30:37.206 [2024-11-30 04:32:27.532992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.533079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.533109] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.533208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.533297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.533321] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.533447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.533557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.533581] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.533671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.533782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.533807] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.533902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.533995] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.534021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.534111] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.534222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.534246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.534394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.534480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.534504] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.534620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.534712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.534737] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.534826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.534942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.534974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.535091] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.535181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.535207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.535303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.535384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.535408] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.535533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.535641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.535666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.535749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.535858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.535882] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.536007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.536087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.536113] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.536204] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.536291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.536315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.536402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.536520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.536546] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.536661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.536742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.536767] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.536858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.536941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.536972] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.537087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.537232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.537257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.537381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.537501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.537526] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.537616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.537703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.537727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.537809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.537923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.537948] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.538046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.538130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.538155] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.538275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.538419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.538444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.538562] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.538646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.538670] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.538751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.538838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.538862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.538949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.539070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.539094] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.539179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.539265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.539290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.539381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.539524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.207 [2024-11-30 04:32:27.539549] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.207 qpair failed and we were unable to recover it. 00:30:37.207 [2024-11-30 04:32:27.539645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.539729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.539755] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.539840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.539925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.539949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.540077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.540158] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.540182] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.540266] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.540387] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.540412] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.540532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.540614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.540639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.540724] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.540806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.540830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.540917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.541036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.541061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.541188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.541276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.541300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.541425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.541507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.541532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.541620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.541727] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.541753] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.541864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.541952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.541983] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.542100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.542217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.542241] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.542332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.542422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.542447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.542535] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.542651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.542676] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.542801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.542890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.542915] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.543008] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.543099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.543123] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.543216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.543329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.543354] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.543447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.543536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.543561] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.543650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.543776] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.543801] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.543883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.543999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.544025] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.544121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.544212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.544238] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.544332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.544418] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.544442] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.544526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.544624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.544654] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.544752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.544903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.544929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.545030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.545109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.545134] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.545216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.545335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.545360] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.545482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.545598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.545624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.545743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.545837] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.545862] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.545950] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.546075] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.208 [2024-11-30 04:32:27.546100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.208 qpair failed and we were unable to recover it. 00:30:37.208 [2024-11-30 04:32:27.546195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.546278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.546304] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.546396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.546515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.546540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.546628] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.546714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.546739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.546833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.546979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.547009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.547139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.547221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.547246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.547334] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.547422] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.547446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.547561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.547642] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.547666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.547754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.547834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.547859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.547982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.548074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.548098] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.548190] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.548272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.548296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.548395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.548514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.548538] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.548658] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.548775] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.548800] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.548891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.549003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.549029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.549121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.549208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.549232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.549364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.549444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.549468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.549561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.549653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.549678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.549768] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.549851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.549876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.550004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.550089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.550114] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.550236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.550325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.550349] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.550444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.550530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.550555] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.550674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.550764] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.550790] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.550907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.551004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.551029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.551123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.551206] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.551231] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.551351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.551448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.551473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.551576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.551661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.551685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.551802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.551891] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.551917] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.552022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.552112] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.552136] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.552250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.552336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.552361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.552507] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.552597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.552622] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.209 qpair failed and we were unable to recover it. 00:30:37.209 [2024-11-30 04:32:27.552707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.209 [2024-11-30 04:32:27.552786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.552810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.552931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.553039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.553064] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.553159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.553242] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.553267] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.553389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.553477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.553501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.553591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.553702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.553728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.553819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.553967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.553994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.554085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.554202] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.554227] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.554322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.554403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.554429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.554548] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.554635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.554660] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.554783] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.554899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.554925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.555026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.555109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.555133] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.555250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.555333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.555358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.555445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.555561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.555586] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.555676] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.555788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.555813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.555918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.556030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.556056] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.556150] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.556265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.556290] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.556403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.556489] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.556514] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.556638] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.556732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.556756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.556847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.556929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.556953] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.557054] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.557137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.557163] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.557258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.557354] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.557379] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.557499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.557599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.557624] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.557711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.557807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.557831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.557955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.558071] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.558095] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.558188] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.558275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.558300] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.558383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.558468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.558497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.558616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.558702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.558726] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.558841] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.558939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.558970] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.559055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.559143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.559168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.210 qpair failed and we were unable to recover it. 00:30:37.210 [2024-11-30 04:32:27.559254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.210 [2024-11-30 04:32:27.559343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.559367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.559461] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.559579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.559604] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.559694] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.559788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.559813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.559926] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.560016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.560041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.560157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.560284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.560308] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.560402] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.560484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.560510] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.560596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.560705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.560730] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.560831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.560949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.560980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.561070] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.561154] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.561178] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.561267] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.561353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.561380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.561513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.561624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.561649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.561732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.561851] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.561875] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.561969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.562064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.562089] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.562185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.562299] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.562324] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.562439] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.562553] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.562578] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.562699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.562816] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.562842] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.562928] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.563052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.563078] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.563197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.563281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.563306] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.563388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.563506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.563532] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.563627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.563710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.563735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.563853] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.563974] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.564000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.564093] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.564183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.564207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.564328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.564468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.564495] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.564584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.564666] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.564690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.564782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.564901] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.564926] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.565047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.565161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.565186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.211 qpair failed and we were unable to recover it. 00:30:37.211 [2024-11-30 04:32:27.565277] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.565366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.211 [2024-11-30 04:32:27.565392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.565484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.565564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.565589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.565716] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.565811] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.565836] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.565962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.566055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.566080] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.566169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.566285] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.566310] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.566401] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.566485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.566509] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.566600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.566715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.566740] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.566836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.566930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.566956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.567053] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.567135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.567160] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.567272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.567383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.567407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.567495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.567583] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.567609] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.567692] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.567779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.567804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.567921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.568064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.568090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.568179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.568268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.568293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.568416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.568498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.568524] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.568645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.568737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.568762] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.568848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.568934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.568965] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.569068] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.569149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.569173] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.569262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.569353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.569378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.569495] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.569590] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.569615] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.569707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.569791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.569816] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.569930] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.570052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.570082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.570176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.570314] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.570339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.570426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.570510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.570535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.570625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.570745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.570770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.570882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.570966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.570991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.571088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.571172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.571199] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.571291] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.571376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.571400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.571488] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.571601] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.571626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.212 [2024-11-30 04:32:27.571714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.571828] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.212 [2024-11-30 04:32:27.571853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.212 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.571941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.572027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.572051] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.572151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.572235] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.572262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.572359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.572438] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.572464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.572559] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.572641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.572666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.572767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.572883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.572907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.572999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.573080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.573105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.573227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.573311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.573336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.573448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.573533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.573557] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.573645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.573733] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.573758] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.573848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.573931] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.573956] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.574083] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.574197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.574222] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.574346] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.574436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.574460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.574555] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.574636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.574661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.574755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.574878] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.574903] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.574994] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.575077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.575101] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.575189] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.575302] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.575327] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.575443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.575526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.575551] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.575650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.575767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.575792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.575904] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.575996] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.576021] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.576108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.576193] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.576218] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.576308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.576396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.576421] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.576504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.576621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.576646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.576782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.576895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.576924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.577055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.577143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.577169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.577258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.577376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.577402] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.577519] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.577604] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.577630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.577752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.577838] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.577864] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.577969] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.578086] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.578112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.213 [2024-11-30 04:32:27.578208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.578296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.213 [2024-11-30 04:32:27.578322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.213 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.578444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.578528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.578552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.578643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.578729] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.578754] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.578835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.578917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.578942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.579085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.579237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.579262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.579349] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.579437] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.579462] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.579550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.579637] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.579661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.579782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.579874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.579899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.580016] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.580113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.580138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.580229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.580347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.580373] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.580472] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.580557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.580582] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.580669] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.580785] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.580810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.580932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.581032] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.581058] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.581268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.581355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.581380] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.581480] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.581603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.581630] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.581720] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.581809] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.581837] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.581934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.582057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.582083] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.582175] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.582260] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.582285] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.582403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.582491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.582518] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.582610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.582722] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.582749] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.582867] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.582953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.582987] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.583073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.583194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.583219] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.583313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.583403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.583429] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.583521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.583680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.583707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.583796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.583889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.583920] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.584049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.584142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.584166] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.584324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.584443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.584468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.584584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.584704] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.584729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.584818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.584898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.584923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.214 qpair failed and we were unable to recover it. 00:30:37.214 [2024-11-30 04:32:27.585028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.585118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.214 [2024-11-30 04:32:27.585144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.585236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.585353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.585378] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.585468] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.585596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.585621] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.585709] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.585799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.585824] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.585914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.586039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.586067] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.586155] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.586244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.586275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.586368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.586451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.586475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.586591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.586675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.586701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.586812] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.586902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.586929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.587061] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.587157] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.587183] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.587272] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.587366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.587390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.587481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.587594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.587620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.587712] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.587830] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.587856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.587941] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.588096] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.588122] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.588244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.588331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.588358] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.588482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.588568] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.588602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.588687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.588780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.588805] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.588900] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.588984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.589010] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.589124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.589207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.589232] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.589353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.589464] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.589490] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.589591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.589710] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.589735] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.589819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.589903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.589929] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.590057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.590149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.590176] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.590281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.590397] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.590423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.590509] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.590623] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.590649] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.590742] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.590850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.590880] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.590980] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.591099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.215 [2024-11-30 04:32:27.591125] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.215 qpair failed and we were unable to recover it. 00:30:37.215 [2024-11-30 04:32:27.591217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.591303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.591330] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.591414] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.591530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.591556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.591648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.591762] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.591786] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.591874] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.591968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.591994] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.592082] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.592200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.592226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.592322] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.592446] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.592472] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.592564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.592653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.592679] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.592773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.592859] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.592884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.593003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.593118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.593143] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.593275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.593366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.593392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.593477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.593563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.593587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.593682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.593826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.593852] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.593976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.594064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.594090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.594181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.594264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.594289] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.594410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.594531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.594556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.594646] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.594737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.594763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.594876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.594982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.595009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.595139] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.595222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.595246] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.595327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.595412] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.595438] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.595593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.595689] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.595715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.595801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.595917] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.595943] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.596066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.596152] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.596179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.596265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.596348] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.596374] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.596498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.596612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.596637] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.596757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.596875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.596899] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.596988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.597103] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.597127] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.597222] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.597336] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.597361] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.597453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.597564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.597589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.216 [2024-11-30 04:32:27.597678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.597761] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.216 [2024-11-30 04:32:27.597787] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.216 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.597883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.598003] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.598029] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.598146] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.598232] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.598257] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.598372] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.598453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.598478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.598606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.598745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.598770] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.598862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.598943] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.598975] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.599094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.599208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.599233] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.599328] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.599413] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.599437] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.599532] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.599641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.599666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.599763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.599856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.599881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.599973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.600055] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.600081] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.600167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.600257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.600283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.600370] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.600463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.600489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.600584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.600695] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.600721] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.600855] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.600942] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.600974] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.601064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.601173] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.601200] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.601325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.601409] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.601435] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.601520] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.601610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.601635] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.601754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.601840] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.601865] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.601966] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.602060] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.602086] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.602183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.602269] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.602296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.602419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.602506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.602530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.602651] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.602731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.602756] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.602848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.602937] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.602980] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.603073] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.603163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.603187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.603276] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.603359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.603385] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.603501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.603593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.603619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.603714] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.603864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.603890] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.604011] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.604127] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.604152] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.217 [2024-11-30 04:32:27.604274] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.604394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.217 [2024-11-30 04:32:27.604419] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.217 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.604506] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.604588] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.604612] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.604734] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.604847] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.604871] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.604967] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.605087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.605112] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.605198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.605287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.605312] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.605431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.605543] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.605568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.605661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.605751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.605777] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.605870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.605963] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.605991] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.606087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.606183] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.606209] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.606333] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.606426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.606450] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.606536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.606626] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.606651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.606739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.606834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.606859] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.606997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.607109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.607138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.607258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.607377] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.607404] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.607499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.607619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.607645] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.607736] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.607827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.607853] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.607940] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.608064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.608090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.608179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.608294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.608320] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.608416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.608508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.608534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.608647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.608793] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.608819] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.608905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.609023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.609050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.609169] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.609247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.609273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.609392] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.609512] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.609537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.609660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.609778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.609804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.609897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.609985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.610013] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.610102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.610195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.610220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.610318] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.610434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.610461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.610542] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.610635] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.610661] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.610752] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.610869] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.610895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.218 qpair failed and we were unable to recover it. 00:30:37.218 [2024-11-30 04:32:27.610988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.611072] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.218 [2024-11-30 04:32:27.611097] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.611185] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.611271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.611296] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.611420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.611511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.611535] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.611631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.611753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.611778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.611863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.611953] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.611985] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.612099] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.612211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.612237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.612358] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.612445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.612470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.612591] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.612681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.612706] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.612797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.612888] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.612914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.613030] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.613144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.613169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.613254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.613375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.613400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.613521] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.613611] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.613636] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.613755] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.613870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.613895] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.613989] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.614084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.614110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.614209] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.614327] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.614353] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.614476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.614565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.614592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.614711] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.614792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.614817] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.614902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.615023] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.615049] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.615141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.615228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.615253] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.615374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.615457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.615482] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.615603] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.615748] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.615773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.615868] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.615954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.615986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.616108] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.616199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.616226] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.616320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.616440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.616466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.616557] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.616644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.616669] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.616760] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.616850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.616879] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.616997] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.617084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.617111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.617201] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.617282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.617311] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.617427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.617510] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.617534] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.219 qpair failed and we were unable to recover it. 00:30:37.219 [2024-11-30 04:32:27.617627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.219 [2024-11-30 04:32:27.617718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.617744] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.617829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.617944] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.617977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.618067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.618163] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.618189] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.618271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.618359] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.618384] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.618498] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.618641] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.618666] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.618778] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.618860] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.618885] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.618977] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.619064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.619090] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.619176] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.619271] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.619297] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.619416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.619561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.619587] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.619682] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.619772] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.619798] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.619895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.620009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.620035] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.620123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.620212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.620237] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.620324] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.620441] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.620466] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.620552] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.620665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.620691] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.620803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.620895] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.620925] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.621040] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.621124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.621149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.621243] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.621364] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.621391] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.621513] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.621616] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.621643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.621737] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.621862] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.621888] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.621991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.622081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.622106] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.622227] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.622313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.622338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.622427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.622514] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.622539] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.622634] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.622732] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.622757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.622848] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.622939] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.622973] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.623080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.623199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.623229] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.623331] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.623448] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.623473] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.220 qpair failed and we were unable to recover it. 00:30:37.220 [2024-11-30 04:32:27.623594] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.623701] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.220 [2024-11-30 04:32:27.623727] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.623827] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.623951] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.624002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.624094] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.624211] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.624236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.624326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.624445] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.624470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.624563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.624677] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.624701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.624820] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.624934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.624966] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.625064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.625145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.625169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.625257] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.625374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.625399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.625493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.625614] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.625646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.625746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.625834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.625858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.625945] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.626074] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.626100] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.626191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.626310] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.626335] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.626453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.626541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.626568] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.626655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.626767] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.626792] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.626914] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.627007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.627033] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.627123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.627210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.627236] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.627396] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.627481] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.627506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.627605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.627747] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.627772] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.627864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.627954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.628009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.628135] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.628221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.628247] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.628343] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.628453] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.628479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.628571] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.628691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.628715] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.628807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.628927] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.628952] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.629077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.629162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.629186] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.629282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.629398] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.629423] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.629556] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.629647] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.629685] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.629807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.629922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.629947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.630044] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.630130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.630154] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.221 [2024-11-30 04:32:27.630282] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.630366] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.221 [2024-11-30 04:32:27.630390] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.221 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.630487] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.630596] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.630620] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.630738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.630856] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.630881] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.630972] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.631113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.631138] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.631229] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.631317] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.631351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.631443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.631522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.631547] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.631668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.631756] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.631782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.631902] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.632015] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.632040] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.632153] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.632239] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.632268] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.632388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.632476] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.632502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.632600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.632685] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.632709] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.632826] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.632947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.632977] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.633079] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.633166] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.633191] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.633332] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.633428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.633454] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.633539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.633655] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.633680] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.633773] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.633858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.633884] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.634017] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.634137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.634164] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.634295] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.634381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.634405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.634491] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.634576] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.634602] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 04:32:27 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:37.222 [2024-11-30 04:32:27.634715] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 04:32:27 -- common/autotest_common.sh@862 -- # return 0 00:30:37.222 [2024-11-30 04:32:27.634796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.634821] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.634911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 04:32:27 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:30:37.222 [2024-11-30 04:32:27.635035] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.635061] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 04:32:27 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:37.222 [2024-11-30 04:32:27.635178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 04:32:27 -- common/autotest_common.sh@10 -- # set +x 00:30:37.222 [2024-11-30 04:32:27.635278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.635302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.635391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.635482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.635506] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.635605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.635691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.635716] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.635836] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.635979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.636005] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.636102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.636194] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.636220] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.636326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.636416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.636441] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.636538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.636621] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.636646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.222 [2024-11-30 04:32:27.636743] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.636844] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.222 [2024-11-30 04:32:27.636870] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.222 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.636954] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.637051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.637076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.637179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.637296] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.637338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.637499] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.637610] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.637639] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.637774] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.637866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.637894] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.638029] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.638125] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.638151] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.638238] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.638355] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.638381] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.638479] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.638569] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.638595] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.638717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.638804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.638831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.638923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.639018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.639045] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.639164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.639247] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.639273] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.639425] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.639526] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.639552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.639645] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.639777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.639804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.639905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.640004] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.640031] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.640122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.640212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.640239] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.640330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.640410] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.640436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.640534] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.640620] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.640646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.640749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.640863] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.640889] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.640979] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.641066] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.641092] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.641187] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.641284] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.641314] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.641440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.641531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.641558] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.641683] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.641801] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.641826] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.641919] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.642021] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.642048] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.642171] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.642263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.642288] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.642384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.642471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.642497] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.642624] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.642745] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.642771] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.642861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.642968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.642995] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.643084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.643199] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.643225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.643361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.643452] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.643478] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.223 [2024-11-30 04:32:27.643584] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.643702] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.223 [2024-11-30 04:32:27.643728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.223 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.643873] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.643955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.643990] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.644085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.644172] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.644198] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.644321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.644443] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.644468] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.644558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.644643] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.644668] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.644751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.644870] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.644896] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.644999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.645088] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.645115] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.645207] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.645297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.645322] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.645451] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.645551] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.645577] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.645705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.645794] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.645820] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.645968] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.646098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.646124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.646215] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.646307] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.646333] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.646457] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.646550] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.646575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.646699] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.646792] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.646823] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.646948] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.647050] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.647076] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.647167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.647289] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.647315] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.647411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.647528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.647554] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.647680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.647769] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.647796] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.647883] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.647976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.648003] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.648121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.648208] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.648235] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.648340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.648431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.648456] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.648541] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.648632] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.648657] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.648744] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.648865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.648891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.648999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.649149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.649179] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.649278] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.649368] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.649400] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.649493] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.649593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.649619] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.649738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.649819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.224 [2024-11-30 04:32:27.649845] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.224 qpair failed and we were unable to recover it. 00:30:37.224 [2024-11-30 04:32:27.649932] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.650067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.650093] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.650179] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.650303] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.650328] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.650421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.650537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.650562] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.650656] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.650738] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.650763] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.650866] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.650955] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.650986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.651081] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.651198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.651223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.651312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.651433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.651464] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.651578] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.651675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.651701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.651786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.651905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.651930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.652026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 04:32:27 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:30:37.225 [2024-11-30 04:32:27.652115] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.652141] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 04:32:27 -- host/target_disconnect.sh@19 -- # rpc_cmd bdev_malloc_create 64 512 -b Malloc0 00:30:37.225 [2024-11-30 04:32:27.652265] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.652365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.652392] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 04:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.652484] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 04:32:27 -- common/autotest_common.sh@10 -- # set +x 00:30:37.225 [2024-11-30 04:32:27.652598] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.652623] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.652746] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.652861] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.652887] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.652991] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.653105] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.653131] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.653233] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.653315] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.653342] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.653427] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.653511] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.653537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.653627] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.653713] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.653739] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.653864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.653988] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.654015] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.654140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.654236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.654261] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.654353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.654436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.654461] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.654581] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.654665] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.654690] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.654808] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.654889] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.654914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.655049] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.655143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.655170] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.655264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.655383] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.655409] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.655522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.655668] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.655695] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.655782] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.655865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.655891] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.656007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.656102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.656129] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.656250] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.656340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.225 [2024-11-30 04:32:27.656366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.225 qpair failed and we were unable to recover it. 00:30:37.225 [2024-11-30 04:32:27.656447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.656564] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.656589] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.656691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.656777] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.656802] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.656892] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.657025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.657052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.657178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.657275] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.657302] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.657395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.657515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.657542] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.657633] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.657753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.657778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.657875] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.657976] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.658002] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.658113] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.658200] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.658225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.658316] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.658447] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.658475] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.658563] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.658686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.658711] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.658802] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.658898] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.658923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.659052] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.659145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.659172] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.659264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.659388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.659414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.659537] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.659671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.659697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.659818] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.659934] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.659976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.660067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.660192] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.660217] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.660326] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.660421] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.660448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.660565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.660660] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.660686] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.660789] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.660903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.660928] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.661048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.661142] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.661168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.661263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.661382] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.661407] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.661503] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.661599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.661625] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.661718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.661806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.661831] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.661918] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.662024] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.662050] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.662136] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.662224] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.662250] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.662379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.662463] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.662489] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.662593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.662675] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.662701] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.662833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.662985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.663012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.226 [2024-11-30 04:32:27.663131] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.663217] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.226 [2024-11-30 04:32:27.663242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.226 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.663361] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.663475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.663501] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.663592] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.663680] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.663705] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.663807] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.663923] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.663949] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.664078] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.664230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.664256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.664388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.664482] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.664508] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.664606] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.664691] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.664717] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.664804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.664897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.664923] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.665027] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.665151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.665177] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.665300] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.665389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.665414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.665539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.665661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.665689] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.665787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.665903] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.665930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.666064] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.666162] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.666187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.666287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.666389] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.666414] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.666528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.666615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.666641] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.666739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.666829] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.666856] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.666985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.667102] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.667128] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.667218] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.667304] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.667331] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.667458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.667539] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.667564] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.667686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.667831] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.667857] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.667992] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.668145] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.668171] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.668264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.668381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.668406] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.668529] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.668648] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.668674] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.668797] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.668916] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.668942] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.669041] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.669161] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.669187] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.669294] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.669391] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.669417] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.669504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.669619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.669644] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.669763] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.669858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.669883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.670019] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.670121] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.670147] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.227 [2024-11-30 04:32:27.670264] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.670350] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.227 [2024-11-30 04:32:27.670376] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.227 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.670471] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.670599] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.670626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.670759] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.670850] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.670876] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.670978] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.671123] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.671149] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.671287] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.671376] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.671401] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.671530] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.671619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.671646] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.671741] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.671857] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.671883] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.671983] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.672085] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.672110] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.672230] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.672341] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.672366] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.672450] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.672533] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.672559] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.672654] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.672800] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.672825] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.672910] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.673025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.673052] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.673151] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.673240] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.673266] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.673388] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.673504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.673530] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.673649] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.673765] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.673791] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.673911] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.674018] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.674044] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.674170] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.674268] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.674293] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.674381] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.674475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.674502] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.674600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.674717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.674743] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.674865] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.674952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.674986] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.675107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.675198] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.675223] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.675319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.675416] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.675443] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.675575] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.675671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.675697] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.675784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.675907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.675933] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.676067] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.676167] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.676194] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.676290] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.676406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.676432] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.676528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.676617] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.676643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.676740] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.676833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.676860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.676999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.677118] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.677144] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.228 qpair failed and we were unable to recover it. 00:30:37.228 [2024-11-30 04:32:27.677241] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.228 [2024-11-30 04:32:27.677329] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.677355] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.677477] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.677565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.677592] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.677698] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 Malloc0 00:30:37.229 [2024-11-30 04:32:27.677780] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.677810] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.677925] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.678037] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.678063] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 04:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.229 [2024-11-30 04:32:27.678159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.678249] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.678275] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 04:32:27 -- host/target_disconnect.sh@21 -- # rpc_cmd nvmf_create_transport -t tcp -o 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.678395] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 04:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.229 [2024-11-30 04:32:27.678485] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.678511] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 04:32:27 -- common/autotest_common.sh@10 -- # set +x 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.678657] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.678751] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.678779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.678894] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.678985] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.679012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.679109] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.679197] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.679225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.679347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.679431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.679457] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.679561] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.679686] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.679712] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.679804] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.679884] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.679910] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.680047] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.680143] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.680168] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.680308] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.680394] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.680420] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.680522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.680636] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.680662] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.680806] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.680890] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.680916] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.681025] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.681119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.681145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.681236] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.681321] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.681347] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.681465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.681486] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:37.229 [2024-11-30 04:32:27.681582] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.681607] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.681700] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.681791] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.681815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.681906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.682014] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.682041] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.682140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.682234] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.682259] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.682375] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.682460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.682485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.682615] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.682731] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.682757] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.682876] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.682973] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.683000] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.229 qpair failed and we were unable to recover it. 00:30:37.229 [2024-11-30 04:32:27.683089] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.683181] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.229 [2024-11-30 04:32:27.683207] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.683337] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.683426] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.683451] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.683600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.683681] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.683707] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.683805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.683905] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.683930] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1cc000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.684051] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.684159] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.684190] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.684319] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.684420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.684447] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.684538] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.684631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.684656] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.684750] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.684835] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.684860] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.684949] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.685077] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.685104] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.685195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.685320] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.685345] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.685440] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.685536] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.685563] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.685662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.685749] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.685773] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.685864] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.685952] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.685984] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.686087] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.686177] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.686202] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.686330] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.686419] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.686444] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.686528] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.686619] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.686643] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.686739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.686832] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.686858] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.686986] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.687084] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.687111] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.687212] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.687313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.687338] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.687436] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.687516] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.687540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.687661] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.687753] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.687778] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.687896] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.687999] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.688024] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.688122] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.688219] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.688243] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.688374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.688466] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.688491] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.688587] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.688678] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.688702] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.688799] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.688887] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.688914] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.689028] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.689119] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.689145] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.689262] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.689384] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.689410] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.230 qpair failed and we were unable to recover it. 00:30:37.230 [2024-11-30 04:32:27.689504] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.230 [2024-11-30 04:32:27.689593] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.689618] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 04:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.231 [2024-11-30 04:32:27.689707] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.689819] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 04:32:27 -- host/target_disconnect.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 00:30:37.231 [2024-11-30 04:32:27.689844] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.689929] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 04:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.231 [2024-11-30 04:32:27.690022] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.690047] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 04:32:27 -- common/autotest_common.sh@10 -- # set +x 00:30:37.231 [2024-11-30 04:32:27.690149] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.690237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.690262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.690351] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.690475] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.690500] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.690612] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.690705] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.690729] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.690823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.690909] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.690936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.691039] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.691132] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.691156] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.691244] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.691347] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.691372] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.691465] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.691558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.691583] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.691674] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.691786] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.691811] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.691897] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.691993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.692019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.692140] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.692258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.692284] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d0000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.692403] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.692508] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.692537] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.692671] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.692757] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.692782] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.692906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.693007] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.693032] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.693124] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.693237] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.693262] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.693353] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.693444] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.693470] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.693579] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.693703] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.693728] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.693823] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.693912] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.693936] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.694090] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.694196] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.694225] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.694335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.694423] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.694448] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.694565] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.694653] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.694678] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.694796] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.694882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.694907] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.695009] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.695098] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.695124] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.695228] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.695313] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.695339] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.695458] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.695547] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.695573] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.695667] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.695788] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.695813] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.231 qpair failed and we were unable to recover it. 00:30:37.231 [2024-11-30 04:32:27.695907] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.696057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.231 [2024-11-30 04:32:27.696084] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.696174] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.696258] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.696283] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.696374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.696460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.696485] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.696605] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.696718] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.696742] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.696833] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.696921] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.696946] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.697048] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.697168] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.697193] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.697297] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.697411] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.697436] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.697558] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.697650] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.697675] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 04:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.232 [2024-11-30 04:32:27.697758] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.697843] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.697869] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 04:32:27 -- host/target_disconnect.sh@24 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Malloc0 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.697962] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 04:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.232 [2024-11-30 04:32:27.698056] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.698082] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 04:32:27 -- common/autotest_common.sh@10 -- # set +x 00:30:37.232 [2024-11-30 04:32:27.698178] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.698292] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.698317] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.698406] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.698501] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.698525] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.698644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.698771] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.698795] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.698877] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.698984] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.699009] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.699100] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.699221] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.699245] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.699365] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.699454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.699479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.699597] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.699679] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.699703] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.699787] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.699906] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.699932] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.700036] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.700130] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.700157] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.700254] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.700342] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.700367] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.700460] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.700549] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.700575] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.700697] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.700790] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.700815] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.700908] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.701020] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.701046] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.701137] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.701312] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.701337] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.701431] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.701517] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.701541] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.701662] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.701779] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.701804] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.701899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.701993] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.702019] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.702141] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.702231] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.702256] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.232 [2024-11-30 04:32:27.702345] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.702434] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.232 [2024-11-30 04:32:27.702460] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.232 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.702545] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.702631] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.702655] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.702784] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.702899] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.702924] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.703026] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.703107] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.703132] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.703253] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.703374] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.703399] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.703522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.703600] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.703626] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.703717] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.703803] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.703827] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.703947] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.704046] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.704070] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.704164] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.704281] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.704307] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.704420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.704531] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.704556] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.704644] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.704739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.704764] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.704858] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.704946] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.704976] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.705106] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.705195] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.705221] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.705340] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.705454] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.705479] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.705567] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.705687] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.705713] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 04:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.233 [2024-11-30 04:32:27.705834] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 04:32:27 -- host/target_disconnect.sh@25 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:30:37.233 [2024-11-30 04:32:27.705922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.705947] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 04:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.233 [2024-11-30 04:32:27.706057] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.706144] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 04:32:27 -- common/autotest_common.sh@10 -- # set +x 00:30:37.233 [2024-11-30 04:32:27.706169] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.706263] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.706379] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.706405] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.706524] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.706607] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.706632] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.706721] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.706805] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.706830] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.706922] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.707045] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.707071] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.707191] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.707311] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.707336] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.707428] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.707515] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.707540] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.707640] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.707754] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.707779] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x7fc1d8000b90 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.707882] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.707982] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.708012] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.233 [2024-11-30 04:32:27.708101] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.708216] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.233 [2024-11-30 04:32:27.708242] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.233 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.708335] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.708420] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.708446] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.708544] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.708625] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.708651] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.708739] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.708849] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.708873] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.708987] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.709080] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.709105] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.709210] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.709325] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.709351] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.709433] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.709522] posix.c:1032:posix_sock_create: *ERROR*: connect() failed, errno = 111 00:30:37.234 [2024-11-30 04:32:27.709552] nvme_tcp.c:2289:nvme_tcp_qpair_connect_sock: *ERROR*: sock connection error of tqpair=0x1ec0f20 with addr=10.0.0.2, port=4420 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.710043] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:30:37.234 [2024-11-30 04:32:27.712205] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.234 [2024-11-30 04:32:27.712336] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.234 [2024-11-30 04:32:27.712365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.234 [2024-11-30 04:32:27.712379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.234 [2024-11-30 04:32:27.712392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.234 [2024-11-30 04:32:27.712426] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 04:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.234 04:32:27 -- host/target_disconnect.sh@26 -- # rpc_cmd nvmf_subsystem_add_listener discovery -t tcp -a 10.0.0.2 -s 4420 00:30:37.234 04:32:27 -- common/autotest_common.sh@561 -- # xtrace_disable 00:30:37.234 04:32:27 -- common/autotest_common.sh@10 -- # set +x 00:30:37.234 04:32:27 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:30:37.234 04:32:27 -- host/target_disconnect.sh@58 -- # wait 2493893 00:30:37.234 [2024-11-30 04:32:27.722023] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.234 [2024-11-30 04:32:27.722119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.234 [2024-11-30 04:32:27.722146] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.234 [2024-11-30 04:32:27.722160] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.234 [2024-11-30 04:32:27.722173] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.234 [2024-11-30 04:32:27.722203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.732044] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.234 [2024-11-30 04:32:27.732140] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.234 [2024-11-30 04:32:27.732167] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.234 [2024-11-30 04:32:27.732182] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.234 [2024-11-30 04:32:27.732195] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.234 [2024-11-30 04:32:27.732223] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.742064] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.234 [2024-11-30 04:32:27.742162] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.234 [2024-11-30 04:32:27.742189] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.234 [2024-11-30 04:32:27.742203] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.234 [2024-11-30 04:32:27.742222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.234 [2024-11-30 04:32:27.742251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.752040] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.234 [2024-11-30 04:32:27.752134] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.234 [2024-11-30 04:32:27.752161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.234 [2024-11-30 04:32:27.752175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.234 [2024-11-30 04:32:27.752188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.234 [2024-11-30 04:32:27.752216] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.762070] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.234 [2024-11-30 04:32:27.762167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.234 [2024-11-30 04:32:27.762194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.234 [2024-11-30 04:32:27.762209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.234 [2024-11-30 04:32:27.762222] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.234 [2024-11-30 04:32:27.762250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.772363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.234 [2024-11-30 04:32:27.772499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.234 [2024-11-30 04:32:27.772524] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.234 [2024-11-30 04:32:27.772538] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.234 [2024-11-30 04:32:27.772551] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.234 [2024-11-30 04:32:27.772579] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.782172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.234 [2024-11-30 04:32:27.782282] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.234 [2024-11-30 04:32:27.782308] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.234 [2024-11-30 04:32:27.782322] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.234 [2024-11-30 04:32:27.782335] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.234 [2024-11-30 04:32:27.782363] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.792187] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.234 [2024-11-30 04:32:27.792286] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.234 [2024-11-30 04:32:27.792312] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.234 [2024-11-30 04:32:27.792327] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.234 [2024-11-30 04:32:27.792339] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.234 [2024-11-30 04:32:27.792367] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.234 [2024-11-30 04:32:27.802277] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.234 [2024-11-30 04:32:27.802382] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.234 [2024-11-30 04:32:27.802407] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.234 [2024-11-30 04:32:27.802421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.234 [2024-11-30 04:32:27.802435] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.234 [2024-11-30 04:32:27.802462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.234 qpair failed and we were unable to recover it. 00:30:37.493 [2024-11-30 04:32:27.812224] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.493 [2024-11-30 04:32:27.812321] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.493 [2024-11-30 04:32:27.812347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.493 [2024-11-30 04:32:27.812360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.493 [2024-11-30 04:32:27.812373] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.493 [2024-11-30 04:32:27.812402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.493 qpair failed and we were unable to recover it. 00:30:37.493 [2024-11-30 04:32:27.822212] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.493 [2024-11-30 04:32:27.822307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.493 [2024-11-30 04:32:27.822333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.493 [2024-11-30 04:32:27.822348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.493 [2024-11-30 04:32:27.822361] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.493 [2024-11-30 04:32:27.822388] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.493 qpair failed and we were unable to recover it. 00:30:37.493 [2024-11-30 04:32:27.832237] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.493 [2024-11-30 04:32:27.832349] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.493 [2024-11-30 04:32:27.832375] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.493 [2024-11-30 04:32:27.832389] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.493 [2024-11-30 04:32:27.832407] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.493 [2024-11-30 04:32:27.832436] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.493 qpair failed and we were unable to recover it. 00:30:37.493 [2024-11-30 04:32:27.842336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.493 [2024-11-30 04:32:27.842429] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.493 [2024-11-30 04:32:27.842455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.493 [2024-11-30 04:32:27.842469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.493 [2024-11-30 04:32:27.842482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.493 [2024-11-30 04:32:27.842510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.493 qpair failed and we were unable to recover it. 00:30:37.493 [2024-11-30 04:32:27.852365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.493 [2024-11-30 04:32:27.852500] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.493 [2024-11-30 04:32:27.852529] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.493 [2024-11-30 04:32:27.852545] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.493 [2024-11-30 04:32:27.852558] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.493 [2024-11-30 04:32:27.852587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.493 qpair failed and we were unable to recover it. 00:30:37.493 [2024-11-30 04:32:27.862349] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.493 [2024-11-30 04:32:27.862446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.493 [2024-11-30 04:32:27.862472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.493 [2024-11-30 04:32:27.862486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.493 [2024-11-30 04:32:27.862499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.493 [2024-11-30 04:32:27.862527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.493 qpair failed and we were unable to recover it. 00:30:37.493 [2024-11-30 04:32:27.872365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.493 [2024-11-30 04:32:27.872457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.493 [2024-11-30 04:32:27.872482] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.493 [2024-11-30 04:32:27.872496] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.493 [2024-11-30 04:32:27.872509] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.493 [2024-11-30 04:32:27.872537] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.493 qpair failed and we were unable to recover it. 00:30:37.493 [2024-11-30 04:32:27.882430] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.493 [2024-11-30 04:32:27.882546] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.493 [2024-11-30 04:32:27.882572] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.493 [2024-11-30 04:32:27.882586] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.493 [2024-11-30 04:32:27.882599] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.493 [2024-11-30 04:32:27.882627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.493 qpair failed and we were unable to recover it. 00:30:37.493 [2024-11-30 04:32:27.892408] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.493 [2024-11-30 04:32:27.892499] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.892525] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.892539] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.892552] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.892580] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:27.902501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:27.902595] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.902620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.902634] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.902647] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.902677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:27.912509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:27.912666] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.912696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.912723] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.912738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.912768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:27.922584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:27.922703] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.922729] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.922743] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.922762] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.922790] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:27.932497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:27.932601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.932627] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.932641] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.932656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.932683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:27.942533] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:27.942630] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.942655] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.942669] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.942682] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.942711] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:27.952588] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:27.952685] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.952711] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.952725] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.952738] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.952766] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:27.962635] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:27.962731] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.962757] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.962771] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.962784] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.962813] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:27.972646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:27.972739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.972764] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.972779] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.972792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.972819] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:27.982680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:27.982800] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.982828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.982843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.982855] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.982883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:27.992707] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:27.992803] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:27.992828] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:27.992843] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:27.992856] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:27.992883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:28.002745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:28.002833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:28.002860] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:28.002874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:28.002887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:28.002916] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:28.012777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:28.012871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:28.012898] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:28.012919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:28.012933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:28.012970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.494 qpair failed and we were unable to recover it. 00:30:37.494 [2024-11-30 04:32:28.022814] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.494 [2024-11-30 04:32:28.022928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.494 [2024-11-30 04:32:28.022963] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.494 [2024-11-30 04:32:28.022982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.494 [2024-11-30 04:32:28.022997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.494 [2024-11-30 04:32:28.023026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.495 qpair failed and we were unable to recover it. 00:30:37.495 [2024-11-30 04:32:28.032845] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.495 [2024-11-30 04:32:28.032939] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.495 [2024-11-30 04:32:28.032970] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.495 [2024-11-30 04:32:28.032986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.495 [2024-11-30 04:32:28.032999] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.495 [2024-11-30 04:32:28.033026] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.495 qpair failed and we were unable to recover it. 00:30:37.495 [2024-11-30 04:32:28.042853] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.495 [2024-11-30 04:32:28.042977] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.495 [2024-11-30 04:32:28.043003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.495 [2024-11-30 04:32:28.043017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.495 [2024-11-30 04:32:28.043030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.495 [2024-11-30 04:32:28.043058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.495 qpair failed and we were unable to recover it. 00:30:37.495 [2024-11-30 04:32:28.052869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.495 [2024-11-30 04:32:28.052970] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.495 [2024-11-30 04:32:28.052996] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.495 [2024-11-30 04:32:28.053010] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.495 [2024-11-30 04:32:28.053023] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.495 [2024-11-30 04:32:28.053051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.495 qpair failed and we were unable to recover it. 00:30:37.495 [2024-11-30 04:32:28.062946] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.495 [2024-11-30 04:32:28.063070] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.495 [2024-11-30 04:32:28.063099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.495 [2024-11-30 04:32:28.063114] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.495 [2024-11-30 04:32:28.063127] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.495 [2024-11-30 04:32:28.063156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.495 qpair failed and we were unable to recover it. 00:30:37.495 [2024-11-30 04:32:28.072952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.495 [2024-11-30 04:32:28.073061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.495 [2024-11-30 04:32:28.073087] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.495 [2024-11-30 04:32:28.073102] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.495 [2024-11-30 04:32:28.073115] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.495 [2024-11-30 04:32:28.073143] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.495 qpair failed and we were unable to recover it. 00:30:37.495 [2024-11-30 04:32:28.082980] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.495 [2024-11-30 04:32:28.083071] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.495 [2024-11-30 04:32:28.083097] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.495 [2024-11-30 04:32:28.083111] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.495 [2024-11-30 04:32:28.083124] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.495 [2024-11-30 04:32:28.083151] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.495 qpair failed and we were unable to recover it. 00:30:37.495 [2024-11-30 04:32:28.092991] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.495 [2024-11-30 04:32:28.093088] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.495 [2024-11-30 04:32:28.093114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.495 [2024-11-30 04:32:28.093128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.495 [2024-11-30 04:32:28.093141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.495 [2024-11-30 04:32:28.093170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.495 qpair failed and we were unable to recover it. 00:30:37.495 [2024-11-30 04:32:28.103137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.495 [2024-11-30 04:32:28.103257] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.495 [2024-11-30 04:32:28.103283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.495 [2024-11-30 04:32:28.103306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.495 [2024-11-30 04:32:28.103320] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.495 [2024-11-30 04:32:28.103348] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.495 qpair failed and we were unable to recover it. 00:30:37.495 [2024-11-30 04:32:28.113042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.495 [2024-11-30 04:32:28.113136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.495 [2024-11-30 04:32:28.113163] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.495 [2024-11-30 04:32:28.113177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.495 [2024-11-30 04:32:28.113190] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.495 [2024-11-30 04:32:28.113218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.495 qpair failed and we were unable to recover it. 00:30:37.753 [2024-11-30 04:32:28.123075] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.753 [2024-11-30 04:32:28.123167] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.753 [2024-11-30 04:32:28.123194] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.753 [2024-11-30 04:32:28.123208] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.753 [2024-11-30 04:32:28.123221] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.753 [2024-11-30 04:32:28.123249] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.753 qpair failed and we were unable to recover it. 00:30:37.753 [2024-11-30 04:32:28.133116] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.753 [2024-11-30 04:32:28.133207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.753 [2024-11-30 04:32:28.133233] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.753 [2024-11-30 04:32:28.133247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.753 [2024-11-30 04:32:28.133260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.753 [2024-11-30 04:32:28.133287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.753 qpair failed and we were unable to recover it. 00:30:37.753 [2024-11-30 04:32:28.143139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.753 [2024-11-30 04:32:28.143265] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.753 [2024-11-30 04:32:28.143290] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.753 [2024-11-30 04:32:28.143304] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.753 [2024-11-30 04:32:28.143318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.753 [2024-11-30 04:32:28.143346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.753 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.153223] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.153365] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.153391] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.153405] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.153419] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.153448] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.163183] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.163290] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.163315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.163329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.163342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.163370] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.173222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.173308] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.173335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.173349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.173362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.173390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.183328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.183440] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.183466] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.183482] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.183499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.183528] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.193276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.193372] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.193398] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.193419] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.193433] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.193462] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.203319] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.203414] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.203441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.203455] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.203468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.203496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.213374] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.213491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.213517] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.213531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.213544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.213572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.223435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.223553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.223579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.223593] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.223606] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.223634] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.233442] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.233538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.233565] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.233579] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.233593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.233621] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.243473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.243568] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.243594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.243609] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.243621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.243649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.253507] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.253601] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.253628] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.253642] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.253656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.253684] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.263556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.263678] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.263707] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.263722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.263735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.263763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.273558] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.754 [2024-11-30 04:32:28.273655] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.754 [2024-11-30 04:32:28.273681] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.754 [2024-11-30 04:32:28.273696] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.754 [2024-11-30 04:32:28.273709] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.754 [2024-11-30 04:32:28.273738] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.754 qpair failed and we were unable to recover it. 00:30:37.754 [2024-11-30 04:32:28.283657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.755 [2024-11-30 04:32:28.283750] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.755 [2024-11-30 04:32:28.283776] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.755 [2024-11-30 04:32:28.283797] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.755 [2024-11-30 04:32:28.283811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.755 [2024-11-30 04:32:28.283839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.755 qpair failed and we were unable to recover it. 00:30:37.755 [2024-11-30 04:32:28.293688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.755 [2024-11-30 04:32:28.293779] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.755 [2024-11-30 04:32:28.293805] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.755 [2024-11-30 04:32:28.293820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.755 [2024-11-30 04:32:28.293833] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.755 [2024-11-30 04:32:28.293861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.755 qpair failed and we were unable to recover it. 00:30:37.755 [2024-11-30 04:32:28.303617] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.755 [2024-11-30 04:32:28.303712] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.755 [2024-11-30 04:32:28.303738] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.755 [2024-11-30 04:32:28.303753] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.755 [2024-11-30 04:32:28.303766] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.755 [2024-11-30 04:32:28.303794] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.755 qpair failed and we were unable to recover it. 00:30:37.755 [2024-11-30 04:32:28.313688] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.755 [2024-11-30 04:32:28.313781] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.755 [2024-11-30 04:32:28.313807] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.755 [2024-11-30 04:32:28.313821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.755 [2024-11-30 04:32:28.313834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.755 [2024-11-30 04:32:28.313862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.755 qpair failed and we were unable to recover it. 00:30:37.755 [2024-11-30 04:32:28.323777] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.755 [2024-11-30 04:32:28.323910] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.755 [2024-11-30 04:32:28.323936] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.755 [2024-11-30 04:32:28.323951] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.755 [2024-11-30 04:32:28.323972] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.755 [2024-11-30 04:32:28.324002] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.755 qpair failed and we were unable to recover it. 00:30:37.755 [2024-11-30 04:32:28.333708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.755 [2024-11-30 04:32:28.333799] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.755 [2024-11-30 04:32:28.333825] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.755 [2024-11-30 04:32:28.333840] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.755 [2024-11-30 04:32:28.333853] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.755 [2024-11-30 04:32:28.333882] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.755 qpair failed and we were unable to recover it. 00:30:37.755 [2024-11-30 04:32:28.343837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.755 [2024-11-30 04:32:28.343942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.755 [2024-11-30 04:32:28.343981] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.755 [2024-11-30 04:32:28.343997] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.755 [2024-11-30 04:32:28.344011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.755 [2024-11-30 04:32:28.344039] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.755 qpair failed and we were unable to recover it. 00:30:37.755 [2024-11-30 04:32:28.353796] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.755 [2024-11-30 04:32:28.353890] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.755 [2024-11-30 04:32:28.353916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.755 [2024-11-30 04:32:28.353931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.755 [2024-11-30 04:32:28.353944] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.755 [2024-11-30 04:32:28.353982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.755 qpair failed and we were unable to recover it. 00:30:37.755 [2024-11-30 04:32:28.363827] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.755 [2024-11-30 04:32:28.363930] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.755 [2024-11-30 04:32:28.363965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.755 [2024-11-30 04:32:28.363982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.755 [2024-11-30 04:32:28.363997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.755 [2024-11-30 04:32:28.364025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.755 qpair failed and we were unable to recover it. 00:30:37.755 [2024-11-30 04:32:28.373841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:37.755 [2024-11-30 04:32:28.373936] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:37.755 [2024-11-30 04:32:28.373985] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:37.755 [2024-11-30 04:32:28.374006] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:37.755 [2024-11-30 04:32:28.374022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:37.755 [2024-11-30 04:32:28.374053] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:37.755 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.383856] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.383955] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.383989] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.384003] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.384016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.384046] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.393943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.394051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.394081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.394096] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.394109] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.394138] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.403945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.404054] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.404081] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.404095] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.404108] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.404136] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.414031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.414121] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.414148] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.414163] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.414175] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.414203] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.424015] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.424159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.424185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.424200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.424213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.424241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.434007] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.434100] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.434126] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.434140] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.434153] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.434181] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.444055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.444152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.444178] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.444193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.444206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.444234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.454097] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.454205] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.454232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.454246] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.454259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.454286] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.464139] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.464238] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.464272] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.464291] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.464305] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.464333] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.474127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.474225] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.474251] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.474265] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.474279] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.474307] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.484153] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.484243] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.484269] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.484284] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.484297] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.484325] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.494204] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.494294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.494320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.494335] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.494348] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.494376] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.504259] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.504397] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.504424] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.504439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.504452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.504486] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.514333] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.514437] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.514463] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.514477] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.514490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.514518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.013 [2024-11-30 04:32:28.524261] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.013 [2024-11-30 04:32:28.524353] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.013 [2024-11-30 04:32:28.524380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.013 [2024-11-30 04:32:28.524394] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.013 [2024-11-30 04:32:28.524408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.013 [2024-11-30 04:32:28.524435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.013 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.534314] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.534404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.534429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.534444] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.534457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.534485] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.544336] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.544450] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.544476] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.544490] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.544503] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.544531] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.554435] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.554558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.554591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.554608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.554620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.554649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.564393] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.564489] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.564516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.564531] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.564544] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.564571] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.574488] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.574583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.574610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.574625] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.574638] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.574666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.584464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.584567] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.584593] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.584608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.584621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.584649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.594509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.594605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.594631] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.594646] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.594659] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.594693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.604594] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.604700] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.604726] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.604740] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.604753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.604781] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.614576] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.614671] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.614697] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.614712] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.614725] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.614752] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.624671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.624801] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.624827] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.624841] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.624854] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.624883] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.014 [2024-11-30 04:32:28.634645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.014 [2024-11-30 04:32:28.634739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.014 [2024-11-30 04:32:28.634765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.014 [2024-11-30 04:32:28.634780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.014 [2024-11-30 04:32:28.634793] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.014 [2024-11-30 04:32:28.634822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.014 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.644695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.644792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.644823] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.644839] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.644852] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.644879] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.654651] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.654748] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.654775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.654789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.654802] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.654830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.664720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.664821] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.664847] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.664861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.664875] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.664902] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.674720] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.674833] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.674859] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.674874] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.674887] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.674915] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.684753] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.684856] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.684881] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.684895] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.684907] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.684941] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.694745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.694835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.694862] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.694876] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.694889] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.694917] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.704820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.704919] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.704946] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.704968] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.704984] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.705012] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.714802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.714893] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.714919] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.714934] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.714947] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.714988] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.724820] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.724912] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.724939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.724953] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.724973] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.725003] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.734945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.735068] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.735099] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.735115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.735128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.735156] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.744941] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.745053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.745079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.745094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.745107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.745135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.754962] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.755059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.755085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.755100] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.755113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.755141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.764952] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.765059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.765085] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.765099] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.765113] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.765141] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.774979] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.775084] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.775110] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.775124] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.775137] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.272 [2024-11-30 04:32:28.775171] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.272 qpair failed and we were unable to recover it. 00:30:38.272 [2024-11-30 04:32:28.785127] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.272 [2024-11-30 04:32:28.785268] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.272 [2024-11-30 04:32:28.785295] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.272 [2024-11-30 04:32:28.785309] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.272 [2024-11-30 04:32:28.785322] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.785350] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.795068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.795164] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.795190] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.795205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.795218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.795246] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.805071] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.805165] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.805191] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.805205] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.805218] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.805245] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.815115] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.815201] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.815227] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.815242] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.815255] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.815283] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.825121] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.825215] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.825247] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.825262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.825275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.825303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.835141] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.835232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.835258] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.835273] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.835285] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.835313] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.845181] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.845277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.845303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.845319] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.845332] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.845360] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.855296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.855392] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.855419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.855433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.855446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.855475] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.865241] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.865341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.865366] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.865381] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.865399] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.865428] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.875289] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.875418] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.875444] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.875458] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.875472] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.875499] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.885311] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.885401] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.885428] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.885442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.885455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.885482] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.273 [2024-11-30 04:32:28.895329] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.273 [2024-11-30 04:32:28.895422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.273 [2024-11-30 04:32:28.895448] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.273 [2024-11-30 04:32:28.895463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.273 [2024-11-30 04:32:28.895476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.273 [2024-11-30 04:32:28.895504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.273 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-30 04:32:28.905384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.531 [2024-11-30 04:32:28.905488] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.531 [2024-11-30 04:32:28.905514] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.531 [2024-11-30 04:32:28.905529] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.531 [2024-11-30 04:32:28.905542] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.531 [2024-11-30 04:32:28.905569] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-30 04:32:28.915467] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.531 [2024-11-30 04:32:28.915584] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.531 [2024-11-30 04:32:28.915610] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.531 [2024-11-30 04:32:28.915624] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.531 [2024-11-30 04:32:28.915637] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.531 [2024-11-30 04:32:28.915665] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-30 04:32:28.925446] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.531 [2024-11-30 04:32:28.925558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.531 [2024-11-30 04:32:28.925587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.531 [2024-11-30 04:32:28.925603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.531 [2024-11-30 04:32:28.925616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.531 [2024-11-30 04:32:28.925645] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-30 04:32:28.935457] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.531 [2024-11-30 04:32:28.935543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.531 [2024-11-30 04:32:28.935570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.531 [2024-11-30 04:32:28.935584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.531 [2024-11-30 04:32:28.935597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.531 [2024-11-30 04:32:28.935625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-30 04:32:28.945464] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.531 [2024-11-30 04:32:28.945558] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.531 [2024-11-30 04:32:28.945584] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.531 [2024-11-30 04:32:28.945598] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.531 [2024-11-30 04:32:28.945612] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.531 [2024-11-30 04:32:28.945639] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.531 qpair failed and we were unable to recover it. 00:30:38.531 [2024-11-30 04:32:28.955535] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.531 [2024-11-30 04:32:28.955631] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.531 [2024-11-30 04:32:28.955657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.531 [2024-11-30 04:32:28.955672] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.531 [2024-11-30 04:32:28.955690] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:28.955719] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:28.965575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:28.965698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:28.965725] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:28.965739] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:28.965753] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:28.965780] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:28.975578] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:28.975669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:28.975695] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:28.975709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:28.975722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:28.975750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:28.985631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:28.985739] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:28.985765] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:28.985780] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:28.985792] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:28.985822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:28.995673] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:28.995774] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:28.995803] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:28.995819] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:28.995832] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:28.995861] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:29.005764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:29.005883] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:29.005910] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:29.005925] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:29.005939] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:29.005975] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:29.015776] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:29.015871] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:29.015897] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:29.015912] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:29.015925] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:29.015953] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:29.025826] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:29.025925] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:29.025950] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:29.025979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:29.025996] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:29.026025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:29.035884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:29.036022] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:29.036049] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:29.036063] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:29.036076] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:29.036105] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:29.045806] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:29.045899] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:29.045925] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:29.045939] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:29.045963] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:29.045995] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:29.055869] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:29.055968] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:29.055995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:29.056009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:29.056022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:29.056051] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:29.065847] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:29.065945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:29.065979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:29.065994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:29.066007] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:29.066035] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:29.075881] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:29.076011] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:29.076038] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:29.076052] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:29.076065] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:29.076094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:29.085986] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:29.086083] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:29.086108] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.532 [2024-11-30 04:32:29.086123] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.532 [2024-11-30 04:32:29.086135] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.532 [2024-11-30 04:32:29.086164] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.532 qpair failed and we were unable to recover it. 00:30:38.532 [2024-11-30 04:32:29.095938] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.532 [2024-11-30 04:32:29.096053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.532 [2024-11-30 04:32:29.096080] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.533 [2024-11-30 04:32:29.096094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.533 [2024-11-30 04:32:29.096107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.533 [2024-11-30 04:32:29.096135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-30 04:32:29.106060] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.533 [2024-11-30 04:32:29.106197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.533 [2024-11-30 04:32:29.106222] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.533 [2024-11-30 04:32:29.106237] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.533 [2024-11-30 04:32:29.106250] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.533 [2024-11-30 04:32:29.106278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-30 04:32:29.116077] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.533 [2024-11-30 04:32:29.116173] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.533 [2024-11-30 04:32:29.116203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.533 [2024-11-30 04:32:29.116219] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.533 [2024-11-30 04:32:29.116232] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.533 [2024-11-30 04:32:29.116261] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-30 04:32:29.126014] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.533 [2024-11-30 04:32:29.126146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.533 [2024-11-30 04:32:29.126172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.533 [2024-11-30 04:32:29.126187] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.533 [2024-11-30 04:32:29.126200] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.533 [2024-11-30 04:32:29.126230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-30 04:32:29.136042] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.533 [2024-11-30 04:32:29.136151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.533 [2024-11-30 04:32:29.136176] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.533 [2024-11-30 04:32:29.136191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.533 [2024-11-30 04:32:29.136209] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.533 [2024-11-30 04:32:29.136238] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-30 04:32:29.146109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.533 [2024-11-30 04:32:29.146237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.533 [2024-11-30 04:32:29.146263] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.533 [2024-11-30 04:32:29.146277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.533 [2024-11-30 04:32:29.146290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.533 [2024-11-30 04:32:29.146319] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.533 [2024-11-30 04:32:29.156112] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.533 [2024-11-30 04:32:29.156230] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.533 [2024-11-30 04:32:29.156256] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.533 [2024-11-30 04:32:29.156271] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.533 [2024-11-30 04:32:29.156284] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.533 [2024-11-30 04:32:29.156311] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.533 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.166217] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.166313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.166339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.166353] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.166366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.166395] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.176134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.176222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.176248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.176262] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.176275] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.176303] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.186160] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.186253] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.186279] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.186293] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.186306] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.186336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.196242] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.196336] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.196362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.196378] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.196391] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.196420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.206222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.206320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.206346] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.206360] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.206374] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.206403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.216262] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.216393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.216419] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.216435] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.216449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.216477] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.226318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.226422] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.226452] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.226476] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.226490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.226519] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.236366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.236460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.236486] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.236500] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.236513] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.236543] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.246423] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.246519] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.246545] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.246559] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.246573] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.246601] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.256365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.256454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.256480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.256494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.256507] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.256535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.266407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.266502] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.266527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.266542] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.266555] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.266582] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.792 [2024-11-30 04:32:29.276553] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.792 [2024-11-30 04:32:29.276654] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.792 [2024-11-30 04:32:29.276683] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.792 [2024-11-30 04:32:29.276699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.792 [2024-11-30 04:32:29.276712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.792 [2024-11-30 04:32:29.276740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.792 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.286544] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.286641] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.286666] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.286680] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.286693] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.286721] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.296528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.296643] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.296670] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.296684] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.296697] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.296725] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.306512] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.306611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.306636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.306650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.306664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.306693] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.316584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.316726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.316752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.316773] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.316787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.316815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.326584] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.326687] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.326716] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.326731] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.326744] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.326774] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.336592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.336726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.336753] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.336767] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.336780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.336807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.346632] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.346727] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.346752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.346766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.346779] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.346807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.356666] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.356807] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.356835] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.356850] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.356864] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.356892] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.366735] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.366840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.366866] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.366880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.366894] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.366921] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.376739] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.376841] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.376867] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.376882] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.376896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.376923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.386784] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.386881] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.386906] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.386921] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.386934] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.386970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.396865] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.397002] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.397028] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.397043] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.397056] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.397086] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.406868] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.406974] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.407000] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.793 [2024-11-30 04:32:29.407020] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.793 [2024-11-30 04:32:29.407035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.793 [2024-11-30 04:32:29.407063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.793 qpair failed and we were unable to recover it. 00:30:38.793 [2024-11-30 04:32:29.416934] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:38.793 [2024-11-30 04:32:29.417032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:38.793 [2024-11-30 04:32:29.417058] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:38.794 [2024-11-30 04:32:29.417072] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:38.794 [2024-11-30 04:32:29.417091] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:38.794 [2024-11-30 04:32:29.417119] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:38.794 qpair failed and we were unable to recover it. 00:30:39.052 [2024-11-30 04:32:29.426943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.052 [2024-11-30 04:32:29.427051] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.052 [2024-11-30 04:32:29.427077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.052 [2024-11-30 04:32:29.427091] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.052 [2024-11-30 04:32:29.427104] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.052 [2024-11-30 04:32:29.427131] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.052 qpair failed and we were unable to recover it. 00:30:39.052 [2024-11-30 04:32:29.436914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.052 [2024-11-30 04:32:29.437044] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.052 [2024-11-30 04:32:29.437070] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.052 [2024-11-30 04:32:29.437085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.052 [2024-11-30 04:32:29.437097] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.052 [2024-11-30 04:32:29.437125] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.052 qpair failed and we were unable to recover it. 00:30:39.052 [2024-11-30 04:32:29.446949] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.052 [2024-11-30 04:32:29.447061] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.447089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.447104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.447117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.447147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.457072] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.457214] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.457244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.457259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.457272] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.457301] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.467022] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.467117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.467142] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.467156] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.467170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.467198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.477106] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.477200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.477226] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.477240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.477254] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.477281] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.487067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.487174] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.487203] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.487217] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.487230] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.487259] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.497107] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.497198] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.497224] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.497245] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.497259] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.497287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.507152] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.507254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.507280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.507294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.507307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.507336] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.517173] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.517271] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.517297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.517311] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.517324] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.517351] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.527175] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.527309] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.527335] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.527349] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.527363] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.527390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.537238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.537332] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.537357] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.537371] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.537385] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.537412] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.547238] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.547338] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.547363] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.547377] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.547390] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.547419] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.557346] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.557444] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.557470] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.557484] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.557497] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.557524] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.567296] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.567387] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.567413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.567427] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.567440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.053 [2024-11-30 04:32:29.567468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.053 qpair failed and we were unable to recover it. 00:30:39.053 [2024-11-30 04:32:29.577399] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.053 [2024-11-30 04:32:29.577506] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.053 [2024-11-30 04:32:29.577532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.053 [2024-11-30 04:32:29.577546] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.053 [2024-11-30 04:32:29.577560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.577587] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.054 [2024-11-30 04:32:29.587443] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.054 [2024-11-30 04:32:29.587538] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.054 [2024-11-30 04:32:29.587568] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.054 [2024-11-30 04:32:29.587584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.054 [2024-11-30 04:32:29.587597] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.587627] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.054 [2024-11-30 04:32:29.597372] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.054 [2024-11-30 04:32:29.597464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.054 [2024-11-30 04:32:29.597490] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.054 [2024-11-30 04:32:29.597505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.054 [2024-11-30 04:32:29.597518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.597545] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.054 [2024-11-30 04:32:29.607432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.054 [2024-11-30 04:32:29.607537] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.054 [2024-11-30 04:32:29.607562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.054 [2024-11-30 04:32:29.607577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.054 [2024-11-30 04:32:29.607590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.607618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.054 [2024-11-30 04:32:29.617545] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.054 [2024-11-30 04:32:29.617639] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.054 [2024-11-30 04:32:29.617665] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.054 [2024-11-30 04:32:29.617679] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.054 [2024-11-30 04:32:29.617692] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.617720] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.054 [2024-11-30 04:32:29.627504] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.054 [2024-11-30 04:32:29.627625] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.054 [2024-11-30 04:32:29.627650] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.054 [2024-11-30 04:32:29.627664] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.054 [2024-11-30 04:32:29.627677] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.627705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.054 [2024-11-30 04:32:29.637487] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.054 [2024-11-30 04:32:29.637579] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.054 [2024-11-30 04:32:29.637604] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.054 [2024-11-30 04:32:29.637618] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.054 [2024-11-30 04:32:29.637631] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.637661] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.054 [2024-11-30 04:32:29.647568] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.054 [2024-11-30 04:32:29.647688] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.054 [2024-11-30 04:32:29.647713] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.054 [2024-11-30 04:32:29.647727] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.054 [2024-11-30 04:32:29.647740] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.647768] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.054 [2024-11-30 04:32:29.657580] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.054 [2024-11-30 04:32:29.657677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.054 [2024-11-30 04:32:29.657703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.054 [2024-11-30 04:32:29.657719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.054 [2024-11-30 04:32:29.657732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.657760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.054 [2024-11-30 04:32:29.667602] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.054 [2024-11-30 04:32:29.667735] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.054 [2024-11-30 04:32:29.667760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.054 [2024-11-30 04:32:29.667774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.054 [2024-11-30 04:32:29.667788] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.667815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.054 [2024-11-30 04:32:29.677654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.054 [2024-11-30 04:32:29.677755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.054 [2024-11-30 04:32:29.677797] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.054 [2024-11-30 04:32:29.677812] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.054 [2024-11-30 04:32:29.677825] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.054 [2024-11-30 04:32:29.677853] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.054 qpair failed and we were unable to recover it. 00:30:39.313 [2024-11-30 04:32:29.687629] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.313 [2024-11-30 04:32:29.687730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.313 [2024-11-30 04:32:29.687755] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.313 [2024-11-30 04:32:29.687769] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.313 [2024-11-30 04:32:29.687781] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.313 [2024-11-30 04:32:29.687808] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.313 qpair failed and we were unable to recover it. 00:30:39.313 [2024-11-30 04:32:29.697708] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.313 [2024-11-30 04:32:29.697804] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.313 [2024-11-30 04:32:29.697829] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.313 [2024-11-30 04:32:29.697844] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.313 [2024-11-30 04:32:29.697857] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.313 [2024-11-30 04:32:29.697884] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.313 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.707802] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.707896] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.707921] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.707935] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.707953] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.707989] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.717774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.717876] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.717903] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.717917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.717930] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.717982] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.727781] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.727866] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.727891] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.727905] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.727918] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.727945] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.737822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.737922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.737965] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.737982] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.737997] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.738025] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.747860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.747976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.748001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.748016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.748030] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.748059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.757876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.757978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.758004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.758019] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.758032] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.758059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.767923] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.768032] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.768066] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.768082] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.768095] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.768123] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.778035] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.778169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.778195] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.778209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.778223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.778250] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.788004] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.788099] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.788125] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.788139] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.788152] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.788180] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.798137] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.798234] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.798260] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.798274] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.798288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.798315] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.808146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.808237] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.808262] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.808276] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.808290] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.808323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.818118] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.818216] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.818242] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.818256] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.818269] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.818296] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.314 qpair failed and we were unable to recover it. 00:30:39.314 [2024-11-30 04:32:29.828166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.314 [2024-11-30 04:32:29.828264] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.314 [2024-11-30 04:32:29.828289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.314 [2024-11-30 04:32:29.828303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.314 [2024-11-30 04:32:29.828317] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.314 [2024-11-30 04:32:29.828344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.838079] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.838207] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.838232] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.838247] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.838260] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.838287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.848166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.848263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.848288] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.848302] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.848315] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.848343] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.858172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.858279] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.858313] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.858329] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.858342] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.858369] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.868213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.868310] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.868334] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.868348] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.868362] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.868390] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.878209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.878302] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.878331] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.878346] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.878359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.878387] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.888250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.888340] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.888365] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.888379] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.888392] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.888420] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.898279] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.898369] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.898395] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.898410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.898423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.898456] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.908426] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.908553] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.908579] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.908592] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.908605] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.908633] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.918318] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.918415] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.918441] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.918455] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.918468] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.918496] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.928365] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.928454] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.928480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.928494] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.928506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.928535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.315 [2024-11-30 04:32:29.938473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.315 [2024-11-30 04:32:29.938604] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.315 [2024-11-30 04:32:29.938629] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.315 [2024-11-30 04:32:29.938643] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.315 [2024-11-30 04:32:29.938656] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.315 [2024-11-30 04:32:29.938683] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.315 qpair failed and we were unable to recover it. 00:30:39.574 [2024-11-30 04:32:29.948445] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.574 [2024-11-30 04:32:29.948581] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.574 [2024-11-30 04:32:29.948611] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.574 [2024-11-30 04:32:29.948626] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.574 [2024-11-30 04:32:29.948639] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.574 [2024-11-30 04:32:29.948666] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.574 qpair failed and we were unable to recover it. 00:30:39.574 [2024-11-30 04:32:29.958480] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.574 [2024-11-30 04:32:29.958605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.574 [2024-11-30 04:32:29.958631] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.574 [2024-11-30 04:32:29.958645] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.574 [2024-11-30 04:32:29.958658] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.574 [2024-11-30 04:32:29.958685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.574 qpair failed and we were unable to recover it. 00:30:39.574 [2024-11-30 04:32:29.968496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.574 [2024-11-30 04:32:29.968597] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.574 [2024-11-30 04:32:29.968623] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.574 [2024-11-30 04:32:29.968637] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.574 [2024-11-30 04:32:29.968650] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.574 [2024-11-30 04:32:29.968677] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:29.978529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:29.978620] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:29.978646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:29.978660] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:29.978674] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:29.978702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:29.988550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:29.988650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:29.988675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:29.988689] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:29.988702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:29.988736] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:29.998571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:29.998669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:29.998694] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:29.998709] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:29.998722] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:29.998750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.008615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.008745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.008775] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:30.008790] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:30.008803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:30.008846] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.018670] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.018782] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.018811] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:30.018825] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:30.018838] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:30.018868] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.028771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.028873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.028900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:30.028916] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:30.028929] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:30.028966] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.038725] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.038835] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.038888] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:30.038919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:30.038933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:30.038970] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.048737] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.048837] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.048865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:30.048880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:30.048893] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:30.048923] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.058812] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.058917] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.058943] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:30.058975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:30.058990] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:30.059020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.068822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.068924] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.068954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:30.068979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:30.068994] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:30.069031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.078821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.078971] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.078998] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:30.079012] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:30.079041] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:30.079070] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.088910] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.089053] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.089079] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:30.089094] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:30.089107] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:30.089135] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.098876] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.098981] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.099007] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.575 [2024-11-30 04:32:30.099022] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.575 [2024-11-30 04:32:30.099035] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.575 [2024-11-30 04:32:30.099063] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.575 qpair failed and we were unable to recover it. 00:30:39.575 [2024-11-30 04:32:30.108914] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.575 [2024-11-30 04:32:30.109036] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.575 [2024-11-30 04:32:30.109078] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.576 [2024-11-30 04:32:30.109093] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.576 [2024-11-30 04:32:30.109106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.576 [2024-11-30 04:32:30.109134] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.576 qpair failed and we were unable to recover it. 00:30:39.576 [2024-11-30 04:32:30.118920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.576 [2024-11-30 04:32:30.119035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.576 [2024-11-30 04:32:30.119061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.576 [2024-11-30 04:32:30.119075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.576 [2024-11-30 04:32:30.119088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.576 [2024-11-30 04:32:30.119115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.576 qpair failed and we were unable to recover it. 00:30:39.576 [2024-11-30 04:32:30.128946] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.576 [2024-11-30 04:32:30.129048] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.576 [2024-11-30 04:32:30.129077] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.576 [2024-11-30 04:32:30.129092] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.576 [2024-11-30 04:32:30.129106] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.576 [2024-11-30 04:32:30.129133] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.576 qpair failed and we were unable to recover it. 00:30:39.576 [2024-11-30 04:32:30.139050] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.576 [2024-11-30 04:32:30.139159] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.576 [2024-11-30 04:32:30.139185] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.576 [2024-11-30 04:32:30.139200] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.576 [2024-11-30 04:32:30.139213] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.576 [2024-11-30 04:32:30.139241] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.576 qpair failed and we were unable to recover it. 00:30:39.576 [2024-11-30 04:32:30.149027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.576 [2024-11-30 04:32:30.149136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.576 [2024-11-30 04:32:30.149162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.576 [2024-11-30 04:32:30.149176] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.576 [2024-11-30 04:32:30.149189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.576 [2024-11-30 04:32:30.149219] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.576 qpair failed and we were unable to recover it. 00:30:39.576 [2024-11-30 04:32:30.159031] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.576 [2024-11-30 04:32:30.159127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.576 [2024-11-30 04:32:30.159153] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.576 [2024-11-30 04:32:30.159167] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.576 [2024-11-30 04:32:30.159180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.576 [2024-11-30 04:32:30.159208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.576 qpair failed and we were unable to recover it. 00:30:39.576 [2024-11-30 04:32:30.169100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.576 [2024-11-30 04:32:30.169191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.576 [2024-11-30 04:32:30.169216] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.576 [2024-11-30 04:32:30.169230] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.576 [2024-11-30 04:32:30.169249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.576 [2024-11-30 04:32:30.169278] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.576 qpair failed and we were unable to recover it. 00:30:39.576 [2024-11-30 04:32:30.179134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.576 [2024-11-30 04:32:30.179229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.576 [2024-11-30 04:32:30.179254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.576 [2024-11-30 04:32:30.179269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.576 [2024-11-30 04:32:30.179282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.576 [2024-11-30 04:32:30.179310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.576 qpair failed and we were unable to recover it. 00:30:39.576 [2024-11-30 04:32:30.189129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.576 [2024-11-30 04:32:30.189229] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.576 [2024-11-30 04:32:30.189254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.576 [2024-11-30 04:32:30.189268] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.576 [2024-11-30 04:32:30.189281] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.576 [2024-11-30 04:32:30.189309] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.576 qpair failed and we were unable to recover it. 00:30:39.576 [2024-11-30 04:32:30.199146] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.576 [2024-11-30 04:32:30.199254] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.576 [2024-11-30 04:32:30.199280] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.576 [2024-11-30 04:32:30.199294] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.576 [2024-11-30 04:32:30.199307] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.576 [2024-11-30 04:32:30.199335] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.576 qpair failed and we were unable to recover it. 00:30:39.835 [2024-11-30 04:32:30.209192] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.835 [2024-11-30 04:32:30.209287] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.835 [2024-11-30 04:32:30.209315] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.835 [2024-11-30 04:32:30.209330] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.835 [2024-11-30 04:32:30.209344] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.835 [2024-11-30 04:32:30.209371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.835 qpair failed and we were unable to recover it. 00:30:39.835 [2024-11-30 04:32:30.219294] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.835 [2024-11-30 04:32:30.219389] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.835 [2024-11-30 04:32:30.219415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.219429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.219443] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.219471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.229284] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.229381] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.229406] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.229421] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.229434] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.229473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.239276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.239364] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.239390] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.239404] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.239417] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.239444] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.249347] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.249436] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.249461] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.249475] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.249488] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.249516] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.259369] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.259485] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.259511] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.259524] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.259543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.259572] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.269363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.269466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.269495] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.269511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.269524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.269553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.279411] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.279507] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.279532] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.279547] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.279560] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.279588] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.289492] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.289593] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.289618] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.289633] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.289648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.289678] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.299455] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.299547] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.299574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.299588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.299601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.299629] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.309509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.309610] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.309636] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.309651] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.309664] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.309692] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.319526] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.319615] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.319641] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.319655] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.319669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.319696] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.329552] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.329650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.329678] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.329693] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.329707] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.329735] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.339569] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.339669] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.339696] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.339710] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.339723] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.836 [2024-11-30 04:32:30.339750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.836 qpair failed and we were unable to recover it. 00:30:39.836 [2024-11-30 04:32:30.349701] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.836 [2024-11-30 04:32:30.349800] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.836 [2024-11-30 04:32:30.349826] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.836 [2024-11-30 04:32:30.349846] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.836 [2024-11-30 04:32:30.349860] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.349890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.359716] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.359809] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.359834] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.359849] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.359862] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.359890] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.369656] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.369783] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.369809] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.369823] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.369836] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.369864] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.379695] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.379794] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.379820] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.379834] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.379847] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.379875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.389743] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.389840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.389865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.389879] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.389892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.389920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.399727] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.399850] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.399875] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.399890] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.399903] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.399930] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.409854] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.409945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.409977] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.409992] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.410006] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.410034] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.419816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.419928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.419954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.419979] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.419993] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.420020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.429873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.430013] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.430039] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.430053] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.430066] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.430094] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.439899] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.440000] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.440026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.440045] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.440059] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.440087] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.449916] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.450017] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.450042] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.450056] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.450070] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.450098] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:39.837 [2024-11-30 04:32:30.459915] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:39.837 [2024-11-30 04:32:30.460010] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:39.837 [2024-11-30 04:32:30.460036] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:39.837 [2024-11-30 04:32:30.460050] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:39.837 [2024-11-30 04:32:30.460064] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:39.837 [2024-11-30 04:32:30.460093] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:39.837 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.469945] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.470059] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.470089] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.470104] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.470117] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.470147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.480002] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.480112] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.480138] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.480153] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.480166] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.480194] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.490000] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.490119] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.490144] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.490158] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.490171] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.490199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.500026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.500123] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.500150] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.500164] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.500178] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.500205] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.510076] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.510170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.510196] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.510213] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.510228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.510256] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.520095] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.520191] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.520217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.520231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.520244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.520272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.530203] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.530294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.530320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.530340] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.530354] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.530382] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.540129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.540228] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.540254] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.540269] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.540282] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.540310] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.550199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.550298] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.550323] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.550337] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.550350] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.550377] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.560199] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.560291] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.560317] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.560331] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.560343] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.560371] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.570302] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.570399] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.570425] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.570439] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.570452] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.570480] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.580268] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.580362] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.580387] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.580402] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.096 [2024-11-30 04:32:30.580415] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.096 [2024-11-30 04:32:30.580443] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.096 qpair failed and we were unable to recover it. 00:30:40.096 [2024-11-30 04:32:30.590366] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.096 [2024-11-30 04:32:30.590466] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.096 [2024-11-30 04:32:30.590491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.096 [2024-11-30 04:32:30.590505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.590518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.590546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.600363] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.600464] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.600491] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.600505] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.600518] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.600546] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.610425] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.610526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.610552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.610566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.610580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.610608] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.620424] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.620520] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.620546] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.620566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.620580] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.620609] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.630482] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.630583] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.630609] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.630623] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.630636] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.630664] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.640529] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.640621] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.640648] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.640662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.640675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.640702] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.650473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.650566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.650591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.650605] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.650619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.650646] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.660525] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.660616] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.660642] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.660656] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.660669] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.660697] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.670575] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.670677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.670705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.670722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.670735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.670764] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.680561] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.680659] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.680685] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.680699] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.680712] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.680740] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.690614] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.690745] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.690769] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.690783] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.690795] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.690822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.700680] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.700775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.700801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.700815] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.700828] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.700856] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.710658] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.710755] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.710780] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.710802] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.710815] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.710843] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.097 [2024-11-30 04:32:30.720671] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.097 [2024-11-30 04:32:30.720768] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.097 [2024-11-30 04:32:30.720793] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.097 [2024-11-30 04:32:30.720807] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.097 [2024-11-30 04:32:30.720820] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.097 [2024-11-30 04:32:30.720847] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.097 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-30 04:32:30.730718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.356 [2024-11-30 04:32:30.730815] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.356 [2024-11-30 04:32:30.730840] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.356 [2024-11-30 04:32:30.730855] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.356 [2024-11-30 04:32:30.730868] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.356 [2024-11-30 04:32:30.730896] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-30 04:32:30.740755] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.356 [2024-11-30 04:32:30.740848] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.356 [2024-11-30 04:32:30.740874] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.356 [2024-11-30 04:32:30.740888] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.356 [2024-11-30 04:32:30.740902] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.356 [2024-11-30 04:32:30.740929] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-30 04:32:30.750884] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.356 [2024-11-30 04:32:30.750988] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.356 [2024-11-30 04:32:30.751017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.356 [2024-11-30 04:32:30.751031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.356 [2024-11-30 04:32:30.751044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.356 [2024-11-30 04:32:30.751072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-30 04:32:30.760906] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.356 [2024-11-30 04:32:30.761047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.356 [2024-11-30 04:32:30.761073] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.356 [2024-11-30 04:32:30.761087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.356 [2024-11-30 04:32:30.761100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.356 [2024-11-30 04:32:30.761129] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-30 04:32:30.770889] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.356 [2024-11-30 04:32:30.770994] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.356 [2024-11-30 04:32:30.771020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.356 [2024-11-30 04:32:30.771034] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.356 [2024-11-30 04:32:30.771047] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.356 [2024-11-30 04:32:30.771074] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-30 04:32:30.780848] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.356 [2024-11-30 04:32:30.780945] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.356 [2024-11-30 04:32:30.780979] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.356 [2024-11-30 04:32:30.780994] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.356 [2024-11-30 04:32:30.781008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.356 [2024-11-30 04:32:30.781037] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-30 04:32:30.790888] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.356 [2024-11-30 04:32:30.790991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.356 [2024-11-30 04:32:30.791017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.356 [2024-11-30 04:32:30.791031] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.356 [2024-11-30 04:32:30.791044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.356 [2024-11-30 04:32:30.791072] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-30 04:32:30.800929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.356 [2024-11-30 04:32:30.801038] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.356 [2024-11-30 04:32:30.801069] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.356 [2024-11-30 04:32:30.801085] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.356 [2024-11-30 04:32:30.801098] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.356 [2024-11-30 04:32:30.801126] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-30 04:32:30.810943] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.356 [2024-11-30 04:32:30.811039] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.356 [2024-11-30 04:32:30.811065] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.356 [2024-11-30 04:32:30.811079] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.356 [2024-11-30 04:32:30.811092] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.356 [2024-11-30 04:32:30.811120] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.356 qpair failed and we were unable to recover it. 00:30:40.356 [2024-11-30 04:32:30.821016] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.356 [2024-11-30 04:32:30.821127] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.821152] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.821166] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.821180] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.821208] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.831067] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.831197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.831222] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.831236] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.831249] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.831277] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.841052] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.841169] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.841198] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.841212] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.841225] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.841253] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.851119] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.851218] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.851244] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.851258] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.851271] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.851299] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.861101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.861193] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.861219] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.861233] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.861246] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.861275] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.871140] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.871266] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.871291] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.871306] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.871318] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.871346] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.881247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.881342] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.881368] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.881383] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.881396] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.881423] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.891248] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.891341] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.891372] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.891387] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.891400] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.891427] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.901361] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.901460] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.901485] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.901499] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.901512] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.901541] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.911276] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.911374] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.911399] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.911413] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.911426] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.911454] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.921321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.921456] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.921481] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.921495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.921508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.921535] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.931359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.931453] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.931478] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.931493] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.931506] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.931540] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.941407] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.941533] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.941562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.357 [2024-11-30 04:32:30.941577] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.357 [2024-11-30 04:32:30.941590] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.357 [2024-11-30 04:32:30.941618] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.357 qpair failed and we were unable to recover it. 00:30:40.357 [2024-11-30 04:32:30.951378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.357 [2024-11-30 04:32:30.951475] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.357 [2024-11-30 04:32:30.951501] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.358 [2024-11-30 04:32:30.951515] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.358 [2024-11-30 04:32:30.951528] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.358 [2024-11-30 04:32:30.951556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-30 04:32:30.961432] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.358 [2024-11-30 04:32:30.961526] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.358 [2024-11-30 04:32:30.961552] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.358 [2024-11-30 04:32:30.961566] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.358 [2024-11-30 04:32:30.961579] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.358 [2024-11-30 04:32:30.961607] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-30 04:32:30.971550] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.358 [2024-11-30 04:32:30.971663] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.358 [2024-11-30 04:32:30.971692] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.358 [2024-11-30 04:32:30.971708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.358 [2024-11-30 04:32:30.971721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.358 [2024-11-30 04:32:30.971750] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.358 [2024-11-30 04:32:30.981497] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.358 [2024-11-30 04:32:30.981589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.358 [2024-11-30 04:32:30.981620] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.358 [2024-11-30 04:32:30.981635] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.358 [2024-11-30 04:32:30.981648] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.358 [2024-11-30 04:32:30.981676] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.358 qpair failed and we were unable to recover it. 00:30:40.616 [2024-11-30 04:32:30.991503] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.616 [2024-11-30 04:32:30.991628] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.616 [2024-11-30 04:32:30.991657] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.616 [2024-11-30 04:32:30.991671] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.616 [2024-11-30 04:32:30.991684] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.616 [2024-11-30 04:32:30.991712] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.616 qpair failed and we were unable to recover it. 00:30:40.616 [2024-11-30 04:32:31.001645] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.616 [2024-11-30 04:32:31.001780] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.616 [2024-11-30 04:32:31.001806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.616 [2024-11-30 04:32:31.001820] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.616 [2024-11-30 04:32:31.001834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.616 [2024-11-30 04:32:31.001862] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.616 qpair failed and we were unable to recover it. 00:30:40.616 [2024-11-30 04:32:31.011571] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.616 [2024-11-30 04:32:31.011677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.616 [2024-11-30 04:32:31.011703] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.616 [2024-11-30 04:32:31.011718] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.616 [2024-11-30 04:32:31.011731] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.616 [2024-11-30 04:32:31.011758] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.616 qpair failed and we were unable to recover it. 00:30:40.616 [2024-11-30 04:32:31.021579] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.616 [2024-11-30 04:32:31.021673] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.616 [2024-11-30 04:32:31.021700] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.616 [2024-11-30 04:32:31.021715] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.616 [2024-11-30 04:32:31.021728] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.616 [2024-11-30 04:32:31.021762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.616 qpair failed and we were unable to recover it. 00:30:40.616 [2024-11-30 04:32:31.031628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.616 [2024-11-30 04:32:31.031726] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.031752] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.031766] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.031780] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.031807] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.041672] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.041796] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.041822] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.041837] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.041850] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.041877] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.051657] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.051749] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.051774] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.051789] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.051803] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.051830] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.061822] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.061976] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.062003] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.062017] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.062029] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.062058] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.071764] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.071873] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.071904] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.071920] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.071933] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.071968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.081765] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.081880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.081905] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.081919] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.081932] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.081968] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.091771] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.091869] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.091894] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.091908] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.091921] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.091949] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.101929] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.102026] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.102052] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.102066] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.102079] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.102107] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.111930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.112075] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.112101] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.112115] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.112128] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.112162] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.121920] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.122047] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.122072] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.122087] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.122100] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.122128] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.131940] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.132035] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.132061] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.132075] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.132088] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.132115] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.141931] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.142029] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.142054] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.142069] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.142082] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.142109] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.152027] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.152136] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.152161] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.152175] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.152188] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.617 [2024-11-30 04:32:31.152218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.617 qpair failed and we were unable to recover it. 00:30:40.617 [2024-11-30 04:32:31.162049] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.617 [2024-11-30 04:32:31.162149] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.617 [2024-11-30 04:32:31.162180] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.617 [2024-11-30 04:32:31.162195] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.617 [2024-11-30 04:32:31.162208] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.618 [2024-11-30 04:32:31.162236] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.618 qpair failed and we were unable to recover it. 00:30:40.618 [2024-11-30 04:32:31.172051] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.618 [2024-11-30 04:32:31.172170] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.618 [2024-11-30 04:32:31.172195] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.618 [2024-11-30 04:32:31.172209] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.618 [2024-11-30 04:32:31.172223] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.618 [2024-11-30 04:32:31.172251] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.618 qpair failed and we were unable to recover it. 00:30:40.618 [2024-11-30 04:32:31.182068] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.618 [2024-11-30 04:32:31.182200] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.618 [2024-11-30 04:32:31.182225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.618 [2024-11-30 04:32:31.182239] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.618 [2024-11-30 04:32:31.182253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.618 [2024-11-30 04:32:31.182280] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.618 qpair failed and we were unable to recover it. 00:30:40.618 [2024-11-30 04:32:31.192164] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.618 [2024-11-30 04:32:31.192274] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.618 [2024-11-30 04:32:31.192299] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.618 [2024-11-30 04:32:31.192314] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.618 [2024-11-30 04:32:31.192327] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.618 [2024-11-30 04:32:31.192354] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.618 qpair failed and we were unable to recover it. 00:30:40.618 [2024-11-30 04:32:31.202134] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.618 [2024-11-30 04:32:31.202232] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.618 [2024-11-30 04:32:31.202261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.618 [2024-11-30 04:32:31.202277] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.618 [2024-11-30 04:32:31.202296] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.618 [2024-11-30 04:32:31.202326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.618 qpair failed and we were unable to recover it. 00:30:40.618 [2024-11-30 04:32:31.212126] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.618 [2024-11-30 04:32:31.212219] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.618 [2024-11-30 04:32:31.212245] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.618 [2024-11-30 04:32:31.212259] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.618 [2024-11-30 04:32:31.212273] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.618 [2024-11-30 04:32:31.212300] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.618 qpair failed and we were unable to recover it. 00:30:40.618 [2024-11-30 04:32:31.222168] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.618 [2024-11-30 04:32:31.222294] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.618 [2024-11-30 04:32:31.222320] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.618 [2024-11-30 04:32:31.222334] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.618 [2024-11-30 04:32:31.222347] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.618 [2024-11-30 04:32:31.222375] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.618 qpair failed and we were unable to recover it. 00:30:40.618 [2024-11-30 04:32:31.232209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.618 [2024-11-30 04:32:31.232337] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.618 [2024-11-30 04:32:31.232362] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.618 [2024-11-30 04:32:31.232376] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.618 [2024-11-30 04:32:31.232388] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.618 [2024-11-30 04:32:31.232416] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.618 qpair failed and we were unable to recover it. 00:30:40.618 [2024-11-30 04:32:31.242334] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.618 [2024-11-30 04:32:31.242430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.618 [2024-11-30 04:32:31.242455] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.618 [2024-11-30 04:32:31.242469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.618 [2024-11-30 04:32:31.242482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.618 [2024-11-30 04:32:31.242510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.618 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-30 04:32:31.252250] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.876 [2024-11-30 04:32:31.252385] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.876 [2024-11-30 04:32:31.252415] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.876 [2024-11-30 04:32:31.252430] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.876 [2024-11-30 04:32:31.252444] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.876 [2024-11-30 04:32:31.252471] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-30 04:32:31.262321] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.876 [2024-11-30 04:32:31.262446] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.876 [2024-11-30 04:32:31.262472] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.876 [2024-11-30 04:32:31.262486] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.876 [2024-11-30 04:32:31.262499] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.876 [2024-11-30 04:32:31.262527] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-30 04:32:31.272328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.876 [2024-11-30 04:32:31.272430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.876 [2024-11-30 04:32:31.272457] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.876 [2024-11-30 04:32:31.272471] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.876 [2024-11-30 04:32:31.272483] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.876 [2024-11-30 04:32:31.272511] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-30 04:32:31.282379] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.876 [2024-11-30 04:32:31.282472] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.876 [2024-11-30 04:32:31.282497] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.876 [2024-11-30 04:32:31.282514] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.876 [2024-11-30 04:32:31.282527] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.876 [2024-11-30 04:32:31.282556] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.876 qpair failed and we were unable to recover it. 00:30:40.876 [2024-11-30 04:32:31.292378] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.876 [2024-11-30 04:32:31.292468] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.876 [2024-11-30 04:32:31.292494] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.292508] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.292526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.292555] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.302429] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.302522] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.302548] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.302563] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.302576] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.302604] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.312563] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.312664] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.312689] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.312703] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.312717] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.312745] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.322496] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.322591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.322617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.322631] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.322644] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.322672] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.332501] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.332589] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.332614] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.332629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.332642] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.332670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.342539] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.342677] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.342706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.342721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.342733] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.342761] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.352572] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.352690] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.352715] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.352730] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.352743] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.352771] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.362620] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.362719] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.362745] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.362759] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.362773] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.362800] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.372702] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.372825] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.372850] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.372864] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.372876] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.372905] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.382631] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.382730] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.382756] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.382770] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.382791] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.382821] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.392789] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.392884] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.392909] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.392924] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.392937] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.392974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.402750] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.402865] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.402892] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.402906] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.402919] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.402947] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.412821] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.412922] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.412951] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.412975] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.412989] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.413017] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.877 qpair failed and we were unable to recover it. 00:30:40.877 [2024-11-30 04:32:31.422831] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.877 [2024-11-30 04:32:31.422975] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.877 [2024-11-30 04:32:31.423001] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.877 [2024-11-30 04:32:31.423016] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.877 [2024-11-30 04:32:31.423028] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.877 [2024-11-30 04:32:31.423056] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-30 04:32:31.432817] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.878 [2024-11-30 04:32:31.432950] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.878 [2024-11-30 04:32:31.432982] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.878 [2024-11-30 04:32:31.432998] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.878 [2024-11-30 04:32:31.433011] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.878 [2024-11-30 04:32:31.433040] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-30 04:32:31.442842] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.878 [2024-11-30 04:32:31.442942] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.878 [2024-11-30 04:32:31.442974] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.878 [2024-11-30 04:32:31.442989] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.878 [2024-11-30 04:32:31.443002] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.878 [2024-11-30 04:32:31.443030] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-30 04:32:31.452886] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.878 [2024-11-30 04:32:31.453005] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.878 [2024-11-30 04:32:31.453030] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.878 [2024-11-30 04:32:31.453044] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.878 [2024-11-30 04:32:31.453057] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.878 [2024-11-30 04:32:31.453085] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-30 04:32:31.462892] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.878 [2024-11-30 04:32:31.462999] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.878 [2024-11-30 04:32:31.463026] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.878 [2024-11-30 04:32:31.463041] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.878 [2024-11-30 04:32:31.463054] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.878 [2024-11-30 04:32:31.463082] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-30 04:32:31.472930] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.878 [2024-11-30 04:32:31.473058] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.878 [2024-11-30 04:32:31.473083] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.878 [2024-11-30 04:32:31.473098] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.878 [2024-11-30 04:32:31.473116] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.878 [2024-11-30 04:32:31.473145] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-30 04:32:31.483041] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.878 [2024-11-30 04:32:31.483137] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.878 [2024-11-30 04:32:31.483162] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.878 [2024-11-30 04:32:31.483177] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.878 [2024-11-30 04:32:31.483189] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.878 [2024-11-30 04:32:31.483218] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-30 04:32:31.493055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.878 [2024-11-30 04:32:31.493152] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.878 [2024-11-30 04:32:31.493179] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.878 [2024-11-30 04:32:31.493193] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.878 [2024-11-30 04:32:31.493206] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.878 [2024-11-30 04:32:31.493234] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.878 qpair failed and we were unable to recover it. 00:30:40.878 [2024-11-30 04:32:31.503055] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:40.878 [2024-11-30 04:32:31.503151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:40.878 [2024-11-30 04:32:31.503177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:40.878 [2024-11-30 04:32:31.503191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:40.878 [2024-11-30 04:32:31.503204] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:40.878 [2024-11-30 04:32:31.503232] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:40.878 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.513048] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.513146] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.513172] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.513186] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.513199] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.513227] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.523081] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.523194] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.523220] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.523234] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.523247] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.523274] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.533102] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.533239] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.533265] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.533279] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.533292] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.533320] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.543147] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.543272] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.543297] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.543312] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.543325] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.543353] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.553185] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.553285] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.553310] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.553324] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.553337] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.553365] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.563213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.563314] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.563339] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.563359] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.563372] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.563400] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.573214] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.573313] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.573342] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.573358] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.573371] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.573399] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.583222] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.583312] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.583338] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.583352] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.583365] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.583392] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.593359] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.593455] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.593480] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.593495] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.593508] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.593536] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.603304] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.603402] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.603427] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.603442] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.603455] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.603483] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.613307] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.613396] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.613421] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.613436] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.613449] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.613476] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.623348] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.623471] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.623496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.623510] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.623524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.137 [2024-11-30 04:32:31.623552] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.137 qpair failed and we were unable to recover it. 00:30:41.137 [2024-11-30 04:32:31.633428] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.137 [2024-11-30 04:32:31.633525] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.137 [2024-11-30 04:32:31.633551] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.137 [2024-11-30 04:32:31.633565] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.137 [2024-11-30 04:32:31.633577] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.633605] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.643444] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.643545] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.643570] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.643584] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.643596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.643624] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.653469] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.653591] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.653617] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.653638] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.653652] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.653679] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.663474] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.663566] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.663591] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.663606] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.663619] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.663647] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.673494] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.673590] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.673615] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.673629] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.673643] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.673670] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.683531] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.683651] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.683676] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.683690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.683704] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.683732] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.693556] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.693650] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.693675] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.693690] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.693702] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.693730] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.703565] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.703674] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.703699] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.703714] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.703727] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.703755] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.713615] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.713711] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.713736] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.713750] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.713764] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.713791] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.723628] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.723718] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.723743] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.723757] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.723770] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.723799] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.733649] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.733741] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.733767] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.733781] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.733794] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.733822] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.743718] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.743824] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.743849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.743870] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.743884] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.743912] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.753741] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.753840] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.753865] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.753880] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.753892] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.753920] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.138 [2024-11-30 04:32:31.763768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.138 [2024-11-30 04:32:31.763915] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.138 [2024-11-30 04:32:31.763941] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.138 [2024-11-30 04:32:31.763963] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.138 [2024-11-30 04:32:31.763978] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.138 [2024-11-30 04:32:31.764007] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.138 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-30 04:32:31.773782] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.397 [2024-11-30 04:32:31.773885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.397 [2024-11-30 04:32:31.773914] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.397 [2024-11-30 04:32:31.773929] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.397 [2024-11-30 04:32:31.773942] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.397 [2024-11-30 04:32:31.773983] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-30 04:32:31.783811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.397 [2024-11-30 04:32:31.783906] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.397 [2024-11-30 04:32:31.783932] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.397 [2024-11-30 04:32:31.783947] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.397 [2024-11-30 04:32:31.783967] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.397 [2024-11-30 04:32:31.783997] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-30 04:32:31.793935] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.397 [2024-11-30 04:32:31.794093] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.397 [2024-11-30 04:32:31.794118] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.397 [2024-11-30 04:32:31.794133] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.397 [2024-11-30 04:32:31.794147] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.397 [2024-11-30 04:32:31.794176] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-30 04:32:31.803873] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.397 [2024-11-30 04:32:31.803978] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.397 [2024-11-30 04:32:31.804004] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.397 [2024-11-30 04:32:31.804018] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.397 [2024-11-30 04:32:31.804031] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.397 [2024-11-30 04:32:31.804059] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.397 qpair failed and we were unable to recover it. 00:30:41.397 [2024-11-30 04:32:31.813932] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.814089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.814115] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.814129] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.814142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.814170] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.823967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.824067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.824093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.824108] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.824121] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.824148] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.833967] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.834065] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.834090] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.834110] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.834125] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.834152] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.843965] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.844109] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.844135] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.844149] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.844162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.844189] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.854006] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.854105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.854134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.854150] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.854163] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.854192] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.864065] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.864183] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.864210] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.864224] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.864237] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.864265] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.874090] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.874186] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.874211] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.874225] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.874239] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.874267] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.884117] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.884242] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.884268] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.884282] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.884295] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.884323] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.894100] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.894245] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.894271] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.894286] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.894299] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.894326] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.904209] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.904320] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.904345] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.904361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.904375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.904403] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.914200] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.914300] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.914325] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.914352] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.914366] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.914394] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.924247] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.924391] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.398 [2024-11-30 04:32:31.924416] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.398 [2024-11-30 04:32:31.924437] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.398 [2024-11-30 04:32:31.924451] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.398 [2024-11-30 04:32:31.924479] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.398 qpair failed and we were unable to recover it. 00:30:41.398 [2024-11-30 04:32:31.934225] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.398 [2024-11-30 04:32:31.934327] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.399 [2024-11-30 04:32:31.934353] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.399 [2024-11-30 04:32:31.934367] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.399 [2024-11-30 04:32:31.934380] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.399 [2024-11-30 04:32:31.934407] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-30 04:32:31.944282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.399 [2024-11-30 04:32:31.944388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.399 [2024-11-30 04:32:31.944414] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.399 [2024-11-30 04:32:31.944429] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.399 [2024-11-30 04:32:31.944442] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.399 [2024-11-30 04:32:31.944470] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-30 04:32:31.954282] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.399 [2024-11-30 04:32:31.954404] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.399 [2024-11-30 04:32:31.954429] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.399 [2024-11-30 04:32:31.954443] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.399 [2024-11-30 04:32:31.954457] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.399 [2024-11-30 04:32:31.954484] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-30 04:32:31.964328] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.399 [2024-11-30 04:32:31.964428] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.399 [2024-11-30 04:32:31.964454] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.399 [2024-11-30 04:32:31.964469] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.399 [2024-11-30 04:32:31.964482] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.399 [2024-11-30 04:32:31.964510] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-30 04:32:31.974342] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.399 [2024-11-30 04:32:31.974457] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.399 [2024-11-30 04:32:31.974496] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.399 [2024-11-30 04:32:31.974511] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.399 [2024-11-30 04:32:31.974524] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.399 [2024-11-30 04:32:31.974553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-30 04:32:31.984397] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.399 [2024-11-30 04:32:31.984544] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.399 [2024-11-30 04:32:31.984574] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.399 [2024-11-30 04:32:31.984588] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.399 [2024-11-30 04:32:31.984601] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.399 [2024-11-30 04:32:31.984631] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-30 04:32:31.994440] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.399 [2024-11-30 04:32:31.994543] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.399 [2024-11-30 04:32:31.994569] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.399 [2024-11-30 04:32:31.994583] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.399 [2024-11-30 04:32:31.994596] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.399 [2024-11-30 04:32:31.994625] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-30 04:32:32.004528] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.399 [2024-11-30 04:32:32.004627] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.399 [2024-11-30 04:32:32.004652] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.399 [2024-11-30 04:32:32.004666] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.399 [2024-11-30 04:32:32.004680] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.399 [2024-11-30 04:32:32.004708] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-30 04:32:32.014477] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.399 [2024-11-30 04:32:32.014605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.399 [2024-11-30 04:32:32.014635] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.399 [2024-11-30 04:32:32.014650] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.399 [2024-11-30 04:32:32.014663] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.399 [2024-11-30 04:32:32.014691] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.399 [2024-11-30 04:32:32.024473] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.399 [2024-11-30 04:32:32.024563] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.399 [2024-11-30 04:32:32.024589] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.399 [2024-11-30 04:32:32.024603] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.399 [2024-11-30 04:32:32.024616] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.399 [2024-11-30 04:32:32.024644] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.399 qpair failed and we were unable to recover it. 00:30:41.658 [2024-11-30 04:32:32.034646] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.658 [2024-11-30 04:32:32.034747] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.658 [2024-11-30 04:32:32.034772] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.658 [2024-11-30 04:32:32.034787] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.658 [2024-11-30 04:32:32.034799] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.658 [2024-11-30 04:32:32.034827] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.658 qpair failed and we were unable to recover it. 00:30:41.658 [2024-11-30 04:32:32.044590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.658 [2024-11-30 04:32:32.044702] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.658 [2024-11-30 04:32:32.044727] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.658 [2024-11-30 04:32:32.044741] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.658 [2024-11-30 04:32:32.044754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.658 [2024-11-30 04:32:32.044782] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.658 qpair failed and we were unable to recover it. 00:30:41.658 [2024-11-30 04:32:32.054654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.658 [2024-11-30 04:32:32.054752] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.658 [2024-11-30 04:32:32.054781] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.658 [2024-11-30 04:32:32.054796] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.658 [2024-11-30 04:32:32.054809] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.054837] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.064596] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.064681] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.064706] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.064721] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.064734] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.064762] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.074665] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.074789] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.074814] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.074828] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.074842] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.074870] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.084699] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.084792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.084818] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.084833] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.084845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.084875] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.094681] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.094777] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.094806] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.094821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.094834] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.094863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.104721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.104811] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.104842] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.104861] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.104874] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.104903] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.114745] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.114843] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.114868] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.114883] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.114896] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.114924] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.124841] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.124969] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.124995] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.125009] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.125022] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.125050] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.134816] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.134928] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.134954] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.134976] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.134991] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.135020] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.144809] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.144905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.144933] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.144948] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.144969] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.145008] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.154860] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.154987] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.155013] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.155027] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.155039] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.155067] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.164885] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.164991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.165017] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.165032] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.165045] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.165073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.174997] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.175087] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.175113] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.175128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.175141] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.175168] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.184944] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.185089] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.659 [2024-11-30 04:32:32.185114] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.659 [2024-11-30 04:32:32.185128] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.659 [2024-11-30 04:32:32.185142] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.659 [2024-11-30 04:32:32.185172] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.659 qpair failed and we were unable to recover it. 00:30:41.659 [2024-11-30 04:32:32.195003] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.659 [2024-11-30 04:32:32.195105] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.660 [2024-11-30 04:32:32.195140] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.660 [2024-11-30 04:32:32.195157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.660 [2024-11-30 04:32:32.195170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.660 [2024-11-30 04:32:32.195199] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.660 qpair failed and we were unable to recover it. 00:30:41.660 [2024-11-30 04:32:32.205013] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.660 [2024-11-30 04:32:32.205108] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.660 [2024-11-30 04:32:32.205134] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.660 [2024-11-30 04:32:32.205148] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.660 [2024-11-30 04:32:32.205162] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.660 [2024-11-30 04:32:32.205190] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.660 qpair failed and we were unable to recover it. 00:30:41.660 [2024-11-30 04:32:32.215059] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.660 [2024-11-30 04:32:32.215179] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.660 [2024-11-30 04:32:32.215205] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.660 [2024-11-30 04:32:32.215220] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.660 [2024-11-30 04:32:32.215233] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.660 [2024-11-30 04:32:32.215260] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.660 qpair failed and we were unable to recover it. 00:30:41.660 [2024-11-30 04:32:32.225129] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.660 [2024-11-30 04:32:32.225224] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.660 [2024-11-30 04:32:32.225249] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.660 [2024-11-30 04:32:32.225263] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.660 [2024-11-30 04:32:32.225276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.660 [2024-11-30 04:32:32.225304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.660 qpair failed and we were unable to recover it. 00:30:41.660 [2024-11-30 04:32:32.235096] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.660 [2024-11-30 04:32:32.235197] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.660 [2024-11-30 04:32:32.235225] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.660 [2024-11-30 04:32:32.235240] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.660 [2024-11-30 04:32:32.235253] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.660 [2024-11-30 04:32:32.235287] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.660 qpair failed and we were unable to recover it. 00:30:41.660 [2024-11-30 04:32:32.245101] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.660 [2024-11-30 04:32:32.245192] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.660 [2024-11-30 04:32:32.245217] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.660 [2024-11-30 04:32:32.245231] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.660 [2024-11-30 04:32:32.245244] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.660 [2024-11-30 04:32:32.245272] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.660 qpair failed and we were unable to recover it. 00:30:41.660 [2024-11-30 04:32:32.255166] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.660 [2024-11-30 04:32:32.255263] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.660 [2024-11-30 04:32:32.255289] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.660 [2024-11-30 04:32:32.255303] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.660 [2024-11-30 04:32:32.255316] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.660 [2024-11-30 04:32:32.255344] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.660 qpair failed and we were unable to recover it. 00:30:41.660 [2024-11-30 04:32:32.265213] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.660 [2024-11-30 04:32:32.265307] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.660 [2024-11-30 04:32:32.265333] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.660 [2024-11-30 04:32:32.265347] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.660 [2024-11-30 04:32:32.265359] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.660 [2024-11-30 04:32:32.265389] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.660 qpair failed and we were unable to recover it. 00:30:41.660 [2024-11-30 04:32:32.275327] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.660 [2024-11-30 04:32:32.275424] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.660 [2024-11-30 04:32:32.275449] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.660 [2024-11-30 04:32:32.275463] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.660 [2024-11-30 04:32:32.275476] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.660 [2024-11-30 04:32:32.275504] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.660 qpair failed and we were unable to recover it. 00:30:41.660 [2024-11-30 04:32:32.285249] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.660 [2024-11-30 04:32:32.285350] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.660 [2024-11-30 04:32:32.285380] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.660 [2024-11-30 04:32:32.285395] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.660 [2024-11-30 04:32:32.285408] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.660 [2024-11-30 04:32:32.285435] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.660 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.295335] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.295430] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.295456] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.295470] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.295490] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.295518] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.305297] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.305388] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.305413] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.305426] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.305440] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.305468] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.315305] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.315400] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.315426] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.315440] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.315453] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.315481] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.325439] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.325536] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.325562] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.325576] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.325589] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.325623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.335352] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.335491] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.335516] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.335530] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.335543] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.335570] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.345383] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.345474] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.345499] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.345513] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.345526] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.345553] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.355456] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.355569] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.355594] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.355608] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.355621] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.355648] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.365453] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.365549] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.365575] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.365589] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.365602] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.365630] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.375509] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.375611] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.375646] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.375662] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.375675] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.375705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.385530] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.385624] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.385649] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.385663] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.385676] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.385705] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.920 [2024-11-30 04:32:32.395547] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.920 [2024-11-30 04:32:32.395667] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.920 [2024-11-30 04:32:32.395693] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.920 [2024-11-30 04:32:32.395708] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.920 [2024-11-30 04:32:32.395721] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.920 [2024-11-30 04:32:32.395749] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.920 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.405585] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.405682] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.405708] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.405722] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.405735] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.405763] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.415592] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.415692] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.415721] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.415736] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.415754] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.415783] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.425625] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.425715] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.425741] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.425755] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.425768] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.425796] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.435662] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.435760] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.435785] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.435798] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.435811] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.435839] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.445704] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.445792] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.445817] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.445832] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.445845] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.445873] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.455721] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.455813] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.455838] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.455852] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.455866] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.455893] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.465785] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.465885] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.465916] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.465931] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.465945] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.465980] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.475839] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.475947] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.475980] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.475995] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.476008] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.476036] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.485798] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.485888] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.485913] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.485927] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.485940] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.485993] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.495855] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.495991] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.496020] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.496035] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.496048] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.496076] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.505891] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.505986] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.506011] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.506025] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.506044] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.506073] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.515917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.516020] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.516046] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.516060] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.516074] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.516102] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.525917] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.526019] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.526045] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.921 [2024-11-30 04:32:32.526059] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.921 [2024-11-30 04:32:32.526072] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.921 [2024-11-30 04:32:32.526099] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.921 qpair failed and we were unable to recover it. 00:30:41.921 [2024-11-30 04:32:32.535972] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.921 [2024-11-30 04:32:32.536067] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.921 [2024-11-30 04:32:32.536093] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.922 [2024-11-30 04:32:32.536107] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.922 [2024-11-30 04:32:32.536120] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.922 [2024-11-30 04:32:32.536147] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.922 qpair failed and we were unable to recover it. 00:30:41.922 [2024-11-30 04:32:32.546026] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:41.922 [2024-11-30 04:32:32.546117] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:41.922 [2024-11-30 04:32:32.546143] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:41.922 [2024-11-30 04:32:32.546157] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:41.922 [2024-11-30 04:32:32.546170] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:41.922 [2024-11-30 04:32:32.546198] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:41.922 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-30 04:32:32.556109] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.181 [2024-11-30 04:32:32.556235] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.181 [2024-11-30 04:32:32.556261] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.181 [2024-11-30 04:32:32.556275] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.181 [2024-11-30 04:32:32.556288] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.181 [2024-11-30 04:32:32.556318] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-30 04:32:32.566057] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.181 [2024-11-30 04:32:32.566151] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.181 [2024-11-30 04:32:32.566177] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.181 [2024-11-30 04:32:32.566191] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.181 [2024-11-30 04:32:32.566203] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.181 [2024-11-30 04:32:32.566230] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-30 04:32:32.576080] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.181 [2024-11-30 04:32:32.576175] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.181 [2024-11-30 04:32:32.576200] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.181 [2024-11-30 04:32:32.576215] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.181 [2024-11-30 04:32:32.576228] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.181 [2024-11-30 04:32:32.576255] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-30 04:32:32.586132] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.181 [2024-11-30 04:32:32.586222] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.181 [2024-11-30 04:32:32.586248] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.181 [2024-11-30 04:32:32.586261] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.181 [2024-11-30 04:32:32.586276] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.181 [2024-11-30 04:32:32.586304] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.181 qpair failed and we were unable to recover it. 00:30:42.181 [2024-11-30 04:32:32.596172] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.181 [2024-11-30 04:32:32.596277] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.181 [2024-11-30 04:32:32.596303] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.181 [2024-11-30 04:32:32.596317] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.181 [2024-11-30 04:32:32.596336] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.596364] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.606163] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.606258] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.606283] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.606297] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.606310] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.606338] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.616197] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.616289] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.616316] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.616337] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.616351] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.616381] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.626230] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.626322] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.626347] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.626361] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.626375] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.626402] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.636229] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.636371] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.636397] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.636410] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.636423] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.636451] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.646283] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.646384] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.646410] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.646425] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.646438] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.646465] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.656301] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.656393] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.656418] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.656433] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.656446] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.656473] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.666354] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.666448] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.666474] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.666488] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.666501] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.666529] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.676384] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.676482] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.676508] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.676522] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.676535] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.676562] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.686416] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.686562] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.686587] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.686601] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.686620] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.686649] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.696403] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.696503] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.696527] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.696541] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.696554] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.696581] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.706450] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.706541] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.706566] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.706580] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.706593] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.706623] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.716505] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.716605] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.716630] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.716645] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.716657] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.716685] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.726598] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.726698] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.182 [2024-11-30 04:32:32.726723] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.182 [2024-11-30 04:32:32.726738] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.182 [2024-11-30 04:32:32.726751] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.182 [2024-11-30 04:32:32.726778] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.182 qpair failed and we were unable to recover it. 00:30:42.182 [2024-11-30 04:32:32.736623] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.182 [2024-11-30 04:32:32.736773] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.183 [2024-11-30 04:32:32.736802] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.183 [2024-11-30 04:32:32.736817] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.183 [2024-11-30 04:32:32.736830] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.183 [2024-11-30 04:32:32.736859] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-30 04:32:32.746590] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.183 [2024-11-30 04:32:32.746680] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.183 [2024-11-30 04:32:32.746705] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.183 [2024-11-30 04:32:32.746719] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.183 [2024-11-30 04:32:32.746732] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.183 [2024-11-30 04:32:32.746760] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-30 04:32:32.756616] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.183 [2024-11-30 04:32:32.756734] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.183 [2024-11-30 04:32:32.756760] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.183 [2024-11-30 04:32:32.756774] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.183 [2024-11-30 04:32:32.756787] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.183 [2024-11-30 04:32:32.756815] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-30 04:32:32.766654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.183 [2024-11-30 04:32:32.766744] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.183 [2024-11-30 04:32:32.766770] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.183 [2024-11-30 04:32:32.766785] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.183 [2024-11-30 04:32:32.766798] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.183 [2024-11-30 04:32:32.766826] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-30 04:32:32.776654] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.183 [2024-11-30 04:32:32.776775] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.183 [2024-11-30 04:32:32.776801] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.183 [2024-11-30 04:32:32.776821] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.183 [2024-11-30 04:32:32.776835] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x1ec0f20 00:30:42.183 [2024-11-30 04:32:32.776863] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 3 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-30 04:32:32.786710] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.183 [2024-11-30 04:32:32.786817] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.183 [2024-11-30 04:32:32.786849] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.183 [2024-11-30 04:32:32.786865] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.183 [2024-11-30 04:32:32.786879] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc1d0000b90 00:30:42.183 [2024-11-30 04:32:32.786925] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-30 04:32:32.796768] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.183 [2024-11-30 04:32:32.796880] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.183 [2024-11-30 04:32:32.796907] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.183 [2024-11-30 04:32:32.796922] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.183 [2024-11-30 04:32:32.796936] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc1d0000b90 00:30:42.183 [2024-11-30 04:32:32.796974] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 2 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.183 [2024-11-30 04:32:32.806774] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.183 [2024-11-30 04:32:32.806867] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.183 [2024-11-30 04:32:32.806900] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.183 [2024-11-30 04:32:32.806917] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.183 [2024-11-30 04:32:32.806931] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc1cc000b90 00:30:42.183 [2024-11-30 04:32:32.806984] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:42.183 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-30 04:32:32.816864] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.441 [2024-11-30 04:32:32.816951] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.441 [2024-11-30 04:32:32.816987] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.441 [2024-11-30 04:32:32.817002] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.441 [2024-11-30 04:32:32.817016] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc1cc000b90 00:30:42.441 [2024-11-30 04:32:32.817048] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 4 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-30 04:32:32.826811] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.441 [2024-11-30 04:32:32.826905] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.441 [2024-11-30 04:32:32.826939] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.441 [2024-11-30 04:32:32.826955] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.441 [2024-11-30 04:32:32.826979] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc1d8000b90 00:30:42.441 [2024-11-30 04:32:32.827011] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-30 04:32:32.836837] ctrlr.c: 662:_nvmf_ctrlr_add_io_qpair: *ERROR*: Unknown controller ID 0x1 00:30:42.441 [2024-11-30 04:32:32.836933] nvme_fabric.c: 598:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command failed, rc -5, trtype:TCP adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1 00:30:42.441 [2024-11-30 04:32:32.836968] nvme_fabric.c: 609:nvme_fabric_qpair_connect_poll: *ERROR*: Connect command completed with error: sct 1, sc 130 00:30:42.441 [2024-11-30 04:32:32.836986] nvme_tcp.c:2341:nvme_tcp_ctrlr_connect_qpair_poll: *ERROR*: Failed to poll NVMe-oF Fabric CONNECT command 00:30:42.441 [2024-11-30 04:32:32.837001] nvme_tcp.c:2138:nvme_tcp_qpair_process_completions: *ERROR*: Failed to connect tqpair=0x7fc1d8000b90 00:30:42.441 [2024-11-30 04:32:32.837031] nvme_qpair.c: 804:spdk_nvme_qpair_process_completions: *ERROR*: CQ transport error -6 (No such device or address) on qpair id 1 00:30:42.441 qpair failed and we were unable to recover it. 00:30:42.441 [2024-11-30 04:32:32.837124] nvme_ctrlr.c:4339:nvme_ctrlr_keep_alive: *ERROR*: [nqn.2016-06.io.spdk:cnode1] Submitting Keep Alive failed 00:30:42.441 A controller has encountered a failure and is being reset. 00:30:42.441 [2024-11-30 04:32:32.837176] nvme_tcp.c:2098:nvme_tcp_qpair_process_completions: *ERROR*: Failed to flush tqpair=0x1ece980 (9): Bad file descriptor 00:30:42.441 Controller properly reset. 00:30:42.441 Initializing NVMe Controllers 00:30:42.441 Attaching to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:42.441 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:cnode1 00:30:42.441 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 0 00:30:42.441 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 1 00:30:42.441 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 2 00:30:42.441 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:cnode1) with lcore 3 00:30:42.441 Initialization complete. Launching workers. 00:30:42.441 Starting thread on core 1 00:30:42.441 Starting thread on core 2 00:30:42.441 Starting thread on core 3 00:30:42.441 Starting thread on core 0 00:30:42.441 04:32:32 -- host/target_disconnect.sh@59 -- # sync 00:30:42.441 00:30:42.441 real 0m11.423s 00:30:42.441 user 0m21.503s 00:30:42.441 sys 0m5.257s 00:30:42.441 04:32:32 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:42.441 04:32:32 -- common/autotest_common.sh@10 -- # set +x 00:30:42.441 ************************************ 00:30:42.441 END TEST nvmf_target_disconnect_tc2 00:30:42.441 ************************************ 00:30:42.441 04:32:32 -- host/target_disconnect.sh@80 -- # '[' -n '' ']' 00:30:42.441 04:32:32 -- host/target_disconnect.sh@84 -- # trap - SIGINT SIGTERM EXIT 00:30:42.441 04:32:32 -- host/target_disconnect.sh@85 -- # nvmftestfini 00:30:42.441 04:32:32 -- nvmf/common.sh@476 -- # nvmfcleanup 00:30:42.441 04:32:32 -- nvmf/common.sh@116 -- # sync 00:30:42.441 04:32:32 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:30:42.441 04:32:32 -- nvmf/common.sh@119 -- # set +e 00:30:42.441 04:32:32 -- nvmf/common.sh@120 -- # for i in {1..20} 00:30:42.441 04:32:32 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:30:42.441 rmmod nvme_tcp 00:30:42.441 rmmod nvme_fabrics 00:30:42.441 rmmod nvme_keyring 00:30:42.441 04:32:32 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:30:42.441 04:32:32 -- nvmf/common.sh@123 -- # set -e 00:30:42.442 04:32:32 -- nvmf/common.sh@124 -- # return 0 00:30:42.442 04:32:32 -- nvmf/common.sh@477 -- # '[' -n 2494434 ']' 00:30:42.442 04:32:32 -- nvmf/common.sh@478 -- # killprocess 2494434 00:30:42.442 04:32:32 -- common/autotest_common.sh@936 -- # '[' -z 2494434 ']' 00:30:42.442 04:32:32 -- common/autotest_common.sh@940 -- # kill -0 2494434 00:30:42.442 04:32:32 -- common/autotest_common.sh@941 -- # uname 00:30:42.442 04:32:32 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:30:42.442 04:32:32 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2494434 00:30:42.442 04:32:32 -- common/autotest_common.sh@942 -- # process_name=reactor_4 00:30:42.442 04:32:32 -- common/autotest_common.sh@946 -- # '[' reactor_4 = sudo ']' 00:30:42.442 04:32:32 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2494434' 00:30:42.442 killing process with pid 2494434 00:30:42.442 04:32:32 -- common/autotest_common.sh@955 -- # kill 2494434 00:30:42.442 04:32:32 -- common/autotest_common.sh@960 -- # wait 2494434 00:30:42.700 04:32:33 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:30:42.700 04:32:33 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:30:42.700 04:32:33 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:30:42.700 04:32:33 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:30:42.700 04:32:33 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:30:42.700 04:32:33 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:30:42.700 04:32:33 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 14> /dev/null' 00:30:42.700 04:32:33 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:30:45.248 04:32:35 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:30:45.248 00:30:45.248 real 0m16.363s 00:30:45.248 user 0m47.728s 00:30:45.248 sys 0m7.229s 00:30:45.248 04:32:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:45.248 04:32:35 -- common/autotest_common.sh@10 -- # set +x 00:30:45.248 ************************************ 00:30:45.248 END TEST nvmf_target_disconnect 00:30:45.248 ************************************ 00:30:45.248 04:32:35 -- nvmf/nvmf.sh@127 -- # timing_exit host 00:30:45.248 04:32:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:45.248 04:32:35 -- common/autotest_common.sh@10 -- # set +x 00:30:45.248 04:32:35 -- nvmf/nvmf.sh@129 -- # trap - SIGINT SIGTERM EXIT 00:30:45.248 00:30:45.248 real 22m53.097s 00:30:45.248 user 66m21.398s 00:30:45.248 sys 5m33.281s 00:30:45.248 04:32:35 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:30:45.248 04:32:35 -- common/autotest_common.sh@10 -- # set +x 00:30:45.248 ************************************ 00:30:45.248 END TEST nvmf_tcp 00:30:45.248 ************************************ 00:30:45.248 04:32:35 -- spdk/autotest.sh@283 -- # [[ 0 -eq 0 ]] 00:30:45.248 04:32:35 -- spdk/autotest.sh@284 -- # run_test spdkcli_nvmf_tcp /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:45.248 04:32:35 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:30:45.248 04:32:35 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:30:45.248 04:32:35 -- common/autotest_common.sh@10 -- # set +x 00:30:45.248 ************************************ 00:30:45.248 START TEST spdkcli_nvmf_tcp 00:30:45.248 ************************************ 00:30:45.248 04:32:35 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/nvmf.sh --transport=tcp 00:30:45.248 * Looking for test storage... 00:30:45.248 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli 00:30:45.248 04:32:35 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:30:45.248 04:32:35 -- common/autotest_common.sh@1690 -- # lcov --version 00:30:45.248 04:32:35 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:30:45.248 04:32:35 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:30:45.248 04:32:35 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:30:45.248 04:32:35 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:30:45.248 04:32:35 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:30:45.248 04:32:35 -- scripts/common.sh@335 -- # IFS=.-: 00:30:45.248 04:32:35 -- scripts/common.sh@335 -- # read -ra ver1 00:30:45.248 04:32:35 -- scripts/common.sh@336 -- # IFS=.-: 00:30:45.248 04:32:35 -- scripts/common.sh@336 -- # read -ra ver2 00:30:45.248 04:32:35 -- scripts/common.sh@337 -- # local 'op=<' 00:30:45.248 04:32:35 -- scripts/common.sh@339 -- # ver1_l=2 00:30:45.248 04:32:35 -- scripts/common.sh@340 -- # ver2_l=1 00:30:45.249 04:32:35 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:30:45.249 04:32:35 -- scripts/common.sh@343 -- # case "$op" in 00:30:45.249 04:32:35 -- scripts/common.sh@344 -- # : 1 00:30:45.249 04:32:35 -- scripts/common.sh@363 -- # (( v = 0 )) 00:30:45.249 04:32:35 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:30:45.249 04:32:35 -- scripts/common.sh@364 -- # decimal 1 00:30:45.249 04:32:35 -- scripts/common.sh@352 -- # local d=1 00:30:45.249 04:32:35 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:30:45.249 04:32:35 -- scripts/common.sh@354 -- # echo 1 00:30:45.249 04:32:35 -- scripts/common.sh@364 -- # ver1[v]=1 00:30:45.249 04:32:35 -- scripts/common.sh@365 -- # decimal 2 00:30:45.249 04:32:35 -- scripts/common.sh@352 -- # local d=2 00:30:45.249 04:32:35 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:30:45.249 04:32:35 -- scripts/common.sh@354 -- # echo 2 00:30:45.249 04:32:35 -- scripts/common.sh@365 -- # ver2[v]=2 00:30:45.249 04:32:35 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:30:45.249 04:32:35 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:30:45.249 04:32:35 -- scripts/common.sh@367 -- # return 0 00:30:45.249 04:32:35 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:30:45.249 04:32:35 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:30:45.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.249 --rc genhtml_branch_coverage=1 00:30:45.249 --rc genhtml_function_coverage=1 00:30:45.249 --rc genhtml_legend=1 00:30:45.249 --rc geninfo_all_blocks=1 00:30:45.249 --rc geninfo_unexecuted_blocks=1 00:30:45.249 00:30:45.249 ' 00:30:45.249 04:32:35 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:30:45.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.249 --rc genhtml_branch_coverage=1 00:30:45.249 --rc genhtml_function_coverage=1 00:30:45.249 --rc genhtml_legend=1 00:30:45.249 --rc geninfo_all_blocks=1 00:30:45.249 --rc geninfo_unexecuted_blocks=1 00:30:45.249 00:30:45.249 ' 00:30:45.249 04:32:35 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:30:45.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.249 --rc genhtml_branch_coverage=1 00:30:45.249 --rc genhtml_function_coverage=1 00:30:45.249 --rc genhtml_legend=1 00:30:45.249 --rc geninfo_all_blocks=1 00:30:45.249 --rc geninfo_unexecuted_blocks=1 00:30:45.249 00:30:45.249 ' 00:30:45.249 04:32:35 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:30:45.249 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:30:45.249 --rc genhtml_branch_coverage=1 00:30:45.249 --rc genhtml_function_coverage=1 00:30:45.249 --rc genhtml_legend=1 00:30:45.249 --rc geninfo_all_blocks=1 00:30:45.249 --rc geninfo_unexecuted_blocks=1 00:30:45.249 00:30:45.249 ' 00:30:45.249 04:32:35 -- spdkcli/nvmf.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/common.sh 00:30:45.249 04:32:35 -- spdkcli/common.sh@6 -- # spdkcli_job=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py 00:30:45.249 04:32:35 -- spdkcli/common.sh@7 -- # spdk_clear_config_py=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/json_config/clear_config.py 00:30:45.249 04:32:35 -- spdkcli/nvmf.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:30:45.249 04:32:35 -- nvmf/common.sh@7 -- # uname -s 00:30:45.249 04:32:35 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:30:45.249 04:32:35 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:30:45.249 04:32:35 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:30:45.249 04:32:35 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:30:45.249 04:32:35 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:30:45.249 04:32:35 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:30:45.249 04:32:35 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:30:45.249 04:32:35 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:30:45.249 04:32:35 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:30:45.249 04:32:35 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:30:45.249 04:32:35 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:30:45.249 04:32:35 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:30:45.249 04:32:35 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:30:45.249 04:32:35 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:30:45.249 04:32:35 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:30:45.249 04:32:35 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:30:45.249 04:32:35 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:30:45.249 04:32:35 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:30:45.249 04:32:35 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:30:45.249 04:32:35 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.249 04:32:35 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.249 04:32:35 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.249 04:32:35 -- paths/export.sh@5 -- # export PATH 00:30:45.249 04:32:35 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:30:45.249 04:32:35 -- nvmf/common.sh@46 -- # : 0 00:30:45.249 04:32:35 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:30:45.249 04:32:35 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:30:45.249 04:32:35 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:30:45.249 04:32:35 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:30:45.249 04:32:35 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:30:45.249 04:32:35 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:30:45.249 04:32:35 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:30:45.249 04:32:35 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:30:45.249 04:32:35 -- spdkcli/nvmf.sh@12 -- # MATCH_FILE=spdkcli_nvmf.test 00:30:45.249 04:32:35 -- spdkcli/nvmf.sh@13 -- # SPDKCLI_BRANCH=/nvmf 00:30:45.249 04:32:35 -- spdkcli/nvmf.sh@15 -- # trap cleanup EXIT 00:30:45.249 04:32:35 -- spdkcli/nvmf.sh@17 -- # timing_enter run_nvmf_tgt 00:30:45.249 04:32:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:45.249 04:32:35 -- common/autotest_common.sh@10 -- # set +x 00:30:45.249 04:32:35 -- spdkcli/nvmf.sh@18 -- # run_nvmf_tgt 00:30:45.249 04:32:35 -- spdkcli/common.sh@33 -- # nvmf_tgt_pid=2495668 00:30:45.249 04:32:35 -- spdkcli/common.sh@32 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -m 0x3 -p 0 00:30:45.249 04:32:35 -- spdkcli/common.sh@34 -- # waitforlisten 2495668 00:30:45.249 04:32:35 -- common/autotest_common.sh@829 -- # '[' -z 2495668 ']' 00:30:45.249 04:32:35 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:30:45.249 04:32:35 -- common/autotest_common.sh@834 -- # local max_retries=100 00:30:45.249 04:32:35 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:30:45.249 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:30:45.249 04:32:35 -- common/autotest_common.sh@838 -- # xtrace_disable 00:30:45.249 04:32:35 -- common/autotest_common.sh@10 -- # set +x 00:30:45.249 [2024-11-30 04:32:35.529530] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:30:45.249 [2024-11-30 04:32:35.529604] [ DPDK EAL parameters: nvmf --no-shconf -c 0x3 --huge-unlink --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk_pid2495668 ] 00:30:45.249 EAL: No free 2048 kB hugepages reported on node 1 00:30:45.249 [2024-11-30 04:32:35.608557] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 2 00:30:45.249 [2024-11-30 04:32:35.708827] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:30:45.249 [2024-11-30 04:32:35.709096] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:30:45.249 [2024-11-30 04:32:35.709108] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:30:45.508 04:32:35 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:30:45.508 04:32:35 -- common/autotest_common.sh@862 -- # return 0 00:30:45.508 04:32:35 -- spdkcli/nvmf.sh@19 -- # timing_exit run_nvmf_tgt 00:30:45.508 04:32:35 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:45.508 04:32:35 -- common/autotest_common.sh@10 -- # set +x 00:30:45.508 04:32:35 -- spdkcli/nvmf.sh@21 -- # NVMF_TARGET_IP=127.0.0.1 00:30:45.508 04:32:35 -- spdkcli/nvmf.sh@22 -- # [[ tcp == \r\d\m\a ]] 00:30:45.508 04:32:35 -- spdkcli/nvmf.sh@27 -- # timing_enter spdkcli_create_nvmf_config 00:30:45.508 04:32:35 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:45.508 04:32:35 -- common/autotest_common.sh@10 -- # set +x 00:30:45.508 04:32:35 -- spdkcli/nvmf.sh@65 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/bdevs/malloc create 32 512 Malloc1'\'' '\''Malloc1'\'' True 00:30:45.508 '\''/bdevs/malloc create 32 512 Malloc2'\'' '\''Malloc2'\'' True 00:30:45.508 '\''/bdevs/malloc create 32 512 Malloc3'\'' '\''Malloc3'\'' True 00:30:45.508 '\''/bdevs/malloc create 32 512 Malloc4'\'' '\''Malloc4'\'' True 00:30:45.508 '\''/bdevs/malloc create 32 512 Malloc5'\'' '\''Malloc5'\'' True 00:30:45.508 '\''/bdevs/malloc create 32 512 Malloc6'\'' '\''Malloc6'\'' True 00:30:45.509 '\''nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192'\'' '\'''\'' True 00:30:45.509 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1'\'' '\''Malloc3'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2'\'' '\''Malloc4'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:45.509 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2'\'' '\''Malloc2'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:45.509 '\''/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1'\'' '\''Malloc1'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4'\'' '\''127.0.0.1:4260'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True'\'' '\''Allow any host'\'' 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False'\'' '\''Allow any host'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4'\'' '\''127.0.0.1:4261'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4'\'' '\''127.0.0.1:4262'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5'\'' '\''Malloc5'\'' True 00:30:45.509 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6'\'' '\''Malloc6'\'' True 00:30:45.509 '\''/nvmf/referral create tcp 127.0.0.2 4030 IPv4'\'' 00:30:45.509 ' 00:30:45.768 [2024-11-30 04:32:36.354894] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:30:48.296 [2024-11-30 04:32:38.538894] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:30:49.243 [2024-11-30 04:32:39.791426] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4260 *** 00:30:51.771 [2024-11-30 04:32:42.114967] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4261 *** 00:30:53.670 [2024-11-30 04:32:44.105356] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 127.0.0.1 port 4262 *** 00:30:55.044 Executing command: ['/bdevs/malloc create 32 512 Malloc1', 'Malloc1', True] 00:30:55.044 Executing command: ['/bdevs/malloc create 32 512 Malloc2', 'Malloc2', True] 00:30:55.044 Executing command: ['/bdevs/malloc create 32 512 Malloc3', 'Malloc3', True] 00:30:55.044 Executing command: ['/bdevs/malloc create 32 512 Malloc4', 'Malloc4', True] 00:30:55.044 Executing command: ['/bdevs/malloc create 32 512 Malloc5', 'Malloc5', True] 00:30:55.044 Executing command: ['/bdevs/malloc create 32 512 Malloc6', 'Malloc6', True] 00:30:55.044 Executing command: ['nvmf/transport create tcp max_io_qpairs_per_ctrlr=4 io_unit_size=8192', '', True] 00:30:55.044 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode1 N37SXV509SRW max_namespaces=4 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc3 1', 'Malloc3', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc4 2', 'Malloc4', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:55.044 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode2 N37SXV509SRD max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/namespaces create Malloc2', 'Malloc2', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode2/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:55.044 Executing command: ['/nvmf/subsystem create nqn.2014-08.org.spdk:cnode3 N37SXV509SRR max_namespaces=2 allow_any_host=True', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/namespaces create Malloc1', 'Malloc1', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4260 IPv4', '127.0.0.1:4260', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode1', 'nqn.2014-08.org.spdk:cnode1', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host True', 'Allow any host', False] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1 allow_any_host False', 'Allow any host', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4261 IPv4', '127.0.0.1:4261', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses create tcp 127.0.0.1 4262 IPv4', '127.0.0.1:4262', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts create nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc5', 'Malloc5', True] 00:30:55.044 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces create Malloc6', 'Malloc6', True] 00:30:55.044 Executing command: ['/nvmf/referral create tcp 127.0.0.2 4030 IPv4', False] 00:30:55.302 04:32:45 -- spdkcli/nvmf.sh@66 -- # timing_exit spdkcli_create_nvmf_config 00:30:55.302 04:32:45 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:55.302 04:32:45 -- common/autotest_common.sh@10 -- # set +x 00:30:55.302 04:32:45 -- spdkcli/nvmf.sh@68 -- # timing_enter spdkcli_check_match 00:30:55.302 04:32:45 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:55.302 04:32:45 -- common/autotest_common.sh@10 -- # set +x 00:30:55.302 04:32:45 -- spdkcli/nvmf.sh@69 -- # check_match 00:30:55.302 04:32:45 -- spdkcli/common.sh@44 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdkcli.py ll /nvmf 00:30:55.868 04:32:46 -- spdkcli/common.sh@45 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/app/match/match /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test.match 00:30:55.868 04:32:46 -- spdkcli/common.sh@46 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_nvmf.test 00:30:55.868 04:32:46 -- spdkcli/nvmf.sh@70 -- # timing_exit spdkcli_check_match 00:30:55.868 04:32:46 -- common/autotest_common.sh@728 -- # xtrace_disable 00:30:55.868 04:32:46 -- common/autotest_common.sh@10 -- # set +x 00:30:55.868 04:32:46 -- spdkcli/nvmf.sh@72 -- # timing_enter spdkcli_clear_nvmf_config 00:30:55.868 04:32:46 -- common/autotest_common.sh@722 -- # xtrace_disable 00:30:55.868 04:32:46 -- common/autotest_common.sh@10 -- # set +x 00:30:55.868 04:32:46 -- spdkcli/nvmf.sh@87 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_job.py ''\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1'\'' '\''Malloc3'\'' 00:30:55.868 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all'\'' '\''Malloc4'\'' 00:30:55.868 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:55.868 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all'\'' '\''nqn.2014-08.org.spdk:cnode1'\'' 00:30:55.868 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262'\'' '\''127.0.0.1:4262'\'' 00:30:55.868 '\''/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all'\'' '\''127.0.0.1:4261'\'' 00:30:55.868 '\''/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3'\'' '\''nqn.2014-08.org.spdk:cnode3'\'' 00:30:55.868 '\''/nvmf/subsystem delete_all'\'' '\''nqn.2014-08.org.spdk:cnode2'\'' 00:30:55.868 '\''/bdevs/malloc delete Malloc6'\'' '\''Malloc6'\'' 00:30:55.868 '\''/bdevs/malloc delete Malloc5'\'' '\''Malloc5'\'' 00:30:55.868 '\''/bdevs/malloc delete Malloc4'\'' '\''Malloc4'\'' 00:30:55.868 '\''/bdevs/malloc delete Malloc3'\'' '\''Malloc3'\'' 00:30:55.868 '\''/bdevs/malloc delete Malloc2'\'' '\''Malloc2'\'' 00:30:55.868 '\''/bdevs/malloc delete Malloc1'\'' '\''Malloc1'\'' 00:30:55.868 ' 00:31:01.130 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete nsid=1', 'Malloc3', False] 00:31:01.130 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/namespaces delete_all', 'Malloc4', False] 00:31:01.130 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/hosts delete nqn.2014-08.org.spdk:cnode2', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:01.130 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode3/hosts delete_all', 'nqn.2014-08.org.spdk:cnode1', False] 00:31:01.130 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete tcp 127.0.0.1 4262', '127.0.0.1:4262', False] 00:31:01.130 Executing command: ['/nvmf/subsystem/nqn.2014-08.org.spdk:cnode1/listen_addresses delete_all', '127.0.0.1:4261', False] 00:31:01.130 Executing command: ['/nvmf/subsystem delete nqn.2014-08.org.spdk:cnode3', 'nqn.2014-08.org.spdk:cnode3', False] 00:31:01.130 Executing command: ['/nvmf/subsystem delete_all', 'nqn.2014-08.org.spdk:cnode2', False] 00:31:01.130 Executing command: ['/bdevs/malloc delete Malloc6', 'Malloc6', False] 00:31:01.130 Executing command: ['/bdevs/malloc delete Malloc5', 'Malloc5', False] 00:31:01.130 Executing command: ['/bdevs/malloc delete Malloc4', 'Malloc4', False] 00:31:01.130 Executing command: ['/bdevs/malloc delete Malloc3', 'Malloc3', False] 00:31:01.130 Executing command: ['/bdevs/malloc delete Malloc2', 'Malloc2', False] 00:31:01.130 Executing command: ['/bdevs/malloc delete Malloc1', 'Malloc1', False] 00:31:01.130 04:32:51 -- spdkcli/nvmf.sh@88 -- # timing_exit spdkcli_clear_nvmf_config 00:31:01.130 04:32:51 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:01.130 04:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:01.130 04:32:51 -- spdkcli/nvmf.sh@90 -- # killprocess 2495668 00:31:01.130 04:32:51 -- common/autotest_common.sh@936 -- # '[' -z 2495668 ']' 00:31:01.130 04:32:51 -- common/autotest_common.sh@940 -- # kill -0 2495668 00:31:01.130 04:32:51 -- common/autotest_common.sh@941 -- # uname 00:31:01.130 04:32:51 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:01.130 04:32:51 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2495668 00:31:01.130 04:32:51 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:01.130 04:32:51 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:01.130 04:32:51 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2495668' 00:31:01.130 killing process with pid 2495668 00:31:01.130 04:32:51 -- common/autotest_common.sh@955 -- # kill 2495668 00:31:01.130 [2024-11-30 04:32:51.661682] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:01.130 04:32:51 -- common/autotest_common.sh@960 -- # wait 2495668 00:31:01.389 04:32:51 -- spdkcli/nvmf.sh@1 -- # cleanup 00:31:01.389 04:32:51 -- spdkcli/common.sh@10 -- # '[' -n '' ']' 00:31:01.389 04:32:51 -- spdkcli/common.sh@13 -- # '[' -n 2495668 ']' 00:31:01.389 04:32:51 -- spdkcli/common.sh@14 -- # killprocess 2495668 00:31:01.389 04:32:51 -- common/autotest_common.sh@936 -- # '[' -z 2495668 ']' 00:31:01.389 04:32:51 -- common/autotest_common.sh@940 -- # kill -0 2495668 00:31:01.389 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2495668) - No such process 00:31:01.389 04:32:51 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2495668 is not found' 00:31:01.389 Process with pid 2495668 is not found 00:31:01.389 04:32:51 -- spdkcli/common.sh@16 -- # '[' -n '' ']' 00:31:01.389 04:32:51 -- spdkcli/common.sh@19 -- # '[' -n '' ']' 00:31:01.389 04:32:51 -- spdkcli/common.sh@22 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/spdkcli_nvmf.test /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/spdkcli/match_files/spdkcli_details_vhost.test /tmp/sample_aio 00:31:01.389 00:31:01.389 real 0m16.557s 00:31:01.389 user 0m35.397s 00:31:01.389 sys 0m0.805s 00:31:01.389 04:32:51 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:01.389 04:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:01.389 ************************************ 00:31:01.389 END TEST spdkcli_nvmf_tcp 00:31:01.389 ************************************ 00:31:01.389 04:32:51 -- spdk/autotest.sh@285 -- # run_test nvmf_identify_passthru /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:01.389 04:32:51 -- common/autotest_common.sh@1087 -- # '[' 3 -le 1 ']' 00:31:01.389 04:32:51 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:01.389 04:32:51 -- common/autotest_common.sh@10 -- # set +x 00:31:01.389 ************************************ 00:31:01.389 START TEST nvmf_identify_passthru 00:31:01.389 ************************************ 00:31:01.389 04:32:51 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/identify_passthru.sh --transport=tcp 00:31:01.389 * Looking for test storage... 00:31:01.389 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:01.389 04:32:51 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:01.389 04:32:51 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:01.389 04:32:51 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:01.647 04:32:52 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:01.647 04:32:52 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:01.647 04:32:52 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:01.647 04:32:52 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:01.647 04:32:52 -- scripts/common.sh@335 -- # IFS=.-: 00:31:01.647 04:32:52 -- scripts/common.sh@335 -- # read -ra ver1 00:31:01.647 04:32:52 -- scripts/common.sh@336 -- # IFS=.-: 00:31:01.647 04:32:52 -- scripts/common.sh@336 -- # read -ra ver2 00:31:01.647 04:32:52 -- scripts/common.sh@337 -- # local 'op=<' 00:31:01.647 04:32:52 -- scripts/common.sh@339 -- # ver1_l=2 00:31:01.647 04:32:52 -- scripts/common.sh@340 -- # ver2_l=1 00:31:01.647 04:32:52 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:01.647 04:32:52 -- scripts/common.sh@343 -- # case "$op" in 00:31:01.647 04:32:52 -- scripts/common.sh@344 -- # : 1 00:31:01.647 04:32:52 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:01.647 04:32:52 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:01.647 04:32:52 -- scripts/common.sh@364 -- # decimal 1 00:31:01.647 04:32:52 -- scripts/common.sh@352 -- # local d=1 00:31:01.647 04:32:52 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:01.647 04:32:52 -- scripts/common.sh@354 -- # echo 1 00:31:01.647 04:32:52 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:01.647 04:32:52 -- scripts/common.sh@365 -- # decimal 2 00:31:01.648 04:32:52 -- scripts/common.sh@352 -- # local d=2 00:31:01.648 04:32:52 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:01.648 04:32:52 -- scripts/common.sh@354 -- # echo 2 00:31:01.648 04:32:52 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:01.648 04:32:52 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:01.648 04:32:52 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:01.648 04:32:52 -- scripts/common.sh@367 -- # return 0 00:31:01.648 04:32:52 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:01.648 04:32:52 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:01.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:01.648 --rc genhtml_branch_coverage=1 00:31:01.648 --rc genhtml_function_coverage=1 00:31:01.648 --rc genhtml_legend=1 00:31:01.648 --rc geninfo_all_blocks=1 00:31:01.648 --rc geninfo_unexecuted_blocks=1 00:31:01.648 00:31:01.648 ' 00:31:01.648 04:32:52 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:01.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:01.648 --rc genhtml_branch_coverage=1 00:31:01.648 --rc genhtml_function_coverage=1 00:31:01.648 --rc genhtml_legend=1 00:31:01.648 --rc geninfo_all_blocks=1 00:31:01.648 --rc geninfo_unexecuted_blocks=1 00:31:01.648 00:31:01.648 ' 00:31:01.648 04:32:52 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:01.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:01.648 --rc genhtml_branch_coverage=1 00:31:01.648 --rc genhtml_function_coverage=1 00:31:01.648 --rc genhtml_legend=1 00:31:01.648 --rc geninfo_all_blocks=1 00:31:01.648 --rc geninfo_unexecuted_blocks=1 00:31:01.648 00:31:01.648 ' 00:31:01.648 04:32:52 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:01.648 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:01.648 --rc genhtml_branch_coverage=1 00:31:01.648 --rc genhtml_function_coverage=1 00:31:01.648 --rc genhtml_legend=1 00:31:01.648 --rc geninfo_all_blocks=1 00:31:01.648 --rc geninfo_unexecuted_blocks=1 00:31:01.648 00:31:01.648 ' 00:31:01.648 04:32:52 -- target/identify_passthru.sh@9 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:01.648 04:32:52 -- nvmf/common.sh@7 -- # uname -s 00:31:01.648 04:32:52 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:01.648 04:32:52 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:01.648 04:32:52 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:01.648 04:32:52 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:01.648 04:32:52 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:01.648 04:32:52 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:01.648 04:32:52 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:01.648 04:32:52 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:01.648 04:32:52 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:01.648 04:32:52 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:01.648 04:32:52 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:01.648 04:32:52 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:01.648 04:32:52 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:01.648 04:32:52 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:01.648 04:32:52 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:01.648 04:32:52 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:01.648 04:32:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:01.648 04:32:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:01.648 04:32:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:01.648 04:32:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:01.648 04:32:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:01.648 04:32:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:01.648 04:32:52 -- paths/export.sh@5 -- # export PATH 00:31:01.648 04:32:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:01.648 04:32:52 -- nvmf/common.sh@46 -- # : 0 00:31:01.648 04:32:52 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:01.648 04:32:52 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:01.648 04:32:52 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:01.648 04:32:52 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:01.648 04:32:52 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:01.648 04:32:52 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:01.648 04:32:52 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:01.648 04:32:52 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:01.648 04:32:52 -- target/identify_passthru.sh@10 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:01.648 04:32:52 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:01.648 04:32:52 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:01.648 04:32:52 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:01.648 04:32:52 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:01.648 04:32:52 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:01.648 04:32:52 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:01.648 04:32:52 -- paths/export.sh@5 -- # export PATH 00:31:01.648 04:32:52 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:01.648 04:32:52 -- target/identify_passthru.sh@12 -- # nvmftestinit 00:31:01.648 04:32:52 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:01.648 04:32:52 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:01.648 04:32:52 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:01.648 04:32:52 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:01.648 04:32:52 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:01.648 04:32:52 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:01.648 04:32:52 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:01.648 04:32:52 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:01.648 04:32:52 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:01.648 04:32:52 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:01.648 04:32:52 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:01.648 04:32:52 -- common/autotest_common.sh@10 -- # set +x 00:31:03.546 04:32:53 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:03.546 04:32:53 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:03.546 04:32:53 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:03.546 04:32:53 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:03.546 04:32:53 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:03.546 04:32:53 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:03.546 04:32:53 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:03.546 04:32:53 -- nvmf/common.sh@294 -- # net_devs=() 00:31:03.546 04:32:53 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:03.546 04:32:53 -- nvmf/common.sh@295 -- # e810=() 00:31:03.546 04:32:53 -- nvmf/common.sh@295 -- # local -ga e810 00:31:03.546 04:32:53 -- nvmf/common.sh@296 -- # x722=() 00:31:03.546 04:32:53 -- nvmf/common.sh@296 -- # local -ga x722 00:31:03.546 04:32:53 -- nvmf/common.sh@297 -- # mlx=() 00:31:03.546 04:32:53 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:03.546 04:32:53 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:03.546 04:32:53 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:03.546 04:32:53 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:03.546 04:32:53 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:03.546 04:32:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:03.546 04:32:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:03.546 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:03.546 04:32:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:03.546 04:32:53 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:03.546 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:03.546 04:32:53 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:03.546 04:32:53 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:03.546 04:32:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:03.547 04:32:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:03.547 04:32:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:03.547 04:32:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:03.547 04:32:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:03.547 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:03.547 04:32:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:03.547 04:32:53 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:03.547 04:32:53 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:03.547 04:32:53 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:03.547 04:32:53 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:03.547 04:32:53 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:03.547 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:03.547 04:32:53 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:03.547 04:32:53 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:03.547 04:32:53 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:03.547 04:32:53 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:03.547 04:32:53 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:03.547 04:32:53 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:03.547 04:32:53 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:03.547 04:32:53 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:03.547 04:32:53 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:03.547 04:32:53 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:03.547 04:32:53 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:03.547 04:32:53 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:03.547 04:32:53 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:03.547 04:32:53 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:03.547 04:32:53 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:03.547 04:32:53 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:03.547 04:32:53 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:03.547 04:32:53 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:03.547 04:32:53 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:03.547 04:32:54 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:03.547 04:32:54 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:03.547 04:32:54 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:03.547 04:32:54 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:03.547 04:32:54 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:03.547 04:32:54 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:03.547 04:32:54 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:03.547 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:03.547 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.278 ms 00:31:03.547 00:31:03.547 --- 10.0.0.2 ping statistics --- 00:31:03.547 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:03.547 rtt min/avg/max/mdev = 0.278/0.278/0.278/0.000 ms 00:31:03.547 04:32:54 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:03.547 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:03.547 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.096 ms 00:31:03.547 00:31:03.547 --- 10.0.0.1 ping statistics --- 00:31:03.547 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:03.547 rtt min/avg/max/mdev = 0.096/0.096/0.096/0.000 ms 00:31:03.547 04:32:54 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:03.547 04:32:54 -- nvmf/common.sh@410 -- # return 0 00:31:03.547 04:32:54 -- nvmf/common.sh@438 -- # '[' '' == iso ']' 00:31:03.547 04:32:54 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:03.547 04:32:54 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:03.547 04:32:54 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:03.547 04:32:54 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:03.547 04:32:54 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:03.547 04:32:54 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:03.547 04:32:54 -- target/identify_passthru.sh@14 -- # timing_enter nvme_identify 00:31:03.547 04:32:54 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:03.547 04:32:54 -- common/autotest_common.sh@10 -- # set +x 00:31:03.547 04:32:54 -- target/identify_passthru.sh@16 -- # get_first_nvme_bdf 00:31:03.547 04:32:54 -- common/autotest_common.sh@1519 -- # bdfs=() 00:31:03.547 04:32:54 -- common/autotest_common.sh@1519 -- # local bdfs 00:31:03.547 04:32:54 -- common/autotest_common.sh@1520 -- # bdfs=($(get_nvme_bdfs)) 00:31:03.547 04:32:54 -- common/autotest_common.sh@1520 -- # get_nvme_bdfs 00:31:03.547 04:32:54 -- common/autotest_common.sh@1508 -- # bdfs=() 00:31:03.547 04:32:54 -- common/autotest_common.sh@1508 -- # local bdfs 00:31:03.547 04:32:54 -- common/autotest_common.sh@1509 -- # bdfs=($("$rootdir/scripts/gen_nvme.sh" | jq -r '.config[].params.traddr')) 00:31:03.547 04:32:54 -- common/autotest_common.sh@1509 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/gen_nvme.sh 00:31:03.547 04:32:54 -- common/autotest_common.sh@1509 -- # jq -r '.config[].params.traddr' 00:31:03.547 04:32:54 -- common/autotest_common.sh@1510 -- # (( 1 == 0 )) 00:31:03.547 04:32:54 -- common/autotest_common.sh@1514 -- # printf '%s\n' 0000:88:00.0 00:31:03.547 04:32:54 -- common/autotest_common.sh@1522 -- # echo 0000:88:00.0 00:31:03.547 04:32:54 -- target/identify_passthru.sh@16 -- # bdf=0000:88:00.0 00:31:03.547 04:32:54 -- target/identify_passthru.sh@17 -- # '[' -z 0000:88:00.0 ']' 00:31:03.547 04:32:54 -- target/identify_passthru.sh@23 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:03.547 04:32:54 -- target/identify_passthru.sh@23 -- # grep 'Serial Number:' 00:31:03.547 04:32:54 -- target/identify_passthru.sh@23 -- # awk '{print $3}' 00:31:03.805 EAL: No free 2048 kB hugepages reported on node 1 00:31:07.988 04:32:58 -- target/identify_passthru.sh@23 -- # nvme_serial_number=PHLJ916004901P0FGN 00:31:07.988 04:32:58 -- target/identify_passthru.sh@24 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r 'trtype:PCIe traddr:0000:88:00.0' -i 0 00:31:07.988 04:32:58 -- target/identify_passthru.sh@24 -- # grep 'Model Number:' 00:31:07.988 04:32:58 -- target/identify_passthru.sh@24 -- # awk '{print $3}' 00:31:07.988 EAL: No free 2048 kB hugepages reported on node 1 00:31:12.173 04:33:02 -- target/identify_passthru.sh@24 -- # nvme_model_number=INTEL 00:31:12.173 04:33:02 -- target/identify_passthru.sh@26 -- # timing_exit nvme_identify 00:31:12.173 04:33:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:12.173 04:33:02 -- common/autotest_common.sh@10 -- # set +x 00:31:12.173 04:33:02 -- target/identify_passthru.sh@28 -- # timing_enter start_nvmf_tgt 00:31:12.173 04:33:02 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:12.173 04:33:02 -- common/autotest_common.sh@10 -- # set +x 00:31:12.173 04:33:02 -- target/identify_passthru.sh@31 -- # nvmfpid=2500416 00:31:12.173 04:33:02 -- target/identify_passthru.sh@30 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xF --wait-for-rpc 00:31:12.173 04:33:02 -- target/identify_passthru.sh@33 -- # trap 'process_shm --id $NVMF_APP_SHM_ID; nvmftestfini; exit 1' SIGINT SIGTERM EXIT 00:31:12.173 04:33:02 -- target/identify_passthru.sh@35 -- # waitforlisten 2500416 00:31:12.173 04:33:02 -- common/autotest_common.sh@829 -- # '[' -z 2500416 ']' 00:31:12.173 04:33:02 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:12.173 04:33:02 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:12.173 04:33:02 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:12.173 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:12.173 04:33:02 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:12.173 04:33:02 -- common/autotest_common.sh@10 -- # set +x 00:31:12.173 [2024-11-30 04:33:02.608970] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:12.173 [2024-11-30 04:33:02.609068] [ DPDK EAL parameters: nvmf -c 0xF --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:12.173 EAL: No free 2048 kB hugepages reported on node 1 00:31:12.173 [2024-11-30 04:33:02.674457] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:31:12.173 [2024-11-30 04:33:02.760260] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:12.173 [2024-11-30 04:33:02.760398] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:12.173 [2024-11-30 04:33:02.760414] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:12.173 [2024-11-30 04:33:02.760425] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:12.173 [2024-11-30 04:33:02.760660] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:31:12.173 [2024-11-30 04:33:02.760723] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:31:12.173 [2024-11-30 04:33:02.760787] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:31:12.173 [2024-11-30 04:33:02.760790] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:12.431 04:33:02 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:12.431 04:33:02 -- common/autotest_common.sh@862 -- # return 0 00:31:12.431 04:33:02 -- target/identify_passthru.sh@36 -- # rpc_cmd -v nvmf_set_config --passthru-identify-ctrlr 00:31:12.431 04:33:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:12.431 04:33:02 -- common/autotest_common.sh@10 -- # set +x 00:31:12.431 INFO: Log level set to 20 00:31:12.431 INFO: Requests: 00:31:12.431 { 00:31:12.431 "jsonrpc": "2.0", 00:31:12.431 "method": "nvmf_set_config", 00:31:12.431 "id": 1, 00:31:12.431 "params": { 00:31:12.431 "admin_cmd_passthru": { 00:31:12.431 "identify_ctrlr": true 00:31:12.431 } 00:31:12.431 } 00:31:12.431 } 00:31:12.431 00:31:12.431 INFO: response: 00:31:12.431 { 00:31:12.431 "jsonrpc": "2.0", 00:31:12.431 "id": 1, 00:31:12.431 "result": true 00:31:12.431 } 00:31:12.431 00:31:12.431 04:33:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:12.431 04:33:02 -- target/identify_passthru.sh@37 -- # rpc_cmd -v framework_start_init 00:31:12.431 04:33:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:12.431 04:33:02 -- common/autotest_common.sh@10 -- # set +x 00:31:12.431 INFO: Setting log level to 20 00:31:12.431 INFO: Setting log level to 20 00:31:12.431 INFO: Log level set to 20 00:31:12.431 INFO: Log level set to 20 00:31:12.431 INFO: Requests: 00:31:12.431 { 00:31:12.431 "jsonrpc": "2.0", 00:31:12.431 "method": "framework_start_init", 00:31:12.431 "id": 1 00:31:12.431 } 00:31:12.431 00:31:12.431 INFO: Requests: 00:31:12.431 { 00:31:12.431 "jsonrpc": "2.0", 00:31:12.431 "method": "framework_start_init", 00:31:12.431 "id": 1 00:31:12.431 } 00:31:12.431 00:31:12.431 [2024-11-30 04:33:02.956337] nvmf_tgt.c: 423:nvmf_tgt_advance_state: *NOTICE*: Custom identify ctrlr handler enabled 00:31:12.431 INFO: response: 00:31:12.431 { 00:31:12.431 "jsonrpc": "2.0", 00:31:12.431 "id": 1, 00:31:12.431 "result": true 00:31:12.431 } 00:31:12.431 00:31:12.431 INFO: response: 00:31:12.431 { 00:31:12.431 "jsonrpc": "2.0", 00:31:12.431 "id": 1, 00:31:12.431 "result": true 00:31:12.431 } 00:31:12.431 00:31:12.431 04:33:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:12.431 04:33:02 -- target/identify_passthru.sh@38 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:31:12.431 04:33:02 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:12.431 04:33:02 -- common/autotest_common.sh@10 -- # set +x 00:31:12.431 INFO: Setting log level to 40 00:31:12.431 INFO: Setting log level to 40 00:31:12.431 INFO: Setting log level to 40 00:31:12.431 [2024-11-30 04:33:02.966416] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:12.431 04:33:02 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:12.431 04:33:02 -- target/identify_passthru.sh@39 -- # timing_exit start_nvmf_tgt 00:31:12.431 04:33:02 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:12.432 04:33:02 -- common/autotest_common.sh@10 -- # set +x 00:31:12.432 04:33:02 -- target/identify_passthru.sh@41 -- # rpc_cmd bdev_nvme_attach_controller -b Nvme0 -t PCIe -a 0000:88:00.0 00:31:12.432 04:33:03 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:12.432 04:33:03 -- common/autotest_common.sh@10 -- # set +x 00:31:15.787 Nvme0n1 00:31:15.787 04:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:15.787 04:33:05 -- target/identify_passthru.sh@42 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 -a -s SPDK00000000000001 -m 1 00:31:15.787 04:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:15.787 04:33:05 -- common/autotest_common.sh@10 -- # set +x 00:31:15.787 04:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:15.787 04:33:05 -- target/identify_passthru.sh@43 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 Nvme0n1 00:31:15.787 04:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:15.787 04:33:05 -- common/autotest_common.sh@10 -- # set +x 00:31:15.787 04:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:15.787 04:33:05 -- target/identify_passthru.sh@44 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:15.787 04:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:15.787 04:33:05 -- common/autotest_common.sh@10 -- # set +x 00:31:15.787 [2024-11-30 04:33:05.867041] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:15.787 04:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:15.787 04:33:05 -- target/identify_passthru.sh@46 -- # rpc_cmd nvmf_get_subsystems 00:31:15.787 04:33:05 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:15.787 04:33:05 -- common/autotest_common.sh@10 -- # set +x 00:31:15.787 [2024-11-30 04:33:05.874732] nvmf_rpc.c: 275:rpc_nvmf_get_subsystems: *WARNING*: rpc_nvmf_get_subsystems: deprecated feature listener.transport is deprecated in favor of trtype to be removed in v24.05 00:31:15.787 [ 00:31:15.787 { 00:31:15.787 "nqn": "nqn.2014-08.org.nvmexpress.discovery", 00:31:15.787 "subtype": "Discovery", 00:31:15.787 "listen_addresses": [], 00:31:15.787 "allow_any_host": true, 00:31:15.787 "hosts": [] 00:31:15.787 }, 00:31:15.787 { 00:31:15.787 "nqn": "nqn.2016-06.io.spdk:cnode1", 00:31:15.787 "subtype": "NVMe", 00:31:15.787 "listen_addresses": [ 00:31:15.787 { 00:31:15.787 "transport": "TCP", 00:31:15.787 "trtype": "TCP", 00:31:15.787 "adrfam": "IPv4", 00:31:15.787 "traddr": "10.0.0.2", 00:31:15.787 "trsvcid": "4420" 00:31:15.787 } 00:31:15.787 ], 00:31:15.787 "allow_any_host": true, 00:31:15.787 "hosts": [], 00:31:15.787 "serial_number": "SPDK00000000000001", 00:31:15.787 "model_number": "SPDK bdev Controller", 00:31:15.787 "max_namespaces": 1, 00:31:15.787 "min_cntlid": 1, 00:31:15.787 "max_cntlid": 65519, 00:31:15.787 "namespaces": [ 00:31:15.787 { 00:31:15.787 "nsid": 1, 00:31:15.787 "bdev_name": "Nvme0n1", 00:31:15.787 "name": "Nvme0n1", 00:31:15.787 "nguid": "BE93538A680C477E9C23E62D810CDA0B", 00:31:15.787 "uuid": "be93538a-680c-477e-9c23-e62d810cda0b" 00:31:15.787 } 00:31:15.787 ] 00:31:15.787 } 00:31:15.787 ] 00:31:15.787 04:33:05 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:15.787 04:33:05 -- target/identify_passthru.sh@54 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:15.787 04:33:05 -- target/identify_passthru.sh@54 -- # grep 'Serial Number:' 00:31:15.787 04:33:05 -- target/identify_passthru.sh@54 -- # awk '{print $3}' 00:31:15.787 EAL: No free 2048 kB hugepages reported on node 1 00:31:15.787 04:33:05 -- target/identify_passthru.sh@54 -- # nvmf_serial_number=PHLJ916004901P0FGN 00:31:15.787 04:33:05 -- target/identify_passthru.sh@61 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/spdk_nvme_identify -r ' trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:cnode1' 00:31:15.787 04:33:05 -- target/identify_passthru.sh@61 -- # grep 'Model Number:' 00:31:15.787 04:33:05 -- target/identify_passthru.sh@61 -- # awk '{print $3}' 00:31:15.787 EAL: No free 2048 kB hugepages reported on node 1 00:31:15.787 04:33:06 -- target/identify_passthru.sh@61 -- # nvmf_model_number=INTEL 00:31:15.787 04:33:06 -- target/identify_passthru.sh@63 -- # '[' PHLJ916004901P0FGN '!=' PHLJ916004901P0FGN ']' 00:31:15.787 04:33:06 -- target/identify_passthru.sh@68 -- # '[' INTEL '!=' INTEL ']' 00:31:15.787 04:33:06 -- target/identify_passthru.sh@73 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:15.787 04:33:06 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:15.787 04:33:06 -- common/autotest_common.sh@10 -- # set +x 00:31:15.787 04:33:06 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:15.787 04:33:06 -- target/identify_passthru.sh@75 -- # trap - SIGINT SIGTERM EXIT 00:31:15.787 04:33:06 -- target/identify_passthru.sh@77 -- # nvmftestfini 00:31:15.787 04:33:06 -- nvmf/common.sh@476 -- # nvmfcleanup 00:31:15.787 04:33:06 -- nvmf/common.sh@116 -- # sync 00:31:15.787 04:33:06 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:31:15.787 04:33:06 -- nvmf/common.sh@119 -- # set +e 00:31:15.787 04:33:06 -- nvmf/common.sh@120 -- # for i in {1..20} 00:31:15.787 04:33:06 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:31:15.787 rmmod nvme_tcp 00:31:15.787 rmmod nvme_fabrics 00:31:15.787 rmmod nvme_keyring 00:31:15.787 04:33:06 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:31:15.787 04:33:06 -- nvmf/common.sh@123 -- # set -e 00:31:15.787 04:33:06 -- nvmf/common.sh@124 -- # return 0 00:31:15.787 04:33:06 -- nvmf/common.sh@477 -- # '[' -n 2500416 ']' 00:31:15.787 04:33:06 -- nvmf/common.sh@478 -- # killprocess 2500416 00:31:15.787 04:33:06 -- common/autotest_common.sh@936 -- # '[' -z 2500416 ']' 00:31:15.787 04:33:06 -- common/autotest_common.sh@940 -- # kill -0 2500416 00:31:15.787 04:33:06 -- common/autotest_common.sh@941 -- # uname 00:31:15.787 04:33:06 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:31:15.787 04:33:06 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2500416 00:31:15.787 04:33:06 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:31:15.787 04:33:06 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:31:15.787 04:33:06 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2500416' 00:31:15.787 killing process with pid 2500416 00:31:15.787 04:33:06 -- common/autotest_common.sh@955 -- # kill 2500416 00:31:15.787 [2024-11-30 04:33:06.320231] app.c: 883:log_deprecation_hits: *WARNING*: rpc_nvmf_get_subsystems: deprecation 'listener.transport is deprecated in favor of trtype' scheduled for removal in v24.05 hit 1 times 00:31:15.787 04:33:06 -- common/autotest_common.sh@960 -- # wait 2500416 00:31:17.687 04:33:07 -- nvmf/common.sh@480 -- # '[' '' == iso ']' 00:31:17.687 04:33:07 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:31:17.687 04:33:07 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:31:17.687 04:33:07 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:31:17.687 04:33:07 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:31:17.687 04:33:07 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:17.687 04:33:07 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:17.687 04:33:07 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:19.588 04:33:09 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:31:19.588 00:31:19.588 real 0m17.963s 00:31:19.588 user 0m26.807s 00:31:19.588 sys 0m2.254s 00:31:19.588 04:33:09 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:19.588 04:33:09 -- common/autotest_common.sh@10 -- # set +x 00:31:19.588 ************************************ 00:31:19.588 END TEST nvmf_identify_passthru 00:31:19.588 ************************************ 00:31:19.588 04:33:09 -- spdk/autotest.sh@287 -- # run_test nvmf_dif /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:19.588 04:33:09 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:19.588 04:33:09 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:19.588 04:33:09 -- common/autotest_common.sh@10 -- # set +x 00:31:19.588 ************************************ 00:31:19.588 START TEST nvmf_dif 00:31:19.588 ************************************ 00:31:19.588 04:33:09 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/dif.sh 00:31:19.588 * Looking for test storage... 00:31:19.588 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:31:19.588 04:33:09 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:31:19.588 04:33:09 -- common/autotest_common.sh@1690 -- # lcov --version 00:31:19.588 04:33:09 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:31:19.588 04:33:10 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:31:19.588 04:33:10 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:31:19.588 04:33:10 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:31:19.588 04:33:10 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:31:19.588 04:33:10 -- scripts/common.sh@335 -- # IFS=.-: 00:31:19.588 04:33:10 -- scripts/common.sh@335 -- # read -ra ver1 00:31:19.588 04:33:10 -- scripts/common.sh@336 -- # IFS=.-: 00:31:19.588 04:33:10 -- scripts/common.sh@336 -- # read -ra ver2 00:31:19.588 04:33:10 -- scripts/common.sh@337 -- # local 'op=<' 00:31:19.588 04:33:10 -- scripts/common.sh@339 -- # ver1_l=2 00:31:19.588 04:33:10 -- scripts/common.sh@340 -- # ver2_l=1 00:31:19.588 04:33:10 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:31:19.588 04:33:10 -- scripts/common.sh@343 -- # case "$op" in 00:31:19.588 04:33:10 -- scripts/common.sh@344 -- # : 1 00:31:19.588 04:33:10 -- scripts/common.sh@363 -- # (( v = 0 )) 00:31:19.588 04:33:10 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:31:19.588 04:33:10 -- scripts/common.sh@364 -- # decimal 1 00:31:19.588 04:33:10 -- scripts/common.sh@352 -- # local d=1 00:31:19.588 04:33:10 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:31:19.588 04:33:10 -- scripts/common.sh@354 -- # echo 1 00:31:19.588 04:33:10 -- scripts/common.sh@364 -- # ver1[v]=1 00:31:19.588 04:33:10 -- scripts/common.sh@365 -- # decimal 2 00:31:19.588 04:33:10 -- scripts/common.sh@352 -- # local d=2 00:31:19.588 04:33:10 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:31:19.588 04:33:10 -- scripts/common.sh@354 -- # echo 2 00:31:19.588 04:33:10 -- scripts/common.sh@365 -- # ver2[v]=2 00:31:19.589 04:33:10 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:31:19.589 04:33:10 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:31:19.589 04:33:10 -- scripts/common.sh@367 -- # return 0 00:31:19.589 04:33:10 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:31:19.589 04:33:10 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:31:19.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:19.589 --rc genhtml_branch_coverage=1 00:31:19.589 --rc genhtml_function_coverage=1 00:31:19.589 --rc genhtml_legend=1 00:31:19.589 --rc geninfo_all_blocks=1 00:31:19.589 --rc geninfo_unexecuted_blocks=1 00:31:19.589 00:31:19.589 ' 00:31:19.589 04:33:10 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:31:19.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:19.589 --rc genhtml_branch_coverage=1 00:31:19.589 --rc genhtml_function_coverage=1 00:31:19.589 --rc genhtml_legend=1 00:31:19.589 --rc geninfo_all_blocks=1 00:31:19.589 --rc geninfo_unexecuted_blocks=1 00:31:19.589 00:31:19.589 ' 00:31:19.589 04:33:10 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:31:19.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:19.589 --rc genhtml_branch_coverage=1 00:31:19.589 --rc genhtml_function_coverage=1 00:31:19.589 --rc genhtml_legend=1 00:31:19.589 --rc geninfo_all_blocks=1 00:31:19.589 --rc geninfo_unexecuted_blocks=1 00:31:19.589 00:31:19.589 ' 00:31:19.589 04:33:10 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:31:19.589 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:31:19.589 --rc genhtml_branch_coverage=1 00:31:19.589 --rc genhtml_function_coverage=1 00:31:19.589 --rc genhtml_legend=1 00:31:19.589 --rc geninfo_all_blocks=1 00:31:19.589 --rc geninfo_unexecuted_blocks=1 00:31:19.589 00:31:19.589 ' 00:31:19.589 04:33:10 -- target/dif.sh@13 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:31:19.589 04:33:10 -- nvmf/common.sh@7 -- # uname -s 00:31:19.589 04:33:10 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:31:19.589 04:33:10 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:31:19.589 04:33:10 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:31:19.589 04:33:10 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:31:19.589 04:33:10 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:31:19.589 04:33:10 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:31:19.589 04:33:10 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:31:19.589 04:33:10 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:31:19.589 04:33:10 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:31:19.589 04:33:10 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:31:19.589 04:33:10 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:31:19.589 04:33:10 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:31:19.589 04:33:10 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:31:19.589 04:33:10 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:31:19.589 04:33:10 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:31:19.589 04:33:10 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:31:19.589 04:33:10 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:31:19.589 04:33:10 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:31:19.589 04:33:10 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:31:19.589 04:33:10 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.589 04:33:10 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.589 04:33:10 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.589 04:33:10 -- paths/export.sh@5 -- # export PATH 00:31:19.589 04:33:10 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:31:19.589 04:33:10 -- nvmf/common.sh@46 -- # : 0 00:31:19.589 04:33:10 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:31:19.589 04:33:10 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:31:19.589 04:33:10 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:31:19.589 04:33:10 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:31:19.589 04:33:10 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:31:19.589 04:33:10 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:31:19.589 04:33:10 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:31:19.589 04:33:10 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:31:19.589 04:33:10 -- target/dif.sh@15 -- # NULL_META=16 00:31:19.589 04:33:10 -- target/dif.sh@15 -- # NULL_BLOCK_SIZE=512 00:31:19.589 04:33:10 -- target/dif.sh@15 -- # NULL_SIZE=64 00:31:19.589 04:33:10 -- target/dif.sh@15 -- # NULL_DIF=1 00:31:19.589 04:33:10 -- target/dif.sh@135 -- # nvmftestinit 00:31:19.589 04:33:10 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:31:19.589 04:33:10 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:31:19.589 04:33:10 -- nvmf/common.sh@436 -- # prepare_net_devs 00:31:19.589 04:33:10 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:31:19.589 04:33:10 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:31:19.589 04:33:10 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:31:19.589 04:33:10 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:31:19.589 04:33:10 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:31:19.589 04:33:10 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:31:19.589 04:33:10 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:31:19.589 04:33:10 -- nvmf/common.sh@284 -- # xtrace_disable 00:31:19.589 04:33:10 -- common/autotest_common.sh@10 -- # set +x 00:31:21.487 04:33:12 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:31:21.487 04:33:12 -- nvmf/common.sh@290 -- # pci_devs=() 00:31:21.487 04:33:12 -- nvmf/common.sh@290 -- # local -a pci_devs 00:31:21.487 04:33:12 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:31:21.487 04:33:12 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:31:21.487 04:33:12 -- nvmf/common.sh@292 -- # pci_drivers=() 00:31:21.487 04:33:12 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:31:21.487 04:33:12 -- nvmf/common.sh@294 -- # net_devs=() 00:31:21.487 04:33:12 -- nvmf/common.sh@294 -- # local -ga net_devs 00:31:21.487 04:33:12 -- nvmf/common.sh@295 -- # e810=() 00:31:21.487 04:33:12 -- nvmf/common.sh@295 -- # local -ga e810 00:31:21.487 04:33:12 -- nvmf/common.sh@296 -- # x722=() 00:31:21.487 04:33:12 -- nvmf/common.sh@296 -- # local -ga x722 00:31:21.487 04:33:12 -- nvmf/common.sh@297 -- # mlx=() 00:31:21.487 04:33:12 -- nvmf/common.sh@297 -- # local -ga mlx 00:31:21.487 04:33:12 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:31:21.487 04:33:12 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:31:21.487 04:33:12 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:31:21.487 04:33:12 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:31:21.487 04:33:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:21.487 04:33:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:31:21.487 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:31:21.487 04:33:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:31:21.487 04:33:12 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:31:21.487 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:31:21.487 04:33:12 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:31:21.487 04:33:12 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:21.487 04:33:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:21.487 04:33:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:21.487 04:33:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:21.487 04:33:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:31:21.487 Found net devices under 0000:0a:00.0: cvl_0_0 00:31:21.487 04:33:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:21.487 04:33:12 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:31:21.487 04:33:12 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:31:21.487 04:33:12 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:31:21.487 04:33:12 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:31:21.487 04:33:12 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:31:21.487 Found net devices under 0000:0a:00.1: cvl_0_1 00:31:21.487 04:33:12 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:31:21.487 04:33:12 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:31:21.487 04:33:12 -- nvmf/common.sh@402 -- # is_hw=yes 00:31:21.487 04:33:12 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:31:21.487 04:33:12 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:31:21.487 04:33:12 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:31:21.487 04:33:12 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:31:21.487 04:33:12 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:31:21.487 04:33:12 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:31:21.487 04:33:12 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:31:21.487 04:33:12 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:31:21.487 04:33:12 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:31:21.487 04:33:12 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:31:21.487 04:33:12 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:31:21.487 04:33:12 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:31:21.487 04:33:12 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:31:21.487 04:33:12 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:31:21.487 04:33:12 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:31:21.746 04:33:12 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:31:21.747 04:33:12 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:31:21.747 04:33:12 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:31:21.747 04:33:12 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:31:21.747 04:33:12 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:31:21.747 04:33:12 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:31:21.747 04:33:12 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:31:21.747 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:31:21.747 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.198 ms 00:31:21.747 00:31:21.747 --- 10.0.0.2 ping statistics --- 00:31:21.747 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:21.747 rtt min/avg/max/mdev = 0.198/0.198/0.198/0.000 ms 00:31:21.747 04:33:12 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:31:21.747 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:31:21.747 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.102 ms 00:31:21.747 00:31:21.747 --- 10.0.0.1 ping statistics --- 00:31:21.747 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:31:21.747 rtt min/avg/max/mdev = 0.102/0.102/0.102/0.000 ms 00:31:21.747 04:33:12 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:31:21.747 04:33:12 -- nvmf/common.sh@410 -- # return 0 00:31:21.747 04:33:12 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:31:21.747 04:33:12 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:31:23.124 0000:00:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:23.124 0000:88:00.0 (8086 0a54): Already using the vfio-pci driver 00:31:23.124 0000:00:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:23.124 0000:00:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:23.124 0000:00:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:23.124 0000:00:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:23.124 0000:00:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:23.124 0000:00:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:23.124 0000:00:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:23.124 0000:80:04.7 (8086 0e27): Already using the vfio-pci driver 00:31:23.124 0000:80:04.6 (8086 0e26): Already using the vfio-pci driver 00:31:23.124 0000:80:04.5 (8086 0e25): Already using the vfio-pci driver 00:31:23.124 0000:80:04.4 (8086 0e24): Already using the vfio-pci driver 00:31:23.124 0000:80:04.3 (8086 0e23): Already using the vfio-pci driver 00:31:23.124 0000:80:04.2 (8086 0e22): Already using the vfio-pci driver 00:31:23.124 0000:80:04.1 (8086 0e21): Already using the vfio-pci driver 00:31:23.124 0000:80:04.0 (8086 0e20): Already using the vfio-pci driver 00:31:23.124 04:33:13 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:31:23.124 04:33:13 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:31:23.124 04:33:13 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:31:23.124 04:33:13 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:31:23.124 04:33:13 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:31:23.124 04:33:13 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:31:23.124 04:33:13 -- target/dif.sh@136 -- # NVMF_TRANSPORT_OPTS+=' --dif-insert-or-strip' 00:31:23.124 04:33:13 -- target/dif.sh@137 -- # nvmfappstart 00:31:23.124 04:33:13 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:31:23.124 04:33:13 -- common/autotest_common.sh@722 -- # xtrace_disable 00:31:23.124 04:33:13 -- common/autotest_common.sh@10 -- # set +x 00:31:23.124 04:33:13 -- nvmf/common.sh@469 -- # nvmfpid=2504239 00:31:23.124 04:33:13 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF 00:31:23.124 04:33:13 -- nvmf/common.sh@470 -- # waitforlisten 2504239 00:31:23.124 04:33:13 -- common/autotest_common.sh@829 -- # '[' -z 2504239 ']' 00:31:23.124 04:33:13 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:31:23.124 04:33:13 -- common/autotest_common.sh@834 -- # local max_retries=100 00:31:23.124 04:33:13 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:31:23.124 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:31:23.124 04:33:13 -- common/autotest_common.sh@838 -- # xtrace_disable 00:31:23.124 04:33:13 -- common/autotest_common.sh@10 -- # set +x 00:31:23.124 [2024-11-30 04:33:13.587623] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:31:23.124 [2024-11-30 04:33:13.587692] [ DPDK EAL parameters: nvmf -c 0x1 --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:31:23.124 EAL: No free 2048 kB hugepages reported on node 1 00:31:23.124 [2024-11-30 04:33:13.650185] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 1 00:31:23.124 [2024-11-30 04:33:13.732313] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:31:23.124 [2024-11-30 04:33:13.732493] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:31:23.124 [2024-11-30 04:33:13.732512] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:31:23.124 [2024-11-30 04:33:13.732525] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:31:23.124 [2024-11-30 04:33:13.732552] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:31:24.059 04:33:14 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:31:24.059 04:33:14 -- common/autotest_common.sh@862 -- # return 0 00:31:24.059 04:33:14 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:31:24.059 04:33:14 -- common/autotest_common.sh@728 -- # xtrace_disable 00:31:24.059 04:33:14 -- common/autotest_common.sh@10 -- # set +x 00:31:24.059 04:33:14 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:31:24.059 04:33:14 -- target/dif.sh@139 -- # create_transport 00:31:24.059 04:33:14 -- target/dif.sh@50 -- # rpc_cmd nvmf_create_transport -t tcp -o --dif-insert-or-strip 00:31:24.059 04:33:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:24.059 04:33:14 -- common/autotest_common.sh@10 -- # set +x 00:31:24.059 [2024-11-30 04:33:14.588012] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:31:24.059 04:33:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:24.059 04:33:14 -- target/dif.sh@141 -- # run_test fio_dif_1_default fio_dif_1 00:31:24.059 04:33:14 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:24.059 04:33:14 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:24.059 04:33:14 -- common/autotest_common.sh@10 -- # set +x 00:31:24.059 ************************************ 00:31:24.059 START TEST fio_dif_1_default 00:31:24.059 ************************************ 00:31:24.059 04:33:14 -- common/autotest_common.sh@1114 -- # fio_dif_1 00:31:24.059 04:33:14 -- target/dif.sh@86 -- # create_subsystems 0 00:31:24.059 04:33:14 -- target/dif.sh@28 -- # local sub 00:31:24.059 04:33:14 -- target/dif.sh@30 -- # for sub in "$@" 00:31:24.059 04:33:14 -- target/dif.sh@31 -- # create_subsystem 0 00:31:24.059 04:33:14 -- target/dif.sh@18 -- # local sub_id=0 00:31:24.059 04:33:14 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:24.059 04:33:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:24.059 04:33:14 -- common/autotest_common.sh@10 -- # set +x 00:31:24.059 bdev_null0 00:31:24.059 04:33:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:24.059 04:33:14 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:24.059 04:33:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:24.059 04:33:14 -- common/autotest_common.sh@10 -- # set +x 00:31:24.059 04:33:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:24.059 04:33:14 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:24.059 04:33:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:24.059 04:33:14 -- common/autotest_common.sh@10 -- # set +x 00:31:24.059 04:33:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:24.059 04:33:14 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:24.059 04:33:14 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:24.059 04:33:14 -- common/autotest_common.sh@10 -- # set +x 00:31:24.059 [2024-11-30 04:33:14.624318] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:24.059 04:33:14 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:24.059 04:33:14 -- target/dif.sh@87 -- # fio /dev/fd/62 00:31:24.059 04:33:14 -- target/dif.sh@87 -- # create_json_sub_conf 0 00:31:24.059 04:33:14 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:24.059 04:33:14 -- nvmf/common.sh@520 -- # config=() 00:31:24.059 04:33:14 -- nvmf/common.sh@520 -- # local subsystem config 00:31:24.059 04:33:14 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:24.059 04:33:14 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:24.059 04:33:14 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:24.059 { 00:31:24.059 "params": { 00:31:24.059 "name": "Nvme$subsystem", 00:31:24.059 "trtype": "$TEST_TRANSPORT", 00:31:24.059 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:24.059 "adrfam": "ipv4", 00:31:24.059 "trsvcid": "$NVMF_PORT", 00:31:24.059 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:24.059 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:24.059 "hdgst": ${hdgst:-false}, 00:31:24.059 "ddgst": ${ddgst:-false} 00:31:24.059 }, 00:31:24.059 "method": "bdev_nvme_attach_controller" 00:31:24.059 } 00:31:24.059 EOF 00:31:24.059 )") 00:31:24.059 04:33:14 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:24.059 04:33:14 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:24.059 04:33:14 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:24.059 04:33:14 -- target/dif.sh@82 -- # gen_fio_conf 00:31:24.059 04:33:14 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:24.059 04:33:14 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:24.059 04:33:14 -- target/dif.sh@54 -- # local file 00:31:24.059 04:33:14 -- common/autotest_common.sh@1330 -- # shift 00:31:24.059 04:33:14 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:24.059 04:33:14 -- target/dif.sh@56 -- # cat 00:31:24.059 04:33:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:24.059 04:33:14 -- nvmf/common.sh@542 -- # cat 00:31:24.059 04:33:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:24.059 04:33:14 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:24.059 04:33:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:24.059 04:33:14 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:24.059 04:33:14 -- target/dif.sh@72 -- # (( file <= files )) 00:31:24.059 04:33:14 -- nvmf/common.sh@544 -- # jq . 00:31:24.059 04:33:14 -- nvmf/common.sh@545 -- # IFS=, 00:31:24.059 04:33:14 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:24.059 "params": { 00:31:24.059 "name": "Nvme0", 00:31:24.059 "trtype": "tcp", 00:31:24.059 "traddr": "10.0.0.2", 00:31:24.059 "adrfam": "ipv4", 00:31:24.059 "trsvcid": "4420", 00:31:24.059 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:24.059 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:24.059 "hdgst": false, 00:31:24.059 "ddgst": false 00:31:24.059 }, 00:31:24.059 "method": "bdev_nvme_attach_controller" 00:31:24.059 }' 00:31:24.059 04:33:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:24.059 04:33:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:24.059 04:33:14 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:24.059 04:33:14 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:24.059 04:33:14 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:24.059 04:33:14 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:24.059 04:33:14 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:24.059 04:33:14 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:24.059 04:33:14 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:24.059 04:33:14 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:24.317 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:24.317 fio-3.35 00:31:24.317 Starting 1 thread 00:31:24.317 EAL: No free 2048 kB hugepages reported on node 1 00:31:24.882 [2024-11-30 04:33:15.286652] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:24.882 [2024-11-30 04:33:15.286720] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:34.865 00:31:34.865 filename0: (groupid=0, jobs=1): err= 0: pid=2504601: Sat Nov 30 04:33:25 2024 00:31:34.865 read: IOPS=97, BW=390KiB/s (399kB/s)(3904KiB/10011msec) 00:31:34.865 slat (nsec): min=4151, max=72132, avg=8820.89, stdev=3776.60 00:31:34.865 clat (usec): min=40813, max=47342, avg=40998.40, stdev=407.95 00:31:34.865 lat (usec): min=40820, max=47366, avg=41007.22, stdev=408.00 00:31:34.865 clat percentiles (usec): 00:31:34.865 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:34.865 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:34.865 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[41157], 00:31:34.865 | 99.00th=[41157], 99.50th=[41157], 99.90th=[47449], 99.95th=[47449], 00:31:34.865 | 99.99th=[47449] 00:31:34.865 bw ( KiB/s): min= 384, max= 416, per=99.49%, avg=388.80, stdev=11.72, samples=20 00:31:34.865 iops : min= 96, max= 104, avg=97.20, stdev= 2.93, samples=20 00:31:34.865 lat (msec) : 50=100.00% 00:31:34.865 cpu : usr=91.53%, sys=8.19%, ctx=18, majf=0, minf=299 00:31:34.865 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:34.865 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:34.865 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:34.865 issued rwts: total=976,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:34.865 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:34.865 00:31:34.865 Run status group 0 (all jobs): 00:31:34.865 READ: bw=390KiB/s (399kB/s), 390KiB/s-390KiB/s (399kB/s-399kB/s), io=3904KiB (3998kB), run=10011-10011msec 00:31:35.122 04:33:25 -- target/dif.sh@88 -- # destroy_subsystems 0 00:31:35.122 04:33:25 -- target/dif.sh@43 -- # local sub 00:31:35.122 04:33:25 -- target/dif.sh@45 -- # for sub in "$@" 00:31:35.122 04:33:25 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:35.122 04:33:25 -- target/dif.sh@36 -- # local sub_id=0 00:31:35.122 04:33:25 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:35.122 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.122 04:33:25 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:35.122 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.122 00:31:35.122 real 0m11.072s 00:31:35.122 user 0m10.245s 00:31:35.122 sys 0m1.079s 00:31:35.122 04:33:25 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 ************************************ 00:31:35.122 END TEST fio_dif_1_default 00:31:35.122 ************************************ 00:31:35.122 04:33:25 -- target/dif.sh@142 -- # run_test fio_dif_1_multi_subsystems fio_dif_1_multi_subsystems 00:31:35.122 04:33:25 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:35.122 04:33:25 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 ************************************ 00:31:35.122 START TEST fio_dif_1_multi_subsystems 00:31:35.122 ************************************ 00:31:35.122 04:33:25 -- common/autotest_common.sh@1114 -- # fio_dif_1_multi_subsystems 00:31:35.122 04:33:25 -- target/dif.sh@92 -- # local files=1 00:31:35.122 04:33:25 -- target/dif.sh@94 -- # create_subsystems 0 1 00:31:35.122 04:33:25 -- target/dif.sh@28 -- # local sub 00:31:35.122 04:33:25 -- target/dif.sh@30 -- # for sub in "$@" 00:31:35.122 04:33:25 -- target/dif.sh@31 -- # create_subsystem 0 00:31:35.122 04:33:25 -- target/dif.sh@18 -- # local sub_id=0 00:31:35.122 04:33:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:31:35.122 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 bdev_null0 00:31:35.122 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.122 04:33:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:35.122 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.122 04:33:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:35.122 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.122 04:33:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:35.122 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 [2024-11-30 04:33:25.724721] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:35.122 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.122 04:33:25 -- target/dif.sh@30 -- # for sub in "$@" 00:31:35.122 04:33:25 -- target/dif.sh@31 -- # create_subsystem 1 00:31:35.122 04:33:25 -- target/dif.sh@18 -- # local sub_id=1 00:31:35.122 04:33:25 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:31:35.122 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 bdev_null1 00:31:35.122 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.122 04:33:25 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:35.122 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.122 04:33:25 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:35.122 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.122 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.122 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.122 04:33:25 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:35.385 04:33:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:35.385 04:33:25 -- common/autotest_common.sh@10 -- # set +x 00:31:35.385 04:33:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:35.385 04:33:25 -- target/dif.sh@95 -- # fio /dev/fd/62 00:31:35.385 04:33:25 -- target/dif.sh@95 -- # create_json_sub_conf 0 1 00:31:35.385 04:33:25 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:31:35.385 04:33:25 -- nvmf/common.sh@520 -- # config=() 00:31:35.385 04:33:25 -- nvmf/common.sh@520 -- # local subsystem config 00:31:35.385 04:33:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:35.386 04:33:25 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:35.386 04:33:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:35.386 { 00:31:35.386 "params": { 00:31:35.386 "name": "Nvme$subsystem", 00:31:35.386 "trtype": "$TEST_TRANSPORT", 00:31:35.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:35.386 "adrfam": "ipv4", 00:31:35.386 "trsvcid": "$NVMF_PORT", 00:31:35.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:35.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:35.386 "hdgst": ${hdgst:-false}, 00:31:35.386 "ddgst": ${ddgst:-false} 00:31:35.386 }, 00:31:35.386 "method": "bdev_nvme_attach_controller" 00:31:35.386 } 00:31:35.386 EOF 00:31:35.386 )") 00:31:35.386 04:33:25 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:35.386 04:33:25 -- target/dif.sh@82 -- # gen_fio_conf 00:31:35.386 04:33:25 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:35.386 04:33:25 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:35.386 04:33:25 -- target/dif.sh@54 -- # local file 00:31:35.386 04:33:25 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:35.386 04:33:25 -- target/dif.sh@56 -- # cat 00:31:35.386 04:33:25 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:35.386 04:33:25 -- common/autotest_common.sh@1330 -- # shift 00:31:35.386 04:33:25 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:35.386 04:33:25 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:35.386 04:33:25 -- nvmf/common.sh@542 -- # cat 00:31:35.386 04:33:25 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:35.386 04:33:25 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:35.386 04:33:25 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:35.386 04:33:25 -- target/dif.sh@72 -- # (( file <= files )) 00:31:35.386 04:33:25 -- target/dif.sh@73 -- # cat 00:31:35.386 04:33:25 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:35.386 04:33:25 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:35.386 04:33:25 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:35.386 { 00:31:35.386 "params": { 00:31:35.386 "name": "Nvme$subsystem", 00:31:35.386 "trtype": "$TEST_TRANSPORT", 00:31:35.386 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:35.386 "adrfam": "ipv4", 00:31:35.386 "trsvcid": "$NVMF_PORT", 00:31:35.386 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:35.386 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:35.386 "hdgst": ${hdgst:-false}, 00:31:35.386 "ddgst": ${ddgst:-false} 00:31:35.386 }, 00:31:35.386 "method": "bdev_nvme_attach_controller" 00:31:35.386 } 00:31:35.386 EOF 00:31:35.386 )") 00:31:35.386 04:33:25 -- nvmf/common.sh@542 -- # cat 00:31:35.386 04:33:25 -- target/dif.sh@72 -- # (( file++ )) 00:31:35.386 04:33:25 -- target/dif.sh@72 -- # (( file <= files )) 00:31:35.386 04:33:25 -- nvmf/common.sh@544 -- # jq . 00:31:35.386 04:33:25 -- nvmf/common.sh@545 -- # IFS=, 00:31:35.386 04:33:25 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:35.386 "params": { 00:31:35.386 "name": "Nvme0", 00:31:35.386 "trtype": "tcp", 00:31:35.386 "traddr": "10.0.0.2", 00:31:35.386 "adrfam": "ipv4", 00:31:35.386 "trsvcid": "4420", 00:31:35.386 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:35.386 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:35.386 "hdgst": false, 00:31:35.386 "ddgst": false 00:31:35.386 }, 00:31:35.386 "method": "bdev_nvme_attach_controller" 00:31:35.386 },{ 00:31:35.386 "params": { 00:31:35.386 "name": "Nvme1", 00:31:35.386 "trtype": "tcp", 00:31:35.386 "traddr": "10.0.0.2", 00:31:35.386 "adrfam": "ipv4", 00:31:35.386 "trsvcid": "4420", 00:31:35.386 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:35.386 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:35.386 "hdgst": false, 00:31:35.386 "ddgst": false 00:31:35.386 }, 00:31:35.386 "method": "bdev_nvme_attach_controller" 00:31:35.386 }' 00:31:35.386 04:33:25 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:35.386 04:33:25 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:35.386 04:33:25 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:35.386 04:33:25 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:35.386 04:33:25 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:35.386 04:33:25 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:35.386 04:33:25 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:35.386 04:33:25 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:35.386 04:33:25 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:35.386 04:33:25 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:35.645 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:35.645 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=4 00:31:35.645 fio-3.35 00:31:35.645 Starting 2 threads 00:31:35.645 EAL: No free 2048 kB hugepages reported on node 1 00:31:36.211 [2024-11-30 04:33:26.576884] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:36.211 [2024-11-30 04:33:26.576945] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:46.189 00:31:46.189 filename0: (groupid=0, jobs=1): err= 0: pid=2506042: Sat Nov 30 04:33:36 2024 00:31:46.189 read: IOPS=97, BW=391KiB/s (400kB/s)(3920KiB/10035msec) 00:31:46.189 slat (nsec): min=6471, max=45571, avg=9197.70, stdev=3020.01 00:31:46.189 clat (usec): min=3485, max=43175, avg=40928.65, stdev=2421.70 00:31:46.189 lat (usec): min=3491, max=43189, avg=40937.85, stdev=2421.92 00:31:46.189 clat percentiles (usec): 00:31:46.189 | 1.00th=[40633], 5.00th=[41157], 10.00th=[41157], 20.00th=[41157], 00:31:46.189 | 30.00th=[41157], 40.00th=[41157], 50.00th=[41157], 60.00th=[41157], 00:31:46.189 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41681], 95.00th=[42206], 00:31:46.189 | 99.00th=[42206], 99.50th=[42730], 99.90th=[43254], 99.95th=[43254], 00:31:46.189 | 99.99th=[43254] 00:31:46.189 bw ( KiB/s): min= 384, max= 416, per=33.78%, avg=390.40, stdev=13.13, samples=20 00:31:46.189 iops : min= 96, max= 104, avg=97.60, stdev= 3.28, samples=20 00:31:46.189 lat (msec) : 4=0.41%, 50=99.59% 00:31:46.189 cpu : usr=95.38%, sys=4.33%, ctx=14, majf=0, minf=124 00:31:46.189 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:46.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.189 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.189 issued rwts: total=980,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.189 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:46.189 filename1: (groupid=0, jobs=1): err= 0: pid=2506043: Sat Nov 30 04:33:36 2024 00:31:46.189 read: IOPS=191, BW=764KiB/s (782kB/s)(7664KiB/10030msec) 00:31:46.189 slat (nsec): min=6641, max=72827, avg=8945.19, stdev=3162.76 00:31:46.189 clat (usec): min=529, max=42429, avg=20910.63, stdev=20382.82 00:31:46.189 lat (usec): min=536, max=42440, avg=20919.57, stdev=20382.40 00:31:46.189 clat percentiles (usec): 00:31:46.189 | 1.00th=[ 578], 5.00th=[ 586], 10.00th=[ 594], 20.00th=[ 603], 00:31:46.189 | 30.00th=[ 619], 40.00th=[ 644], 50.00th=[ 1074], 60.00th=[41157], 00:31:46.189 | 70.00th=[41157], 80.00th=[41157], 90.00th=[41157], 95.00th=[42206], 00:31:46.189 | 99.00th=[42206], 99.50th=[42206], 99.90th=[42206], 99.95th=[42206], 00:31:46.189 | 99.99th=[42206] 00:31:46.189 bw ( KiB/s): min= 704, max= 832, per=66.18%, avg=764.80, stdev=22.98, samples=20 00:31:46.189 iops : min= 176, max= 208, avg=191.20, stdev= 5.75, samples=20 00:31:46.189 lat (usec) : 750=43.84%, 1000=5.58% 00:31:46.189 lat (msec) : 2=0.68%, 4=0.21%, 50=49.69% 00:31:46.189 cpu : usr=95.61%, sys=4.07%, ctx=17, majf=0, minf=209 00:31:46.189 IO depths : 1=25.0%, 2=50.0%, 4=25.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:46.189 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.189 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:46.189 issued rwts: total=1916,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:46.189 latency : target=0, window=0, percentile=100.00%, depth=4 00:31:46.189 00:31:46.189 Run status group 0 (all jobs): 00:31:46.189 READ: bw=1154KiB/s (1182kB/s), 391KiB/s-764KiB/s (400kB/s-782kB/s), io=11.3MiB (11.9MB), run=10030-10035msec 00:31:46.447 04:33:36 -- target/dif.sh@96 -- # destroy_subsystems 0 1 00:31:46.447 04:33:36 -- target/dif.sh@43 -- # local sub 00:31:46.447 04:33:36 -- target/dif.sh@45 -- # for sub in "$@" 00:31:46.447 04:33:36 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:46.447 04:33:36 -- target/dif.sh@36 -- # local sub_id=0 00:31:46.447 04:33:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:46.447 04:33:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:46.447 04:33:36 -- common/autotest_common.sh@10 -- # set +x 00:31:46.447 04:33:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:46.447 04:33:36 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:46.447 04:33:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:46.447 04:33:36 -- common/autotest_common.sh@10 -- # set +x 00:31:46.447 04:33:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:46.447 04:33:36 -- target/dif.sh@45 -- # for sub in "$@" 00:31:46.447 04:33:36 -- target/dif.sh@46 -- # destroy_subsystem 1 00:31:46.447 04:33:36 -- target/dif.sh@36 -- # local sub_id=1 00:31:46.447 04:33:36 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:31:46.447 04:33:36 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:46.447 04:33:36 -- common/autotest_common.sh@10 -- # set +x 00:31:46.447 04:33:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:46.447 04:33:37 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:31:46.447 04:33:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:46.447 04:33:37 -- common/autotest_common.sh@10 -- # set +x 00:31:46.447 04:33:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:46.447 00:31:46.447 real 0m11.316s 00:31:46.447 user 0m20.449s 00:31:46.447 sys 0m1.137s 00:31:46.447 04:33:37 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:31:46.447 04:33:37 -- common/autotest_common.sh@10 -- # set +x 00:31:46.447 ************************************ 00:31:46.447 END TEST fio_dif_1_multi_subsystems 00:31:46.447 ************************************ 00:31:46.447 04:33:37 -- target/dif.sh@143 -- # run_test fio_dif_rand_params fio_dif_rand_params 00:31:46.447 04:33:37 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:31:46.447 04:33:37 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:31:46.447 04:33:37 -- common/autotest_common.sh@10 -- # set +x 00:31:46.447 ************************************ 00:31:46.447 START TEST fio_dif_rand_params 00:31:46.447 ************************************ 00:31:46.447 04:33:37 -- common/autotest_common.sh@1114 -- # fio_dif_rand_params 00:31:46.447 04:33:37 -- target/dif.sh@100 -- # local NULL_DIF 00:31:46.447 04:33:37 -- target/dif.sh@101 -- # local bs numjobs runtime iodepth files 00:31:46.447 04:33:37 -- target/dif.sh@103 -- # NULL_DIF=3 00:31:46.447 04:33:37 -- target/dif.sh@103 -- # bs=128k 00:31:46.447 04:33:37 -- target/dif.sh@103 -- # numjobs=3 00:31:46.447 04:33:37 -- target/dif.sh@103 -- # iodepth=3 00:31:46.447 04:33:37 -- target/dif.sh@103 -- # runtime=5 00:31:46.447 04:33:37 -- target/dif.sh@105 -- # create_subsystems 0 00:31:46.447 04:33:37 -- target/dif.sh@28 -- # local sub 00:31:46.447 04:33:37 -- target/dif.sh@30 -- # for sub in "$@" 00:31:46.447 04:33:37 -- target/dif.sh@31 -- # create_subsystem 0 00:31:46.447 04:33:37 -- target/dif.sh@18 -- # local sub_id=0 00:31:46.447 04:33:37 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:31:46.447 04:33:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:46.447 04:33:37 -- common/autotest_common.sh@10 -- # set +x 00:31:46.447 bdev_null0 00:31:46.447 04:33:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:46.447 04:33:37 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:46.447 04:33:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:46.447 04:33:37 -- common/autotest_common.sh@10 -- # set +x 00:31:46.447 04:33:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:46.447 04:33:37 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:46.447 04:33:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:46.447 04:33:37 -- common/autotest_common.sh@10 -- # set +x 00:31:46.447 04:33:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:46.447 04:33:37 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:46.447 04:33:37 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:46.447 04:33:37 -- common/autotest_common.sh@10 -- # set +x 00:31:46.447 [2024-11-30 04:33:37.076239] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:46.708 04:33:37 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:46.708 04:33:37 -- target/dif.sh@106 -- # fio /dev/fd/62 00:31:46.708 04:33:37 -- target/dif.sh@106 -- # create_json_sub_conf 0 00:31:46.708 04:33:37 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:31:46.708 04:33:37 -- nvmf/common.sh@520 -- # config=() 00:31:46.708 04:33:37 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:46.708 04:33:37 -- nvmf/common.sh@520 -- # local subsystem config 00:31:46.708 04:33:37 -- target/dif.sh@82 -- # gen_fio_conf 00:31:46.708 04:33:37 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:46.708 04:33:37 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:46.708 04:33:37 -- target/dif.sh@54 -- # local file 00:31:46.708 04:33:37 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:46.708 { 00:31:46.708 "params": { 00:31:46.708 "name": "Nvme$subsystem", 00:31:46.708 "trtype": "$TEST_TRANSPORT", 00:31:46.708 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:46.708 "adrfam": "ipv4", 00:31:46.708 "trsvcid": "$NVMF_PORT", 00:31:46.708 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:46.708 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:46.708 "hdgst": ${hdgst:-false}, 00:31:46.708 "ddgst": ${ddgst:-false} 00:31:46.708 }, 00:31:46.708 "method": "bdev_nvme_attach_controller" 00:31:46.708 } 00:31:46.708 EOF 00:31:46.708 )") 00:31:46.708 04:33:37 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:46.708 04:33:37 -- target/dif.sh@56 -- # cat 00:31:46.708 04:33:37 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:46.708 04:33:37 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:46.708 04:33:37 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:46.708 04:33:37 -- common/autotest_common.sh@1330 -- # shift 00:31:46.708 04:33:37 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:46.708 04:33:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:46.708 04:33:37 -- nvmf/common.sh@542 -- # cat 00:31:46.708 04:33:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:46.708 04:33:37 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:46.708 04:33:37 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:46.708 04:33:37 -- target/dif.sh@72 -- # (( file <= files )) 00:31:46.708 04:33:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:46.708 04:33:37 -- nvmf/common.sh@544 -- # jq . 00:31:46.708 04:33:37 -- nvmf/common.sh@545 -- # IFS=, 00:31:46.708 04:33:37 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:46.708 "params": { 00:31:46.708 "name": "Nvme0", 00:31:46.708 "trtype": "tcp", 00:31:46.708 "traddr": "10.0.0.2", 00:31:46.708 "adrfam": "ipv4", 00:31:46.708 "trsvcid": "4420", 00:31:46.708 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:46.708 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:46.708 "hdgst": false, 00:31:46.708 "ddgst": false 00:31:46.708 }, 00:31:46.708 "method": "bdev_nvme_attach_controller" 00:31:46.708 }' 00:31:46.708 04:33:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:46.708 04:33:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:46.708 04:33:37 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:46.708 04:33:37 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:46.708 04:33:37 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:46.708 04:33:37 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:46.708 04:33:37 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:46.708 04:33:37 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:46.708 04:33:37 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:46.708 04:33:37 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:46.965 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:31:46.965 ... 00:31:46.965 fio-3.35 00:31:46.965 Starting 3 threads 00:31:46.965 EAL: No free 2048 kB hugepages reported on node 1 00:31:47.531 [2024-11-30 04:33:37.879508] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:47.531 [2024-11-30 04:33:37.879571] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:31:52.795 00:31:52.795 filename0: (groupid=0, jobs=1): err= 0: pid=2507481: Sat Nov 30 04:33:43 2024 00:31:52.795 read: IOPS=206, BW=25.8MiB/s (27.0MB/s)(130MiB/5045msec) 00:31:52.795 slat (nsec): min=4599, max=27984, avg=12173.38, stdev=1796.83 00:31:52.795 clat (usec): min=4630, max=95103, avg=14480.58, stdev=10896.58 00:31:52.795 lat (usec): min=4641, max=95115, avg=14492.75, stdev=10896.45 00:31:52.795 clat percentiles (usec): 00:31:52.795 | 1.00th=[ 5800], 5.00th=[ 8586], 10.00th=[ 9372], 20.00th=[10552], 00:31:52.795 | 30.00th=[10945], 40.00th=[11600], 50.00th=[11994], 60.00th=[12518], 00:31:52.795 | 70.00th=[13173], 80.00th=[13960], 90.00th=[15401], 95.00th=[50594], 00:31:52.795 | 99.00th=[56361], 99.50th=[57410], 99.90th=[93848], 99.95th=[94897], 00:31:52.795 | 99.99th=[94897] 00:31:52.795 bw ( KiB/s): min=17920, max=32000, per=30.58%, avg=26598.40, stdev=3855.05, samples=10 00:31:52.795 iops : min= 140, max= 250, avg=207.80, stdev=30.12, samples=10 00:31:52.795 lat (msec) : 10=13.74%, 20=80.50%, 50=0.58%, 100=5.19% 00:31:52.795 cpu : usr=93.56%, sys=6.01%, ctx=10, majf=0, minf=52 00:31:52.795 IO depths : 1=0.6%, 2=99.4%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:52.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.795 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.795 issued rwts: total=1041,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:52.795 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:52.795 filename0: (groupid=0, jobs=1): err= 0: pid=2507482: Sat Nov 30 04:33:43 2024 00:31:52.795 read: IOPS=245, BW=30.7MiB/s (32.2MB/s)(155MiB/5044msec) 00:31:52.795 slat (nsec): min=4419, max=27021, avg=12296.46, stdev=1540.48 00:31:52.795 clat (usec): min=4536, max=53658, avg=12163.02, stdev=5243.99 00:31:52.795 lat (usec): min=4548, max=53669, avg=12175.32, stdev=5244.06 00:31:52.795 clat percentiles (usec): 00:31:52.795 | 1.00th=[ 5276], 5.00th=[ 7242], 10.00th=[ 8029], 20.00th=[ 8979], 00:31:52.795 | 30.00th=[10159], 40.00th=[11076], 50.00th=[11863], 60.00th=[12649], 00:31:52.795 | 70.00th=[13435], 80.00th=[14222], 90.00th=[15401], 95.00th=[16057], 00:31:52.795 | 99.00th=[50070], 99.50th=[50070], 99.90th=[53740], 99.95th=[53740], 00:31:52.795 | 99.99th=[53740] 00:31:52.795 bw ( KiB/s): min=27136, max=37888, per=36.41%, avg=31667.20, stdev=3869.38, samples=10 00:31:52.795 iops : min= 212, max= 296, avg=247.40, stdev=30.23, samples=10 00:31:52.795 lat (msec) : 10=29.14%, 20=69.49%, 50=0.65%, 100=0.73% 00:31:52.795 cpu : usr=91.85%, sys=7.69%, ctx=17, majf=0, minf=103 00:31:52.795 IO depths : 1=0.5%, 2=99.5%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:52.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.795 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.795 issued rwts: total=1239,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:52.795 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:52.795 filename0: (groupid=0, jobs=1): err= 0: pid=2507483: Sat Nov 30 04:33:43 2024 00:31:52.795 read: IOPS=229, BW=28.7MiB/s (30.1MB/s)(144MiB/5006msec) 00:31:52.795 slat (nsec): min=4648, max=60436, avg=12716.75, stdev=2216.26 00:31:52.795 clat (usec): min=4566, max=56197, avg=13063.25, stdev=6646.84 00:31:52.795 lat (usec): min=4578, max=56210, avg=13075.97, stdev=6646.76 00:31:52.795 clat percentiles (usec): 00:31:52.795 | 1.00th=[ 5604], 5.00th=[ 7570], 10.00th=[ 8225], 20.00th=[ 9503], 00:31:52.795 | 30.00th=[10814], 40.00th=[11600], 50.00th=[12256], 60.00th=[13042], 00:31:52.795 | 70.00th=[13829], 80.00th=[14746], 90.00th=[16057], 95.00th=[17171], 00:31:52.795 | 99.00th=[52167], 99.50th=[54264], 99.90th=[55313], 99.95th=[56361], 00:31:52.795 | 99.99th=[56361] 00:31:52.795 bw ( KiB/s): min=23552, max=35840, per=33.71%, avg=29317.50, stdev=3717.81, samples=10 00:31:52.795 iops : min= 184, max= 280, avg=229.00, stdev=29.06, samples=10 00:31:52.795 lat (msec) : 10=22.82%, 20=74.56%, 50=0.70%, 100=1.92% 00:31:52.795 cpu : usr=92.97%, sys=6.57%, ctx=13, majf=0, minf=124 00:31:52.795 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:31:52.795 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.795 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:31:52.795 issued rwts: total=1148,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:31:52.795 latency : target=0, window=0, percentile=100.00%, depth=3 00:31:52.795 00:31:52.795 Run status group 0 (all jobs): 00:31:52.795 READ: bw=84.9MiB/s (89.1MB/s), 25.8MiB/s-30.7MiB/s (27.0MB/s-32.2MB/s), io=429MiB (449MB), run=5006-5045msec 00:31:52.795 04:33:43 -- target/dif.sh@107 -- # destroy_subsystems 0 00:31:52.795 04:33:43 -- target/dif.sh@43 -- # local sub 00:31:52.795 04:33:43 -- target/dif.sh@45 -- # for sub in "$@" 00:31:52.795 04:33:43 -- target/dif.sh@46 -- # destroy_subsystem 0 00:31:52.795 04:33:43 -- target/dif.sh@36 -- # local sub_id=0 00:31:52.795 04:33:43 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:31:52.795 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.795 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.795 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.795 04:33:43 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:31:52.795 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.795 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.795 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.795 04:33:43 -- target/dif.sh@109 -- # NULL_DIF=2 00:31:52.795 04:33:43 -- target/dif.sh@109 -- # bs=4k 00:31:52.795 04:33:43 -- target/dif.sh@109 -- # numjobs=8 00:31:52.795 04:33:43 -- target/dif.sh@109 -- # iodepth=16 00:31:52.795 04:33:43 -- target/dif.sh@109 -- # runtime= 00:31:52.795 04:33:43 -- target/dif.sh@109 -- # files=2 00:31:52.795 04:33:43 -- target/dif.sh@111 -- # create_subsystems 0 1 2 00:31:52.795 04:33:43 -- target/dif.sh@28 -- # local sub 00:31:52.795 04:33:43 -- target/dif.sh@30 -- # for sub in "$@" 00:31:52.795 04:33:43 -- target/dif.sh@31 -- # create_subsystem 0 00:31:52.795 04:33:43 -- target/dif.sh@18 -- # local sub_id=0 00:31:52.795 04:33:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 2 00:31:52.795 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.795 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.795 bdev_null0 00:31:52.795 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.795 04:33:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:31:52.795 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.795 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.795 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.795 04:33:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:31:52.795 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.795 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.795 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.795 04:33:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:31:52.795 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.795 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.795 [2024-11-30 04:33:43.337371] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:31:52.795 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.795 04:33:43 -- target/dif.sh@30 -- # for sub in "$@" 00:31:52.795 04:33:43 -- target/dif.sh@31 -- # create_subsystem 1 00:31:52.795 04:33:43 -- target/dif.sh@18 -- # local sub_id=1 00:31:52.795 04:33:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 2 00:31:52.795 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.795 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.795 bdev_null1 00:31:52.795 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.795 04:33:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:31:52.795 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.795 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.795 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.795 04:33:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:31:52.795 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.795 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.795 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.795 04:33:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:31:52.795 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.795 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.795 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.796 04:33:43 -- target/dif.sh@30 -- # for sub in "$@" 00:31:52.796 04:33:43 -- target/dif.sh@31 -- # create_subsystem 2 00:31:52.796 04:33:43 -- target/dif.sh@18 -- # local sub_id=2 00:31:52.796 04:33:43 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null2 64 512 --md-size 16 --dif-type 2 00:31:52.796 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.796 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.796 bdev_null2 00:31:52.796 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.796 04:33:43 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode2 --serial-number 53313233-2 --allow-any-host 00:31:52.796 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.796 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.796 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.796 04:33:43 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode2 bdev_null2 00:31:52.796 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.796 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.796 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.796 04:33:43 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode2 -t tcp -a 10.0.0.2 -s 4420 00:31:52.796 04:33:43 -- common/autotest_common.sh@561 -- # xtrace_disable 00:31:52.796 04:33:43 -- common/autotest_common.sh@10 -- # set +x 00:31:52.796 04:33:43 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:31:52.796 04:33:43 -- target/dif.sh@112 -- # fio /dev/fd/62 00:31:52.796 04:33:43 -- target/dif.sh@112 -- # create_json_sub_conf 0 1 2 00:31:52.796 04:33:43 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 2 00:31:52.796 04:33:43 -- nvmf/common.sh@520 -- # config=() 00:31:52.796 04:33:43 -- nvmf/common.sh@520 -- # local subsystem config 00:31:52.796 04:33:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:52.796 04:33:43 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.796 04:33:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:52.796 { 00:31:52.796 "params": { 00:31:52.796 "name": "Nvme$subsystem", 00:31:52.796 "trtype": "$TEST_TRANSPORT", 00:31:52.796 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:52.796 "adrfam": "ipv4", 00:31:52.796 "trsvcid": "$NVMF_PORT", 00:31:52.796 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:52.796 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:52.796 "hdgst": ${hdgst:-false}, 00:31:52.796 "ddgst": ${ddgst:-false} 00:31:52.796 }, 00:31:52.796 "method": "bdev_nvme_attach_controller" 00:31:52.796 } 00:31:52.796 EOF 00:31:52.796 )") 00:31:52.796 04:33:43 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:52.796 04:33:43 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:31:52.796 04:33:43 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:31:52.796 04:33:43 -- common/autotest_common.sh@1328 -- # local sanitizers 00:31:52.796 04:33:43 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.796 04:33:43 -- common/autotest_common.sh@1330 -- # shift 00:31:52.796 04:33:43 -- target/dif.sh@82 -- # gen_fio_conf 00:31:52.796 04:33:43 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:31:52.796 04:33:43 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:52.796 04:33:43 -- target/dif.sh@54 -- # local file 00:31:52.796 04:33:43 -- target/dif.sh@56 -- # cat 00:31:52.796 04:33:43 -- nvmf/common.sh@542 -- # cat 00:31:52.796 04:33:43 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:52.796 04:33:43 -- common/autotest_common.sh@1334 -- # grep libasan 00:31:52.796 04:33:43 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:52.796 04:33:43 -- target/dif.sh@72 -- # (( file = 1 )) 00:31:52.796 04:33:43 -- target/dif.sh@72 -- # (( file <= files )) 00:31:52.796 04:33:43 -- target/dif.sh@73 -- # cat 00:31:52.796 04:33:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:52.796 04:33:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:52.796 { 00:31:52.796 "params": { 00:31:52.796 "name": "Nvme$subsystem", 00:31:52.796 "trtype": "$TEST_TRANSPORT", 00:31:52.796 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:52.796 "adrfam": "ipv4", 00:31:52.796 "trsvcid": "$NVMF_PORT", 00:31:52.796 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:52.796 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:52.796 "hdgst": ${hdgst:-false}, 00:31:52.796 "ddgst": ${ddgst:-false} 00:31:52.796 }, 00:31:52.796 "method": "bdev_nvme_attach_controller" 00:31:52.796 } 00:31:52.796 EOF 00:31:52.796 )") 00:31:52.796 04:33:43 -- nvmf/common.sh@542 -- # cat 00:31:52.796 04:33:43 -- target/dif.sh@72 -- # (( file++ )) 00:31:52.796 04:33:43 -- target/dif.sh@72 -- # (( file <= files )) 00:31:52.796 04:33:43 -- target/dif.sh@73 -- # cat 00:31:52.796 04:33:43 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:31:52.796 04:33:43 -- target/dif.sh@72 -- # (( file++ )) 00:31:52.796 04:33:43 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:31:52.796 { 00:31:52.796 "params": { 00:31:52.796 "name": "Nvme$subsystem", 00:31:52.796 "trtype": "$TEST_TRANSPORT", 00:31:52.796 "traddr": "$NVMF_FIRST_TARGET_IP", 00:31:52.796 "adrfam": "ipv4", 00:31:52.796 "trsvcid": "$NVMF_PORT", 00:31:52.796 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:31:52.796 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:31:52.796 "hdgst": ${hdgst:-false}, 00:31:52.796 "ddgst": ${ddgst:-false} 00:31:52.796 }, 00:31:52.796 "method": "bdev_nvme_attach_controller" 00:31:52.796 } 00:31:52.796 EOF 00:31:52.796 )") 00:31:52.796 04:33:43 -- target/dif.sh@72 -- # (( file <= files )) 00:31:52.796 04:33:43 -- nvmf/common.sh@542 -- # cat 00:31:52.796 04:33:43 -- nvmf/common.sh@544 -- # jq . 00:31:52.796 04:33:43 -- nvmf/common.sh@545 -- # IFS=, 00:31:52.796 04:33:43 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:31:52.796 "params": { 00:31:52.796 "name": "Nvme0", 00:31:52.796 "trtype": "tcp", 00:31:52.796 "traddr": "10.0.0.2", 00:31:52.796 "adrfam": "ipv4", 00:31:52.796 "trsvcid": "4420", 00:31:52.796 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:31:52.796 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:31:52.796 "hdgst": false, 00:31:52.796 "ddgst": false 00:31:52.796 }, 00:31:52.796 "method": "bdev_nvme_attach_controller" 00:31:52.796 },{ 00:31:52.796 "params": { 00:31:52.796 "name": "Nvme1", 00:31:52.796 "trtype": "tcp", 00:31:52.796 "traddr": "10.0.0.2", 00:31:52.796 "adrfam": "ipv4", 00:31:52.796 "trsvcid": "4420", 00:31:52.796 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:31:52.796 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:31:52.796 "hdgst": false, 00:31:52.796 "ddgst": false 00:31:52.796 }, 00:31:52.796 "method": "bdev_nvme_attach_controller" 00:31:52.796 },{ 00:31:52.796 "params": { 00:31:52.796 "name": "Nvme2", 00:31:52.796 "trtype": "tcp", 00:31:52.796 "traddr": "10.0.0.2", 00:31:52.796 "adrfam": "ipv4", 00:31:52.796 "trsvcid": "4420", 00:31:52.796 "subnqn": "nqn.2016-06.io.spdk:cnode2", 00:31:52.796 "hostnqn": "nqn.2016-06.io.spdk:host2", 00:31:52.796 "hdgst": false, 00:31:52.796 "ddgst": false 00:31:52.796 }, 00:31:52.796 "method": "bdev_nvme_attach_controller" 00:31:52.796 }' 00:31:53.054 04:33:43 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:53.054 04:33:43 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:53.054 04:33:43 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:31:53.054 04:33:43 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:31:53.054 04:33:43 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:31:53.054 04:33:43 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:31:53.054 04:33:43 -- common/autotest_common.sh@1334 -- # asan_lib= 00:31:53.054 04:33:43 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:31:53.054 04:33:43 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:31:53.054 04:33:43 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:31:53.054 filename0: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:53.054 ... 00:31:53.054 filename1: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:53.054 ... 00:31:53.054 filename2: (g=0): rw=randread, bs=(R) 4096B-4096B, (W) 4096B-4096B, (T) 4096B-4096B, ioengine=spdk_bdev, iodepth=16 00:31:53.054 ... 00:31:53.054 fio-3.35 00:31:53.054 Starting 24 threads 00:31:53.312 EAL: No free 2048 kB hugepages reported on node 1 00:31:53.877 [2024-11-30 04:33:44.429750] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:31:53.877 [2024-11-30 04:33:44.429819] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:06.089 00:32:06.089 filename0: (groupid=0, jobs=1): err= 0: pid=2508364: Sat Nov 30 04:33:54 2024 00:32:06.089 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.8MiB/10005msec) 00:32:06.089 slat (usec): min=7, max=130, avg=41.19, stdev=19.07 00:32:06.089 clat (usec): min=18441, max=64509, avg=31291.17, stdev=2237.21 00:32:06.089 lat (usec): min=18464, max=64532, avg=31332.36, stdev=2237.59 00:32:06.089 clat percentiles (usec): 00:32:06.089 | 1.00th=[29754], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:32:06.089 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:32:06.089 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[33424], 00:32:06.089 | 99.00th=[34341], 99.50th=[34341], 99.90th=[64226], 99.95th=[64226], 00:32:06.089 | 99.99th=[64750] 00:32:06.089 bw ( KiB/s): min= 1664, max= 2064, per=4.15%, avg=2014.32, stdev=94.04, samples=19 00:32:06.089 iops : min= 416, max= 516, avg=503.58, stdev=23.51, samples=19 00:32:06.089 lat (msec) : 20=0.32%, 50=99.33%, 100=0.36% 00:32:06.089 cpu : usr=98.86%, sys=0.72%, ctx=11, majf=0, minf=43 00:32:06.090 IO depths : 1=5.7%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.8%, 32=0.0%, >=64=0.0% 00:32:06.090 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.090 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.090 filename0: (groupid=0, jobs=1): err= 0: pid=2508365: Sat Nov 30 04:33:54 2024 00:32:06.090 read: IOPS=507, BW=2031KiB/s (2080kB/s)(19.9MiB/10021msec) 00:32:06.090 slat (usec): min=3, max=121, avg=30.96, stdev=26.73 00:32:06.090 clat (usec): min=15740, max=45126, avg=31239.31, stdev=1412.48 00:32:06.090 lat (usec): min=15744, max=45148, avg=31270.27, stdev=1407.85 00:32:06.090 clat percentiles (usec): 00:32:06.090 | 1.00th=[29492], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:32:06.090 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.090 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33424], 00:32:06.090 | 99.00th=[34341], 99.50th=[34341], 99.90th=[34866], 99.95th=[34866], 00:32:06.090 | 99.99th=[45351] 00:32:06.090 bw ( KiB/s): min= 1920, max= 2048, per=4.18%, avg=2028.80, stdev=46.89, samples=20 00:32:06.090 iops : min= 480, max= 512, avg=507.20, stdev=11.72, samples=20 00:32:06.090 lat (msec) : 20=0.35%, 50=99.65% 00:32:06.090 cpu : usr=96.89%, sys=1.79%, ctx=148, majf=0, minf=104 00:32:06.090 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.090 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.090 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.090 filename0: (groupid=0, jobs=1): err= 0: pid=2508366: Sat Nov 30 04:33:54 2024 00:32:06.090 read: IOPS=505, BW=2022KiB/s (2071kB/s)(19.8MiB/10001msec) 00:32:06.090 slat (usec): min=9, max=131, avg=43.96, stdev=25.03 00:32:06.090 clat (usec): min=19952, max=55846, avg=31225.91, stdev=1242.30 00:32:06.090 lat (usec): min=19967, max=55861, avg=31269.87, stdev=1242.62 00:32:06.090 clat percentiles (usec): 00:32:06.090 | 1.00th=[29754], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:32:06.090 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:32:06.090 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[33424], 00:32:06.090 | 99.00th=[34341], 99.50th=[34341], 99.90th=[45351], 99.95th=[45351], 00:32:06.090 | 99.99th=[55837] 00:32:06.090 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2021.05, stdev=68.52, samples=19 00:32:06.090 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:32:06.090 lat (msec) : 20=0.04%, 50=99.92%, 100=0.04% 00:32:06.090 cpu : usr=97.82%, sys=1.35%, ctx=37, majf=0, minf=52 00:32:06.090 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.090 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.090 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.090 filename0: (groupid=0, jobs=1): err= 0: pid=2508367: Sat Nov 30 04:33:54 2024 00:32:06.090 read: IOPS=504, BW=2020KiB/s (2068kB/s)(19.8MiB/10013msec) 00:32:06.090 slat (usec): min=8, max=117, avg=37.34, stdev=13.91 00:32:06.090 clat (usec): min=18302, max=72668, avg=31354.95, stdev=2533.32 00:32:06.090 lat (usec): min=18318, max=72704, avg=31392.30, stdev=2534.41 00:32:06.090 clat percentiles (usec): 00:32:06.090 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:32:06.090 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.090 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[33162], 00:32:06.090 | 99.00th=[34341], 99.50th=[34341], 99.90th=[72877], 99.95th=[72877], 00:32:06.090 | 99.99th=[72877] 00:32:06.090 bw ( KiB/s): min= 1664, max= 2048, per=4.15%, avg=2014.32, stdev=93.89, samples=19 00:32:06.090 iops : min= 416, max= 512, avg=503.58, stdev=23.47, samples=19 00:32:06.090 lat (msec) : 20=0.32%, 50=99.37%, 100=0.32% 00:32:06.090 cpu : usr=96.97%, sys=1.76%, ctx=199, majf=0, minf=63 00:32:06.090 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:06.090 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.090 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.090 filename0: (groupid=0, jobs=1): err= 0: pid=2508368: Sat Nov 30 04:33:54 2024 00:32:06.090 read: IOPS=505, BW=2021KiB/s (2069kB/s)(19.8MiB/10009msec) 00:32:06.090 slat (usec): min=11, max=115, avg=36.20, stdev=13.34 00:32:06.090 clat (usec): min=18473, max=78916, avg=31332.02, stdev=2451.82 00:32:06.090 lat (usec): min=18508, max=78948, avg=31368.22, stdev=2451.26 00:32:06.090 clat percentiles (usec): 00:32:06.090 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:32:06.090 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:32:06.090 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[33817], 00:32:06.090 | 99.00th=[34341], 99.50th=[34866], 99.90th=[67634], 99.95th=[67634], 00:32:06.090 | 99.99th=[79168] 00:32:06.090 bw ( KiB/s): min= 1664, max= 2048, per=4.15%, avg=2014.32, stdev=93.89, samples=19 00:32:06.090 iops : min= 416, max= 512, avg=503.58, stdev=23.47, samples=19 00:32:06.090 lat (msec) : 20=0.32%, 50=99.37%, 100=0.32% 00:32:06.090 cpu : usr=98.29%, sys=1.21%, ctx=19, majf=0, minf=56 00:32:06.090 IO depths : 1=5.8%, 2=12.0%, 4=25.0%, 8=50.5%, 16=6.7%, 32=0.0%, >=64=0.0% 00:32:06.090 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.090 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.090 filename0: (groupid=0, jobs=1): err= 0: pid=2508369: Sat Nov 30 04:33:54 2024 00:32:06.090 read: IOPS=506, BW=2025KiB/s (2074kB/s)(19.8MiB/10018msec) 00:32:06.090 slat (nsec): min=9980, max=65221, avg=31807.37, stdev=7373.07 00:32:06.090 clat (usec): min=20388, max=41238, avg=31317.70, stdev=1129.35 00:32:06.090 lat (usec): min=20418, max=41270, avg=31349.50, stdev=1128.76 00:32:06.090 clat percentiles (usec): 00:32:06.090 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:32:06.090 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.090 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33817], 00:32:06.090 | 99.00th=[34341], 99.50th=[34341], 99.90th=[41157], 99.95th=[41157], 00:32:06.090 | 99.99th=[41157] 00:32:06.090 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2022.40, stdev=66.96, samples=20 00:32:06.090 iops : min= 448, max= 512, avg=505.60, stdev=16.74, samples=20 00:32:06.090 lat (msec) : 50=100.00% 00:32:06.090 cpu : usr=98.67%, sys=0.93%, ctx=12, majf=0, minf=71 00:32:06.090 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.090 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.090 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.090 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.090 filename0: (groupid=0, jobs=1): err= 0: pid=2508370: Sat Nov 30 04:33:54 2024 00:32:06.090 read: IOPS=508, BW=2032KiB/s (2081kB/s)(19.9MiB/10014msec) 00:32:06.091 slat (usec): min=5, max=101, avg=30.10, stdev=18.85 00:32:06.091 clat (usec): min=8927, max=38848, avg=31247.66, stdev=1807.46 00:32:06.091 lat (usec): min=8933, max=38871, avg=31277.76, stdev=1810.39 00:32:06.091 clat percentiles (usec): 00:32:06.091 | 1.00th=[29754], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:32:06.091 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.091 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33162], 00:32:06.091 | 99.00th=[34341], 99.50th=[34341], 99.90th=[36439], 99.95th=[36439], 00:32:06.091 | 99.99th=[39060] 00:32:06.091 bw ( KiB/s): min= 1920, max= 2048, per=4.18%, avg=2028.80, stdev=46.89, samples=20 00:32:06.091 iops : min= 480, max= 512, avg=507.20, stdev=11.72, samples=20 00:32:06.091 lat (msec) : 10=0.31%, 20=0.31%, 50=99.37% 00:32:06.091 cpu : usr=97.15%, sys=1.80%, ctx=46, majf=0, minf=73 00:32:06.091 IO depths : 1=6.2%, 2=12.4%, 4=24.9%, 8=50.2%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.091 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.091 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.091 filename0: (groupid=0, jobs=1): err= 0: pid=2508371: Sat Nov 30 04:33:54 2024 00:32:06.091 read: IOPS=505, BW=2022KiB/s (2071kB/s)(19.8MiB/10001msec) 00:32:06.091 slat (usec): min=8, max=119, avg=37.14, stdev=18.39 00:32:06.091 clat (usec): min=20216, max=55812, avg=31334.55, stdev=1201.47 00:32:06.091 lat (usec): min=20226, max=55847, avg=31371.69, stdev=1202.99 00:32:06.091 clat percentiles (usec): 00:32:06.091 | 1.00th=[29754], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:32:06.091 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.091 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33424], 00:32:06.091 | 99.00th=[34341], 99.50th=[34341], 99.90th=[44827], 99.95th=[44827], 00:32:06.091 | 99.99th=[55837] 00:32:06.091 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2021.05, stdev=68.52, samples=19 00:32:06.091 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:32:06.091 lat (msec) : 50=99.96%, 100=0.04% 00:32:06.091 cpu : usr=96.17%, sys=2.17%, ctx=284, majf=0, minf=58 00:32:06.091 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.091 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.091 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.091 filename1: (groupid=0, jobs=1): err= 0: pid=2508372: Sat Nov 30 04:33:54 2024 00:32:06.091 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.8MiB/10005msec) 00:32:06.091 slat (usec): min=7, max=119, avg=35.55, stdev=17.68 00:32:06.091 clat (usec): min=18449, max=64664, avg=31302.62, stdev=2140.04 00:32:06.091 lat (usec): min=18483, max=64679, avg=31338.17, stdev=2140.81 00:32:06.091 clat percentiles (usec): 00:32:06.091 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:32:06.091 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:32:06.091 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[32900], 00:32:06.091 | 99.00th=[34341], 99.50th=[34341], 99.90th=[64750], 99.95th=[64750], 00:32:06.091 | 99.99th=[64750] 00:32:06.091 bw ( KiB/s): min= 1664, max= 2048, per=4.15%, avg=2014.32, stdev=93.89, samples=19 00:32:06.091 iops : min= 416, max= 512, avg=503.58, stdev=23.47, samples=19 00:32:06.091 lat (msec) : 20=0.32%, 50=99.37%, 100=0.32% 00:32:06.091 cpu : usr=96.79%, sys=1.94%, ctx=108, majf=0, minf=57 00:32:06.091 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:06.091 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.091 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.091 filename1: (groupid=0, jobs=1): err= 0: pid=2508373: Sat Nov 30 04:33:54 2024 00:32:06.091 read: IOPS=505, BW=2022KiB/s (2071kB/s)(19.8MiB/10001msec) 00:32:06.091 slat (usec): min=8, max=146, avg=49.81, stdev=32.66 00:32:06.091 clat (usec): min=18147, max=55802, avg=31231.04, stdev=1431.85 00:32:06.091 lat (usec): min=18157, max=55834, avg=31280.84, stdev=1427.53 00:32:06.091 clat percentiles (usec): 00:32:06.091 | 1.00th=[29492], 5.00th=[30016], 10.00th=[30278], 20.00th=[30802], 00:32:06.091 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.091 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33424], 00:32:06.091 | 99.00th=[34341], 99.50th=[40633], 99.90th=[44827], 99.95th=[45351], 00:32:06.091 | 99.99th=[55837] 00:32:06.091 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2021.05, stdev=68.52, samples=19 00:32:06.091 iops : min= 448, max= 512, avg=505.26, stdev=17.13, samples=19 00:32:06.091 lat (msec) : 20=0.16%, 50=99.80%, 100=0.04% 00:32:06.091 cpu : usr=98.74%, sys=0.84%, ctx=15, majf=0, minf=46 00:32:06.091 IO depths : 1=6.1%, 2=12.3%, 4=25.0%, 8=50.2%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:06.091 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.091 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.091 filename1: (groupid=0, jobs=1): err= 0: pid=2508374: Sat Nov 30 04:33:54 2024 00:32:06.091 read: IOPS=508, BW=2033KiB/s (2081kB/s)(19.9MiB/10005msec) 00:32:06.091 slat (usec): min=7, max=142, avg=22.02, stdev=22.47 00:32:06.091 clat (usec): min=9712, max=75747, avg=31384.74, stdev=3957.62 00:32:06.091 lat (usec): min=9721, max=75777, avg=31406.75, stdev=3959.65 00:32:06.091 clat percentiles (usec): 00:32:06.091 | 1.00th=[21890], 5.00th=[24773], 10.00th=[29754], 20.00th=[31065], 00:32:06.091 | 30.00th=[31065], 40.00th=[31327], 50.00th=[31327], 60.00th=[31327], 00:32:06.091 | 70.00th=[31589], 80.00th=[31851], 90.00th=[32900], 95.00th=[34341], 00:32:06.091 | 99.00th=[45351], 99.50th=[51119], 99.90th=[76022], 99.95th=[76022], 00:32:06.091 | 99.99th=[76022] 00:32:06.091 bw ( KiB/s): min= 1667, max= 2160, per=4.17%, avg=2025.42, stdev=98.36, samples=19 00:32:06.091 iops : min= 416, max= 540, avg=506.32, stdev=24.74, samples=19 00:32:06.091 lat (msec) : 10=0.08%, 20=0.45%, 50=98.90%, 100=0.57% 00:32:06.091 cpu : usr=98.81%, sys=0.76%, ctx=24, majf=0, minf=67 00:32:06.091 IO depths : 1=0.3%, 2=0.6%, 4=2.2%, 8=79.7%, 16=17.3%, 32=0.0%, >=64=0.0% 00:32:06.091 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 complete : 0=0.0%, 4=89.5%, 8=9.5%, 16=1.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 issued rwts: total=5084,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.091 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.091 filename1: (groupid=0, jobs=1): err= 0: pid=2508375: Sat Nov 30 04:33:54 2024 00:32:06.091 read: IOPS=508, BW=2032KiB/s (2081kB/s)(19.9MiB/10014msec) 00:32:06.091 slat (nsec): min=3912, max=72245, avg=26782.94, stdev=10367.15 00:32:06.091 clat (usec): min=9401, max=36934, avg=31271.63, stdev=1837.19 00:32:06.091 lat (usec): min=9414, max=36963, avg=31298.41, stdev=1838.25 00:32:06.091 clat percentiles (usec): 00:32:06.091 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:32:06.091 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.091 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33817], 00:32:06.091 | 99.00th=[34341], 99.50th=[34341], 99.90th=[36963], 99.95th=[36963], 00:32:06.091 | 99.99th=[36963] 00:32:06.091 bw ( KiB/s): min= 1920, max= 2048, per=4.18%, avg=2028.80, stdev=46.89, samples=20 00:32:06.091 iops : min= 480, max= 512, avg=507.20, stdev=11.72, samples=20 00:32:06.091 lat (msec) : 10=0.28%, 20=0.35%, 50=99.37% 00:32:06.091 cpu : usr=98.15%, sys=1.25%, ctx=116, majf=0, minf=76 00:32:06.091 IO depths : 1=6.1%, 2=12.3%, 4=24.9%, 8=50.3%, 16=6.4%, 32=0.0%, >=64=0.0% 00:32:06.091 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 complete : 0=0.0%, 4=94.1%, 8=0.1%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.091 issued rwts: total=5088,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.091 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.092 filename1: (groupid=0, jobs=1): err= 0: pid=2508376: Sat Nov 30 04:33:54 2024 00:32:06.092 read: IOPS=504, BW=2020KiB/s (2068kB/s)(19.8MiB/10012msec) 00:32:06.092 slat (usec): min=8, max=111, avg=38.37, stdev=16.89 00:32:06.092 clat (usec): min=18677, max=71305, avg=31354.16, stdev=2502.20 00:32:06.092 lat (usec): min=18715, max=71338, avg=31392.53, stdev=2502.93 00:32:06.092 clat percentiles (usec): 00:32:06.092 | 1.00th=[30016], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:32:06.092 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:32:06.092 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33424], 00:32:06.092 | 99.00th=[34341], 99.50th=[34341], 99.90th=[70779], 99.95th=[70779], 00:32:06.092 | 99.99th=[71828] 00:32:06.092 bw ( KiB/s): min= 1667, max= 2176, per=4.15%, avg=2014.47, stdev=102.56, samples=19 00:32:06.092 iops : min= 416, max= 544, avg=503.58, stdev=25.78, samples=19 00:32:06.092 lat (msec) : 20=0.40%, 50=99.29%, 100=0.32% 00:32:06.092 cpu : usr=98.43%, sys=1.15%, ctx=20, majf=0, minf=60 00:32:06.092 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.092 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.092 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.092 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.092 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.092 filename1: (groupid=0, jobs=1): err= 0: pid=2508377: Sat Nov 30 04:33:54 2024 00:32:06.092 read: IOPS=516, BW=2064KiB/s (2114kB/s)(20.2MiB/10002msec) 00:32:06.092 slat (usec): min=8, max=133, avg=29.24, stdev=13.98 00:32:06.092 clat (usec): min=9925, max=62955, avg=30759.72, stdev=4123.51 00:32:06.092 lat (usec): min=9934, max=62992, avg=30788.97, stdev=4126.42 00:32:06.092 clat percentiles (usec): 00:32:06.092 | 1.00th=[19530], 5.00th=[21890], 10.00th=[25822], 20.00th=[30802], 00:32:06.092 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.092 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32375], 95.00th=[34341], 00:32:06.092 | 99.00th=[43254], 99.50th=[50594], 99.90th=[62653], 99.95th=[62653], 00:32:06.092 | 99.99th=[63177] 00:32:06.092 bw ( KiB/s): min= 1664, max= 2448, per=4.24%, avg=2058.95, stdev=156.14, samples=19 00:32:06.092 iops : min= 416, max= 612, avg=514.74, stdev=39.03, samples=19 00:32:06.092 lat (msec) : 10=0.15%, 20=1.86%, 50=97.37%, 100=0.62% 00:32:06.092 cpu : usr=98.70%, sys=0.88%, ctx=14, majf=0, minf=53 00:32:06.092 IO depths : 1=3.6%, 2=8.4%, 4=19.8%, 8=58.4%, 16=9.7%, 32=0.0%, >=64=0.0% 00:32:06.092 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.092 complete : 0=0.0%, 4=93.0%, 8=2.1%, 16=4.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.092 issued rwts: total=5162,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.092 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.092 filename1: (groupid=0, jobs=1): err= 0: pid=2508378: Sat Nov 30 04:33:54 2024 00:32:06.092 read: IOPS=506, BW=2025KiB/s (2074kB/s)(19.8MiB/10018msec) 00:32:06.092 slat (usec): min=12, max=126, avg=39.97, stdev=21.66 00:32:06.092 clat (usec): min=20391, max=41380, avg=31247.70, stdev=1122.18 00:32:06.092 lat (usec): min=20423, max=41401, avg=31287.67, stdev=1122.22 00:32:06.092 clat percentiles (usec): 00:32:06.092 | 1.00th=[29754], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:32:06.092 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31065], 00:32:06.092 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33162], 00:32:06.092 | 99.00th=[34341], 99.50th=[34341], 99.90th=[41157], 99.95th=[41157], 00:32:06.092 | 99.99th=[41157] 00:32:06.092 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2022.40, stdev=66.96, samples=20 00:32:06.092 iops : min= 448, max= 512, avg=505.60, stdev=16.74, samples=20 00:32:06.092 lat (msec) : 50=100.00% 00:32:06.092 cpu : usr=98.62%, sys=0.97%, ctx=9, majf=0, minf=54 00:32:06.092 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:06.092 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.092 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.092 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.092 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.092 filename1: (groupid=0, jobs=1): err= 0: pid=2508379: Sat Nov 30 04:33:54 2024 00:32:06.092 read: IOPS=506, BW=2027KiB/s (2076kB/s)(19.8MiB/10009msec) 00:32:06.092 slat (usec): min=6, max=121, avg=37.82, stdev=18.01 00:32:06.092 clat (usec): min=14099, max=42122, avg=31239.94, stdev=1205.90 00:32:06.092 lat (usec): min=14157, max=42139, avg=31277.76, stdev=1208.64 00:32:06.092 clat percentiles (usec): 00:32:06.092 | 1.00th=[29754], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:32:06.092 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.092 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33162], 00:32:06.092 | 99.00th=[34341], 99.50th=[34341], 99.90th=[36963], 99.95th=[36963], 00:32:06.092 | 99.99th=[42206] 00:32:06.092 bw ( KiB/s): min= 1920, max= 2048, per=4.16%, avg=2022.55, stdev=52.23, samples=20 00:32:06.092 iops : min= 480, max= 512, avg=505.60, stdev=13.13, samples=20 00:32:06.092 lat (msec) : 20=0.32%, 50=99.68% 00:32:06.092 cpu : usr=96.55%, sys=2.01%, ctx=227, majf=0, minf=45 00:32:06.092 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.092 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.092 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.092 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.092 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.092 filename2: (groupid=0, jobs=1): err= 0: pid=2508380: Sat Nov 30 04:33:54 2024 00:32:06.092 read: IOPS=505, BW=2020KiB/s (2069kB/s)(19.8MiB/10011msec) 00:32:06.092 slat (nsec): min=6101, max=95000, avg=34775.03, stdev=10187.18 00:32:06.092 clat (usec): min=18522, max=69740, avg=31365.59, stdev=2424.26 00:32:06.092 lat (usec): min=18557, max=69755, avg=31400.36, stdev=2422.64 00:32:06.092 clat percentiles (usec): 00:32:06.092 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:32:06.092 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.092 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[33817], 00:32:06.092 | 99.00th=[34341], 99.50th=[34866], 99.90th=[69731], 99.95th=[69731], 00:32:06.092 | 99.99th=[69731] 00:32:06.092 bw ( KiB/s): min= 1664, max= 2048, per=4.15%, avg=2014.32, stdev=93.89, samples=19 00:32:06.092 iops : min= 416, max= 512, avg=503.58, stdev=23.47, samples=19 00:32:06.092 lat (msec) : 20=0.32%, 50=99.37%, 100=0.32% 00:32:06.092 cpu : usr=98.63%, sys=0.96%, ctx=18, majf=0, minf=42 00:32:06.092 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.092 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.092 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.092 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.092 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.092 filename2: (groupid=0, jobs=1): err= 0: pid=2508381: Sat Nov 30 04:33:54 2024 00:32:06.092 read: IOPS=502, BW=2012KiB/s (2060kB/s)(19.7MiB/10005msec) 00:32:06.092 slat (usec): min=8, max=124, avg=35.94, stdev=18.39 00:32:06.092 clat (usec): min=11823, max=75568, avg=31490.05, stdev=3231.00 00:32:06.092 lat (usec): min=11831, max=75607, avg=31526.00, stdev=3233.75 00:32:06.092 clat percentiles (usec): 00:32:06.092 | 1.00th=[23725], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:32:06.092 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.092 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33817], 00:32:06.092 | 99.00th=[41681], 99.50th=[46400], 99.90th=[74974], 99.95th=[76022], 00:32:06.092 | 99.99th=[76022] 00:32:06.092 bw ( KiB/s): min= 1667, max= 2048, per=4.12%, avg=2003.53, stdev=95.20, samples=19 00:32:06.092 iops : min= 416, max= 512, avg=500.84, stdev=23.95, samples=19 00:32:06.092 lat (msec) : 20=0.28%, 50=99.40%, 100=0.32% 00:32:06.092 cpu : usr=97.41%, sys=1.60%, ctx=91, majf=0, minf=58 00:32:06.092 IO depths : 1=5.7%, 2=11.6%, 4=23.7%, 8=52.0%, 16=7.0%, 32=0.0%, >=64=0.0% 00:32:06.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 complete : 0=0.0%, 4=93.8%, 8=0.5%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 issued rwts: total=5032,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.093 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.093 filename2: (groupid=0, jobs=1): err= 0: pid=2508382: Sat Nov 30 04:33:54 2024 00:32:06.093 read: IOPS=507, BW=2032KiB/s (2080kB/s)(19.9MiB/10014msec) 00:32:06.093 slat (usec): min=6, max=151, avg=55.25, stdev=31.73 00:32:06.093 clat (usec): min=9841, max=39138, avg=31026.10, stdev=1783.94 00:32:06.093 lat (usec): min=9851, max=39188, avg=31081.35, stdev=1783.55 00:32:06.093 clat percentiles (usec): 00:32:06.093 | 1.00th=[29230], 5.00th=[29754], 10.00th=[30278], 20.00th=[30540], 00:32:06.093 | 30.00th=[30802], 40.00th=[30802], 50.00th=[31065], 60.00th=[31065], 00:32:06.093 | 70.00th=[31327], 80.00th=[31589], 90.00th=[31851], 95.00th=[33162], 00:32:06.093 | 99.00th=[34341], 99.50th=[34341], 99.90th=[36439], 99.95th=[36963], 00:32:06.093 | 99.99th=[39060] 00:32:06.093 bw ( KiB/s): min= 1904, max= 2048, per=4.18%, avg=2028.00, stdev=48.94, samples=20 00:32:06.093 iops : min= 476, max= 512, avg=507.00, stdev=12.23, samples=20 00:32:06.093 lat (msec) : 10=0.28%, 20=0.31%, 50=99.41% 00:32:06.093 cpu : usr=96.45%, sys=2.13%, ctx=125, majf=0, minf=75 00:32:06.093 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 issued rwts: total=5086,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.093 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.093 filename2: (groupid=0, jobs=1): err= 0: pid=2508383: Sat Nov 30 04:33:54 2024 00:32:06.093 read: IOPS=506, BW=2025KiB/s (2073kB/s)(19.8MiB/10020msec) 00:32:06.093 slat (usec): min=7, max=133, avg=31.17, stdev=14.88 00:32:06.093 clat (usec): min=19072, max=41218, avg=31334.80, stdev=1273.27 00:32:06.093 lat (usec): min=19107, max=41232, avg=31365.97, stdev=1270.28 00:32:06.093 clat percentiles (usec): 00:32:06.093 | 1.00th=[27919], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:32:06.093 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.093 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[34341], 00:32:06.093 | 99.00th=[34866], 99.50th=[35390], 99.90th=[41157], 99.95th=[41157], 00:32:06.093 | 99.99th=[41157] 00:32:06.093 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2022.40, stdev=66.96, samples=20 00:32:06.093 iops : min= 448, max= 512, avg=505.60, stdev=16.74, samples=20 00:32:06.093 lat (msec) : 20=0.04%, 50=99.96% 00:32:06.093 cpu : usr=95.84%, sys=2.28%, ctx=150, majf=0, minf=51 00:32:06.093 IO depths : 1=3.8%, 2=10.0%, 4=25.0%, 8=52.5%, 16=8.7%, 32=0.0%, >=64=0.0% 00:32:06.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 complete : 0=0.0%, 4=94.3%, 8=0.0%, 16=5.7%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.093 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.093 filename2: (groupid=0, jobs=1): err= 0: pid=2508384: Sat Nov 30 04:33:54 2024 00:32:06.093 read: IOPS=505, BW=2022KiB/s (2070kB/s)(19.8MiB/10004msec) 00:32:06.093 slat (nsec): min=8202, max=85909, avg=32486.39, stdev=9120.14 00:32:06.093 clat (usec): min=18385, max=63071, avg=31365.77, stdev=2116.60 00:32:06.093 lat (usec): min=18419, max=63110, avg=31398.26, stdev=2115.97 00:32:06.093 clat percentiles (usec): 00:32:06.093 | 1.00th=[30278], 5.00th=[30540], 10.00th=[30802], 20.00th=[30802], 00:32:06.093 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.093 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33424], 00:32:06.093 | 99.00th=[34341], 99.50th=[34866], 99.90th=[62653], 99.95th=[63177], 00:32:06.093 | 99.99th=[63177] 00:32:06.093 bw ( KiB/s): min= 1664, max= 2176, per=4.15%, avg=2014.32, stdev=103.13, samples=19 00:32:06.093 iops : min= 416, max= 544, avg=503.58, stdev=25.78, samples=19 00:32:06.093 lat (msec) : 20=0.40%, 50=99.29%, 100=0.32% 00:32:06.093 cpu : usr=97.83%, sys=1.36%, ctx=128, majf=0, minf=55 00:32:06.093 IO depths : 1=6.2%, 2=12.4%, 4=25.0%, 8=50.1%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.093 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.093 filename2: (groupid=0, jobs=1): err= 0: pid=2508385: Sat Nov 30 04:33:54 2024 00:32:06.093 read: IOPS=505, BW=2021KiB/s (2070kB/s)(19.8MiB/10005msec) 00:32:06.093 slat (usec): min=7, max=106, avg=22.29, stdev=16.64 00:32:06.093 clat (usec): min=26356, max=53043, avg=31443.33, stdev=1431.77 00:32:06.093 lat (usec): min=26382, max=53071, avg=31465.62, stdev=1435.75 00:32:06.093 clat percentiles (usec): 00:32:06.093 | 1.00th=[30016], 5.00th=[30802], 10.00th=[30802], 20.00th=[31065], 00:32:06.093 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:32:06.093 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33424], 00:32:06.093 | 99.00th=[34341], 99.50th=[34341], 99.90th=[52691], 99.95th=[53216], 00:32:06.093 | 99.99th=[53216] 00:32:06.093 bw ( KiB/s): min= 1664, max= 2048, per=4.15%, avg=2014.32, stdev=93.89, samples=19 00:32:06.093 iops : min= 416, max= 512, avg=503.58, stdev=23.47, samples=19 00:32:06.093 lat (msec) : 50=99.68%, 100=0.32% 00:32:06.093 cpu : usr=98.42%, sys=1.11%, ctx=27, majf=0, minf=69 00:32:06.093 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.2%, 32=0.0%, >=64=0.0% 00:32:06.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 issued rwts: total=5056,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.093 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.093 filename2: (groupid=0, jobs=1): err= 0: pid=2508386: Sat Nov 30 04:33:54 2024 00:32:06.093 read: IOPS=506, BW=2026KiB/s (2075kB/s)(19.8MiB/10013msec) 00:32:06.093 slat (usec): min=5, max=151, avg=27.09, stdev=27.06 00:32:06.093 clat (usec): min=16917, max=39901, avg=31333.82, stdev=1225.45 00:32:06.093 lat (usec): min=16922, max=39999, avg=31360.91, stdev=1223.74 00:32:06.093 clat percentiles (usec): 00:32:06.093 | 1.00th=[29754], 5.00th=[30278], 10.00th=[30540], 20.00th=[30802], 00:32:06.093 | 30.00th=[31065], 40.00th=[31065], 50.00th=[31327], 60.00th=[31327], 00:32:06.093 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33817], 00:32:06.093 | 99.00th=[34341], 99.50th=[34341], 99.90th=[39584], 99.95th=[39584], 00:32:06.093 | 99.99th=[40109] 00:32:06.093 bw ( KiB/s): min= 1795, max= 2048, per=4.16%, avg=2022.55, stdev=66.42, samples=20 00:32:06.093 iops : min= 448, max= 512, avg=505.60, stdev=16.74, samples=20 00:32:06.093 lat (msec) : 20=0.32%, 50=99.68% 00:32:06.093 cpu : usr=98.31%, sys=1.18%, ctx=31, majf=0, minf=62 00:32:06.093 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.093 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.093 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.093 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.093 filename2: (groupid=0, jobs=1): err= 0: pid=2508387: Sat Nov 30 04:33:54 2024 00:32:06.093 read: IOPS=506, BW=2025KiB/s (2074kB/s)(19.8MiB/10018msec) 00:32:06.093 slat (usec): min=9, max=163, avg=35.73, stdev=19.56 00:32:06.093 clat (usec): min=20237, max=41226, avg=31279.83, stdev=1161.06 00:32:06.093 lat (usec): min=20259, max=41248, avg=31315.56, stdev=1157.41 00:32:06.093 clat percentiles (usec): 00:32:06.093 | 1.00th=[29754], 5.00th=[30540], 10.00th=[30540], 20.00th=[30802], 00:32:06.093 | 30.00th=[30802], 40.00th=[31065], 50.00th=[31065], 60.00th=[31327], 00:32:06.093 | 70.00th=[31327], 80.00th=[31589], 90.00th=[32113], 95.00th=[33817], 00:32:06.093 | 99.00th=[34341], 99.50th=[34341], 99.90th=[41157], 99.95th=[41157], 00:32:06.093 | 99.99th=[41157] 00:32:06.093 bw ( KiB/s): min= 1792, max= 2048, per=4.16%, avg=2022.40, stdev=66.96, samples=20 00:32:06.093 iops : min= 448, max= 512, avg=505.60, stdev=16.74, samples=20 00:32:06.093 lat (msec) : 50=100.00% 00:32:06.094 cpu : usr=96.03%, sys=2.20%, ctx=111, majf=0, minf=66 00:32:06.094 IO depths : 1=6.2%, 2=12.5%, 4=25.0%, 8=50.0%, 16=6.3%, 32=0.0%, >=64=0.0% 00:32:06.094 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.094 complete : 0=0.0%, 4=94.1%, 8=0.0%, 16=5.9%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:06.094 issued rwts: total=5072,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:06.094 latency : target=0, window=0, percentile=100.00%, depth=16 00:32:06.094 00:32:06.094 Run status group 0 (all jobs): 00:32:06.094 READ: bw=47.4MiB/s (49.7MB/s), 2012KiB/s-2064KiB/s (2060kB/s-2114kB/s), io=475MiB (498MB), run=10001-10021msec 00:32:06.094 04:33:54 -- target/dif.sh@113 -- # destroy_subsystems 0 1 2 00:32:06.094 04:33:54 -- target/dif.sh@43 -- # local sub 00:32:06.094 04:33:54 -- target/dif.sh@45 -- # for sub in "$@" 00:32:06.094 04:33:54 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:06.094 04:33:54 -- target/dif.sh@36 -- # local sub_id=0 00:32:06.094 04:33:54 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@45 -- # for sub in "$@" 00:32:06.094 04:33:54 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:06.094 04:33:54 -- target/dif.sh@36 -- # local sub_id=1 00:32:06.094 04:33:54 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@45 -- # for sub in "$@" 00:32:06.094 04:33:54 -- target/dif.sh@46 -- # destroy_subsystem 2 00:32:06.094 04:33:54 -- target/dif.sh@36 -- # local sub_id=2 00:32:06.094 04:33:54 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode2 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null2 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@115 -- # NULL_DIF=1 00:32:06.094 04:33:54 -- target/dif.sh@115 -- # bs=8k,16k,128k 00:32:06.094 04:33:54 -- target/dif.sh@115 -- # numjobs=2 00:32:06.094 04:33:54 -- target/dif.sh@115 -- # iodepth=8 00:32:06.094 04:33:54 -- target/dif.sh@115 -- # runtime=5 00:32:06.094 04:33:54 -- target/dif.sh@115 -- # files=1 00:32:06.094 04:33:54 -- target/dif.sh@117 -- # create_subsystems 0 1 00:32:06.094 04:33:54 -- target/dif.sh@28 -- # local sub 00:32:06.094 04:33:54 -- target/dif.sh@30 -- # for sub in "$@" 00:32:06.094 04:33:54 -- target/dif.sh@31 -- # create_subsystem 0 00:32:06.094 04:33:54 -- target/dif.sh@18 -- # local sub_id=0 00:32:06.094 04:33:54 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 1 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 bdev_null0 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 [2024-11-30 04:33:54.902692] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@30 -- # for sub in "$@" 00:32:06.094 04:33:54 -- target/dif.sh@31 -- # create_subsystem 1 00:32:06.094 04:33:54 -- target/dif.sh@18 -- # local sub_id=1 00:32:06.094 04:33:54 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null1 64 512 --md-size 16 --dif-type 1 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 bdev_null1 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode1 --serial-number 53313233-1 --allow-any-host 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode1 bdev_null1 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode1 -t tcp -a 10.0.0.2 -s 4420 00:32:06.094 04:33:54 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:06.094 04:33:54 -- common/autotest_common.sh@10 -- # set +x 00:32:06.094 04:33:54 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:06.094 04:33:54 -- target/dif.sh@118 -- # fio /dev/fd/62 00:32:06.094 04:33:54 -- target/dif.sh@118 -- # create_json_sub_conf 0 1 00:32:06.094 04:33:54 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 1 00:32:06.094 04:33:54 -- nvmf/common.sh@520 -- # config=() 00:32:06.094 04:33:54 -- nvmf/common.sh@520 -- # local subsystem config 00:32:06.094 04:33:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:06.094 04:33:54 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:06.094 04:33:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:06.094 { 00:32:06.094 "params": { 00:32:06.094 "name": "Nvme$subsystem", 00:32:06.094 "trtype": "$TEST_TRANSPORT", 00:32:06.094 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:06.094 "adrfam": "ipv4", 00:32:06.094 "trsvcid": "$NVMF_PORT", 00:32:06.094 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:06.094 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:06.094 "hdgst": ${hdgst:-false}, 00:32:06.094 "ddgst": ${ddgst:-false} 00:32:06.094 }, 00:32:06.094 "method": "bdev_nvme_attach_controller" 00:32:06.094 } 00:32:06.094 EOF 00:32:06.094 )") 00:32:06.094 04:33:54 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:06.094 04:33:54 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:06.094 04:33:54 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:06.094 04:33:54 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:06.094 04:33:54 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:06.095 04:33:54 -- target/dif.sh@82 -- # gen_fio_conf 00:32:06.095 04:33:54 -- common/autotest_common.sh@1330 -- # shift 00:32:06.095 04:33:54 -- target/dif.sh@54 -- # local file 00:32:06.095 04:33:54 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:06.095 04:33:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:06.095 04:33:54 -- target/dif.sh@56 -- # cat 00:32:06.095 04:33:54 -- nvmf/common.sh@542 -- # cat 00:32:06.095 04:33:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:06.095 04:33:54 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:06.095 04:33:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:06.095 04:33:54 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:06.095 04:33:54 -- target/dif.sh@72 -- # (( file <= files )) 00:32:06.095 04:33:54 -- target/dif.sh@73 -- # cat 00:32:06.095 04:33:54 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:06.095 04:33:54 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:06.095 { 00:32:06.095 "params": { 00:32:06.095 "name": "Nvme$subsystem", 00:32:06.095 "trtype": "$TEST_TRANSPORT", 00:32:06.095 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:06.095 "adrfam": "ipv4", 00:32:06.095 "trsvcid": "$NVMF_PORT", 00:32:06.095 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:06.095 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:06.095 "hdgst": ${hdgst:-false}, 00:32:06.095 "ddgst": ${ddgst:-false} 00:32:06.095 }, 00:32:06.095 "method": "bdev_nvme_attach_controller" 00:32:06.095 } 00:32:06.095 EOF 00:32:06.095 )") 00:32:06.095 04:33:54 -- nvmf/common.sh@542 -- # cat 00:32:06.095 04:33:54 -- target/dif.sh@72 -- # (( file++ )) 00:32:06.095 04:33:54 -- target/dif.sh@72 -- # (( file <= files )) 00:32:06.095 04:33:54 -- nvmf/common.sh@544 -- # jq . 00:32:06.095 04:33:54 -- nvmf/common.sh@545 -- # IFS=, 00:32:06.095 04:33:54 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:06.095 "params": { 00:32:06.095 "name": "Nvme0", 00:32:06.095 "trtype": "tcp", 00:32:06.095 "traddr": "10.0.0.2", 00:32:06.095 "adrfam": "ipv4", 00:32:06.095 "trsvcid": "4420", 00:32:06.095 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:06.095 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:06.095 "hdgst": false, 00:32:06.095 "ddgst": false 00:32:06.095 }, 00:32:06.095 "method": "bdev_nvme_attach_controller" 00:32:06.095 },{ 00:32:06.095 "params": { 00:32:06.095 "name": "Nvme1", 00:32:06.095 "trtype": "tcp", 00:32:06.095 "traddr": "10.0.0.2", 00:32:06.095 "adrfam": "ipv4", 00:32:06.095 "trsvcid": "4420", 00:32:06.095 "subnqn": "nqn.2016-06.io.spdk:cnode1", 00:32:06.095 "hostnqn": "nqn.2016-06.io.spdk:host1", 00:32:06.095 "hdgst": false, 00:32:06.095 "ddgst": false 00:32:06.095 }, 00:32:06.095 "method": "bdev_nvme_attach_controller" 00:32:06.095 }' 00:32:06.095 04:33:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:06.095 04:33:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:06.095 04:33:54 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:06.095 04:33:54 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:06.095 04:33:54 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:06.095 04:33:54 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:06.095 04:33:54 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:06.095 04:33:54 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:06.095 04:33:54 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:06.095 04:33:54 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:06.095 filename0: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:06.095 ... 00:32:06.095 filename1: (g=0): rw=randread, bs=(R) 8192B-8192B, (W) 16.0KiB-16.0KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=8 00:32:06.095 ... 00:32:06.095 fio-3.35 00:32:06.095 Starting 4 threads 00:32:06.095 EAL: No free 2048 kB hugepages reported on node 1 00:32:06.095 [2024-11-30 04:33:55.835627] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:06.095 [2024-11-30 04:33:55.835679] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:11.365 00:32:11.365 filename0: (groupid=0, jobs=1): err= 0: pid=2509690: Sat Nov 30 04:34:00 2024 00:32:11.365 read: IOPS=1975, BW=15.4MiB/s (16.2MB/s)(77.2MiB/5001msec) 00:32:11.365 slat (nsec): min=4390, max=65257, avg=20940.08, stdev=9106.60 00:32:11.365 clat (usec): min=754, max=7654, avg=3971.11, stdev=395.53 00:32:11.365 lat (usec): min=768, max=7667, avg=3992.05, stdev=396.45 00:32:11.365 clat percentiles (usec): 00:32:11.365 | 1.00th=[ 2704], 5.00th=[ 3458], 10.00th=[ 3687], 20.00th=[ 3818], 00:32:11.365 | 30.00th=[ 3884], 40.00th=[ 3916], 50.00th=[ 3982], 60.00th=[ 4015], 00:32:11.365 | 70.00th=[ 4080], 80.00th=[ 4146], 90.00th=[ 4228], 95.00th=[ 4359], 00:32:11.365 | 99.00th=[ 5342], 99.50th=[ 6063], 99.90th=[ 6783], 99.95th=[ 7111], 00:32:11.365 | 99.99th=[ 7635] 00:32:11.365 bw ( KiB/s): min=15488, max=16512, per=25.16%, avg=15857.78, stdev=360.57, samples=9 00:32:11.365 iops : min= 1936, max= 2064, avg=1982.22, stdev=45.07, samples=9 00:32:11.365 lat (usec) : 1000=0.05% 00:32:11.365 lat (msec) : 2=0.40%, 4=54.47%, 10=45.07% 00:32:11.365 cpu : usr=95.14%, sys=4.36%, ctx=11, majf=0, minf=101 00:32:11.365 IO depths : 1=0.1%, 2=20.4%, 4=53.5%, 8=25.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:11.365 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.365 complete : 0=0.0%, 4=90.9%, 8=9.1%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.365 issued rwts: total=9880,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.365 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:11.365 filename0: (groupid=0, jobs=1): err= 0: pid=2509691: Sat Nov 30 04:34:00 2024 00:32:11.365 read: IOPS=1973, BW=15.4MiB/s (16.2MB/s)(77.2MiB/5004msec) 00:32:11.365 slat (nsec): min=4132, max=67224, avg=20454.80, stdev=9627.69 00:32:11.365 clat (usec): min=741, max=7572, avg=3978.52, stdev=397.08 00:32:11.365 lat (usec): min=754, max=7585, avg=3998.97, stdev=397.97 00:32:11.365 clat percentiles (usec): 00:32:11.365 | 1.00th=[ 2835], 5.00th=[ 3425], 10.00th=[ 3720], 20.00th=[ 3818], 00:32:11.365 | 30.00th=[ 3884], 40.00th=[ 3949], 50.00th=[ 3982], 60.00th=[ 4047], 00:32:11.365 | 70.00th=[ 4080], 80.00th=[ 4146], 90.00th=[ 4228], 95.00th=[ 4359], 00:32:11.365 | 99.00th=[ 5604], 99.50th=[ 5932], 99.90th=[ 6980], 99.95th=[ 7046], 00:32:11.365 | 99.99th=[ 7570] 00:32:11.365 bw ( KiB/s): min=15232, max=16432, per=25.05%, avg=15788.80, stdev=410.48, samples=10 00:32:11.365 iops : min= 1904, max= 2054, avg=1973.60, stdev=51.31, samples=10 00:32:11.365 lat (usec) : 750=0.01%, 1000=0.04% 00:32:11.365 lat (msec) : 2=0.33%, 4=52.19%, 10=47.43% 00:32:11.365 cpu : usr=92.44%, sys=5.88%, ctx=64, majf=0, minf=94 00:32:11.365 IO depths : 1=0.2%, 2=17.5%, 4=56.4%, 8=25.9%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:11.365 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.365 complete : 0=0.0%, 4=91.0%, 8=9.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.365 issued rwts: total=9876,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.365 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:11.365 filename1: (groupid=0, jobs=1): err= 0: pid=2509692: Sat Nov 30 04:34:00 2024 00:32:11.365 read: IOPS=1975, BW=15.4MiB/s (16.2MB/s)(77.2MiB/5003msec) 00:32:11.365 slat (nsec): min=3653, max=71972, avg=18763.81, stdev=10463.79 00:32:11.365 clat (usec): min=789, max=8499, avg=3988.48, stdev=399.42 00:32:11.365 lat (usec): min=802, max=8512, avg=4007.25, stdev=399.83 00:32:11.365 clat percentiles (usec): 00:32:11.365 | 1.00th=[ 2769], 5.00th=[ 3458], 10.00th=[ 3687], 20.00th=[ 3851], 00:32:11.365 | 30.00th=[ 3884], 40.00th=[ 3949], 50.00th=[ 4015], 60.00th=[ 4047], 00:32:11.365 | 70.00th=[ 4113], 80.00th=[ 4146], 90.00th=[ 4228], 95.00th=[ 4293], 00:32:11.365 | 99.00th=[ 5407], 99.50th=[ 6325], 99.90th=[ 7111], 99.95th=[ 7635], 00:32:11.365 | 99.99th=[ 8455] 00:32:11.365 bw ( KiB/s): min=15312, max=16496, per=25.08%, avg=15808.00, stdev=376.90, samples=10 00:32:11.365 iops : min= 1914, max= 2062, avg=1976.00, stdev=47.11, samples=10 00:32:11.365 lat (usec) : 1000=0.02% 00:32:11.365 lat (msec) : 2=0.16%, 4=49.45%, 10=50.37% 00:32:11.365 cpu : usr=95.52%, sys=3.98%, ctx=9, majf=0, minf=99 00:32:11.365 IO depths : 1=0.2%, 2=12.9%, 4=60.5%, 8=26.4%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:11.365 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.365 complete : 0=0.0%, 4=91.4%, 8=8.6%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.365 issued rwts: total=9883,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.365 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:11.365 filename1: (groupid=0, jobs=1): err= 0: pid=2509693: Sat Nov 30 04:34:00 2024 00:32:11.365 read: IOPS=1956, BW=15.3MiB/s (16.0MB/s)(76.4MiB/5002msec) 00:32:11.365 slat (usec): min=3, max=119, avg=22.76, stdev=10.81 00:32:11.365 clat (usec): min=677, max=8125, avg=4000.09, stdev=479.84 00:32:11.366 lat (usec): min=692, max=8136, avg=4022.86, stdev=480.29 00:32:11.366 clat percentiles (usec): 00:32:11.366 | 1.00th=[ 2212], 5.00th=[ 3523], 10.00th=[ 3752], 20.00th=[ 3818], 00:32:11.366 | 30.00th=[ 3884], 40.00th=[ 3916], 50.00th=[ 3982], 60.00th=[ 4015], 00:32:11.366 | 70.00th=[ 4080], 80.00th=[ 4146], 90.00th=[ 4293], 95.00th=[ 4490], 00:32:11.366 | 99.00th=[ 5932], 99.50th=[ 6456], 99.90th=[ 7111], 99.95th=[ 7373], 00:32:11.366 | 99.99th=[ 8094] 00:32:11.366 bw ( KiB/s): min=15136, max=16352, per=24.87%, avg=15678.11, stdev=351.76, samples=9 00:32:11.366 iops : min= 1892, max= 2044, avg=1959.67, stdev=43.97, samples=9 00:32:11.366 lat (usec) : 750=0.02%, 1000=0.17% 00:32:11.366 lat (msec) : 2=0.61%, 4=55.60%, 10=43.60% 00:32:11.366 cpu : usr=81.52%, sys=10.24%, ctx=442, majf=0, minf=67 00:32:11.366 IO depths : 1=0.3%, 2=19.1%, 4=54.5%, 8=26.1%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:11.366 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.366 complete : 0=0.0%, 4=91.1%, 8=8.9%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:11.366 issued rwts: total=9785,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:11.366 latency : target=0, window=0, percentile=100.00%, depth=8 00:32:11.366 00:32:11.366 Run status group 0 (all jobs): 00:32:11.366 READ: bw=61.5MiB/s (64.5MB/s), 15.3MiB/s-15.4MiB/s (16.0MB/s-16.2MB/s), io=308MiB (323MB), run=5001-5004msec 00:32:11.366 04:34:01 -- target/dif.sh@119 -- # destroy_subsystems 0 1 00:32:11.366 04:34:01 -- target/dif.sh@43 -- # local sub 00:32:11.366 04:34:01 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.366 04:34:01 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:11.366 04:34:01 -- target/dif.sh@36 -- # local sub_id=0 00:32:11.366 04:34:01 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:11.366 04:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.366 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:32:11.366 04:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.366 04:34:01 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:11.366 04:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.366 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:32:11.366 04:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.366 04:34:01 -- target/dif.sh@45 -- # for sub in "$@" 00:32:11.366 04:34:01 -- target/dif.sh@46 -- # destroy_subsystem 1 00:32:11.366 04:34:01 -- target/dif.sh@36 -- # local sub_id=1 00:32:11.366 04:34:01 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode1 00:32:11.366 04:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.366 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:32:11.366 04:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.366 04:34:01 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null1 00:32:11.366 04:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.366 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:32:11.366 04:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.366 00:32:11.366 real 0m24.173s 00:32:11.366 user 4m31.521s 00:32:11.366 sys 0m6.612s 00:32:11.366 04:34:01 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:11.366 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:32:11.366 ************************************ 00:32:11.366 END TEST fio_dif_rand_params 00:32:11.366 ************************************ 00:32:11.366 04:34:01 -- target/dif.sh@144 -- # run_test fio_dif_digest fio_dif_digest 00:32:11.366 04:34:01 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:11.366 04:34:01 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:11.366 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:32:11.366 ************************************ 00:32:11.366 START TEST fio_dif_digest 00:32:11.366 ************************************ 00:32:11.366 04:34:01 -- common/autotest_common.sh@1114 -- # fio_dif_digest 00:32:11.366 04:34:01 -- target/dif.sh@123 -- # local NULL_DIF 00:32:11.366 04:34:01 -- target/dif.sh@124 -- # local bs numjobs runtime iodepth files 00:32:11.366 04:34:01 -- target/dif.sh@125 -- # local hdgst ddgst 00:32:11.366 04:34:01 -- target/dif.sh@127 -- # NULL_DIF=3 00:32:11.366 04:34:01 -- target/dif.sh@127 -- # bs=128k,128k,128k 00:32:11.366 04:34:01 -- target/dif.sh@127 -- # numjobs=3 00:32:11.366 04:34:01 -- target/dif.sh@127 -- # iodepth=3 00:32:11.366 04:34:01 -- target/dif.sh@127 -- # runtime=10 00:32:11.366 04:34:01 -- target/dif.sh@128 -- # hdgst=true 00:32:11.366 04:34:01 -- target/dif.sh@128 -- # ddgst=true 00:32:11.366 04:34:01 -- target/dif.sh@130 -- # create_subsystems 0 00:32:11.366 04:34:01 -- target/dif.sh@28 -- # local sub 00:32:11.366 04:34:01 -- target/dif.sh@30 -- # for sub in "$@" 00:32:11.366 04:34:01 -- target/dif.sh@31 -- # create_subsystem 0 00:32:11.366 04:34:01 -- target/dif.sh@18 -- # local sub_id=0 00:32:11.366 04:34:01 -- target/dif.sh@21 -- # rpc_cmd bdev_null_create bdev_null0 64 512 --md-size 16 --dif-type 3 00:32:11.366 04:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.366 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:32:11.366 bdev_null0 00:32:11.366 04:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.366 04:34:01 -- target/dif.sh@22 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:cnode0 --serial-number 53313233-0 --allow-any-host 00:32:11.366 04:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.366 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:32:11.366 04:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.366 04:34:01 -- target/dif.sh@23 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:cnode0 bdev_null0 00:32:11.366 04:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.366 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:32:11.366 04:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.366 04:34:01 -- target/dif.sh@24 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:cnode0 -t tcp -a 10.0.0.2 -s 4420 00:32:11.366 04:34:01 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:11.366 04:34:01 -- common/autotest_common.sh@10 -- # set +x 00:32:11.366 [2024-11-30 04:34:01.272384] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:11.366 04:34:01 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:11.366 04:34:01 -- target/dif.sh@131 -- # fio /dev/fd/62 00:32:11.366 04:34:01 -- target/dif.sh@131 -- # create_json_sub_conf 0 00:32:11.366 04:34:01 -- target/dif.sh@51 -- # gen_nvmf_target_json 0 00:32:11.366 04:34:01 -- nvmf/common.sh@520 -- # config=() 00:32:11.366 04:34:01 -- nvmf/common.sh@520 -- # local subsystem config 00:32:11.366 04:34:01 -- target/dif.sh@82 -- # fio_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.366 04:34:01 -- nvmf/common.sh@522 -- # for subsystem in "${@:-1}" 00:32:11.366 04:34:01 -- target/dif.sh@82 -- # gen_fio_conf 00:32:11.366 04:34:01 -- nvmf/common.sh@542 -- # config+=("$(cat <<-EOF 00:32:11.366 { 00:32:11.366 "params": { 00:32:11.366 "name": "Nvme$subsystem", 00:32:11.366 "trtype": "$TEST_TRANSPORT", 00:32:11.366 "traddr": "$NVMF_FIRST_TARGET_IP", 00:32:11.366 "adrfam": "ipv4", 00:32:11.366 "trsvcid": "$NVMF_PORT", 00:32:11.366 "subnqn": "nqn.2016-06.io.spdk:cnode$subsystem", 00:32:11.366 "hostnqn": "nqn.2016-06.io.spdk:host$subsystem", 00:32:11.366 "hdgst": ${hdgst:-false}, 00:32:11.366 "ddgst": ${ddgst:-false} 00:32:11.366 }, 00:32:11.366 "method": "bdev_nvme_attach_controller" 00:32:11.366 } 00:32:11.366 EOF 00:32:11.366 )") 00:32:11.366 04:34:01 -- common/autotest_common.sh@1345 -- # fio_plugin /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.366 04:34:01 -- target/dif.sh@54 -- # local file 00:32:11.366 04:34:01 -- target/dif.sh@56 -- # cat 00:32:11.366 04:34:01 -- common/autotest_common.sh@1326 -- # local fio_dir=/usr/src/fio 00:32:11.366 04:34:01 -- common/autotest_common.sh@1328 -- # sanitizers=('libasan' 'libclang_rt.asan') 00:32:11.367 04:34:01 -- common/autotest_common.sh@1328 -- # local sanitizers 00:32:11.367 04:34:01 -- common/autotest_common.sh@1329 -- # local plugin=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.367 04:34:01 -- common/autotest_common.sh@1330 -- # shift 00:32:11.367 04:34:01 -- common/autotest_common.sh@1332 -- # local asan_lib= 00:32:11.367 04:34:01 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:11.367 04:34:01 -- nvmf/common.sh@542 -- # cat 00:32:11.367 04:34:01 -- target/dif.sh@72 -- # (( file = 1 )) 00:32:11.367 04:34:01 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.367 04:34:01 -- target/dif.sh@72 -- # (( file <= files )) 00:32:11.367 04:34:01 -- common/autotest_common.sh@1334 -- # grep libasan 00:32:11.367 04:34:01 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:11.367 04:34:01 -- nvmf/common.sh@544 -- # jq . 00:32:11.367 04:34:01 -- nvmf/common.sh@545 -- # IFS=, 00:32:11.367 04:34:01 -- nvmf/common.sh@546 -- # printf '%s\n' '{ 00:32:11.367 "params": { 00:32:11.367 "name": "Nvme0", 00:32:11.367 "trtype": "tcp", 00:32:11.367 "traddr": "10.0.0.2", 00:32:11.367 "adrfam": "ipv4", 00:32:11.367 "trsvcid": "4420", 00:32:11.367 "subnqn": "nqn.2016-06.io.spdk:cnode0", 00:32:11.367 "hostnqn": "nqn.2016-06.io.spdk:host0", 00:32:11.367 "hdgst": true, 00:32:11.367 "ddgst": true 00:32:11.367 }, 00:32:11.367 "method": "bdev_nvme_attach_controller" 00:32:11.367 }' 00:32:11.367 04:34:01 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:11.367 04:34:01 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:11.367 04:34:01 -- common/autotest_common.sh@1333 -- # for sanitizer in "${sanitizers[@]}" 00:32:11.367 04:34:01 -- common/autotest_common.sh@1334 -- # ldd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev 00:32:11.367 04:34:01 -- common/autotest_common.sh@1334 -- # grep libclang_rt.asan 00:32:11.367 04:34:01 -- common/autotest_common.sh@1334 -- # awk '{print $3}' 00:32:11.367 04:34:01 -- common/autotest_common.sh@1334 -- # asan_lib= 00:32:11.367 04:34:01 -- common/autotest_common.sh@1335 -- # [[ -n '' ]] 00:32:11.367 04:34:01 -- common/autotest_common.sh@1341 -- # LD_PRELOAD=' /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/fio/spdk_bdev' 00:32:11.367 04:34:01 -- common/autotest_common.sh@1341 -- # /usr/src/fio/fio --ioengine=spdk_bdev --spdk_json_conf /dev/fd/62 /dev/fd/61 00:32:11.367 filename0: (g=0): rw=randread, bs=(R) 128KiB-128KiB, (W) 128KiB-128KiB, (T) 128KiB-128KiB, ioengine=spdk_bdev, iodepth=3 00:32:11.367 ... 00:32:11.367 fio-3.35 00:32:11.367 Starting 3 threads 00:32:11.367 EAL: No free 2048 kB hugepages reported on node 1 00:32:11.367 [2024-11-30 04:34:01.892585] rpc.c: 181:spdk_rpc_listen: *ERROR*: RPC Unix domain socket path /var/tmp/spdk.sock in use. Specify another. 00:32:11.367 [2024-11-30 04:34:01.892650] rpc.c: 90:spdk_rpc_initialize: *ERROR*: Unable to start RPC service at /var/tmp/spdk.sock 00:32:23.602 00:32:23.602 filename0: (groupid=0, jobs=1): err= 0: pid=2510464: Sat Nov 30 04:34:12 2024 00:32:23.602 read: IOPS=206, BW=25.8MiB/s (27.1MB/s)(259MiB/10005msec) 00:32:23.602 slat (nsec): min=4701, max=59192, avg=15566.87, stdev=4694.06 00:32:23.602 clat (usec): min=9142, max=19594, avg=14494.18, stdev=985.89 00:32:23.602 lat (usec): min=9165, max=19616, avg=14509.74, stdev=985.28 00:32:23.602 clat percentiles (usec): 00:32:23.602 | 1.00th=[12125], 5.00th=[13042], 10.00th=[13304], 20.00th=[13829], 00:32:23.602 | 30.00th=[13960], 40.00th=[14222], 50.00th=[14484], 60.00th=[14615], 00:32:23.602 | 70.00th=[15008], 80.00th=[15270], 90.00th=[15664], 95.00th=[16188], 00:32:23.602 | 99.00th=[17171], 99.50th=[17433], 99.90th=[19530], 99.95th=[19530], 00:32:23.602 | 99.99th=[19530] 00:32:23.602 bw ( KiB/s): min=25651, max=27648, per=33.35%, avg=26434.55, stdev=471.65, samples=20 00:32:23.602 iops : min= 200, max= 216, avg=206.50, stdev= 3.72, samples=20 00:32:23.602 lat (msec) : 10=0.05%, 20=99.95% 00:32:23.602 cpu : usr=93.32%, sys=6.15%, ctx=33, majf=0, minf=132 00:32:23.602 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:23.602 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.602 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.602 issued rwts: total=2068,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:23.602 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:23.602 filename0: (groupid=0, jobs=1): err= 0: pid=2510465: Sat Nov 30 04:34:12 2024 00:32:23.602 read: IOPS=210, BW=26.3MiB/s (27.6MB/s)(264MiB/10045msec) 00:32:23.602 slat (nsec): min=4868, max=41157, avg=13424.66, stdev=2919.53 00:32:23.602 clat (usec): min=10570, max=53561, avg=14231.83, stdev=1525.74 00:32:23.602 lat (usec): min=10582, max=53578, avg=14245.25, stdev=1525.65 00:32:23.602 clat percentiles (usec): 00:32:23.602 | 1.00th=[11863], 5.00th=[12518], 10.00th=[12911], 20.00th=[13304], 00:32:23.602 | 30.00th=[13698], 40.00th=[13960], 50.00th=[14091], 60.00th=[14353], 00:32:23.602 | 70.00th=[14746], 80.00th=[15008], 90.00th=[15533], 95.00th=[15926], 00:32:23.602 | 99.00th=[17171], 99.50th=[17695], 99.90th=[20317], 99.95th=[46400], 00:32:23.602 | 99.99th=[53740] 00:32:23.602 bw ( KiB/s): min=24832, max=28160, per=34.08%, avg=27008.00, stdev=892.63, samples=20 00:32:23.602 iops : min= 194, max= 220, avg=211.00, stdev= 6.97, samples=20 00:32:23.602 lat (msec) : 20=99.76%, 50=0.19%, 100=0.05% 00:32:23.602 cpu : usr=93.51%, sys=6.03%, ctx=29, majf=0, minf=69 00:32:23.602 IO depths : 1=0.1%, 2=99.9%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:23.602 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.602 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.602 issued rwts: total=2112,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:23.602 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:23.602 filename0: (groupid=0, jobs=1): err= 0: pid=2510466: Sat Nov 30 04:34:12 2024 00:32:23.602 read: IOPS=203, BW=25.4MiB/s (26.6MB/s)(255MiB/10046msec) 00:32:23.602 slat (nsec): min=4357, max=87846, avg=13383.54, stdev=3079.04 00:32:23.602 clat (usec): min=11720, max=49314, avg=14735.76, stdev=1500.75 00:32:23.602 lat (usec): min=11732, max=49332, avg=14749.15, stdev=1500.61 00:32:23.602 clat percentiles (usec): 00:32:23.602 | 1.00th=[12518], 5.00th=[13042], 10.00th=[13435], 20.00th=[13829], 00:32:23.602 | 30.00th=[14091], 40.00th=[14353], 50.00th=[14615], 60.00th=[14877], 00:32:23.602 | 70.00th=[15139], 80.00th=[15533], 90.00th=[16057], 95.00th=[16581], 00:32:23.602 | 99.00th=[17433], 99.50th=[17957], 99.90th=[25035], 99.95th=[45351], 00:32:23.602 | 99.99th=[49546] 00:32:23.602 bw ( KiB/s): min=24271, max=27392, per=32.91%, avg=26083.95, stdev=973.01, samples=20 00:32:23.603 iops : min= 189, max= 214, avg=203.75, stdev= 7.66, samples=20 00:32:23.603 lat (msec) : 20=99.75%, 50=0.25% 00:32:23.603 cpu : usr=93.60%, sys=5.92%, ctx=19, majf=0, minf=232 00:32:23.603 IO depths : 1=0.1%, 2=100.0%, 4=0.0%, 8=0.0%, 16=0.0%, 32=0.0%, >=64=0.0% 00:32:23.603 submit : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.603 complete : 0=0.0%, 4=100.0%, 8=0.0%, 16=0.0%, 32=0.0%, 64=0.0%, >=64=0.0% 00:32:23.603 issued rwts: total=2040,0,0,0 short=0,0,0,0 dropped=0,0,0,0 00:32:23.603 latency : target=0, window=0, percentile=100.00%, depth=3 00:32:23.603 00:32:23.603 Run status group 0 (all jobs): 00:32:23.603 READ: bw=77.4MiB/s (81.2MB/s), 25.4MiB/s-26.3MiB/s (26.6MB/s-27.6MB/s), io=778MiB (815MB), run=10005-10046msec 00:32:23.603 04:34:12 -- target/dif.sh@132 -- # destroy_subsystems 0 00:32:23.603 04:34:12 -- target/dif.sh@43 -- # local sub 00:32:23.603 04:34:12 -- target/dif.sh@45 -- # for sub in "$@" 00:32:23.603 04:34:12 -- target/dif.sh@46 -- # destroy_subsystem 0 00:32:23.603 04:34:12 -- target/dif.sh@36 -- # local sub_id=0 00:32:23.603 04:34:12 -- target/dif.sh@38 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:cnode0 00:32:23.603 04:34:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:23.603 04:34:12 -- common/autotest_common.sh@10 -- # set +x 00:32:23.603 04:34:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:23.603 04:34:12 -- target/dif.sh@39 -- # rpc_cmd bdev_null_delete bdev_null0 00:32:23.603 04:34:12 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:23.603 04:34:12 -- common/autotest_common.sh@10 -- # set +x 00:32:23.603 04:34:12 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:23.603 00:32:23.603 real 0m11.047s 00:32:23.603 user 0m29.190s 00:32:23.603 sys 0m2.072s 00:32:23.603 04:34:12 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:23.603 04:34:12 -- common/autotest_common.sh@10 -- # set +x 00:32:23.603 ************************************ 00:32:23.603 END TEST fio_dif_digest 00:32:23.603 ************************************ 00:32:23.603 04:34:12 -- target/dif.sh@146 -- # trap - SIGINT SIGTERM EXIT 00:32:23.603 04:34:12 -- target/dif.sh@147 -- # nvmftestfini 00:32:23.603 04:34:12 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:23.603 04:34:12 -- nvmf/common.sh@116 -- # sync 00:32:23.603 04:34:12 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:23.603 04:34:12 -- nvmf/common.sh@119 -- # set +e 00:32:23.603 04:34:12 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:23.603 04:34:12 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:23.603 rmmod nvme_tcp 00:32:23.603 rmmod nvme_fabrics 00:32:23.603 rmmod nvme_keyring 00:32:23.603 04:34:12 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:23.603 04:34:12 -- nvmf/common.sh@123 -- # set -e 00:32:23.603 04:34:12 -- nvmf/common.sh@124 -- # return 0 00:32:23.603 04:34:12 -- nvmf/common.sh@477 -- # '[' -n 2504239 ']' 00:32:23.603 04:34:12 -- nvmf/common.sh@478 -- # killprocess 2504239 00:32:23.603 04:34:12 -- common/autotest_common.sh@936 -- # '[' -z 2504239 ']' 00:32:23.603 04:34:12 -- common/autotest_common.sh@940 -- # kill -0 2504239 00:32:23.603 04:34:12 -- common/autotest_common.sh@941 -- # uname 00:32:23.603 04:34:12 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:23.603 04:34:12 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2504239 00:32:23.603 04:34:12 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:23.603 04:34:12 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:23.603 04:34:12 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2504239' 00:32:23.603 killing process with pid 2504239 00:32:23.603 04:34:12 -- common/autotest_common.sh@955 -- # kill 2504239 00:32:23.603 04:34:12 -- common/autotest_common.sh@960 -- # wait 2504239 00:32:23.603 04:34:12 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:23.603 04:34:12 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:23.603 Waiting for block devices as requested 00:32:23.603 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:23.603 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:23.603 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:23.603 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:23.603 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:23.873 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:23.873 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:23.873 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:23.873 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:23.873 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:24.131 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:24.131 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:24.131 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:24.131 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:24.391 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:24.391 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:24.391 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:24.658 04:34:15 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:24.659 04:34:15 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:24.659 04:34:15 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:24.659 04:34:15 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:24.659 04:34:15 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:24.659 04:34:15 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:24.659 04:34:15 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:26.570 04:34:17 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:32:26.570 00:32:26.570 real 1m7.168s 00:32:26.570 user 6m28.907s 00:32:26.570 sys 0m17.633s 00:32:26.570 04:34:17 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:26.570 04:34:17 -- common/autotest_common.sh@10 -- # set +x 00:32:26.570 ************************************ 00:32:26.570 END TEST nvmf_dif 00:32:26.570 ************************************ 00:32:26.570 04:34:17 -- spdk/autotest.sh@288 -- # run_test nvmf_abort_qd_sizes /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:26.570 04:34:17 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:26.570 04:34:17 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:26.570 04:34:17 -- common/autotest_common.sh@10 -- # set +x 00:32:26.570 ************************************ 00:32:26.570 START TEST nvmf_abort_qd_sizes 00:32:26.570 ************************************ 00:32:26.570 04:34:17 -- common/autotest_common.sh@1114 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target/abort_qd_sizes.sh 00:32:26.570 * Looking for test storage... 00:32:26.570 * Found test storage at /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/target 00:32:26.570 04:34:17 -- common/autotest_common.sh@1689 -- # [[ y == y ]] 00:32:26.570 04:34:17 -- common/autotest_common.sh@1690 -- # lcov --version 00:32:26.570 04:34:17 -- common/autotest_common.sh@1690 -- # awk '{print $NF}' 00:32:26.829 04:34:17 -- common/autotest_common.sh@1690 -- # lt 1.15 2 00:32:26.829 04:34:17 -- scripts/common.sh@372 -- # cmp_versions 1.15 '<' 2 00:32:26.829 04:34:17 -- scripts/common.sh@332 -- # local ver1 ver1_l 00:32:26.829 04:34:17 -- scripts/common.sh@333 -- # local ver2 ver2_l 00:32:26.829 04:34:17 -- scripts/common.sh@335 -- # IFS=.-: 00:32:26.829 04:34:17 -- scripts/common.sh@335 -- # read -ra ver1 00:32:26.829 04:34:17 -- scripts/common.sh@336 -- # IFS=.-: 00:32:26.829 04:34:17 -- scripts/common.sh@336 -- # read -ra ver2 00:32:26.829 04:34:17 -- scripts/common.sh@337 -- # local 'op=<' 00:32:26.829 04:34:17 -- scripts/common.sh@339 -- # ver1_l=2 00:32:26.829 04:34:17 -- scripts/common.sh@340 -- # ver2_l=1 00:32:26.829 04:34:17 -- scripts/common.sh@342 -- # local lt=0 gt=0 eq=0 v 00:32:26.829 04:34:17 -- scripts/common.sh@343 -- # case "$op" in 00:32:26.829 04:34:17 -- scripts/common.sh@344 -- # : 1 00:32:26.829 04:34:17 -- scripts/common.sh@363 -- # (( v = 0 )) 00:32:26.829 04:34:17 -- scripts/common.sh@363 -- # (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:32:26.829 04:34:17 -- scripts/common.sh@364 -- # decimal 1 00:32:26.829 04:34:17 -- scripts/common.sh@352 -- # local d=1 00:32:26.829 04:34:17 -- scripts/common.sh@353 -- # [[ 1 =~ ^[0-9]+$ ]] 00:32:26.829 04:34:17 -- scripts/common.sh@354 -- # echo 1 00:32:26.829 04:34:17 -- scripts/common.sh@364 -- # ver1[v]=1 00:32:26.829 04:34:17 -- scripts/common.sh@365 -- # decimal 2 00:32:26.829 04:34:17 -- scripts/common.sh@352 -- # local d=2 00:32:26.829 04:34:17 -- scripts/common.sh@353 -- # [[ 2 =~ ^[0-9]+$ ]] 00:32:26.829 04:34:17 -- scripts/common.sh@354 -- # echo 2 00:32:26.829 04:34:17 -- scripts/common.sh@365 -- # ver2[v]=2 00:32:26.829 04:34:17 -- scripts/common.sh@366 -- # (( ver1[v] > ver2[v] )) 00:32:26.829 04:34:17 -- scripts/common.sh@367 -- # (( ver1[v] < ver2[v] )) 00:32:26.829 04:34:17 -- scripts/common.sh@367 -- # return 0 00:32:26.829 04:34:17 -- common/autotest_common.sh@1691 -- # lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:32:26.829 04:34:17 -- common/autotest_common.sh@1703 -- # export 'LCOV_OPTS= 00:32:26.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:26.829 --rc genhtml_branch_coverage=1 00:32:26.829 --rc genhtml_function_coverage=1 00:32:26.829 --rc genhtml_legend=1 00:32:26.829 --rc geninfo_all_blocks=1 00:32:26.829 --rc geninfo_unexecuted_blocks=1 00:32:26.829 00:32:26.829 ' 00:32:26.829 04:34:17 -- common/autotest_common.sh@1703 -- # LCOV_OPTS=' 00:32:26.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:26.829 --rc genhtml_branch_coverage=1 00:32:26.829 --rc genhtml_function_coverage=1 00:32:26.829 --rc genhtml_legend=1 00:32:26.829 --rc geninfo_all_blocks=1 00:32:26.829 --rc geninfo_unexecuted_blocks=1 00:32:26.829 00:32:26.829 ' 00:32:26.829 04:34:17 -- common/autotest_common.sh@1704 -- # export 'LCOV=lcov 00:32:26.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:26.829 --rc genhtml_branch_coverage=1 00:32:26.829 --rc genhtml_function_coverage=1 00:32:26.829 --rc genhtml_legend=1 00:32:26.829 --rc geninfo_all_blocks=1 00:32:26.829 --rc geninfo_unexecuted_blocks=1 00:32:26.829 00:32:26.829 ' 00:32:26.829 04:34:17 -- common/autotest_common.sh@1704 -- # LCOV='lcov 00:32:26.829 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:32:26.829 --rc genhtml_branch_coverage=1 00:32:26.829 --rc genhtml_function_coverage=1 00:32:26.829 --rc genhtml_legend=1 00:32:26.829 --rc geninfo_all_blocks=1 00:32:26.829 --rc geninfo_unexecuted_blocks=1 00:32:26.829 00:32:26.829 ' 00:32:26.829 04:34:17 -- target/abort_qd_sizes.sh@14 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/nvmf/common.sh 00:32:26.829 04:34:17 -- nvmf/common.sh@7 -- # uname -s 00:32:26.829 04:34:17 -- nvmf/common.sh@7 -- # [[ Linux == FreeBSD ]] 00:32:26.829 04:34:17 -- nvmf/common.sh@9 -- # NVMF_PORT=4420 00:32:26.829 04:34:17 -- nvmf/common.sh@10 -- # NVMF_SECOND_PORT=4421 00:32:26.829 04:34:17 -- nvmf/common.sh@11 -- # NVMF_THIRD_PORT=4422 00:32:26.829 04:34:17 -- nvmf/common.sh@12 -- # NVMF_IP_PREFIX=192.168.100 00:32:26.829 04:34:17 -- nvmf/common.sh@13 -- # NVMF_IP_LEAST_ADDR=8 00:32:26.829 04:34:17 -- nvmf/common.sh@14 -- # NVMF_TCP_IP_ADDRESS=127.0.0.1 00:32:26.829 04:34:17 -- nvmf/common.sh@15 -- # NVMF_TRANSPORT_OPTS= 00:32:26.829 04:34:17 -- nvmf/common.sh@16 -- # NVMF_SERIAL=SPDKISFASTANDAWESOME 00:32:26.829 04:34:17 -- nvmf/common.sh@17 -- # nvme gen-hostnqn 00:32:26.829 04:34:17 -- nvmf/common.sh@17 -- # NVME_HOSTNQN=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 00:32:26.830 04:34:17 -- nvmf/common.sh@18 -- # NVME_HOSTID=5b23e107-7094-e311-b1cb-001e67a97d55 00:32:26.830 04:34:17 -- nvmf/common.sh@19 -- # NVME_HOST=("--hostnqn=$NVME_HOSTNQN" "--hostid=$NVME_HOSTID") 00:32:26.830 04:34:17 -- nvmf/common.sh@20 -- # NVME_CONNECT='nvme connect' 00:32:26.830 04:34:17 -- nvmf/common.sh@21 -- # NET_TYPE=phy 00:32:26.830 04:34:17 -- nvmf/common.sh@44 -- # source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:32:26.830 04:34:17 -- scripts/common.sh@433 -- # [[ -e /bin/wpdk_common.sh ]] 00:32:26.830 04:34:17 -- scripts/common.sh@441 -- # [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:32:26.830 04:34:17 -- scripts/common.sh@442 -- # source /etc/opt/spdk-pkgdep/paths/export.sh 00:32:26.830 04:34:17 -- paths/export.sh@2 -- # PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:26.830 04:34:17 -- paths/export.sh@3 -- # PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:26.830 04:34:17 -- paths/export.sh@4 -- # PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:26.830 04:34:17 -- paths/export.sh@5 -- # export PATH 00:32:26.830 04:34:17 -- paths/export.sh@6 -- # echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:32:26.830 04:34:17 -- nvmf/common.sh@46 -- # : 0 00:32:26.830 04:34:17 -- nvmf/common.sh@47 -- # export NVMF_APP_SHM_ID 00:32:26.830 04:34:17 -- nvmf/common.sh@48 -- # build_nvmf_app_args 00:32:26.830 04:34:17 -- nvmf/common.sh@24 -- # '[' 0 -eq 1 ']' 00:32:26.830 04:34:17 -- nvmf/common.sh@28 -- # NVMF_APP+=(-i "$NVMF_APP_SHM_ID" -e 0xFFFF) 00:32:26.830 04:34:17 -- nvmf/common.sh@30 -- # NVMF_APP+=("${NO_HUGE[@]}") 00:32:26.830 04:34:17 -- nvmf/common.sh@32 -- # '[' -n '' ']' 00:32:26.830 04:34:17 -- nvmf/common.sh@34 -- # '[' 0 -eq 1 ']' 00:32:26.830 04:34:17 -- nvmf/common.sh@50 -- # have_pci_nics=0 00:32:26.830 04:34:17 -- target/abort_qd_sizes.sh@73 -- # nvmftestinit 00:32:26.830 04:34:17 -- nvmf/common.sh@429 -- # '[' -z tcp ']' 00:32:26.830 04:34:17 -- nvmf/common.sh@434 -- # trap nvmftestfini SIGINT SIGTERM EXIT 00:32:26.830 04:34:17 -- nvmf/common.sh@436 -- # prepare_net_devs 00:32:26.830 04:34:17 -- nvmf/common.sh@398 -- # local -g is_hw=no 00:32:26.830 04:34:17 -- nvmf/common.sh@400 -- # remove_spdk_ns 00:32:26.830 04:34:17 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:26.830 04:34:17 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:26.830 04:34:17 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:32:26.830 04:34:17 -- nvmf/common.sh@402 -- # [[ phy != virt ]] 00:32:26.830 04:34:17 -- nvmf/common.sh@402 -- # gather_supported_nvmf_pci_devs 00:32:26.830 04:34:17 -- nvmf/common.sh@284 -- # xtrace_disable 00:32:26.830 04:34:17 -- common/autotest_common.sh@10 -- # set +x 00:32:28.735 04:34:19 -- nvmf/common.sh@288 -- # local intel=0x8086 mellanox=0x15b3 pci 00:32:28.735 04:34:19 -- nvmf/common.sh@290 -- # pci_devs=() 00:32:28.735 04:34:19 -- nvmf/common.sh@290 -- # local -a pci_devs 00:32:28.735 04:34:19 -- nvmf/common.sh@291 -- # pci_net_devs=() 00:32:28.736 04:34:19 -- nvmf/common.sh@291 -- # local -a pci_net_devs 00:32:28.736 04:34:19 -- nvmf/common.sh@292 -- # pci_drivers=() 00:32:28.736 04:34:19 -- nvmf/common.sh@292 -- # local -A pci_drivers 00:32:28.736 04:34:19 -- nvmf/common.sh@294 -- # net_devs=() 00:32:28.736 04:34:19 -- nvmf/common.sh@294 -- # local -ga net_devs 00:32:28.736 04:34:19 -- nvmf/common.sh@295 -- # e810=() 00:32:28.736 04:34:19 -- nvmf/common.sh@295 -- # local -ga e810 00:32:28.736 04:34:19 -- nvmf/common.sh@296 -- # x722=() 00:32:28.736 04:34:19 -- nvmf/common.sh@296 -- # local -ga x722 00:32:28.736 04:34:19 -- nvmf/common.sh@297 -- # mlx=() 00:32:28.736 04:34:19 -- nvmf/common.sh@297 -- # local -ga mlx 00:32:28.736 04:34:19 -- nvmf/common.sh@300 -- # e810+=(${pci_bus_cache["$intel:0x1592"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@301 -- # e810+=(${pci_bus_cache["$intel:0x159b"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@303 -- # x722+=(${pci_bus_cache["$intel:0x37d2"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@305 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2dc"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@307 -- # mlx+=(${pci_bus_cache["$mellanox:0x1021"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@309 -- # mlx+=(${pci_bus_cache["$mellanox:0xa2d6"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@311 -- # mlx+=(${pci_bus_cache["$mellanox:0x101d"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@313 -- # mlx+=(${pci_bus_cache["$mellanox:0x1017"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@314 -- # mlx+=(${pci_bus_cache["$mellanox:0x1019"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@316 -- # mlx+=(${pci_bus_cache["$mellanox:0x1015"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@317 -- # mlx+=(${pci_bus_cache["$mellanox:0x1013"]}) 00:32:28.736 04:34:19 -- nvmf/common.sh@319 -- # pci_devs+=("${e810[@]}") 00:32:28.736 04:34:19 -- nvmf/common.sh@320 -- # [[ tcp == rdma ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@326 -- # [[ e810 == mlx5 ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@328 -- # [[ e810 == e810 ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@329 -- # pci_devs=("${e810[@]}") 00:32:28.736 04:34:19 -- nvmf/common.sh@334 -- # (( 2 == 0 )) 00:32:28.736 04:34:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:28.736 04:34:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.0 (0x8086 - 0x159b)' 00:32:28.736 Found 0000:0a:00.0 (0x8086 - 0x159b) 00:32:28.736 04:34:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@339 -- # for pci in "${pci_devs[@]}" 00:32:28.736 04:34:19 -- nvmf/common.sh@340 -- # echo 'Found 0000:0a:00.1 (0x8086 - 0x159b)' 00:32:28.736 Found 0000:0a:00.1 (0x8086 - 0x159b) 00:32:28.736 04:34:19 -- nvmf/common.sh@341 -- # [[ ice == unknown ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@345 -- # [[ ice == unbound ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@349 -- # [[ 0x159b == \0\x\1\0\1\7 ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@350 -- # [[ 0x159b == \0\x\1\0\1\9 ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@351 -- # [[ tcp == rdma ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@365 -- # (( 0 > 0 )) 00:32:28.736 04:34:19 -- nvmf/common.sh@371 -- # [[ e810 == e810 ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@371 -- # [[ tcp == rdma ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:28.736 04:34:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:28.736 04:34:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:28.736 04:34:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:28.736 04:34:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.0: cvl_0_0' 00:32:28.736 Found net devices under 0000:0a:00.0: cvl_0_0 00:32:28.736 04:34:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:28.736 04:34:19 -- nvmf/common.sh@381 -- # for pci in "${pci_devs[@]}" 00:32:28.736 04:34:19 -- nvmf/common.sh@382 -- # pci_net_devs=("/sys/bus/pci/devices/$pci/net/"*) 00:32:28.736 04:34:19 -- nvmf/common.sh@383 -- # (( 1 == 0 )) 00:32:28.736 04:34:19 -- nvmf/common.sh@387 -- # pci_net_devs=("${pci_net_devs[@]##*/}") 00:32:28.736 04:34:19 -- nvmf/common.sh@388 -- # echo 'Found net devices under 0000:0a:00.1: cvl_0_1' 00:32:28.736 Found net devices under 0000:0a:00.1: cvl_0_1 00:32:28.736 04:34:19 -- nvmf/common.sh@389 -- # net_devs+=("${pci_net_devs[@]}") 00:32:28.736 04:34:19 -- nvmf/common.sh@392 -- # (( 2 == 0 )) 00:32:28.736 04:34:19 -- nvmf/common.sh@402 -- # is_hw=yes 00:32:28.736 04:34:19 -- nvmf/common.sh@404 -- # [[ yes == yes ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@405 -- # [[ tcp == tcp ]] 00:32:28.736 04:34:19 -- nvmf/common.sh@406 -- # nvmf_tcp_init 00:32:28.736 04:34:19 -- nvmf/common.sh@228 -- # NVMF_INITIATOR_IP=10.0.0.1 00:32:28.736 04:34:19 -- nvmf/common.sh@229 -- # NVMF_FIRST_TARGET_IP=10.0.0.2 00:32:28.736 04:34:19 -- nvmf/common.sh@230 -- # TCP_INTERFACE_LIST=("${net_devs[@]}") 00:32:28.736 04:34:19 -- nvmf/common.sh@233 -- # (( 2 > 1 )) 00:32:28.736 04:34:19 -- nvmf/common.sh@235 -- # NVMF_TARGET_INTERFACE=cvl_0_0 00:32:28.736 04:34:19 -- nvmf/common.sh@236 -- # NVMF_INITIATOR_INTERFACE=cvl_0_1 00:32:28.736 04:34:19 -- nvmf/common.sh@239 -- # NVMF_SECOND_TARGET_IP= 00:32:28.736 04:34:19 -- nvmf/common.sh@241 -- # NVMF_TARGET_NAMESPACE=cvl_0_0_ns_spdk 00:32:28.736 04:34:19 -- nvmf/common.sh@242 -- # NVMF_TARGET_NS_CMD=(ip netns exec "$NVMF_TARGET_NAMESPACE") 00:32:28.736 04:34:19 -- nvmf/common.sh@243 -- # ip -4 addr flush cvl_0_0 00:32:28.736 04:34:19 -- nvmf/common.sh@244 -- # ip -4 addr flush cvl_0_1 00:32:28.736 04:34:19 -- nvmf/common.sh@247 -- # ip netns add cvl_0_0_ns_spdk 00:32:28.736 04:34:19 -- nvmf/common.sh@250 -- # ip link set cvl_0_0 netns cvl_0_0_ns_spdk 00:32:28.736 04:34:19 -- nvmf/common.sh@253 -- # ip addr add 10.0.0.1/24 dev cvl_0_1 00:32:28.736 04:34:19 -- nvmf/common.sh@254 -- # ip netns exec cvl_0_0_ns_spdk ip addr add 10.0.0.2/24 dev cvl_0_0 00:32:28.736 04:34:19 -- nvmf/common.sh@257 -- # ip link set cvl_0_1 up 00:32:28.736 04:34:19 -- nvmf/common.sh@259 -- # ip netns exec cvl_0_0_ns_spdk ip link set cvl_0_0 up 00:32:28.995 04:34:19 -- nvmf/common.sh@260 -- # ip netns exec cvl_0_0_ns_spdk ip link set lo up 00:32:28.995 04:34:19 -- nvmf/common.sh@263 -- # iptables -I INPUT 1 -i cvl_0_1 -p tcp --dport 4420 -j ACCEPT 00:32:28.995 04:34:19 -- nvmf/common.sh@266 -- # ping -c 1 10.0.0.2 00:32:28.995 PING 10.0.0.2 (10.0.0.2) 56(84) bytes of data. 00:32:28.995 64 bytes from 10.0.0.2: icmp_seq=1 ttl=64 time=0.328 ms 00:32:28.995 00:32:28.995 --- 10.0.0.2 ping statistics --- 00:32:28.995 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:28.995 rtt min/avg/max/mdev = 0.328/0.328/0.328/0.000 ms 00:32:28.996 04:34:19 -- nvmf/common.sh@267 -- # ip netns exec cvl_0_0_ns_spdk ping -c 1 10.0.0.1 00:32:28.996 PING 10.0.0.1 (10.0.0.1) 56(84) bytes of data. 00:32:28.996 64 bytes from 10.0.0.1: icmp_seq=1 ttl=64 time=0.167 ms 00:32:28.996 00:32:28.996 --- 10.0.0.1 ping statistics --- 00:32:28.996 1 packets transmitted, 1 received, 0% packet loss, time 0ms 00:32:28.996 rtt min/avg/max/mdev = 0.167/0.167/0.167/0.000 ms 00:32:28.996 04:34:19 -- nvmf/common.sh@269 -- # NVMF_APP=("${NVMF_TARGET_NS_CMD[@]}" "${NVMF_APP[@]}") 00:32:28.996 04:34:19 -- nvmf/common.sh@410 -- # return 0 00:32:28.996 04:34:19 -- nvmf/common.sh@438 -- # '[' iso == iso ']' 00:32:28.996 04:34:19 -- nvmf/common.sh@439 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh 00:32:29.934 0000:00:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:29.934 0000:00:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:29.934 0000:00:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:29.934 0000:00:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:29.934 0000:00:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:29.934 0000:00:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:29.934 0000:00:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:30.193 0000:00:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:30.193 0000:80:04.7 (8086 0e27): ioatdma -> vfio-pci 00:32:30.193 0000:80:04.6 (8086 0e26): ioatdma -> vfio-pci 00:32:30.193 0000:80:04.5 (8086 0e25): ioatdma -> vfio-pci 00:32:30.193 0000:80:04.4 (8086 0e24): ioatdma -> vfio-pci 00:32:30.193 0000:80:04.3 (8086 0e23): ioatdma -> vfio-pci 00:32:30.193 0000:80:04.2 (8086 0e22): ioatdma -> vfio-pci 00:32:30.193 0000:80:04.1 (8086 0e21): ioatdma -> vfio-pci 00:32:30.193 0000:80:04.0 (8086 0e20): ioatdma -> vfio-pci 00:32:31.130 0000:88:00.0 (8086 0a54): nvme -> vfio-pci 00:32:31.130 04:34:21 -- nvmf/common.sh@442 -- # NVMF_TRANSPORT_OPTS='-t tcp' 00:32:31.130 04:34:21 -- nvmf/common.sh@443 -- # [[ tcp == \r\d\m\a ]] 00:32:31.130 04:34:21 -- nvmf/common.sh@452 -- # [[ tcp == \t\c\p ]] 00:32:31.130 04:34:21 -- nvmf/common.sh@453 -- # NVMF_TRANSPORT_OPTS='-t tcp -o' 00:32:31.130 04:34:21 -- nvmf/common.sh@456 -- # '[' tcp == tcp ']' 00:32:31.130 04:34:21 -- nvmf/common.sh@462 -- # modprobe nvme-tcp 00:32:31.130 04:34:21 -- target/abort_qd_sizes.sh@74 -- # nvmfappstart -m 0xf 00:32:31.130 04:34:21 -- nvmf/common.sh@467 -- # timing_enter start_nvmf_tgt 00:32:31.130 04:34:21 -- common/autotest_common.sh@722 -- # xtrace_disable 00:32:31.130 04:34:21 -- common/autotest_common.sh@10 -- # set +x 00:32:31.130 04:34:21 -- nvmf/common.sh@469 -- # nvmfpid=2515475 00:32:31.130 04:34:21 -- nvmf/common.sh@468 -- # ip netns exec cvl_0_0_ns_spdk /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/bin/nvmf_tgt -i 0 -e 0xFFFF -m 0xf 00:32:31.130 04:34:21 -- nvmf/common.sh@470 -- # waitforlisten 2515475 00:32:31.130 04:34:21 -- common/autotest_common.sh@829 -- # '[' -z 2515475 ']' 00:32:31.130 04:34:21 -- common/autotest_common.sh@833 -- # local rpc_addr=/var/tmp/spdk.sock 00:32:31.130 04:34:21 -- common/autotest_common.sh@834 -- # local max_retries=100 00:32:31.130 04:34:21 -- common/autotest_common.sh@836 -- # echo 'Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock...' 00:32:31.130 Waiting for process to start up and listen on UNIX domain socket /var/tmp/spdk.sock... 00:32:31.130 04:34:21 -- common/autotest_common.sh@838 -- # xtrace_disable 00:32:31.130 04:34:21 -- common/autotest_common.sh@10 -- # set +x 00:32:31.130 [2024-11-30 04:34:21.708594] Starting SPDK v24.01.1-pre git sha1 c13c99a5e / DPDK 23.11.0 initialization... 00:32:31.130 [2024-11-30 04:34:21.708680] [ DPDK EAL parameters: nvmf -c 0xf --no-telemetry --log-level=lib.eal:6 --log-level=lib.cryptodev:5 --log-level=user1:6 --base-virtaddr=0x200000000000 --match-allocations --file-prefix=spdk0 --proc-type=auto ] 00:32:31.130 EAL: No free 2048 kB hugepages reported on node 1 00:32:31.389 [2024-11-30 04:34:21.773146] app.c: 798:spdk_app_start: *NOTICE*: Total cores available: 4 00:32:31.389 [2024-11-30 04:34:21.857814] trace_flags.c: 278:trace_register_description: *ERROR*: name (RDMA_REQ_RDY_TO_COMPL_PEND) too long 00:32:31.389 [2024-11-30 04:34:21.857982] app.c: 488:app_setup_trace: *NOTICE*: Tracepoint Group Mask 0xFFFF specified. 00:32:31.389 [2024-11-30 04:34:21.858010] app.c: 489:app_setup_trace: *NOTICE*: Use 'spdk_trace -s nvmf -i 0' to capture a snapshot of events at runtime. 00:32:31.389 [2024-11-30 04:34:21.858022] app.c: 494:app_setup_trace: *NOTICE*: Or copy /dev/shm/nvmf_trace.0 for offline analysis/debug. 00:32:31.389 [2024-11-30 04:34:21.858078] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 1 00:32:31.389 [2024-11-30 04:34:21.858305] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 2 00:32:31.389 [2024-11-30 04:34:21.858363] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 3 00:32:31.389 [2024-11-30 04:34:21.858365] reactor.c: 937:reactor_run: *NOTICE*: Reactor started on core 0 00:32:32.325 04:34:22 -- common/autotest_common.sh@858 -- # (( i == 0 )) 00:32:32.325 04:34:22 -- common/autotest_common.sh@862 -- # return 0 00:32:32.325 04:34:22 -- nvmf/common.sh@471 -- # timing_exit start_nvmf_tgt 00:32:32.325 04:34:22 -- common/autotest_common.sh@728 -- # xtrace_disable 00:32:32.325 04:34:22 -- common/autotest_common.sh@10 -- # set +x 00:32:32.325 04:34:22 -- nvmf/common.sh@472 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini' SIGINT SIGTERM EXIT 00:32:32.325 04:34:22 -- target/abort_qd_sizes.sh@76 -- # trap 'process_shm --id $NVMF_APP_SHM_ID || :; nvmftestfini || :; clean_kernel_target' SIGINT SIGTERM EXIT 00:32:32.325 04:34:22 -- target/abort_qd_sizes.sh@78 -- # mapfile -t nvmes 00:32:32.325 04:34:22 -- target/abort_qd_sizes.sh@78 -- # nvme_in_userspace 00:32:32.325 04:34:22 -- scripts/common.sh@311 -- # local bdf bdfs 00:32:32.325 04:34:22 -- scripts/common.sh@312 -- # local nvmes 00:32:32.325 04:34:22 -- scripts/common.sh@314 -- # [[ -n 0000:88:00.0 ]] 00:32:32.325 04:34:22 -- scripts/common.sh@315 -- # nvmes=(${pci_bus_cache["0x010802"]}) 00:32:32.325 04:34:22 -- scripts/common.sh@320 -- # for bdf in "${nvmes[@]}" 00:32:32.325 04:34:22 -- scripts/common.sh@321 -- # [[ -e /sys/bus/pci/drivers/nvme/0000:88:00.0 ]] 00:32:32.325 04:34:22 -- scripts/common.sh@322 -- # uname -s 00:32:32.325 04:34:22 -- scripts/common.sh@322 -- # [[ Linux == FreeBSD ]] 00:32:32.325 04:34:22 -- scripts/common.sh@325 -- # bdfs+=("$bdf") 00:32:32.325 04:34:22 -- scripts/common.sh@327 -- # (( 1 )) 00:32:32.326 04:34:22 -- scripts/common.sh@328 -- # printf '%s\n' 0000:88:00.0 00:32:32.326 04:34:22 -- target/abort_qd_sizes.sh@79 -- # (( 1 > 0 )) 00:32:32.326 04:34:22 -- target/abort_qd_sizes.sh@81 -- # nvme=0000:88:00.0 00:32:32.326 04:34:22 -- target/abort_qd_sizes.sh@83 -- # run_test spdk_target_abort spdk_target 00:32:32.326 04:34:22 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:32.326 04:34:22 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:32.326 04:34:22 -- common/autotest_common.sh@10 -- # set +x 00:32:32.326 ************************************ 00:32:32.326 START TEST spdk_target_abort 00:32:32.326 ************************************ 00:32:32.326 04:34:22 -- common/autotest_common.sh@1114 -- # spdk_target 00:32:32.326 04:34:22 -- target/abort_qd_sizes.sh@43 -- # local name=spdk_target 00:32:32.326 04:34:22 -- target/abort_qd_sizes.sh@44 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:32.326 04:34:22 -- target/abort_qd_sizes.sh@46 -- # rpc_cmd bdev_nvme_attach_controller -t pcie -a 0000:88:00.0 -b spdk_target 00:32:32.326 04:34:22 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:32.326 04:34:22 -- common/autotest_common.sh@10 -- # set +x 00:32:35.637 spdk_targetn1 00:32:35.637 04:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@48 -- # rpc_cmd nvmf_create_transport -t tcp -o -u 8192 00:32:35.637 04:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:35.637 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:32:35.637 [2024-11-30 04:34:25.548771] tcp.c: 661:nvmf_tcp_create: *NOTICE*: *** TCP Transport Init *** 00:32:35.637 04:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@49 -- # rpc_cmd nvmf_create_subsystem nqn.2016-06.io.spdk:spdk_target -a -s SPDKISFASTANDAWESOME 00:32:35.637 04:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:35.637 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:32:35.637 04:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@50 -- # rpc_cmd nvmf_subsystem_add_ns nqn.2016-06.io.spdk:spdk_target spdk_targetn1 00:32:35.637 04:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:35.637 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:32:35.637 04:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@51 -- # rpc_cmd nvmf_subsystem_add_listener nqn.2016-06.io.spdk:spdk_target -t tcp -a 10.0.0.2 -s 4420 00:32:35.637 04:34:25 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:35.637 04:34:25 -- common/autotest_common.sh@10 -- # set +x 00:32:35.637 [2024-11-30 04:34:25.581088] tcp.c: 953:nvmf_tcp_listen: *NOTICE*: *** NVMe/TCP Target Listening on 10.0.0.2 port 4420 *** 00:32:35.637 04:34:25 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@53 -- # rabort tcp IPv4 10.0.0.2 4420 nqn.2016-06.io.spdk:spdk_target 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.2 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@21 -- # local subnqn=nqn.2016-06.io.spdk:spdk_target 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2' 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420' 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:35.637 04:34:25 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:35.637 EAL: No free 2048 kB hugepages reported on node 1 00:32:38.918 Initializing NVMe Controllers 00:32:38.918 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:38.918 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:38.918 Initialization complete. Launching workers. 00:32:38.918 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 10778, failed: 0 00:32:38.918 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1243, failed to submit 9535 00:32:38.918 success 753, unsuccess 490, failed 0 00:32:38.918 04:34:28 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:38.918 04:34:28 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:38.918 EAL: No free 2048 kB hugepages reported on node 1 00:32:42.197 Initializing NVMe Controllers 00:32:42.197 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:42.197 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:42.197 Initialization complete. Launching workers. 00:32:42.197 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 8776, failed: 0 00:32:42.197 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 1255, failed to submit 7521 00:32:42.197 success 352, unsuccess 903, failed 0 00:32:42.197 04:34:32 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:42.197 04:34:32 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.2 trsvcid:4420 subnqn:nqn.2016-06.io.spdk:spdk_target' 00:32:42.197 EAL: No free 2048 kB hugepages reported on node 1 00:32:44.725 Initializing NVMe Controllers 00:32:44.725 Attached to NVMe over Fabrics controller at 10.0.0.2:4420: nqn.2016-06.io.spdk:spdk_target 00:32:44.725 Associating TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 with lcore 0 00:32:44.725 Initialization complete. Launching workers. 00:32:44.725 NS: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) NSID 1 I/O completed: 32380, failed: 0 00:32:44.725 CTRLR: TCP (addr:10.0.0.2 subnqn:nqn.2016-06.io.spdk:spdk_target) abort submitted 2721, failed to submit 29659 00:32:44.725 success 530, unsuccess 2191, failed 0 00:32:44.725 04:34:35 -- target/abort_qd_sizes.sh@55 -- # rpc_cmd nvmf_delete_subsystem nqn.2016-06.io.spdk:spdk_target 00:32:44.725 04:34:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:44.725 04:34:35 -- common/autotest_common.sh@10 -- # set +x 00:32:44.725 04:34:35 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:44.725 04:34:35 -- target/abort_qd_sizes.sh@56 -- # rpc_cmd bdev_nvme_detach_controller spdk_target 00:32:44.725 04:34:35 -- common/autotest_common.sh@561 -- # xtrace_disable 00:32:44.725 04:34:35 -- common/autotest_common.sh@10 -- # set +x 00:32:46.097 04:34:36 -- common/autotest_common.sh@589 -- # [[ 0 == 0 ]] 00:32:46.097 04:34:36 -- target/abort_qd_sizes.sh@62 -- # killprocess 2515475 00:32:46.097 04:34:36 -- common/autotest_common.sh@936 -- # '[' -z 2515475 ']' 00:32:46.097 04:34:36 -- common/autotest_common.sh@940 -- # kill -0 2515475 00:32:46.097 04:34:36 -- common/autotest_common.sh@941 -- # uname 00:32:46.097 04:34:36 -- common/autotest_common.sh@941 -- # '[' Linux = Linux ']' 00:32:46.097 04:34:36 -- common/autotest_common.sh@942 -- # ps --no-headers -o comm= 2515475 00:32:46.097 04:34:36 -- common/autotest_common.sh@942 -- # process_name=reactor_0 00:32:46.097 04:34:36 -- common/autotest_common.sh@946 -- # '[' reactor_0 = sudo ']' 00:32:46.097 04:34:36 -- common/autotest_common.sh@954 -- # echo 'killing process with pid 2515475' 00:32:46.097 killing process with pid 2515475 00:32:46.097 04:34:36 -- common/autotest_common.sh@955 -- # kill 2515475 00:32:46.097 04:34:36 -- common/autotest_common.sh@960 -- # wait 2515475 00:32:46.355 00:32:46.355 real 0m14.236s 00:32:46.355 user 0m56.370s 00:32:46.355 sys 0m2.621s 00:32:46.355 04:34:36 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:46.355 04:34:36 -- common/autotest_common.sh@10 -- # set +x 00:32:46.355 ************************************ 00:32:46.355 END TEST spdk_target_abort 00:32:46.355 ************************************ 00:32:46.355 04:34:36 -- target/abort_qd_sizes.sh@84 -- # run_test kernel_target_abort kernel_target 00:32:46.355 04:34:36 -- common/autotest_common.sh@1087 -- # '[' 2 -le 1 ']' 00:32:46.355 04:34:36 -- common/autotest_common.sh@1093 -- # xtrace_disable 00:32:46.355 04:34:36 -- common/autotest_common.sh@10 -- # set +x 00:32:46.355 ************************************ 00:32:46.355 START TEST kernel_target_abort 00:32:46.355 ************************************ 00:32:46.355 04:34:36 -- common/autotest_common.sh@1114 -- # kernel_target 00:32:46.355 04:34:36 -- target/abort_qd_sizes.sh@66 -- # local name=kernel_target 00:32:46.355 04:34:36 -- target/abort_qd_sizes.sh@68 -- # configure_kernel_target kernel_target 00:32:46.355 04:34:36 -- nvmf/common.sh@621 -- # kernel_name=kernel_target 00:32:46.355 04:34:36 -- nvmf/common.sh@622 -- # nvmet=/sys/kernel/config/nvmet 00:32:46.355 04:34:36 -- nvmf/common.sh@623 -- # kernel_subsystem=/sys/kernel/config/nvmet/subsystems/kernel_target 00:32:46.355 04:34:36 -- nvmf/common.sh@624 -- # kernel_namespace=/sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:46.355 04:34:36 -- nvmf/common.sh@625 -- # kernel_port=/sys/kernel/config/nvmet/ports/1 00:32:46.355 04:34:36 -- nvmf/common.sh@627 -- # local block nvme 00:32:46.355 04:34:36 -- nvmf/common.sh@629 -- # [[ ! -e /sys/module/nvmet ]] 00:32:46.355 04:34:36 -- nvmf/common.sh@630 -- # modprobe nvmet 00:32:46.614 04:34:36 -- nvmf/common.sh@633 -- # [[ -e /sys/kernel/config/nvmet ]] 00:32:46.614 04:34:36 -- nvmf/common.sh@635 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:47.548 Waiting for block devices as requested 00:32:47.548 0000:88:00.0 (8086 0a54): vfio-pci -> nvme 00:32:47.807 0000:00:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:47.807 0000:00:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:47.807 0000:00:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:48.067 0000:00:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:48.067 0000:00:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:48.067 0000:00:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:48.067 0000:00:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:48.327 0000:00:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:48.327 0000:80:04.7 (8086 0e27): vfio-pci -> ioatdma 00:32:48.327 0000:80:04.6 (8086 0e26): vfio-pci -> ioatdma 00:32:48.327 0000:80:04.5 (8086 0e25): vfio-pci -> ioatdma 00:32:48.585 0000:80:04.4 (8086 0e24): vfio-pci -> ioatdma 00:32:48.585 0000:80:04.3 (8086 0e23): vfio-pci -> ioatdma 00:32:48.585 0000:80:04.2 (8086 0e22): vfio-pci -> ioatdma 00:32:48.585 0000:80:04.1 (8086 0e21): vfio-pci -> ioatdma 00:32:48.843 0000:80:04.0 (8086 0e20): vfio-pci -> ioatdma 00:32:48.843 04:34:39 -- nvmf/common.sh@638 -- # for block in /sys/block/nvme* 00:32:48.843 04:34:39 -- nvmf/common.sh@639 -- # [[ -e /sys/block/nvme0n1 ]] 00:32:48.843 04:34:39 -- nvmf/common.sh@640 -- # block_in_use nvme0n1 00:32:48.843 04:34:39 -- scripts/common.sh@380 -- # local block=nvme0n1 pt 00:32:48.843 04:34:39 -- scripts/common.sh@389 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/spdk-gpt.py nvme0n1 00:32:48.843 No valid GPT data, bailing 00:32:48.843 04:34:39 -- scripts/common.sh@393 -- # blkid -s PTTYPE -o value /dev/nvme0n1 00:32:48.843 04:34:39 -- scripts/common.sh@393 -- # pt= 00:32:48.843 04:34:39 -- scripts/common.sh@394 -- # return 1 00:32:48.843 04:34:39 -- nvmf/common.sh@640 -- # nvme=/dev/nvme0n1 00:32:48.843 04:34:39 -- nvmf/common.sh@643 -- # [[ -b /dev/nvme0n1 ]] 00:32:48.843 04:34:39 -- nvmf/common.sh@645 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:48.843 04:34:39 -- nvmf/common.sh@646 -- # mkdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:48.843 04:34:39 -- nvmf/common.sh@647 -- # mkdir /sys/kernel/config/nvmet/ports/1 00:32:48.843 04:34:39 -- nvmf/common.sh@652 -- # echo SPDK-kernel_target 00:32:48.843 04:34:39 -- nvmf/common.sh@654 -- # echo 1 00:32:48.843 04:34:39 -- nvmf/common.sh@655 -- # echo /dev/nvme0n1 00:32:48.843 04:34:39 -- nvmf/common.sh@656 -- # echo 1 00:32:48.843 04:34:39 -- nvmf/common.sh@662 -- # echo 10.0.0.1 00:32:48.843 04:34:39 -- nvmf/common.sh@663 -- # echo tcp 00:32:48.843 04:34:39 -- nvmf/common.sh@664 -- # echo 4420 00:32:48.843 04:34:39 -- nvmf/common.sh@665 -- # echo ipv4 00:32:48.843 04:34:39 -- nvmf/common.sh@668 -- # ln -s /sys/kernel/config/nvmet/subsystems/kernel_target /sys/kernel/config/nvmet/ports/1/subsystems/ 00:32:49.102 04:34:39 -- nvmf/common.sh@671 -- # nvme discover --hostnqn=nqn.2014-08.org.nvmexpress:uuid:5b23e107-7094-e311-b1cb-001e67a97d55 --hostid=5b23e107-7094-e311-b1cb-001e67a97d55 -a 10.0.0.1 -t tcp -s 4420 00:32:49.102 00:32:49.102 Discovery Log Number of Records 2, Generation counter 2 00:32:49.102 =====Discovery Log Entry 0====== 00:32:49.102 trtype: tcp 00:32:49.102 adrfam: ipv4 00:32:49.102 subtype: current discovery subsystem 00:32:49.102 treq: not specified, sq flow control disable supported 00:32:49.102 portid: 1 00:32:49.102 trsvcid: 4420 00:32:49.102 subnqn: nqn.2014-08.org.nvmexpress.discovery 00:32:49.102 traddr: 10.0.0.1 00:32:49.102 eflags: none 00:32:49.102 sectype: none 00:32:49.102 =====Discovery Log Entry 1====== 00:32:49.102 trtype: tcp 00:32:49.102 adrfam: ipv4 00:32:49.102 subtype: nvme subsystem 00:32:49.102 treq: not specified, sq flow control disable supported 00:32:49.102 portid: 1 00:32:49.102 trsvcid: 4420 00:32:49.102 subnqn: kernel_target 00:32:49.102 traddr: 10.0.0.1 00:32:49.102 eflags: none 00:32:49.102 sectype: none 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@69 -- # rabort tcp IPv4 10.0.0.1 4420 kernel_target 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@17 -- # local trtype=tcp 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@18 -- # local adrfam=IPv4 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@19 -- # local traddr=10.0.0.1 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@20 -- # local trsvcid=4420 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@21 -- # local subnqn=kernel_target 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@23 -- # local qds qd 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@24 -- # local target r 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@26 -- # qds=(4 24 64) 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@29 -- # target=trtype:tcp 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4' 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1' 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420' 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@28 -- # for r in trtype adrfam traddr trsvcid subnqn 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@29 -- # target='trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:49.102 04:34:39 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 4 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:49.102 EAL: No free 2048 kB hugepages reported on node 1 00:32:52.410 Initializing NVMe Controllers 00:32:52.410 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:52.410 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:52.410 Initialization complete. Launching workers. 00:32:52.410 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 43581, failed: 0 00:32:52.410 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 43581, failed to submit 0 00:32:52.410 success 0, unsuccess 43581, failed 0 00:32:52.410 04:34:42 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:52.410 04:34:42 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 24 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:52.410 EAL: No free 2048 kB hugepages reported on node 1 00:32:55.683 Initializing NVMe Controllers 00:32:55.683 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:55.683 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:55.683 Initialization complete. Launching workers. 00:32:55.683 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 79721, failed: 0 00:32:55.683 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20106, failed to submit 59615 00:32:55.683 success 0, unsuccess 20106, failed 0 00:32:55.683 04:34:45 -- target/abort_qd_sizes.sh@32 -- # for qd in "${qds[@]}" 00:32:55.683 04:34:45 -- target/abort_qd_sizes.sh@34 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/build/examples/abort -q 64 -w rw -M 50 -o 4096 -r 'trtype:tcp adrfam:IPv4 traddr:10.0.0.1 trsvcid:4420 subnqn:kernel_target' 00:32:55.683 EAL: No free 2048 kB hugepages reported on node 1 00:32:58.964 Initializing NVMe Controllers 00:32:58.964 Attached to NVMe over Fabrics controller at 10.0.0.1:4420: kernel_target 00:32:58.964 Associating TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 with lcore 0 00:32:58.964 Initialization complete. Launching workers. 00:32:58.964 NS: TCP (addr:10.0.0.1 subnqn:kernel_target) NSID 1 I/O completed: 81214, failed: 0 00:32:58.964 CTRLR: TCP (addr:10.0.0.1 subnqn:kernel_target) abort submitted 20266, failed to submit 60948 00:32:58.964 success 0, unsuccess 20266, failed 0 00:32:58.964 04:34:48 -- target/abort_qd_sizes.sh@70 -- # clean_kernel_target 00:32:58.964 04:34:48 -- nvmf/common.sh@675 -- # [[ -e /sys/kernel/config/nvmet/subsystems/kernel_target ]] 00:32:58.964 04:34:48 -- nvmf/common.sh@677 -- # echo 0 00:32:58.964 04:34:48 -- nvmf/common.sh@679 -- # rm -f /sys/kernel/config/nvmet/ports/1/subsystems/kernel_target 00:32:58.964 04:34:48 -- nvmf/common.sh@680 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target/namespaces/1 00:32:58.964 04:34:48 -- nvmf/common.sh@681 -- # rmdir /sys/kernel/config/nvmet/ports/1 00:32:58.964 04:34:48 -- nvmf/common.sh@682 -- # rmdir /sys/kernel/config/nvmet/subsystems/kernel_target 00:32:58.964 04:34:48 -- nvmf/common.sh@684 -- # modules=(/sys/module/nvmet/holders/*) 00:32:58.964 04:34:48 -- nvmf/common.sh@686 -- # modprobe -r nvmet_tcp nvmet 00:32:58.964 00:32:58.964 real 0m11.988s 00:32:58.964 user 0m5.683s 00:32:58.964 sys 0m2.405s 00:32:58.964 04:34:48 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:32:58.964 04:34:48 -- common/autotest_common.sh@10 -- # set +x 00:32:58.964 ************************************ 00:32:58.964 END TEST kernel_target_abort 00:32:58.964 ************************************ 00:32:58.964 04:34:48 -- target/abort_qd_sizes.sh@86 -- # trap - SIGINT SIGTERM EXIT 00:32:58.964 04:34:48 -- target/abort_qd_sizes.sh@87 -- # nvmftestfini 00:32:58.964 04:34:48 -- nvmf/common.sh@476 -- # nvmfcleanup 00:32:58.964 04:34:48 -- nvmf/common.sh@116 -- # sync 00:32:58.964 04:34:48 -- nvmf/common.sh@118 -- # '[' tcp == tcp ']' 00:32:58.964 04:34:48 -- nvmf/common.sh@119 -- # set +e 00:32:58.964 04:34:48 -- nvmf/common.sh@120 -- # for i in {1..20} 00:32:58.964 04:34:48 -- nvmf/common.sh@121 -- # modprobe -v -r nvme-tcp 00:32:58.964 rmmod nvme_tcp 00:32:58.964 rmmod nvme_fabrics 00:32:58.964 rmmod nvme_keyring 00:32:58.964 04:34:49 -- nvmf/common.sh@122 -- # modprobe -v -r nvme-fabrics 00:32:58.964 04:34:49 -- nvmf/common.sh@123 -- # set -e 00:32:58.964 04:34:49 -- nvmf/common.sh@124 -- # return 0 00:32:58.964 04:34:49 -- nvmf/common.sh@477 -- # '[' -n 2515475 ']' 00:32:58.964 04:34:49 -- nvmf/common.sh@478 -- # killprocess 2515475 00:32:58.964 04:34:49 -- common/autotest_common.sh@936 -- # '[' -z 2515475 ']' 00:32:58.964 04:34:49 -- common/autotest_common.sh@940 -- # kill -0 2515475 00:32:58.964 /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/test/common/autotest_common.sh: line 940: kill: (2515475) - No such process 00:32:58.964 04:34:49 -- common/autotest_common.sh@963 -- # echo 'Process with pid 2515475 is not found' 00:32:58.964 Process with pid 2515475 is not found 00:32:58.964 04:34:49 -- nvmf/common.sh@480 -- # '[' iso == iso ']' 00:32:58.964 04:34:49 -- nvmf/common.sh@481 -- # /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/setup.sh reset 00:32:59.899 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:32:59.899 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:32:59.899 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:32:59.899 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:32:59.899 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:32:59.899 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:32:59.899 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:32:59.899 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:32:59.899 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:32:59.899 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:32:59.899 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:32:59.899 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:32:59.899 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:32:59.899 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:32:59.899 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:32:59.899 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:32:59.899 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:32:59.899 04:34:50 -- nvmf/common.sh@483 -- # [[ tcp == \t\c\p ]] 00:32:59.899 04:34:50 -- nvmf/common.sh@484 -- # nvmf_tcp_fini 00:32:59.899 04:34:50 -- nvmf/common.sh@273 -- # [[ cvl_0_0_ns_spdk == \n\v\m\f\_\t\g\t\_\n\s ]] 00:32:59.899 04:34:50 -- nvmf/common.sh@277 -- # remove_spdk_ns 00:32:59.899 04:34:50 -- nvmf/common.sh@616 -- # xtrace_disable_per_cmd _remove_spdk_ns 00:32:59.899 04:34:50 -- common/autotest_common.sh@22 -- # eval '_remove_spdk_ns 13> /dev/null' 00:32:59.899 04:34:50 -- common/autotest_common.sh@22 -- # _remove_spdk_ns 00:33:02.442 04:34:52 -- nvmf/common.sh@278 -- # ip -4 addr flush cvl_0_1 00:33:02.442 00:33:02.442 real 0m35.403s 00:33:02.442 user 1m4.470s 00:33:02.442 sys 0m8.424s 00:33:02.442 04:34:52 -- common/autotest_common.sh@1115 -- # xtrace_disable 00:33:02.442 04:34:52 -- common/autotest_common.sh@10 -- # set +x 00:33:02.442 ************************************ 00:33:02.442 END TEST nvmf_abort_qd_sizes 00:33:02.442 ************************************ 00:33:02.442 04:34:52 -- spdk/autotest.sh@298 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@302 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@306 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@311 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@320 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@325 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@329 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@333 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@337 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@342 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@346 -- # '[' 0 -eq 1 ']' 00:33:02.442 04:34:52 -- spdk/autotest.sh@353 -- # [[ 0 -eq 1 ]] 00:33:02.442 04:34:52 -- spdk/autotest.sh@357 -- # [[ 0 -eq 1 ]] 00:33:02.442 04:34:52 -- spdk/autotest.sh@361 -- # [[ 0 -eq 1 ]] 00:33:02.442 04:34:52 -- spdk/autotest.sh@365 -- # [[ 0 -eq 1 ]] 00:33:02.442 04:34:52 -- spdk/autotest.sh@370 -- # trap - SIGINT SIGTERM EXIT 00:33:02.442 04:34:52 -- spdk/autotest.sh@372 -- # timing_enter post_cleanup 00:33:02.442 04:34:52 -- common/autotest_common.sh@722 -- # xtrace_disable 00:33:02.442 04:34:52 -- common/autotest_common.sh@10 -- # set +x 00:33:02.442 04:34:52 -- spdk/autotest.sh@373 -- # autotest_cleanup 00:33:02.442 04:34:52 -- common/autotest_common.sh@1381 -- # local autotest_es=0 00:33:02.442 04:34:52 -- common/autotest_common.sh@1382 -- # xtrace_disable 00:33:02.442 04:34:52 -- common/autotest_common.sh@10 -- # set +x 00:33:03.820 INFO: APP EXITING 00:33:03.820 INFO: killing all VMs 00:33:03.820 INFO: killing vhost app 00:33:03.820 INFO: EXIT DONE 00:33:05.244 0000:88:00.0 (8086 0a54): Already using the nvme driver 00:33:05.244 0000:00:04.7 (8086 0e27): Already using the ioatdma driver 00:33:05.244 0000:00:04.6 (8086 0e26): Already using the ioatdma driver 00:33:05.244 0000:00:04.5 (8086 0e25): Already using the ioatdma driver 00:33:05.244 0000:00:04.4 (8086 0e24): Already using the ioatdma driver 00:33:05.244 0000:00:04.3 (8086 0e23): Already using the ioatdma driver 00:33:05.244 0000:00:04.2 (8086 0e22): Already using the ioatdma driver 00:33:05.244 0000:00:04.1 (8086 0e21): Already using the ioatdma driver 00:33:05.244 0000:00:04.0 (8086 0e20): Already using the ioatdma driver 00:33:05.244 0000:80:04.7 (8086 0e27): Already using the ioatdma driver 00:33:05.244 0000:80:04.6 (8086 0e26): Already using the ioatdma driver 00:33:05.244 0000:80:04.5 (8086 0e25): Already using the ioatdma driver 00:33:05.244 0000:80:04.4 (8086 0e24): Already using the ioatdma driver 00:33:05.244 0000:80:04.3 (8086 0e23): Already using the ioatdma driver 00:33:05.244 0000:80:04.2 (8086 0e22): Already using the ioatdma driver 00:33:05.244 0000:80:04.1 (8086 0e21): Already using the ioatdma driver 00:33:05.244 0000:80:04.0 (8086 0e20): Already using the ioatdma driver 00:33:06.619 Cleaning 00:33:06.619 Removing: /var/run/dpdk/spdk0/config 00:33:06.619 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-0 00:33:06.619 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-1 00:33:06.619 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-2 00:33:06.619 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-0-3 00:33:06.619 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-0 00:33:06.619 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-1 00:33:06.619 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-2 00:33:06.619 Removing: /var/run/dpdk/spdk0/fbarray_memseg-2048k-1-3 00:33:06.619 Removing: /var/run/dpdk/spdk0/fbarray_memzone 00:33:06.619 Removing: /var/run/dpdk/spdk0/hugepage_info 00:33:06.620 Removing: /var/run/dpdk/spdk1/config 00:33:06.620 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-0 00:33:06.620 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-1 00:33:06.620 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-2 00:33:06.620 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-0-3 00:33:06.620 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-0 00:33:06.620 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-1 00:33:06.620 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-2 00:33:06.620 Removing: /var/run/dpdk/spdk1/fbarray_memseg-2048k-1-3 00:33:06.620 Removing: /var/run/dpdk/spdk1/fbarray_memzone 00:33:06.620 Removing: /var/run/dpdk/spdk1/hugepage_info 00:33:06.620 Removing: /var/run/dpdk/spdk1/mp_socket 00:33:06.620 Removing: /var/run/dpdk/spdk2/config 00:33:06.620 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-0 00:33:06.620 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-1 00:33:06.620 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-2 00:33:06.620 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-0-3 00:33:06.620 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-0 00:33:06.620 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-1 00:33:06.620 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-2 00:33:06.620 Removing: /var/run/dpdk/spdk2/fbarray_memseg-2048k-1-3 00:33:06.620 Removing: /var/run/dpdk/spdk2/fbarray_memzone 00:33:06.620 Removing: /var/run/dpdk/spdk2/hugepage_info 00:33:06.620 Removing: /var/run/dpdk/spdk3/config 00:33:06.620 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-0 00:33:06.620 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-1 00:33:06.620 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-2 00:33:06.620 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-0-3 00:33:06.620 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-0 00:33:06.620 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-1 00:33:06.620 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-2 00:33:06.620 Removing: /var/run/dpdk/spdk3/fbarray_memseg-2048k-1-3 00:33:06.620 Removing: /var/run/dpdk/spdk3/fbarray_memzone 00:33:06.620 Removing: /var/run/dpdk/spdk3/hugepage_info 00:33:06.620 Removing: /var/run/dpdk/spdk4/config 00:33:06.620 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-0 00:33:06.620 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-1 00:33:06.620 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-2 00:33:06.620 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-0-3 00:33:06.620 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-0 00:33:06.620 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-1 00:33:06.620 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-2 00:33:06.620 Removing: /var/run/dpdk/spdk4/fbarray_memseg-2048k-1-3 00:33:06.620 Removing: /var/run/dpdk/spdk4/fbarray_memzone 00:33:06.620 Removing: /var/run/dpdk/spdk4/hugepage_info 00:33:06.620 Removing: /dev/shm/bdev_svc_trace.1 00:33:06.620 Removing: /dev/shm/nvmf_trace.0 00:33:06.620 Removing: /dev/shm/spdk_tgt_trace.pid2236234 00:33:06.620 Removing: /var/run/dpdk/spdk0 00:33:06.620 Removing: /var/run/dpdk/spdk1 00:33:06.620 Removing: /var/run/dpdk/spdk2 00:33:06.620 Removing: /var/run/dpdk/spdk3 00:33:06.620 Removing: /var/run/dpdk/spdk4 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2234512 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2235284 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2236234 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2236729 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2238055 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2239027 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2239226 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2239559 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2239901 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2240124 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2240283 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2240437 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2240756 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2241213 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2243723 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2243941 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2244238 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2244268 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2244692 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2244834 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2245142 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2245280 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2245580 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2245603 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2245878 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2245916 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2246409 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2246565 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2246768 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2247074 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2247094 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2247185 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2247421 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2247581 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2247721 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2247900 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2248148 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2248302 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2248446 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2248617 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2248867 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2249029 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2249167 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2249334 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2249588 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2249815 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2250007 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2250172 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2250425 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2250592 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2251061 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2251398 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2251655 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2251820 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2251963 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2252117 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2252382 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2252539 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2252682 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2252844 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2253090 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2253262 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2253407 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2253566 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2253833 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2253989 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2254143 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2254304 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2254569 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2254722 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2254870 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2255052 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2255230 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2255443 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2257654 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2314974 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2317641 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2324778 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2328249 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2330628 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2331043 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2335057 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2335066 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2335618 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2336289 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2336963 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2337376 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2337383 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2337533 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2337665 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2337673 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2338350 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2339012 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2339592 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2340100 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2340131 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2340392 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2341960 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2342829 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2348442 00:33:06.620 Removing: /var/run/dpdk/spdk_pid2348699 00:33:06.879 Removing: /var/run/dpdk/spdk_pid2351411 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2355190 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2357424 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2364056 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2369601 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2370836 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2371515 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2382761 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2385016 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2387979 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2389195 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2390559 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2390714 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2390984 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2391138 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2391733 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2393114 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2394120 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2394571 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2398075 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2401659 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2405300 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2429745 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2432579 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2436665 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2438145 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2439268 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2441978 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2444503 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2448918 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2448920 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2451867 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2452010 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2452150 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2452425 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2452546 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2453653 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2454876 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2456090 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2457301 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2458516 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2459732 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2463624 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2464088 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2465410 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2466161 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2470581 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2472742 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2476364 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2479990 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2483657 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2484079 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2484505 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2484921 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2485516 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2485932 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2486483 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2486916 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2489699 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2489847 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2493711 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2493893 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2495668 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2500834 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2500856 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2504420 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2505857 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2507294 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2508176 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2509504 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2510399 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2515919 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2516316 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2516720 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2518205 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2518614 00:33:06.880 Removing: /var/run/dpdk/spdk_pid2519022 00:33:06.880 Clean 00:33:06.880 killing process with pid 2205963 00:33:14.992 killing process with pid 2205960 00:33:14.992 killing process with pid 2205962 00:33:15.250 killing process with pid 2205961 00:33:15.250 04:35:05 -- common/autotest_common.sh@1446 -- # return 0 00:33:15.250 04:35:05 -- spdk/autotest.sh@374 -- # timing_exit post_cleanup 00:33:15.250 04:35:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:15.250 04:35:05 -- common/autotest_common.sh@10 -- # set +x 00:33:15.250 04:35:05 -- spdk/autotest.sh@376 -- # timing_exit autotest 00:33:15.250 04:35:05 -- common/autotest_common.sh@728 -- # xtrace_disable 00:33:15.250 04:35:05 -- common/autotest_common.sh@10 -- # set +x 00:33:15.250 04:35:05 -- spdk/autotest.sh@377 -- # chmod a+r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:33:15.250 04:35:05 -- spdk/autotest.sh@379 -- # [[ -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log ]] 00:33:15.250 04:35:05 -- spdk/autotest.sh@379 -- # rm -f /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/udev.log 00:33:15.250 04:35:05 -- spdk/autotest.sh@381 -- # [[ y == y ]] 00:33:15.250 04:35:05 -- spdk/autotest.sh@383 -- # hostname 00:33:15.250 04:35:05 -- spdk/autotest.sh@383 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -c --no-external -d /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk -t spdk-gp-11 -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info 00:33:15.510 geninfo: WARNING: invalid characters removed from testname! 00:33:47.594 04:35:33 -- spdk/autotest.sh@384 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_base.info -a /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_test.info -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:47.594 04:35:37 -- spdk/autotest.sh@385 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/dpdk/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:49.499 04:35:39 -- spdk/autotest.sh@389 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info --ignore-errors unused,unused '/usr/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:52.037 04:35:42 -- spdk/autotest.sh@390 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/examples/vmd/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:55.330 04:35:45 -- spdk/autotest.sh@391 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_lspci/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:33:57.870 04:35:48 -- spdk/autotest.sh@392 -- # lcov --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 --rc genhtml_branch_coverage=1 --rc genhtml_function_coverage=1 --rc genhtml_legend=1 --rc geninfo_all_blocks=1 --rc geninfo_unexecuted_blocks=1 -q -r /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info '*/app/spdk_top/*' -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/cov_total.info 00:34:00.405 04:35:50 -- spdk/autotest.sh@393 -- # rm -f cov_base.info cov_test.info OLD_STDOUT OLD_STDERR 00:34:00.405 04:35:50 -- common/autotest_common.sh@1689 -- $ [[ y == y ]] 00:34:00.405 04:35:50 -- common/autotest_common.sh@1690 -- $ lcov --version 00:34:00.405 04:35:50 -- common/autotest_common.sh@1690 -- $ awk '{print $NF}' 00:34:00.405 04:35:50 -- common/autotest_common.sh@1690 -- $ lt 1.15 2 00:34:00.405 04:35:50 -- scripts/common.sh@372 -- $ cmp_versions 1.15 '<' 2 00:34:00.405 04:35:50 -- scripts/common.sh@332 -- $ local ver1 ver1_l 00:34:00.405 04:35:50 -- scripts/common.sh@333 -- $ local ver2 ver2_l 00:34:00.405 04:35:50 -- scripts/common.sh@335 -- $ IFS=.-: 00:34:00.405 04:35:50 -- scripts/common.sh@335 -- $ read -ra ver1 00:34:00.405 04:35:50 -- scripts/common.sh@336 -- $ IFS=.-: 00:34:00.405 04:35:50 -- scripts/common.sh@336 -- $ read -ra ver2 00:34:00.405 04:35:50 -- scripts/common.sh@337 -- $ local 'op=<' 00:34:00.405 04:35:50 -- scripts/common.sh@339 -- $ ver1_l=2 00:34:00.405 04:35:50 -- scripts/common.sh@340 -- $ ver2_l=1 00:34:00.405 04:35:50 -- scripts/common.sh@342 -- $ local lt=0 gt=0 eq=0 v 00:34:00.405 04:35:50 -- scripts/common.sh@343 -- $ case "$op" in 00:34:00.405 04:35:50 -- scripts/common.sh@344 -- $ : 1 00:34:00.405 04:35:50 -- scripts/common.sh@363 -- $ (( v = 0 )) 00:34:00.405 04:35:50 -- scripts/common.sh@363 -- $ (( v < (ver1_l > ver2_l ? ver1_l : ver2_l) )) 00:34:00.405 04:35:50 -- scripts/common.sh@364 -- $ decimal 1 00:34:00.405 04:35:50 -- scripts/common.sh@352 -- $ local d=1 00:34:00.405 04:35:50 -- scripts/common.sh@353 -- $ [[ 1 =~ ^[0-9]+$ ]] 00:34:00.405 04:35:50 -- scripts/common.sh@354 -- $ echo 1 00:34:00.405 04:35:50 -- scripts/common.sh@364 -- $ ver1[v]=1 00:34:00.405 04:35:50 -- scripts/common.sh@365 -- $ decimal 2 00:34:00.406 04:35:50 -- scripts/common.sh@352 -- $ local d=2 00:34:00.406 04:35:50 -- scripts/common.sh@353 -- $ [[ 2 =~ ^[0-9]+$ ]] 00:34:00.406 04:35:50 -- scripts/common.sh@354 -- $ echo 2 00:34:00.406 04:35:51 -- scripts/common.sh@365 -- $ ver2[v]=2 00:34:00.406 04:35:51 -- scripts/common.sh@366 -- $ (( ver1[v] > ver2[v] )) 00:34:00.406 04:35:51 -- scripts/common.sh@367 -- $ (( ver1[v] < ver2[v] )) 00:34:00.406 04:35:51 -- scripts/common.sh@367 -- $ return 0 00:34:00.406 04:35:51 -- common/autotest_common.sh@1691 -- $ lcov_rc_opt='--rc lcov_branch_coverage=1 --rc lcov_function_coverage=1' 00:34:00.406 04:35:51 -- common/autotest_common.sh@1703 -- $ export 'LCOV_OPTS= 00:34:00.406 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:00.406 --rc genhtml_branch_coverage=1 00:34:00.406 --rc genhtml_function_coverage=1 00:34:00.406 --rc genhtml_legend=1 00:34:00.406 --rc geninfo_all_blocks=1 00:34:00.406 --rc geninfo_unexecuted_blocks=1 00:34:00.406 00:34:00.406 ' 00:34:00.406 04:35:51 -- common/autotest_common.sh@1703 -- $ LCOV_OPTS=' 00:34:00.406 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:00.406 --rc genhtml_branch_coverage=1 00:34:00.406 --rc genhtml_function_coverage=1 00:34:00.406 --rc genhtml_legend=1 00:34:00.406 --rc geninfo_all_blocks=1 00:34:00.406 --rc geninfo_unexecuted_blocks=1 00:34:00.406 00:34:00.406 ' 00:34:00.406 04:35:51 -- common/autotest_common.sh@1704 -- $ export 'LCOV=lcov 00:34:00.406 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:00.406 --rc genhtml_branch_coverage=1 00:34:00.406 --rc genhtml_function_coverage=1 00:34:00.406 --rc genhtml_legend=1 00:34:00.406 --rc geninfo_all_blocks=1 00:34:00.406 --rc geninfo_unexecuted_blocks=1 00:34:00.406 00:34:00.406 ' 00:34:00.406 04:35:51 -- common/autotest_common.sh@1704 -- $ LCOV='lcov 00:34:00.406 --rc lcov_branch_coverage=1 --rc lcov_function_coverage=1 00:34:00.406 --rc genhtml_branch_coverage=1 00:34:00.406 --rc genhtml_function_coverage=1 00:34:00.406 --rc genhtml_legend=1 00:34:00.406 --rc geninfo_all_blocks=1 00:34:00.406 --rc geninfo_unexecuted_blocks=1 00:34:00.406 00:34:00.406 ' 00:34:00.406 04:35:51 -- common/autobuild_common.sh@15 -- $ source /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/scripts/common.sh 00:34:00.406 04:35:51 -- scripts/common.sh@433 -- $ [[ -e /bin/wpdk_common.sh ]] 00:34:00.406 04:35:51 -- scripts/common.sh@441 -- $ [[ -e /etc/opt/spdk-pkgdep/paths/export.sh ]] 00:34:00.406 04:35:51 -- scripts/common.sh@442 -- $ source /etc/opt/spdk-pkgdep/paths/export.sh 00:34:00.406 04:35:51 -- paths/export.sh@2 -- $ PATH=/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:00.406 04:35:51 -- paths/export.sh@3 -- $ PATH=/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:00.406 04:35:51 -- paths/export.sh@4 -- $ PATH=/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:00.406 04:35:51 -- paths/export.sh@5 -- $ export PATH 00:34:00.406 04:35:51 -- paths/export.sh@6 -- $ echo /opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/opt/protoc/21.7/bin:/opt/go/1.21.1/bin:/opt/golangci/1.54.2/bin:/home/sys_sgci/.local/bin:/home/sys_sgci/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/bin:/usr/local/sbin:/var/spdk/dependencies/pip/bin:/usr/local/sbin:/usr/local/bin:/usr/sbin:/usr/bin:/sbin:/bin:/var/lib/snapd/snap/bin 00:34:00.406 04:35:51 -- common/autobuild_common.sh@439 -- $ out=/var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output 00:34:00.406 04:35:51 -- common/autobuild_common.sh@440 -- $ date +%s 00:34:00.406 04:35:51 -- common/autobuild_common.sh@440 -- $ mktemp -dt spdk_1732937751.XXXXXX 00:34:00.406 04:35:51 -- common/autobuild_common.sh@440 -- $ SPDK_WORKSPACE=/tmp/spdk_1732937751.cZm1Zs 00:34:00.406 04:35:51 -- common/autobuild_common.sh@442 -- $ [[ -n '' ]] 00:34:00.406 04:35:51 -- common/autobuild_common.sh@446 -- $ '[' -n v23.11 ']' 00:34:00.406 04:35:51 -- common/autobuild_common.sh@447 -- $ dirname /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build 00:34:00.406 04:35:51 -- common/autobuild_common.sh@447 -- $ scanbuild_exclude=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk' 00:34:00.406 04:35:51 -- common/autobuild_common.sh@453 -- $ scanbuild_exclude+=' --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp' 00:34:00.406 04:35:51 -- common/autobuild_common.sh@455 -- $ scanbuild='scan-build -o /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/scan-build-tmp --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk --exclude /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/xnvme --exclude /tmp --status-bugs' 00:34:00.406 04:35:51 -- common/autobuild_common.sh@456 -- $ get_config_params 00:34:00.406 04:35:51 -- common/autotest_common.sh@397 -- $ xtrace_disable 00:34:00.406 04:35:51 -- common/autotest_common.sh@10 -- $ set +x 00:34:00.406 04:35:51 -- common/autobuild_common.sh@456 -- $ config_params='--enable-debug --enable-werror --with-rdma --with-idxd --with-fio=/usr/src/fio --with-iscsi-initiator --disable-unit-tests --enable-ubsan --enable-coverage --with-ublk --with-vfio-user --with-dpdk=/var/jenkins/workspace/nvmf-tcp-phy-autotest/dpdk/build' 00:34:00.406 04:35:51 -- spdk/autopackage.sh@10 -- $ MAKEFLAGS=-j48 00:34:00.406 04:35:51 -- spdk/autopackage.sh@11 -- $ cd /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:00.406 04:35:51 -- spdk/autopackage.sh@13 -- $ [[ 0 -eq 1 ]] 00:34:00.406 04:35:51 -- spdk/autopackage.sh@18 -- $ [[ 1 -eq 0 ]] 00:34:00.406 04:35:51 -- spdk/autopackage.sh@18 -- $ [[ 0 -eq 0 ]] 00:34:00.406 04:35:51 -- spdk/autopackage.sh@19 -- $ timing_finish 00:34:00.406 04:35:51 -- common/autotest_common.sh@734 -- $ flamegraph=/usr/local/FlameGraph/flamegraph.pl 00:34:00.406 04:35:51 -- common/autotest_common.sh@735 -- $ '[' -x /usr/local/FlameGraph/flamegraph.pl ']' 00:34:00.406 04:35:51 -- common/autotest_common.sh@737 -- $ /usr/local/FlameGraph/flamegraph.pl --title 'Build Timing' --nametype Step: --countname seconds /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk/../output/timing.txt 00:34:00.677 04:35:51 -- spdk/autopackage.sh@20 -- $ exit 0 00:34:00.677 + [[ -n 2151492 ]] 00:34:00.677 + sudo kill 2151492 00:34:00.685 [Pipeline] } 00:34:00.698 [Pipeline] // stage 00:34:00.704 [Pipeline] } 00:34:00.716 [Pipeline] // timeout 00:34:00.722 [Pipeline] } 00:34:00.732 [Pipeline] // catchError 00:34:00.736 [Pipeline] } 00:34:00.747 [Pipeline] // wrap 00:34:00.751 [Pipeline] } 00:34:00.760 [Pipeline] // catchError 00:34:00.767 [Pipeline] stage 00:34:00.769 [Pipeline] { (Epilogue) 00:34:00.779 [Pipeline] catchError 00:34:00.781 [Pipeline] { 00:34:00.791 [Pipeline] echo 00:34:00.792 Cleanup processes 00:34:00.796 [Pipeline] sh 00:34:01.076 + sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:01.077 2531305 sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:01.088 [Pipeline] sh 00:34:01.369 ++ sudo pgrep -af /var/jenkins/workspace/nvmf-tcp-phy-autotest/spdk 00:34:01.369 ++ grep -v 'sudo pgrep' 00:34:01.369 ++ awk '{print $1}' 00:34:01.369 + sudo kill -9 00:34:01.369 + true 00:34:01.378 [Pipeline] sh 00:34:01.658 + jbp/jenkins/jjb-config/jobs/scripts/compress_artifacts.sh 00:34:13.860 [Pipeline] sh 00:34:14.150 + jbp/jenkins/jjb-config/jobs/scripts/check_artifacts_size.sh 00:34:14.150 Artifacts sizes are good 00:34:14.164 [Pipeline] archiveArtifacts 00:34:14.171 Archiving artifacts 00:34:14.351 [Pipeline] sh 00:34:14.690 + sudo chown -R sys_sgci: /var/jenkins/workspace/nvmf-tcp-phy-autotest 00:34:14.702 [Pipeline] cleanWs 00:34:14.711 [WS-CLEANUP] Deleting project workspace... 00:34:14.711 [WS-CLEANUP] Deferred wipeout is used... 00:34:14.716 [WS-CLEANUP] done 00:34:14.718 [Pipeline] } 00:34:14.727 [Pipeline] // catchError 00:34:14.734 [Pipeline] sh 00:34:15.009 + logger -p user.info -t JENKINS-CI 00:34:15.017 [Pipeline] } 00:34:15.031 [Pipeline] // stage 00:34:15.037 [Pipeline] } 00:34:15.053 [Pipeline] // node 00:34:15.059 [Pipeline] End of Pipeline 00:34:15.114 Finished: SUCCESS